download mail from walla.com

walla has the worst mail interface… and i needed to get about 25000 messages off of it. along with attachments.

first download each of the 25 mail subject pages… there should be 1000 of them.

its easy to make a list like
http://mail.walla.com/?fid=-1000&f=0&o=6&p=1
http://mail.walla.com/?fid=-1000&f=0&o=6&p=2
http://mail.walla.com/?fid=-1000&f=0&o=6&p=3
etc. and just use downthemall to get them.

cat *.html | grep -i wm_sm > small
the wm_sm part is the message id url..

then, if you want only attachments, i use
cat small | grep -v td 1k /td | grep -v td 2k /td > smaller.html
and so on until you remove the smaller emails…

then i use cut to cut the 72-100 characters
cut 72-100 smaller.html
to get the first number of the three part system.
then i use simple find and replace in any good text editor
to get only the numbers…
then i use sed s/^/a/ to put an a in front of every line.
then replace a with http://mail.walla.com/?w=/@msg&fid=-1000&f=0&o=6&&q=banana&id=

so you end up with a huge list of
http://mail.walla.com/?w=/@msg&fid=-1000&f=0&o=6&q=banana&id=191919191
http://mail.walla.com/?w=/@msg&fid=-1000&f=0&o=6&q=banana&id=191915192
http://mail.walla.com/?w=/@msg&fid=-1000&f=0&o=6&q=banana&id=191913193
etc…

then i use firefox ‘downthemall’ extension to download all of the messages

then cat *.htm | grep -i attach | grep -i save > attach
then open attach with firefox and use downthemall to save all of the attachments.

enjoy.

newsgroups

supernzb downloader is cool , but when an nzb post is incomplete, i’m stuck with 100’s of .txt files which need to be decoded!

luckily the same people that make supernzb also make ‘newztoolz’
http://www.techsono.com/newztoolz/index.html
which you throw the 1-300.txt and hit decode news box and hit glue!

it then cat’s the .txt files together and then decodes the incomplete rar file, then quickpar can read and repair the incomplete rar file :)

http://www.gotnzb.com for free nzb files
also http://www.binsearch.info

if supernzb wont open , try removing the supernzb.sdb file (warning, this is your settings/queue file as well)