A program to download pdf documents from public websites, and catalogue them in BibTeX format
PIEBERRY (IT’S FOR YOUR LIBRARY)
This is a program which I wrote to automate a painful aspect of my work-life - downloading, storing, cataloguing and referencing documents from (mainly public sector & government) websites.
These websites publish reams of documents in pdf format, usually in a random range of cryptic CMS-generated filename schemas, with incomplete or non-existent file metadata.
Typically I download these, rename them with an intelligible title, a six-digit archival date prefix, store then in an appropriate folder, and enter them into my database of reference materials for use with LaTeX/BibTex.
Actually, scratch that. What I REALLY do is download them, leave them on my Desktop folder, look at them once, forget them, fill up my disk quota, delete them, realise I’ve lost them and download them all over again.
Hence, Pieberry, which will do all of the good and none of the bad described above.
It’s mainly for my use, but I hope that someone else will find it useful. I’m open to requests for features.
It’s written in Python, with the PortablePython 2.5.4 distribution (which contains wxpython) in mind, but also requires Beautiful Soup, pyPdf and Pybtex, which are all available through easy_install from setuptools.