pneumatic 0.1

A bulk upload library for DocumentCloud.

pneumatic is a library that adds some luxury and safeguards to the bulk-uploading of hundreds, thousands or hundreds of thousands of files to DocumentCloud. It is meant to do one thing – upload – and serve as an adjunct to, but not a replacement for, the excellent python-documentcloud API wrapper.

pneumatic’s name is inspired by the newsrooms of yore, which featured a series of pneumatic tubes for sending copy from the newsrooms to other departments such as the composing room.

Features

• Multiprocessing for faster submission of files to DocumentCloud’s API.

• Catalogs the API response for each upload in a SQLite database along with the file’s canonical URL.

• Prevents inadvertent submission of files that DocumentCloud doesn’t handle, such as audio.

Links

• Documentation: http://pneumatic.readthedocs.org/

• Repository: https://github.com/anthonydb/pneumatic

• Issues: https://github.com/anthonydb/pneumatic/issues

Basic Usage

You will need an active DocumentCloud account. Uploading all files in a directory (and all sub-directories below it), is as simple as running:

from pneumatic import DocumentCloudUploader

client = DocumentCloudUploader('[e-mail]', 'your-password')
client.upload(file_directory='/files', project='17477-loudoun-county-government')