Skip to main content

Library to interface with Project Gutenberg

Project description

Overview

This package contains a variety of scripts to make working with the Project Gutenberg body of public domain texts easier.

The functionality provided by this package includes:

  • Downloading texts from Project Gutenberg.

  • Cleaning the texts: removing all the crud, leaving just the text behind.

  • Making meta-data about the texts easily accessible.

Installation

This project is on PyPI, so I’d recommend that you just install everything from there using your favourite Python package manager.

pip install gutenberg

If you want to install from source or modify the package, you’ll need to clone this repository:

git clone https://github.com/c-w/Gutenberg.git

Now, you should probably install the dependencies for the package and verify your checkout by running the tests.

cd Gutenberg

virtualenv --no-site-packages virtualenv
source virtualenv/bin/activate
pip install -r requirements.pip

pip install nose
nosetests

Usage

Downloading a text

from gutenberg.acquire import load_etext
from gutenberg.cleanup import strip_headers

text = strip_headers(load_etext(2701)).strip()
assert text.startswith('MOBY DICK; OR THE WHALE\n\nBy Herman Melville')

Looking up meta-data

from gutenberg.query import get_etexts
from gutenberg.query import get_metadata

assert get_metadata('title', 2701)  == 'Moby Dick; Or, The Whale'
assert get_metadata('author', 2701) == 'Melville, Hermann'

assert 2701 in get_etexts('title', 'Moby Dick; Or, The Whale')
assert 2701 in get_etexts('author', 'Melville, Hermann')

Limitations

This project deliberately does not include any natural language processing functionality. Consuming and processing the text is the responsibility of the client; this library merely focuses on offering a simple and easy to use interface to the works in the Project Gutenberg corpus. Any linguistic processing can easily be done client-side e.g. using the TextBlob library.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Gutenberg-0.4.0.tar.gz (14.4 kB view details)

Uploaded Source

File details

Details for the file Gutenberg-0.4.0.tar.gz.

File metadata

  • Download URL: Gutenberg-0.4.0.tar.gz
  • Upload date:
  • Size: 14.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for Gutenberg-0.4.0.tar.gz
Algorithm Hash digest
SHA256 990e1b2c2a7e7ebb1c9f29a04f4a9449130fd126793039a005f1f1c23830118c
MD5 0e359008237d5f2b6306289aba8f0d49
BLAKE2b-256 221d748812d70f05cb07f31f7e8c533fc5f17ebeeab78003e22e21110e99569c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page