Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.7.17.dev1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | deac830dc0befdfdbb1a36537885d9b97e6eb747ba7947151be691e8ab2dc4a0 |
|
| MD5 | 5d587e2dde9bddc022889f175a1166e3 |
|
| BLAKE2b-256 | 4317ce2bcb7622f63be41d3498b3863d79c99d9329f0de52589352f06667caab |
Close
Hashes for streamcorpus_pipeline-0.7.17.dev1-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c763f45655c2d5cc072c141a068aa2bd50110a3f38c4dda527bb0d08b85a919f |
|
| MD5 | 5923e7ddf8f3ae3ce7936347e5508307 |
|
| BLAKE2b-256 | 0fbac0079f73d15004e1c08838679dc49281eb477856f1e3e9bd21879220b926 |
