Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.7.13.dev5.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8ee34e3559ca008a9592ef68df9a02c847985b8677cd1dd7099c5aa5e2308be9 |
|
| MD5 | f6f5a6eae9323b550a47ae25d485e1d1 |
|
| BLAKE2b-256 | 208e778b9cbe01961f8357b6aaaff4eacf5200417b9fe879a974bb56ff38581e |
Close
Hashes for streamcorpus_pipeline-0.7.13.dev5-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b7afb98ca1d8a8485b6342b6d7f545497c2848e015e6ec75cb2dcf3fe427b5f4 |
|
| MD5 | d310eee43510e0d904ce5c147d399a7d |
|
| BLAKE2b-256 | 63b909bf7665503380d50168e57543a68668fd3ec5dd6265919403ddb2823286 |
