Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.7.7.dev6.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bf6ef9c5b9a83cd388adb5b471fa73de136e238a02a996aa0a287d987f4574b5 |
|
| MD5 | dd189e4ed4bee6c9c76ceda229bbc081 |
|
| BLAKE2b-256 | 622ffc423e2ebc9fe9bffa277ad19da844f9545208b4ebc0cc11080a0571c7cc |
Close
Hashes for streamcorpus_pipeline-0.7.7.dev6-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8c5d8be0f16e56ac971ea3ad778729376e2d8879a23d9da1785774872c7f37aa |
|
| MD5 | 0ce150bcdd940169ba722d5e2dc7d965 |
|
| BLAKE2b-256 | ae9b453d65ad25a67954e4f0c77b58a6c9501ce15d3b46a0b307c590108127e7 |
