Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.30.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9f8d004c28563078a62bfddb95459162794696eee490b618deaf5e7c14dd7d7d |
|
| MD5 | 93541b9ec1235d5d9418d26a442b0cc5 |
|
| BLAKE2b-256 | 57f60c1d88d9bcfdb178b2e19f0ed600077b6a113a1323ce79dea79c48a895da |
Close
Hashes for streamcorpus_pipeline-0.5.30-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 13d426ae01006321b9f2018d21338bf5ca83d434b6ca15334b71838052a9441f |
|
| MD5 | d5ed9de50b6016e17b1b8663849e93c0 |
|
| BLAKE2b-256 | 502530305fe72a37dcd61e66a40d3415f414c5f53a6e7226a8fc0185a8252bd8 |
