Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.53.dev3.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bd78d70787786c07733cff722b36ab9ddecde441ad87a78825d1eb9501c9363f |
|
| MD5 | 00b3a31ef4c0fc365c1293873d0670ee |
|
| BLAKE2b-256 | 9c5021af571847ef45f0f0ad84f045243d1381399c662af4cfa6532fabb375ba |
Close
Hashes for streamcorpus_pipeline-0.5.53.dev3-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5fd24b439f01c6060955c8c2c17d29c97fb1599dd3bac486a6a8ef18f7c1151c |
|
| MD5 | 77e776e60ee365174c3331d22188ce0c |
|
| BLAKE2b-256 | 0886564f437df3e2b6ebc388423e8e04205459ea2fbaafa61280d185afdc016a |
