Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.6.4.dev3.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2b7d049f5c43428080ba5f806478ecb2d2f8b7a5c1cfbbd85fd1b94c77d51acf |
|
| MD5 | 1363d55e969a745a5e4121f5c9731c18 |
|
| BLAKE2b-256 | 8b2a3f77df4777d2757a677bfd1073289a36fb0a3445113bd2274de0f5577968 |
Close
Hashes for streamcorpus_pipeline-0.6.4.dev3-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3ee77217b1e6bdb7d4dec51cd8fb6421339658e12fa0213034b685e54c1cfe06 |
|
| MD5 | de77f85c4d95acca95e0a3fe49817b63 |
|
| BLAKE2b-256 | 806efa9da2a553543d3e1d7dbd1ec8da6ffb6a9736d2685c21a0100e929c16c3 |
