Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.33.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3ee609aef04ebdd32e9878febe55b7a74cba50ef3202e3cd10c44487cdb4d18f |
|
| MD5 | 160473ad391d40a12e06c7bd28280e35 |
|
| BLAKE2b-256 | ff091cd06655cb7d8d2c3716e58fe8d3be1c6d7d578c0a5d8d7f73d41de87d9f |
Close
Hashes for streamcorpus_pipeline-0.5.33-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 55780e41dd4061f503e2dd870029dcdb63f985e14334f01aa180041a4884d219 |
|
| MD5 | be77fd4fc07f3e54b869915bc659904c |
|
| BLAKE2b-256 | f0f0c292ba943a713ab37cfdb4562d8a162e1daec4a48b92a2a7b62e84195e2e |
