Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.29.dev1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fc6894bf9d854de9add4857e15c2669ac10795cb0831951de3bf0e2e7e7d5fb0 |
|
| MD5 | e46c5b4dcdcf311499e274e00bf44d33 |
|
| BLAKE2b-256 | 9f2a4d806ba06ad6bdf7eda19d0174180611e20d75b5be861b0d11690362d3cd |
Close
Hashes for streamcorpus_pipeline-0.5.29.dev1-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 86eaee801783b63a927401489940105caaf62735ba3a1fe281813f33b4273d48 |
|
| MD5 | af6c54ebea5c6252f970f9e8578c6142 |
|
| BLAKE2b-256 | 91b697e270529634f1a1d702639532777e228120d5645fe93e135f7f25f27f49 |
