Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.42.dev1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8070ee23b9130bc3bb8ef962483951b2a670c0e219e27f3b6077a6ae52e26098 |
|
| MD5 | efa118e1e9b525a387daaf4f5041e892 |
|
| BLAKE2b-256 | 0d4602712d8342b1f5afe0ae102a7721206b84e44cf6b434c69335d245a4f760 |
Close
Hashes for streamcorpus_pipeline-0.5.42.dev1-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1d4e13f89be71650cc28fe8f2abd68c8b150abc458ba6d230270e6d0de826ba2 |
|
| MD5 | c084d0ff50e6be973646394f191894c8 |
|
| BLAKE2b-256 | a09defb2157554bd22e9d0ef1706045f4565e458cd2ec255359d948f4544529b |
