Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.7.12.dev1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d76be43bfea3b6e398bf44197170787ce915860c8fe3e83caba9beb9b75651cb |
|
| MD5 | 8e6b9d67745a95a8fc3d28dd654aca8b |
|
| BLAKE2b-256 | a6a6d46947894bdcbfab95b56c641fb0048e180a40b7e6704b3b51ae496ae359 |
Close
Hashes for streamcorpus_pipeline-0.7.12.dev1-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1baabf7e10f919a85f68754dc575fab32e48bd096ee5658a6dd5c79694eabd72 |
|
| MD5 | 464ef84770e4d1570d9fba44a14e6c5d |
|
| BLAKE2b-256 | a8cd26cc3cc901c86a6933f43475a104556d3548090222e7e62ea2324777b1a9 |
