Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.15.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 37a6f61310e40af86c3cf8bfcffafdd7f94362af2edaf408097591312efd4d1d |
|
| MD5 | a2de851a79de17b16a8f25633b89537b |
|
| BLAKE2b-256 | 8d4afa97c8ef7486a932b0ee09cd86ccada1a5f7227a3a7900cf5b0b8deaa1b9 |
Close
Hashes for streamcorpus_pipeline-0.5.15-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3573f9f23dbea6f19bf211527aa0c91607cdee92d81567d036319274621c6b7d |
|
| MD5 | af4e592d1d6421531dec5767e665f742 |
|
| BLAKE2b-256 | f128bdb45aa31264525ba2bbd056854f8e172f31bd6dd8c3eb277155451f7997 |
