Tools for building streamcorpus objects, such as those used in TREC.
Project description
streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.
The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.
Read more at [streamcorpus.org](http://streamcorpus.org/)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for streamcorpus_pipeline-0.5.32.dev21.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4c0616cfc4220577e81ab45bbf0c87abc5b5931e7c0133ef1785579de36f432c |
|
| MD5 | 29e62274ff8aadde2a1374bc74f9aa77 |
|
| BLAKE2b-256 | ff6a790b343095f310a80d60629a9932054ff88b125644939ac0bbb13eb9f7ae |
Close
Hashes for streamcorpus_pipeline-0.5.32.dev21-py2.7.egg
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f894095990877da2f5d0611e72e732d64ca870e417ed9371115d81d8b21f4f60 |
|
| MD5 | 514e413752e60dd3b288dce9c3222f15 |
|
| BLAKE2b-256 | a67762016d18bd32dd0b270a59f47b14e582a6e087c810db4d63d2b9c6b54743 |
