Skip to main content
Help us improve PyPI by participating in user testing. All experience levels needed!

Tools for building streamcorpus objects, such as those used in TREC.

Project description

streamcorpus_pipeline is a document processing pipeline that assembles streamcorpus objects from raw data sets.

The streamcorpus_pipeline python module contains tools for processing streamcorpus.StreamItem objects stored in Chunks. It includes transform functions for getting clean_html, clean_visible, creating labels from hyperlinks to particular sites (e.g. Wikipedia), and taggers like LingPipe, Serif, and Factorie, which make Tokens and Sentences.

Read more at [streamcorpus.org](http://streamcorpus.org/)

Project details


Release history Release notifications

History Node

0.7.21

History Node

0.7.19

History Node

0.7.19.dev1

History Node

0.7.18

History Node

0.7.18.dev3

History Node

0.7.17

History Node

0.7.17.dev1

History Node

0.7.16

History Node

0.7.16.dev3

History Node

0.7.16.dev2

History Node

0.7.15

History Node

0.7.15.dev5

History Node

0.7.15.dev4

History Node

0.7.15.dev3

History Node

0.7.15.dev2

History Node

0.7.14

History Node

0.7.14.dev1

History Node

0.7.13

History Node

0.7.13.dev5

History Node

0.7.13.dev4

History Node

0.7.13.dev3

History Node

0.7.13.dev1

History Node

0.7.12

History Node

0.7.12.dev5

History Node

0.7.12.dev4

History Node

0.7.12.dev3

History Node

0.7.12.dev1

History Node

0.7.11

History Node

0.7.11.dev3

History Node

0.7.11.dev1

History Node

0.7.10.dev2

History Node

0.7.10.dev1

History Node

0.7.9

History Node

0.7.8.dev1

History Node

0.7.7

History Node

0.7.7.dev6

History Node

0.7.7.dev2

History Node

0.7.7.dev1

History Node

0.7.6

History Node

0.7.6.dev7

History Node

0.7.6.dev3

History Node

0.7.6.dev1

History Node

0.7.5

History Node

0.7.5.dev7

History Node

0.7.5.dev5

History Node

0.7.5.dev1

History Node

0.7.4

History Node

0.7.4.dev1

History Node

0.7.3

History Node

0.7.2

History Node

0.7.2.dev5

History Node

0.7.2.dev2

History Node

0.7.2.dev1

History Node

0.7.1

History Node

0.7.0

History Node

0.6.8.dev24

History Node

0.6.8.dev23

History Node

0.6.8.dev22

History Node

0.6.8.dev21

History Node

0.6.8.dev20

History Node

0.6.8.dev1

History Node

0.6.7

History Node

0.6.7.dev3

History Node

0.6.7.dev2

History Node

0.6.6

History Node

0.6.5

History Node

0.6.4

History Node

0.6.4.dev10

History Node

0.6.4.dev8

History Node

0.6.4.dev7

History Node

0.6.4.dev5

History Node

0.6.4.dev4

History Node

0.6.4.dev3

History Node

0.6.4.dev2

History Node

0.6.4.dev1

History Node

0.6.3

This version
History Node

0.6.2

History Node

0.6.1

History Node

0.6.1.dev3

History Node

0.6.1.dev1

History Node

0.6.0

History Node

0.5.54

History Node

0.5.54.dev3

History Node

0.5.53.dev5

History Node

0.5.53.dev4

History Node

0.5.53.dev3

History Node

0.5.53.dev2

History Node

0.5.53.dev1

History Node

0.5.52

History Node

0.5.51

History Node

0.5.50

History Node

0.5.50.dev2

History Node

0.5.49

History Node

0.5.49.dev4

History Node

0.5.49.dev3

History Node

0.5.49.dev2

History Node

0.5.48

History Node

0.5.48.dev1

History Node

0.5.47

History Node

0.5.46

History Node

0.5.46.dev2

History Node

0.5.45

History Node

0.5.44.dev2

History Node

0.5.43

History Node

0.5.43.dev8

History Node

0.5.43.dev7

History Node

0.5.43.dev6

History Node

0.5.43.dev5

History Node

0.5.42.dev29

History Node

0.5.42.dev27

History Node

0.5.42.dev24

History Node

0.5.42.dev21

History Node

0.5.42.dev20

History Node

0.5.42.dev19

History Node

0.5.42.dev16

History Node

0.5.42.dev14

History Node

0.5.42.dev13

History Node

0.5.42.dev12

History Node

0.5.42.dev11

History Node

0.5.42.dev10

History Node

0.5.42.dev9

History Node

0.5.42.dev3

History Node

0.5.42.dev2

History Node

0.5.42.dev1

History Node

0.5.41.dev2

History Node

0.5.41.dev1

History Node

0.5.39

History Node

0.5.39.dev10

History Node

0.5.39.dev8

History Node

0.5.39.dev7

History Node

0.5.38

History Node

0.5.38.dev10

History Node

0.5.38.dev7

History Node

0.5.38.dev6

History Node

0.5.38.dev4

History Node

0.5.38.dev3

History Node

0.5.38.dev2

History Node

0.5.38.dev1

History Node

0.5.37

History Node

0.5.35.dev2

History Node

0.5.34.dev2

History Node

0.5.33

History Node

0.5.32.dev26

History Node

0.5.32.dev25

History Node

0.5.32.dev23

History Node

0.5.32.dev22

History Node

0.5.32.dev21

History Node

0.5.32.dev20

History Node

0.5.32.dev18

History Node

0.5.32.dev17

History Node

0.5.32.dev16

History Node

0.5.32.dev14

History Node

0.5.32.dev12

History Node

0.5.32.dev11

History Node

0.5.32.dev9

History Node

0.5.32.dev8

History Node

0.5.32.dev7

History Node

0.5.32.dev6

History Node

0.5.32.dev5

History Node

0.5.32.dev3

History Node

0.5.32.dev2

History Node

0.5.32.dev1

History Node

0.5.31

History Node

0.5.30

History Node

0.5.29.dev2

History Node

0.5.29.dev1

History Node

0.5.28.dev1

History Node

0.5.26.dev8

History Node

0.5.26.dev6

History Node

0.5.26.dev5

History Node

0.5.26.dev4

History Node

0.5.26.dev3

History Node

0.5.25

History Node

0.5.24

History Node

0.5.23

History Node

0.5.23.dev7

History Node

0.5.23.dev1

History Node

0.5.22

History Node

0.5.21

History Node

0.5.19

History Node

0.5.18

History Node

0.5.18.dev3

History Node

0.5.16

History Node

0.5.15

History Node

0.5.14

History Node

0.5.13

History Node

0.5.12

History Node

0.5.10

History Node

0.5.8

History Node

0.5.7

History Node

0.5.6.dev9

History Node

0.5.5

History Node

0.5.4

History Node

0.5.4.dev1

History Node

0.5.3.dev8

History Node

0.5.2

History Node

0.5.1

History Node

0.5.1.dev8

History Node

0.5.1.dev4

History Node

0.5.1.dev3

History Node

0.5.0

History Node

0.4.5.dev7

History Node

0.4.5.dev5

History Node

0.4.5.dev1

History Node

0.4.4

History Node

0.4.4.dev3

History Node

0.4.3

History Node

0.4.2

History Node

0.4.2.dev8

History Node

0.4.2.dev7

History Node

0.4.2.dev1

History Node

0.4.1.dev11

History Node

0.4.1.dev9

History Node

0.4.1.dev1

History Node

0.4.0

History Node

0.3.42.dev2

History Node

0.3.40.dev9

History Node

0.3.40.dev8

History Node

0.3.40.dev7

History Node

0.3.38.dev1

History Node

0.3.37

History Node

0.3.36

History Node

0.3.36.dev27

History Node

0.3.36.dev26

History Node

0.3.36.dev25

History Node

0.3.36.dev24

History Node

0.3.36.dev18

History Node

0.3.36.dev17

History Node

0.3.36.dev10

History Node

0.3.36.dev8

History Node

0.3.36.dev7

History Node

0.3.34.dev2

History Node

0.3.33

History Node

0.3.32

History Node

0.3.32.dev1

History Node

0.3.31.dev8

History Node

0.3.30.dev7

History Node

0.3.30.dev6

History Node

0.3.30.dev2

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
streamcorpus_pipeline-0.6.2-py2.7.egg (9.7 MB) Copy SHA256 hash SHA256 Egg 2.7 Jan 27, 2015
streamcorpus_pipeline-0.6.2.tar.gz (9.3 MB) Copy SHA256 hash SHA256 Source None Jan 27, 2015

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page