Capture data from an iterator as it gets pulled down stream.
Project description
Stream Tap
Capture data from an iterator as it gets pulled down stream.
Example
#!/usr/bin/env python # -*- coding: utf-8 -*- from stream_tap import Bucket from stream_tap import stream_tap def get_fruit(item): """Get things that are fruit. :returns: thing of item if it's a fruit""" if len(item) == 2 and item[1] == u"fruit": return item[0] def get_metal(item): """Get things that are metal. :returns: thing of item if it's metal""" if len(item) == 2 and item[1] == u"metal": return item[0] def certain_kind_tap(data_items): """ :param data_items: A sequence of unicode strings """ fruit_spigot = Bucket(get_fruit) metal_spigot = Bucket(get_metal) items = stream_tap((fruit_spigot, metal_spigot), data_items) # consume iterator. for item in items: print item return fruit_spigot.contents(), metal_spigot.contents() def run(): """ Run the composition of csv_file_consumer and information tap with the csv files in the input directory, and collect the results from each file and merge them together, printing both kinds of results. """ data_items = [ [u"mushroom", u"fungus"], [u"tomato", u"fruit"], [u"topaz", u"mineral"], [u"iron", u"metal"], [u"dróżką", u"utf-8 sample"], [u"apple", u"fruit"], [u"cheese", u"dairy"], [u"peach", u"fruit"], [u"celery", u"vegetable"], [u"pear", u"fruit"], [u"ruby", u"mineral"], [u"titanium", u"metal"], [u"cat", u"animal"], [u"orange", u"fruit"], [u"WĄŻ", u"utf-8 sample"], ] results = certain_kind_tap(data_items) fruits, metals = results print("=== fruits ===") for fruit in fruits: print(fruit) print("=== metals ===") for metal in metals: print(metal) if __name__ == "__main__": run()
Documentation
Read the docs: http://stream_tap.readthedocs.org/en/latest/
Contributing:
Submit any issues or questions here: https://github.com/johnwlockwood/stream_tap/issues.
- Make pull requests to development branch of
- Documentation is written in reStructuredText and currently uses the
Sphinx style for field lists http://sphinx-doc.org/domains.html#info-field-lists
Check out closed pull requests to see the flow of development, as almost every change to master is done via a pull request on GitHub. Code Reviews are welcome, even on merged Pull Requests. Feel free to ask questions about the code.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
stream_tap-0.9.4.tar.gz
(19.4 kB
view hashes)
Built Distributions
stream_tap-0.9.4-py3.5.egg
(12.0 kB
view hashes)
stream_tap-0.9.4-py2.7.egg
(11.7 kB
view hashes)
Close
Hashes for stream_tap-0.9.4.macosx-10.12-x86_64.exe
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8aee262686f66bddb48c8bd6b52f54e5202d6c9b815a929e2882e418d9e57e05 |
|
MD5 | f8bb13b35a6b617351b06a7d63c71a16 |
|
BLAKE2b-256 | d0c99877d5e97df606fa028088daf8b94bf97de084773ff44a4975c85570e9ea |