Capture data from an iterator as it gets pulled down stream.
Project description
Capture data from an iterator as it gets pulled down stream.
Example
#!/usr/bin/env python # -*- coding: utf-8 -*- from stream_tap import Bucket from stream_tap import stream_tap def get_fruit(item): """Get things that are fruit. :returns: thing of item if it's a fruit""" if len(item) == 2 and item[1] == u"fruit": return item[0] def get_metal(item): """Get things that are metal. :returns: thing of item if it's metal""" if len(item) == 2 and item[1] == u"metal": return item[0] def certain_kind_tap(data_items): """ :param data_items: A sequence of unicode strings """ fruit_spigot = Bucket(get_fruit) metal_spigot = Bucket(get_metal) items = stream_tap((fruit_spigot, metal_spigot), data_items) # consume iterator. for item in items: print item return fruit_spigot.contents(), metal_spigot.contents() def run(): """ Run the composition of csv_file_consumer and information tap with the csv files in the input directory, and collect the results from each file and merge them together, printing both kinds of results. """ data_items = [ [u"mushroom", u"fungus"], [u"tomato", u"fruit"], [u"topaz", u"mineral"], [u"iron", u"metal"], [u"dróżką", u"utf-8 sample"], [u"apple", u"fruit"], [u"cheese", u"dairy"], [u"peach", u"fruit"], [u"celery", u"vegetable"], [u"pear", u"fruit"], [u"ruby", u"mineral"], [u"titanium", u"metal"], [u"cat", u"animal"], [u"orange", u"fruit"], [u"WĄŻ", u"utf-8 sample"], ] results = certain_kind_tap(data_items) fruits, metals = results print("=== fruits ===") for fruit in fruits: print(fruit) print("=== metals ===") for metal in metals: print(metal) if __name__ == "__main__": run()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
stream_tap-0.9.tar.gz
(18.4 kB
view hashes)
Built Distributions
stream_tap-0.9-py3.4.egg
(10.7 kB
view hashes)
stream_tap-0.9-py2.7.egg
(10.4 kB
view hashes)
Close
Hashes for stream_tap-0.9.macosx-10.10-x86_64.exe
Algorithm | Hash digest | |
---|---|---|
SHA256 | d55556aa0c11361d71b239807f67f7f3f2ea4489cd871ea114e9334c01d81070 |
|
MD5 | 9e0ed5e9e6f7f29a7be4ca63107c1c67 |
|
BLAKE2b-256 | 00655a90380d9c12506301d80b7234a9b7a69f5984231da6814aa6666b61d99f |