iterpipes 0.2

A library for running shell pipelines using shell-like syntax

This is an alpha release. The library may be changed completely or even may be thrown away. Comments are welcome.

Facts

• Enables piping infinite streams through shell pipelines in Python

• Uses standard modules subprocess, threading

• Allows doing things marked as red warning boxes at the subprocess help page

• 0.2 KLOC, tests included

Basic Usage

Pipe 100 000 lines through wc -l and join the resulting iterable into a single string:

>>> from iterpipes import pipe, runpipe
>>> wc = pipe('wc -l')
>>> ''.join(wc('%d\n' % i for i in xrange(100000)))
'100000\n'

Total lines in *.py files under the directory /path/to/dir, use safe shell parameters formatting:

>>> runpipe(
...     'find {} -name {} -print0 | xargs -0 wc -l | tail -1 | awk {}',
...     '/path/to/dir', '\*.py', '{print $1}')
'147\n'

Just format a string using correct shell escaping:

>>> from iterpipes import format
>>> format('find {} -name {}',
...     ['/home/path with spaces', 'not a shell wildcard.\*'])
'find /home/path\\ with\\ spaces -name not\\ a\\ shell\\ wildcard.\\*'

Download

This is not really a release. Clone the iterpipes repository if you are interested in following the library.