Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (
Help us improve Python packaging - Donate today!

Multiprocessing from the command-line

Project Description


Multiprocessing from the command-line.

Multiproc allows one to use a pool of workers with bash. It provides a
reliable way to launch a lot of concurrent processes while keeping the
control of the number of these processes.

This program uses python3.


Usage: multiproc [-h] [-0] [-v] [-p N] [-1] FORMAT

FORMAT The command to be run in each process.
"%s" input string
"%n" number of the process
"%%" litteral "%"

-h, --help Print this help and exit.
-v, --verbose Set verbose output
-0 Use NUL as delimiter
This doesn't cover potential command output.
-p, --process N Number of processes to be used.
Default is the number of CPU.
-1, --uniq Equivalent to -p1

Example: download multiple files where urls.txt contains the urls list

$ cat urls.txt | multiproc -p 10 "wget %s -O file.%n"


Download multiple files where urls.txt contains the urls list with 10 processes:

$ cat urls.txt | multiproc -p 10 "wget %s -O file.%n"

Work with files

$ find . -iname "*.c" -print0 | multiproc -v -0 "gcc %n"


The easiest is

pip install multiproc

or, in this directory

python3 setup install


docopt or "pip install docopt"


This program is under the GPLv3 License.

You should have received a copy of the GNU General Public License
along with this program. If not, see <>.


Main developper: Cédric Picard
Twitter: @Cym13
GPG: 383A 76B9 D68D 2BD6 9D2B 4716 E3B9 F4FE 5CED 42CB

Release History

This version
History Node


History Node


Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, Size & Hash SHA256 Hash Help File Type Python Version Upload Date
(3.3 kB) Copy SHA256 Hash SHA256
Source None Jun 13, 2014

Supported By

Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Google Google Cloud Servers