Skip to main content

Benchmarking library single core vs multi core for common pandas functions

Project description

# MultiProcessingBenchmark A benchmarking library to check how does your system fares with all the cores for simple statistical functions, utility functions and aggregation functions.

GitHub Link: https://www.github.com/srivassid/multiProcessingBenchmark

Full Code

from MultiProcessingBenchmark import EntryPoint import multiprocessing

bench = EntryPoint.Benchmark() n_cores = multiprocessing.cpu_count() val = 96.50 rows = 375000 other_df_rows = 375000 first_df_start = ‘01-02-2020’ second_df_start = ‘02-15-2020’ bench.SimpleStatistics(n_cores, rows, first_df_start) bench.utilFunctions(val, n_cores, rows, other_df_rows, second_df_start, second_df_start) bench.agg_without_loop(n_cores, rows, first_df_start) bench.agg_with_loops(n_cores, rows, first_df_start)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

MultiProcessingBenchmark-0.2.0.tar.gz (6.6 kB view hashes)

Uploaded Source

Built Distribution

MultiProcessingBenchmark-0.2.0-py2-none-any.whl (11.2 kB view hashes)

Uploaded Python 2

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page