Benchmarking library single core vs multi core for common pandas functions
Project description
# MultiProcessingBenchmark A benchmarking library to check how does your system fares with all the cores for simple statistical functions, utility functions and aggregation functions.
GitHub Link: https://www.github.com/srivassid/multiProcessingBenchmark
Full Code
from MultiProcessingBenchmark import EntryPoint import multiprocessing
bench = EntryPoint.Benchmark() n_cores = multiprocessing.cpu_count() val = 96.50 rows = 375000 other_df_rows = 375000 first_df_start = ‘01-02-2020’ second_df_start = ‘02-15-2020’ bench.SimpleStatistics(n_cores, rows, first_df_start) bench.utilFunctions(val, n_cores, rows, other_df_rows, second_df_start, second_df_start) bench.agg_without_loop(n_cores, rows, first_df_start) bench.agg_with_loops(n_cores, rows, first_df_start)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for MultiProcessingBenchmark-0.2.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1866435a1654b07f3baabf84df4a0932ed8233a0a0f3bd38882f1f3f64de91e9 |
|
MD5 | c6442219638740ca06d2b70e1b7d846f |
|
BLAKE2b-256 | 0552efb0275b68c6f0273341f18f4f3acaec287e26e75b6dc6213abd628b8521 |
Hashes for MultiProcessingBenchmark-0.2.0-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 91d9e13086aa2f8d9d0652f94f44f2fcc4a24c0ce4399c515d9951facbe6804e |
|
MD5 | 952637af167b08063b5d7eb276c45257 |
|
BLAKE2b-256 | 7aa85b72672c7c76cf9a02e9d540410113f50a2f36dfa46289ed4aea909b09f4 |