Benchmarking library single core vs multi core for common pandas functions
Project description
# MultiProcessingBenchmark A benchmarking library to check how does your system fares with all the cores for simple statistical functions, utility functions and aggregation functions.
Usage:
from MultiProcessingBenchmark import EntryPoint import multiprocessing
bench = EntryPoint.Benchmark() n_cores = multiprocessing.cpu_count() # or specify any number of cores you want to use val = 96.50 # to be used to search for a particular value, enter a value between 1 - 100, in decimal format rows = 375000 # number of rows for the dataset other_df_rows = 375000 # number of rows for the second dataset, to be used in merge and join first_df_start = ‘01-02-2020’ # start of time series data of first dataset second_df_start = ‘02-15-2020’ # # start of time series data of second dataset
# Simple statistical functions used are count, sum, mean, standard deviation, rolling mean bench.SimpleStatistics(n_cores, rows, first_df_start)
# utility functions are merge, merge_asof, join, concat, sort, search #other_df_rows is number of rows to be used in second dataset bench.utilFunctions(val, n_cores, rows, other_df_rows, second_df_start, second_df_start)
#groupby aggregation function used are sum, count, mean, prod, without loops bench.agg_without_loop(n_cores, rows, first_df_start)
#groupby aggregation function used are sum, count, mean, prod, with loops bench.agg_with_loops(n_cores, rows, first_df_start)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for MultiProcessingBenchmark-0.1.8.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b536e8096a13fb93519fb8cfbfa7ac3c6eb1c755bd4ff4b4a1d1f7153169f127 |
|
MD5 | 03f97e2326951ce888958e7ae7f2f71d |
|
BLAKE2b-256 | 791d84e301c9bfc2ee1c4f98de1157b4af3763718f056ce5a78480dcb4957552 |
Hashes for MultiProcessingBenchmark-0.1.8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | db97adcac281337ca17d3108fee01556a2fa6d27fcce025ef15d66b94fd04909 |
|
MD5 | 7086577cc05899f72416b7585a2115e7 |
|
BLAKE2b-256 | 3bbb4e96a3b9039254de1f526eb7f63d87e9b9f565e44b1b908a7154daf8cdb8 |