Skip to main content

Benchmarking library single core vs multi core for common pandas functions

Project description

# MultiProcessingBenchmark A benchmarking library to check how does your system fares with all the cores for simple statistical functions, utility functions and aggregation functions.

GitHub Link: https://www.github.com/srivassid/multiProcessingBenchmark

Full Code

from MultiProcessingBenchmark import EntryPoint import multiprocessing

bench = EntryPoint.Benchmark() n_cores = multiprocessing.cpu_count() val = 96.50 rows = 375000 other_df_rows = 375000 first_df_start = ‘01-02-2020’ second_df_start = ‘02-15-2020’ bench.SimpleStatistics(n_cores, rows, first_df_start) bench.utilFunctions(val, n_cores, rows, other_df_rows, second_df_start, second_df_start) bench.agg_without_loop(n_cores, rows, first_df_start) bench.agg_with_loops(n_cores, rows, first_df_start)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

MultiProcessingBenchmark-0.1.9.tar.gz (6.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

MultiProcessingBenchmark-0.1.9-py3-none-any.whl (10.0 kB view details)

Uploaded Python 3

File details

Details for the file MultiProcessingBenchmark-0.1.9.tar.gz.

File metadata

  • Download URL: MultiProcessingBenchmark-0.1.9.tar.gz
  • Upload date:
  • Size: 6.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.11

File hashes

Hashes for MultiProcessingBenchmark-0.1.9.tar.gz
Algorithm Hash digest
SHA256 157abb83567706199f159941e2fccf46b8550db7dc4c679ed15f5cc95372f57b
MD5 c044b5b7e2872b10befb88aa98d9ffbe
BLAKE2b-256 4f75e8418a95ed7b68645200501cc22926f3380ca810f8651dd08507ba52222a

See more details on using hashes here.

File details

Details for the file MultiProcessingBenchmark-0.1.9-py3-none-any.whl.

File metadata

  • Download URL: MultiProcessingBenchmark-0.1.9-py3-none-any.whl
  • Upload date:
  • Size: 10.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/40.6.2 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.11

File hashes

Hashes for MultiProcessingBenchmark-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 5c91d8c4b8499686844d563d963cb0d599dd646853cda9abc8d2bb309264759a
MD5 ad27321aa9d4e6bee1f410270e943835
BLAKE2b-256 c5aa46d241aaf002b4d72e22f266adba862c222ba287e256a105c78155874cf3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page