Skip to main content

Parallel nested-pandas with Dask.

Project description

nested-dask

Template

PyPI Conda

GitHub Workflow Status Codecov Read The Docs Benchmarks

A dask extension of nested-pandas.

Nested-pandas is a pandas extension package that empowers efficient analysis of nested associated datasets. This package wraps the majority of the nested-pandas API with Dask, which enables easy parallelization and capacity for work at scale.

Dev Guide - Getting Started

Before installing any dependencies or writing code, it's a great idea to create a virtual environment. LINCC-Frameworks engineers primarily use conda to manage virtual environments. If you have conda installed locally, you can run the following to create and activate a new environment.

>> conda create env -n <env_name> python=3.10
>> conda activate <env_name>

Once you have created a new environment, you can install this project for local development using the following commands:

>> pip install -e .'[dev]'
>> pre-commit install
>> conda install pandoc

Notes:

  1. The single quotes around '[dev]' may not be required for your operating system.
  2. pre-commit install will initialize pre-commit for this local repository, so that a set of tests will be run prior to completing a local commit. For more information, see the Python Project Template documentation on pre-commit
  3. Install pandoc allows you to verify that automatic rendering of Jupyter notebooks into documentation for ReadTheDocs works as expected. For more information, see the Python Project Template documentation on Sphinx and Python Notebooks

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nested_dask-0.3.2.tar.gz (48.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nested_dask-0.3.2-py3-none-any.whl (22.2 kB view details)

Uploaded Python 3

File details

Details for the file nested_dask-0.3.2.tar.gz.

File metadata

  • Download URL: nested_dask-0.3.2.tar.gz
  • Upload date:
  • Size: 48.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.8

File hashes

Hashes for nested_dask-0.3.2.tar.gz
Algorithm Hash digest
SHA256 afda6583b7c6ae32cd02a6ee8bdef1abc31bd10962630955599a3fb9eaa46eb2
MD5 86db5def3c1db72f26684b2606c16e58
BLAKE2b-256 15f33d8f3b5047eaf24f7ba57b6d0743a50461b06cf879d87cf679c6ce6c48c5

See more details on using hashes here.

Provenance

The following attestation bundles were made for nested_dask-0.3.2.tar.gz:

Publisher: publish-to-pypi.yml on lincc-frameworks/nested-dask

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nested_dask-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: nested_dask-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 22.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.8

File hashes

Hashes for nested_dask-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 9e84f6321f0bf2becc74bfa98bf0d1d25786e2d0227e55cd16755e0f076dd7ea
MD5 52faa92ca039a46674864fc6f2eaab21
BLAKE2b-256 6d540dcbb1c3443f98f5fd2d3e18c52f9a26a37a6362c60e80493f067d9e757b

See more details on using hashes here.

Provenance

The following attestation bundles were made for nested_dask-0.3.2-py3-none-any.whl:

Publisher: publish-to-pypi.yml on lincc-frameworks/nested-dask

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page