Skip to main content

Parallel nested-pandas with Dask.

Project description

nested-dask

Template

PyPI GitHub Workflow Status Codecov Read The Docs Benchmarks

A dask extension of nested-pandas.

Nested-pandas is a pandas extension package that empowers efficient analysis of nested associated datasets. This package wraps the majority of the nested-pandas API with Dask, which enables easy parallelization and capacity for work at scale.

Dev Guide - Getting Started

Before installing any dependencies or writing code, it's a great idea to create a virtual environment. LINCC-Frameworks engineers primarily use conda to manage virtual environments. If you have conda installed locally, you can run the following to create and activate a new environment.

>> conda create env -n <env_name> python=3.10
>> conda activate <env_name>

Once you have created a new environment, you can install this project for local development using the following commands:

>> pip install -e .'[dev]'
>> pre-commit install
>> conda install pandoc

Notes:

  1. The single quotes around '[dev]' may not be required for your operating system.
  2. pre-commit install will initialize pre-commit for this local repository, so that a set of tests will be run prior to completing a local commit. For more information, see the Python Project Template documentation on pre-commit
  3. Install pandoc allows you to verify that automatic rendering of Jupyter notebooks into documentation for ReadTheDocs works as expected. For more information, see the Python Project Template documentation on Sphinx and Python Notebooks

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nested_dask-0.3.1.tar.gz (48.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nested_dask-0.3.1-py3-none-any.whl (22.2 kB view details)

Uploaded Python 3

File details

Details for the file nested_dask-0.3.1.tar.gz.

File metadata

  • Download URL: nested_dask-0.3.1.tar.gz
  • Upload date:
  • Size: 48.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for nested_dask-0.3.1.tar.gz
Algorithm Hash digest
SHA256 c71e7709a6a7df943a9e51456be70cd64021282e8747c81de7a482616311828a
MD5 0d498e98ff91645485523a1e8ff8be5c
BLAKE2b-256 1da192f46ad96b89e7fb1de7913ed39c2c5c79eb4c602c308a70c211a130f532

See more details on using hashes here.

Provenance

The following attestation bundles were made for nested_dask-0.3.1.tar.gz:

Publisher: publish-to-pypi.yml on lincc-frameworks/nested-dask

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nested_dask-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: nested_dask-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 22.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for nested_dask-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 39cc74c67b69a38323b171d3045b7f090355edf6147ed8e0b787823fe72b0ad7
MD5 db3e737975a119ed455058bf38c80ed5
BLAKE2b-256 8451f0f004ba5ca9d8dc20f086026d66d3a71ccb0ea7338d784cf007d1df2767

See more details on using hashes here.

Provenance

The following attestation bundles were made for nested_dask-0.3.1-py3-none-any.whl:

Publisher: publish-to-pypi.yml on lincc-frameworks/nested-dask

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page