Skip to main content

Convenience wrapper around large scientific datasets to process with dask.

Project description

scida

test status DOI

scida is an out-of-the-box analysis tool for large scientific datasets. It primarily supports the astrophysics community, focusing on cosmological and galaxy formation simulations using particles or unstructured meshes, as well as large observational datasets. This tool uses dask, allowing analysis to scale up from your personal computer to HPC resources and the cloud.

Features

  • Unified, high-level interface to load and analyze large datasets from a variety of sources.
  • Parallel, task-based data processing with dask arrays.
  • Physical unit support via pint.
  • Easily extensible architecture.

Requirements

  • Python 3.9, 3.10, 3.11

Documentation

The documentation can be found here.

Install

pip install scida

First Steps

After installing scida, follow the tutorial.

Citation

If you use scida in your research, please cite the following paper:

`Byrohl et al., (2024). scida: scalable analysis for scientific big data. Journal of Open Source Software, 9(94), 6064, https://doi.org/10.21105/joss.06064`

with the following bibtex entry:

@article{scida,
  title = {scida: scalable analysis for scientific big data},
  author = {Chris Byrohl and Dylan Nelson},
  doi = {10.21105/joss.06064},
  url = {https://doi.org/10.21105/joss.06064}, year = {2024},
  publisher = {The Open Journal}, volume = {9}, number = {94},
  pages = {6064},
  journal = {Journal of Open Source Software}
}

Issues

If you encounter any problems, please file an issue along with a detailed description.

License

Distributed under the terms of the MIT license, scida is free and open source software.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scida-0.3.2.tar.gz (76.0 kB view hashes)

Uploaded Source

Built Distribution

scida-0.3.2-py3-none-any.whl (93.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page