Awkward Array is a library for nested, variable-sized data, including arbitrary-length lists, records, mixed types, and missing data, using NumPy-like idioms.
Arrays are dynamically typed, but operations on them are compiled and fast. Their behavior coincides with NumPy when array dimensions are regular and generalizes when they're not.
Motivating example
Given an array of lists of objects with x, y fields (with nested lists in the y field),
import awkward as ak
array = ak.Array([
[{"x": 1.1, "y": [1]}, {"x": 2.2, "y": [1, 2]}, {"x": 3.3, "y": [1, 2, 3]}],
[],
[{"x": 4.4, "y": [1, 2, 3, 4]}, {"x": 5.5, "y": [1, 2, 3, 4, 5]}]
])
the following slices out the y values, drops the first element from each inner list, and runs NumPy's np.square function on everything that is left:
output = np.square(array["y", ..., 1:])
The result is
[
[[], [4], [4, 9]],
[],
[[4, 9, 16], [4, 9, 16, 25]]
]
The equivalent using only Python is
output = []
for sublist in array:
tmp1 = []
for record in sublist:
tmp2 = []
for number in record["y"][1:]:
tmp2.append(np.square(number))
tmp1.append(tmp2)
output.append(tmp1)
The expression using Awkward Arrays is more concise, using idioms familiar from NumPy, and it also has NumPy-like performance. For a similar problem 10 million times larger than the one above (single-threaded on a 2.2 GHz processor),
- the Awkward Array one-liner takes 1.5 seconds to run and uses 2.1 GB of memory,
- the equivalent using Python lists and dicts takes 140 seconds to run and uses 22 GB of memory.
Awkward Array is even faster when used in Numba's JIT-compiled functions.
See the Getting started documentation on awkward-array.org for an introduction, including a no-install demo you can try in your web browser.
Getting help
- View the documentation on awkward-array.org.
- Report bugs, request features, and ask for additional documentation on GitHub Issues.
- If you have a "How do I...?" question, start a GitHub Discussion with category "Q&A".
Installation
Awkward Array can be installed from PyPI using pip:
pip install awkward
The awkward package is pure Python, and it will download the awkward-cpp compiled components as a dependency. If there is no awkward-cpp binary package (wheel) for your platform and Python version, pip will attempt to compile it from source (which has additional dependencies, such as a C++ compiler).
Awkward Array is also available on conda-forge:
conda install -c conda-forge awkward
5 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file awkward-2.13.0.tar.gz.
File metadata
- Download URL: awkward-2.13.0.tar.gz
- Upload date:
- Size: 6.5 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
36f127573295e1ddf65b551bf071b803ad4af21bd14519f4c4dd34953cb3efc2
|
|
| MD5 |
ffab87ff78f15104fa33418836949819
|
|
| BLAKE2b-256 |
43972728ab879ed3edaecfbd8e9daa7d88a2f89a7ea584e413c4d8971fc0414d
|
Provenance
The following attestation bundles were made for awkward-2.13.0.tar.gz:
Publisher:
deploy.yml on scikit-hep/awkward
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
awkward-2.13.0.tar.gz -
Subject digest:
36f127573295e1ddf65b551bf071b803ad4af21bd14519f4c4dd34953cb3efc2 - Sigstore transparency entry: 2467518917
- Sigstore integration time:
-
Permalink:
scikit-hep/awkward@cef1a524fb52896b86ef505526f2fe4689f5e217 -
Branch / Tag:
refs/tags/v2.13.0 - Owner: https://github.com/scikit-hep
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
deploy.yml@cef1a524fb52896b86ef505526f2fe4689f5e217 -
Trigger Event:
release
-
Statement type:
File details
Details for the file awkward-2.13.0-py3-none-any.whl.
File metadata
- Download URL: awkward-2.13.0-py3-none-any.whl
- Upload date:
- Size: 990.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ff40879e7179a6f14f4c4ee5f5297e3dcd027b99b4c64188bdb7dccdf625e982
|
|
| MD5 |
dce5012aecb1ee52551757a16e8a1d79
|
|
| BLAKE2b-256 |
2534b8eece9a8d024defc08418ea883361b3d7e3300392719ee27535e93885a5
|
Provenance
The following attestation bundles were made for awkward-2.13.0-py3-none-any.whl:
Publisher:
deploy.yml on scikit-hep/awkward
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
awkward-2.13.0-py3-none-any.whl -
Subject digest:
ff40879e7179a6f14f4c4ee5f5297e3dcd027b99b4c64188bdb7dccdf625e982 - Sigstore transparency entry: 2467518971
- Sigstore integration time:
-
Permalink:
scikit-hep/awkward@cef1a524fb52896b86ef505526f2fe4689f5e217 -
Branch / Tag:
refs/tags/v2.13.0 - Owner: https://github.com/scikit-hep
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
deploy.yml@cef1a524fb52896b86ef505526f2fe4689f5e217 -
Trigger Event:
release
-
Statement type:
