Skip to main content

This file is part of datamatrix.

Project description

Python DataMatrix

An intuitive, Pythonic way to work with tabular data.

Sebastiaan Mathôt
Copyright 2015-2025
https://pydatamatrix.eu/

Publish to PyPi

Tests

Contents

About

DataMatrix is an intuitive Python library for working with column-based, time-series, and multidimensional data. It's a light-weight and easy-to-use alternative to pandas.

DataMatrix is also one of the core libraries of OpenSesame, a graphical experiment builder for the social sciences, and Rapunzel, a modern code editor for numerical computing with Python and R.

Features

  • An intuitive syntax that makes your code easy to read
  • Mix tabular data with time series and multidimensional data in a single data structure
  • Support for large data by intelligent (and automatic) offloading of data to disk when memory is running low
  • Advanced memoization (caching)
  • Requires only the Python standard libraries (but you can use numpy to improve performance)
  • Compatible with your favorite data-science libraries:
    • seaborn and matplotlib for plotting
    • scipy, statsmodels, and pingouin for statistics
    • mne for analysis of electroencephalographic (EEG) and magnetoencephalographic (MEG) data
    • Convert to and from pandas.DataFrame
    • Looks pretty inside a Jupyter Notebook

Ultra-short cheat sheet

from datamatrix import DataMatrix, io
# Read a DataMatrix from file
dm = io.readtxt('data.csv')
# Create a new DataMatrix
dm = DataMatrix(length=5)
# The first two rows
print(dm[:2])
# Create a new column and initialize it with the Fibonacci series
dm.fibonacci = 0, 1, 1, 2, 3
# You can also specify column names as if they are dict keys
dm['fibonacci'] = 0, 1, 1, 2, 3
# Remove 0 and 3 with a simple selection
dm = (dm.fibonacci > 0) & (dm.fibonacci < 3)
# Get a list of indices that match certain criteria
print(dm[(dm.fibonacci > 0) & (dm.fibonacci < 3)])
# Select 1, 1, and 2 by matching any of the values in a set
dm = dm.fibonacci == {1, 2}
# Select all odd numbers with a lambda expression
dm = dm.fibonacci == (lambda x: x % 2)
# Change all 1s to -1
dm.fibonacci[dm.fibonacci == 1] = -1
# The first two cells from the fibonacci column
print(dm.fibonacci[:2])
# Column mean
print(dm.fibonacci[...])
# Multiply all fibonacci cells by 2
dm.fibonacci_times_two = dm.fibonacci * 2
# Loop through all rows
for row in dm:
    print(row.fibonacci) # get the fibonacci cell from the row
# Loop through all columns
for colname, col in dm.columns:
    for cell in col: # Loop through all cells in the column
        print(cell) # do something with the cell
# Or just see which columns exist
print(dm.column_names)

Documentation

The basic documentation (including function and module references) is hosted on https://pydatamatrix.eu/. Additional tutorials can be found in the data-science course on https://pythontutorials.eu/.

Dependencies

DataMatrix requires only the Python standard library. That is, you can use it without installing any additional Python packages (although the pip and conda packages install some of the optional dependencies by default). Python 3.7 and higher are supported.

The following packages are required for extra functionality:

  • numpy and scipy for using the FloatColumn, IntColumn, SeriesColumn, MultiDimensionalColumn objects
  • pandas for conversion to and from pandas.DataFrame
  • mne for conversion to and from mne.Epochs and mne.TFR
  • fastnumbers for improved performance
  • prettytable for creating a text representation of a DataMatrix (e.g. to print it out)
  • openpyxl for reading and writing .xlsx files
  • json_tricks for hashing, serialization to and from json, and memoization (caching)
  • tomlkit for reading configuration from pyproject.toml
  • psutil for dynamic loading of large data

Installation

PyPi

pip install datamatrix

Historical note: The DataMatrix project used to correspond to another package of the same name, which was discontinued in 2010. If you want to install this package, you can do still do so by providing an explicit version (0.9 is the latest version of this package), as shown below. With thanks to dennogumi.org for handing over this project's entry on PyPi, thus avoiding much unnecessary confusion!

# Doesn't install datamatrix but a previous package by the same name!
pip install datamatrix==0.9

Anaconda

conda install datamatrix -c conda-forge

Ubuntu

sudo add-apt-repository ppa:smathot/cogscinl  # for stable releases
sudo add-apt-repository ppa:smathot/rapunzel  # for development releases
sudo apt-get update
sudo apt install python3-datamatrix

License

python-datamatrix is licensed under the GNU General Public License v3.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datamatrix-1.0.16.tar.gz (78.7 kB view details)

Uploaded Source

Built Distribution

datamatrix-1.0.16-py3-none-any.whl (108.3 kB view details)

Uploaded Python 3

File details

Details for the file datamatrix-1.0.16.tar.gz.

File metadata

  • Download URL: datamatrix-1.0.16.tar.gz
  • Upload date:
  • Size: 78.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.22

File hashes

Hashes for datamatrix-1.0.16.tar.gz
Algorithm Hash digest
SHA256 c54f20e3967ca5e1930783a38265b2bb484c970d51284bc9e57a3419c5a169f1
MD5 b1a9620dbf53f4e6c9f4302eee502759
BLAKE2b-256 811c7a355b801a1870a5f3cd2a85c3b819efb6bbd029ab000a23c8503be576a8

See more details on using hashes here.

File details

Details for the file datamatrix-1.0.16-py3-none-any.whl.

File metadata

  • Download URL: datamatrix-1.0.16-py3-none-any.whl
  • Upload date:
  • Size: 108.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.22

File hashes

Hashes for datamatrix-1.0.16-py3-none-any.whl
Algorithm Hash digest
SHA256 55a05e68d09cea055cebb85235c5a42bbed95ae57e01c10a75e81e2688b2e634
MD5 9c3a088504b0fc6cb97f83cccdbea308
BLAKE2b-256 20af10dbe820257435a6b15bb6ffaad754700d9e9486174b845c319cfd2a0b21

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page