Skip to main content

DATAU - Batch Statistical Data Utilities

Cross-platform batch runner for statistical and numerical files.

Installation

pip install pydatau

Quick example

python:

from datau import autorun

autorun(path_data="my_project/data", pattern='master', log_limit=1)

bash:

datau "my_project/data" -p "master" -l 1

Supported Extensions and Execution Method

Extension Language/Tool Method
.ipynb Jupyter Notebook papermill
.R R rpy2.robjects
.do Stata Stata batch mode
.jl Julia julia (must be in PATH)
.gms GAMS gams (must be in PATH)
.run AMPL ampl (must be in PATH)
.m MATLAB/Octave matlab.engine or Oct2Py

User Reference

autorun(path_data='...', pattern='...', *args, **kwargs)

Automatically runs matching statistical scripts in the given directory. Generates a number of .log files with outputs for each executed file.

Parameters:

path_data : str, default = current working directory
Path to the directory with input files.

pattern : str, optional
Regex pattern to match filenames (not paths), such as 'master'. Case-insensitive.

date_fmt : str, default = '%Y%m%d_%H%M%S'
Datetime format for .log filenames.

log_limit : int, optional
If set, limits the number of log files per script. Older logs beyond this limit will be deleted. Please note that you can turn off logging by setting log_limit to 0.

use_powershell : bool, default = False
If True, redirects via PowerShell on Windows. Ignored on POSIX.

License

MIT License — see the LICENSE file.

Metadata

Release files for pydatau 1.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pydatau 1.1.0
File Size Uploaded
pydatau-1.1.0.tar.gz 4.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pydatau 1.1.0
File Interpreter ABI Platform
pydatau-1.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 9.9 kB

Release files / pydatau-1.1.0.tar.gz

Download URL pydatau-1.1.0.tar.gz
Size 4.5 kB
Tags Source
SHA-256 checksum
How to use checksums
9ef07014a5f5c2e13e453659d740ef86f830936868c5e2e79e61f22fc1f12b75
BLAKE2b-256 checksum
How to use checksums
653fe19f5e921ca81c8efe77f53e014d69f18ef9e874907009a0790d2a2ab4f2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.13

Release files / pydatau-1.1.0-py3-none-any.whl

Download URL pydatau-1.1.0-py3-none-any.whl
Size 5.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
2260a826ccbae8342da6041013fa5a518ccd22de46fae7160dd62b0fe37fbe55
BLAKE2b-256 checksum
How to use checksums
8d47db0c979dd804e0253d39ea51682a732ce6649c149b1a6e6e020301511df9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.13

Release history Release notifications | RSS feed

This release

1.1.0 This release

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page