Skip to main content

Batch Statistical Data Utilities

Project description

DATAU - Batch Statistical Data Utilities

Cross-platform batch runner for statistical and numerical files.

Installation

pip install pydatau

Quick example

python:

from datau import autorun

autorun(path_data="my_project/data", pattern='master', log_limit=1)

bash:

datau "my_project/data" -p "master" -l 1

Supported Extensions and Execution Method

Extension Language/Tool Method
.ipynb Jupyter Notebook papermill
.R R rpy2.robjects
.do Stata Stata batch mode
.jl Julia julia (must be in PATH)
.gms GAMS gams (must be in PATH)
.run AMPL ampl (must be in PATH)
.m MATLAB/Octave matlab.engine or Oct2Py

User Reference

autorun(path_data='...', pattern='...', *args, **kwargs)

Automatically runs matching statistical scripts in the given directory. Generates a number of .log files with outputs for each executed file.

Parameters:

path_data : str, default = current working directory
Path to the directory with input files.

pattern : str, optional
Regex pattern to match filenames (not paths), such as 'master'. Case-insensitive.

date_fmt : str, default = '%Y%m%d_%H%M%S'
Datetime format for .log filenames.

log_limit : int, optional
If set, limits the number of log files per script. Older logs beyond this limit will be deleted. Please note that you can turn off logging by setting log_limit to 0.

use_powershell : bool, default = False
If True, redirects via PowerShell on Windows. Ignored on POSIX.

License

MIT License — see the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pydatau-1.1.0.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pydatau-1.1.0-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file pydatau-1.1.0.tar.gz.

File metadata

  • Download URL: pydatau-1.1.0.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for pydatau-1.1.0.tar.gz
Algorithm Hash digest
SHA256 9ef07014a5f5c2e13e453659d740ef86f830936868c5e2e79e61f22fc1f12b75
MD5 9cf55f8abb52a917bbf2a1590fb6ca34
BLAKE2b-256 653fe19f5e921ca81c8efe77f53e014d69f18ef9e874907009a0790d2a2ab4f2

See more details on using hashes here.

File details

Details for the file pydatau-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: pydatau-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for pydatau-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2260a826ccbae8342da6041013fa5a518ccd22de46fae7160dd62b0fe37fbe55
MD5 a3e6177e7c6c9c9a53b1cbbd72069043
BLAKE2b-256 8d47db0c979dd804e0253d39ea51682a732ce6649c149b1a6e6e020301511df9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page