Skip to main content

Batch Statistical Data Utilities

Project description

DATAU - Batch Statistical Data Utilities

Cross-platform batch runner for statistical and numerical files.

Installation

pip install pydatau

Quick example

python:

from datau import autorun

autorun(path_data="my_project/data", pattern='master', log_limit=1)

bash:

datau "my_project/data" -p "master" -l 1

Supported Extensions and Execution Method

Extension Language/Tool Method
.ipynb Jupyter Notebook papermill
.R R rpy2.robjects
.do Stata Stata batch mode
.jl Julia julia (must be in PATH)
.gms GAMS gams (must be in PATH)
.run AMPL ampl (must be in PATH)
.m MATLAB/Octave matlab.engine or Oct2Py

User Reference

autorun(path_data='...', pattern='...', *args, **kwargs)

Automatically runs matching statistical scripts in the given directory. Generates a number of .log files with outputs for each executed file.

Parameters:

path_data : str, default = current working directory
Path to the directory with input files.

pattern : str, optional
Regex pattern to match filenames (not paths), such as 'master'. Case-insensitive.

date_fmt : str, default = '%Y%m%d_%H%M%S'
Datetime format for .log filenames.

log_limit : int, optional
If set, limits the number of log files per script. Older logs beyond this limit will be deleted. Please note that you can turn off logging by setting log_limit to 0.

use_powershell : bool, default = False
If True, redirects via PowerShell on Windows. Ignored on POSIX.

License

MIT License — see the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pydatau-1.0.8.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pydatau-1.0.8-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file pydatau-1.0.8.tar.gz.

File metadata

  • Download URL: pydatau-1.0.8.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for pydatau-1.0.8.tar.gz
Algorithm Hash digest
SHA256 65ebed5312c46743b1cba0afc4363e33758abc72f10af5d5fdd1366a40999636
MD5 121e23b55bf2af63401c6c64706941b8
BLAKE2b-256 c866bd28c4d3c5431f0b1cf6754760d96883178a29d9076329175abcdb77e7ae

See more details on using hashes here.

File details

Details for the file pydatau-1.0.8-py3-none-any.whl.

File metadata

  • Download URL: pydatau-1.0.8-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for pydatau-1.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 b27f6f1a0b3e975e0516d011cc3481cd55475aa5a874c3b246e474c9f93deb22
MD5 8f40b41e79b7a1776932452f2b671c19
BLAKE2b-256 e31868b55fcd8ff247231399a742ada2fdeef0f878e4e9d4bfac749a13eda84c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page