A utils Python package for data scientists.
Project description
AI/ML Utils | @GitHub | @PyPI
This is a Python pacakage that contains misc utils for AI/ML.
- Misc enhancement of Python's built-in functionalities.
- string
- collections
- pandas DataFrame
- datetime
- Misc other tools
aiutil.filesystem: misc tools for querying and manipulating filesystems; convenient tools for manipulating text files.aiutil.url: URL formatting for HTML, Excel, etc.aiutil.sql: SQL formattingaiutil.cv: some more tools (in addition to OpenCV) for image processingaiutil.shell: parse command-line output to a pandas DataFrameaiutil.shebang: auto correct SheBang of scriptsaiutil.pydev: tools for making it even easier to manage Python projectaiutil.pdf: easy and flexible extracting of PDF pagesaiutil.memory: query and consume memory to a specified rangeaiutil.notebook: Jupyter/Lab notebook related toolsaiutil.dockerhub: managing Docker images on DockerHub in batch mode using Pythonaiutil.hadoop:- A Spark application log analyzing tool for identify root causes of failed Spark applications.
- Pythonic wrappers to the
hdfscommand. - A auto authentication tool for Kerberos.
- An improved version of
spark_submit. - Other misc PySpark functions.
Installation
pip3 install --user -U aiutil
Use the following commands if you want to install all components of aiutil.
Available additional components are cv, docker, pdf, jupyter, admin and all.
pip3 install --user -U aiutil[all]
Executable Scripts
- snb: Search for content in Jupyter notebooks.
- logf: A Spark application log analyzing tool for identify root causes of failed Spark applications.
- pyspark_submit: Makes it easy to run Scala/Python Spark job.
- pykinit: Make it easier to authenticate users' personal accounts on Hadoop.
- match_memory: Query and consume memory.
You can run those executable scripts using uv (so that you don't have to manually install this Python package) . For example,
uvx --from aiutil snb -h
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file aiutil-0.91.0.tar.gz.
File metadata
- Download URL: aiutil-0.91.0.tar.gz
- Upload date:
- Size: 189.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.9.21 {"installer":{"name":"uv","version":"0.9.21","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8ab7efd7ee5dae143194255d9504c39e4fdb8e0a5738772c66bc31258a5705a2
|
|
| MD5 |
76ba37f2d72e344f2b1d5067f2d95c47
|
|
| BLAKE2b-256 |
dc26ae7c8bad4192d47999e10cff902351cb4bfe352a9c2a6eafb11371433231
|
File details
Details for the file aiutil-0.91.0-py3-none-any.whl.
File metadata
- Download URL: aiutil-0.91.0-py3-none-any.whl
- Upload date:
- Size: 45.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.9.21 {"installer":{"name":"uv","version":"0.9.21","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3431d91500bb1500e44fab237f75dd88906ac264cf77515067de36cf25572aa2
|
|
| MD5 |
d0b4efddd985e6557a5059b576eab4fa
|
|
| BLAKE2b-256 |
aab13b475fc6ecadc5b2ecb60fd5846f7d1b67d72181cf5396bd0d2877ce79eb
|
