Skip to main content

AI/ML Utils | @GitHub | @PyPI

This is a Python pacakage that contains misc utils for AI/ML.

  1. Misc enhancement of Python's built-in functionalities.
    • string
    • collections
    • pandas DataFrame
    • datetime
  2. Misc other tools
    • aiutil.filesystem: misc tools for querying and manipulating filesystems; convenient tools for manipulating text files.
    • aiutil.url: URL formatting for HTML, Excel, etc.
    • aiutil.sql: SQL formatting
    • aiutil.cv: some more tools (in addition to OpenCV) for image processing
    • aiutil.shell: parse command-line output to a pandas DataFrame
    • aiutil.pydev: tools for making it even easier to manage Python project
    • aiutil.pdf: easy and flexible extracting of PDF pages
    • aiutil.memory: query and consume memory to a specified range
    • aiutil.notebook: Jupyter/Lab notebook related tools
    • aiutil.dockerhub: managing Docker images on DockerHub in batch mode using Python
    • aiutil.hadoop:
      • A Spark application log analyzing tool for identify root causes of failed Spark applications.
      • Pythonic wrappers to the hdfs command.
      • A auto authentication tool for Kerberos.
      • An improved version of spark_submit.
      • Other misc PySpark functions.

Installation

pip3 install --user -U aiutil

Use the following commands if you want to install all components of aiutil. Available additional components are cv, docker, pdf, jupyter, admin and all.

pip3 install --user -U aiutil[all]

Executable Scripts

  • snb: Search for content in Jupyter notebooks.
  • logf: A Spark application log analyzing tool for identify root causes of failed Spark applications.
  • pyspark_submit: Makes it easy to run Scala/Python Spark job.
  • pykinit: Make it easier to authenticate users' personal accounts on Hadoop.
  • match_memory: Query and consume memory.

You can run those executable scripts using uv (so that you don't have to manually install this Python package) . For example,

uvx --from aiutil snb -h

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aiutil-0.100.0.tar.gz (160.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aiutil-0.100.0-py3-none-any.whl (50.1 kB view details)

Uploaded Python 3

File details

Details for the file aiutil-0.100.0.tar.gz.

File metadata

  • Download URL: aiutil-0.100.0.tar.gz
  • Upload date:
  • Size: 160.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.1 {"installer":{"name":"uv","version":"0.12.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for aiutil-0.100.0.tar.gz
Algorithm Hash digest
SHA256 1b777955dbdeae8a03a71e590bb6636c1a16e261e7942a76546b18997bf8276b
MD5 9e29cc20c4be499402a56ab58ab18f49
BLAKE2b-256 b8a2deb9eaff2afdc6656ef8f200bb37c06a7c5fe92ec4c0530ef242d2706707

See more details on using hashes here.

File details

Details for the file aiutil-0.100.0-py3-none-any.whl.

File metadata

  • Download URL: aiutil-0.100.0-py3-none-any.whl
  • Upload date:
  • Size: 50.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.1 {"installer":{"name":"uv","version":"0.12.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for aiutil-0.100.0-py3-none-any.whl
Algorithm Hash digest
SHA256 10e7c5e7d9e09fcdec7abc5753788b7d7a6768c331a191f3c2fd8b082598b86a
MD5 05c7520dfc1fbdcf323154020780397c
BLAKE2b-256 3d3ac30655ba065fb6aa3e87befd9a9f0cd3e256ceed8cf3d9773df585365916

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.100.0 This release

2 files

0.99.0

2 files

0.98.0

2 files

0.97.0

2 files

0.96.0

2 files

0.95.0

2 files

0.94.0

2 files

0.93.0

2 files

0.92.0

2 files

0.91.0

2 files

0.90.0

2 files

0.89.0

2 files

0.87.1

2 files

0.87.0

2 files

0.86.1

2 files

0.86.0

2 files

0.85.0

2 files

0.83.0

2 files

0.82.0

2 files

0.81.0

2 files

0.80.6

2 files

0.80.5

2 files

0.80.4

2 files

0.79.0

2 files

0.78.0

2 files

0.77.1

2 files

0.77.0

2 files

0.76.1

2 files

0.76.0

2 files

0.75.0

2 files

0.74.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page