Skip to main content

Python utils for specific usecase

Project description

InoPyUtils

A comprehensive Python utility library designed for specific use-cases including S3-compatible storage operations, media processing, file management, AI workflow orchestration, configuration management, and logging.


Important Note

Active Development
This library is under active development and is not yet feature-complete. It was built to satisfy specific use-cases and may change without warning.

Not Production-Ready
Use at your own risk. Do not deploy this in production environments unless you fully understand its internals and have thoroughly tested it for your needs.

Contributions, feedback, and issue reports are welcome—but please be cautious if you plan to rely on this library for critical workloads.


Features

🗄️ S3-Compatible Storage (InoS3Helper)

  • Universal S3 Support: Compatible with AWS S3, Backblaze B2, DigitalOcean Spaces, Wasabi, MinIO, and other S3-compatible services
  • Async Operations: Fully asynchronous file upload/download operations
  • Automatic Retry: Configurable retry mechanism with exponential backoff
  • Flexible Authentication: Support for access keys, environment variables, and IAM roles
  • Advanced Features: Object listing, existence checking, deletion, and metadata support
from inopyutils import InoS3Helper

# Initialize with Backblaze B2
s3_client = InoS3Helper(
    aws_access_key_id='your_key_id',
    aws_secret_access_key='your_secret_key',
    endpoint_url='https://s3.us-west-004.backblazeb2.com',
    region_name='us-west-004',
    bucket_name='your-bucket',
    retries=5
)

# Upload and download files
await s3_client.upload_file('local_file.txt', 'remote/file.txt')
await s3_client.download_file('remote/file.txt', 'downloaded_file.txt')

📁 File Management (InoFileHelper)

  • Archive Operations: ZIP compression and extraction with customizable settings
  • File Operations: Move, copy, remove files and folders with safety checks
  • Batch Processing: Automatic batch name incrementing for organized workflows
  • File Analysis: Count files recursively, get last modified files
  • Media Validation: Validate image and video files with format conversion support
from inopyutils import InoFileHelper
from pathlib import Path

# Zip a folder with compression
await InoFileHelper.zip(
    to_zip=Path("source_folder"),
    path_to_save=Path("output"),
    zip_file_name="archive.zip",
    compression_level=5
)

# Copy files with renaming
InoFileHelper.copy_files(
    from_path=Path("source"),
    to_path=Path("destination"),
    rename_files=True,
    prefix_name="ProcessedFile"
)

🎨 Media Processing (InoMediaHelper)

  • Video Processing: FFmpeg-based video conversion with resolution and FPS control
  • Image Processing: Pillow-based image validation, resizing, and format conversion
  • HEIF Support: Handle HEIF/HEIC image formats with automatic registration
  • Quality Control: Configurable JPEG quality and resolution limits
  • Format Validation: Comprehensive media file validation and conversion
from inopyutils import InoMediaHelper
from pathlib import Path

# Convert and resize image
await InoMediaHelper.image_validate_pillow(
    input_path=Path("input.heic"),
    output_path=Path("output.jpg"),
    max_res=2048,
    jpg_quality=90
)

# Process video with resolution/FPS limits
await InoMediaHelper.video_convert_ffmpeg(
    input_path=Path("input.mp4"),
    output_path=Path("output.mp4"),
    change_res=True,
    max_res=1920,
    change_fps=True,
    max_fps=30
)

⚙️ Configuration Management (InoConfigHelper)

  • INI File Support: Read and write INI-based configuration files
  • Type Safety: Dedicated methods for strings and booleans
  • Debug Mode: Optional debug logging for configuration operations
  • Auto-Save: Automatic saving after configuration changes
from inopyutils import InoConfigHelper

config = InoConfigHelper('config/app.ini')

# Get configuration values with fallbacks
api_key = config.get('api', 'key', fallback='default_key')
debug_mode = config.get_bool('app', 'debug', fallback=False)

# Set configuration values
config.set('api', 'endpoint', 'https://api.example.com')

📝 Structured Logging (InoLogHelper)

  • JSON-Lines Format: Structured logging in JSONL format
  • Automatic Batching: Automatic log file batch naming and rotation
  • Categorized Logging: INFO, WARNING, ERROR categories
  • Timestamped Entries: ISO format timestamps for all log entries
  • Flexible Data: Log arbitrary dictionary data with messages
from inopyutils import InoLogHelper, LogCategory
from pathlib import Path

logger = InoLogHelper(Path("logs"), "MyApp")

# Log with automatic categorization
logger.add({"status": "success", "processed": 100}, "Batch completed")

# Log with explicit category
logger.add({"error": "Connection timeout"}, "API failed", LogCategory.ERROR)

Installation

# Install from PyPI
pip install inopyutils

# Install locally for development:
git clone https://github.com/nobandegani/InoPyUtils.git
cd InoPyUtils
pip install -e .

Dependencies

  • pillow: Image processing
  • pillow_heif: HEIF/HEIC image format support
  • opencv-python: Video processing capabilities
  • aioboto3: Async AWS S3 operations
  • inocloudreve: Cloud storage integration

License

Mozilla Public License Version 2.0

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

inopyutils-0.2.6.tar.gz (23.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

inopyutils-0.2.6-py3-none-any.whl (21.9 kB view details)

Uploaded Python 3

File details

Details for the file inopyutils-0.2.6.tar.gz.

File metadata

  • Download URL: inopyutils-0.2.6.tar.gz
  • Upload date:
  • Size: 23.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3

File hashes

Hashes for inopyutils-0.2.6.tar.gz
Algorithm Hash digest
SHA256 87f218757b75384188984c643bdd9ec401b98d77f98f2f897759b64915209462
MD5 0b07ccea52a3f65ed36bc78a386dc0ad
BLAKE2b-256 d6f66006f6553de859f49c797816e02ac70bba5e99d7a1c6d0cbda1ff1c1dbee

See more details on using hashes here.

File details

Details for the file inopyutils-0.2.6-py3-none-any.whl.

File metadata

  • Download URL: inopyutils-0.2.6-py3-none-any.whl
  • Upload date:
  • Size: 21.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3

File hashes

Hashes for inopyutils-0.2.6-py3-none-any.whl
Algorithm Hash digest
SHA256 b3d429882a0c8a8a5821c8931b5d0071e308a9c8d8b43abf4e3c4b1e263c084f
MD5 eddde9f577836c7b0aacc1156f59fb70
BLAKE2b-256 b269475cd678083a3f6830cea34fafa6e7a35e3f93c5e7ffa1db6f21e07835aa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page