A collection of Luigi tasks for data processing
Project description
Luigi Tasks
A collection of Luigi tasks for data processing.
Installation
You can install this package from PyPI:
pip install luigi-tasks
Or install directly from the source:
pip install .
Available Tasks
HelloTask
A simple task that prints "Hello, World!" and creates a hello.txt file.
from luigi_tasks import HelloTask
import luigi
luigi.build([HelloTask()], local_scheduler=True)
PrintTask
A task that prints a custom message and saves it to a file.
from luigi_tasks import PrintTask
import luigi
# Run with default message
luigi.build([PrintTask()], local_scheduler=True)
# Run with custom message
luigi.build([PrintTask(message="Custom message")], local_scheduler=True)
Using in Docker
To use this package in a Docker container, add the following to your Dockerfile:
FROM python:3.12-slim
# Install the package
RUN pip install luigi-tasks
# Your other Docker configurations...
Development
To set up the development environment:
- Clone the repository
- Install development dependencies:
pip install -e ".[dev]"
- Run tests (if available):
pytest
Building for PyPI
To build and publish to PyPI:
- Update the version in
pyproject.toml - Build the package:
python -m build
- Upload to PyPI:
python -m twine upload dist/*
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file luigi_tasks-0.1.0.tar.gz.
File metadata
- Download URL: luigi_tasks-0.1.0.tar.gz
- Upload date:
- Size: 4.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e1ec95a847d4839ea332395b0b27b8e4021667665904433dbf1f2e2a32836c5c
|
|
| MD5 |
c64bc6235e0aa56a6cbd7c37a9f67518
|
|
| BLAKE2b-256 |
0ef885a43b599e2f85bf7f5a8c5e1571df590ffdc81be7c895233c2998e3ed8d
|
File details
Details for the file luigi_tasks-0.1.0-py3-none-any.whl.
File metadata
- Download URL: luigi_tasks-0.1.0-py3-none-any.whl
- Upload date:
- Size: 2.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
520bb35ce38d4f8f9d6e2700ee3c021af756dead580acbcad2043f7893341d14
|
|
| MD5 |
9a73cdec02d2320ea0cba6524607fafb
|
|
| BLAKE2b-256 |
b61accdab66cd8064bc566431cd1a236f45d6cbd6bbacb473a7fd506418b780b
|