Skip to main content

A collection of Luigi tasks for data processing

Project description

Luigi Tasks

A collection of Luigi tasks for data processing.

Installation

You can install this package from PyPI:

pip install luigi-tasks

Or install directly from the source:

pip install .

Available Tasks

HelloTask

A simple task that prints "Hello, World!" and creates a hello.txt file.

from luigi_tasks import HelloTask
import luigi

luigi.build([HelloTask()], local_scheduler=True)

PrintTask

A task that prints a custom message and saves it to a file.

from luigi_tasks import PrintTask
import luigi

# Run with default message
luigi.build([PrintTask()], local_scheduler=True)

# Run with custom message
luigi.build([PrintTask(message="Custom message")], local_scheduler=True)

Using in Docker

To use this package in a Docker container, add the following to your Dockerfile:

FROM python:3.12-slim

# Install the package
RUN pip install luigi-tasks

# Your other Docker configurations...

Development

To set up the development environment:

  1. Clone the repository
  2. Install development dependencies:
    pip install -e ".[dev]"
    
  3. Run tests (if available):
    pytest
    

Building for PyPI

To build and publish to PyPI:

  1. Update the version in pyproject.toml
  2. Build the package:
    python -m build
    
  3. Upload to PyPI:
    python -m twine upload dist/*
    

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

luigi_tasks-0.1.2.tar.gz (4.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

luigi_tasks-0.1.2-py3-none-any.whl (2.7 kB view details)

Uploaded Python 3

File details

Details for the file luigi_tasks-0.1.2.tar.gz.

File metadata

  • Download URL: luigi_tasks-0.1.2.tar.gz
  • Upload date:
  • Size: 4.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for luigi_tasks-0.1.2.tar.gz
Algorithm Hash digest
SHA256 a8ce2048df747fab76b94f8d937bb4d074ceaa3df9085daa2992ad19cb7571ce
MD5 3684869908bd43a5c8bd625bd5d17752
BLAKE2b-256 8bdde7369ea0e10c20124fd76e33a728da5dfbe916c5709cba1c81663b481e3d

See more details on using hashes here.

File details

Details for the file luigi_tasks-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: luigi_tasks-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 2.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for luigi_tasks-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 952738aebe827e6f679ee54d3a5573fd2f915bfb7b46e9e49c509dc5a0edc8dc
MD5 1b0bb56dd8f3b0cdc0d14ba72d8fd02e
BLAKE2b-256 36e1f1d54ebe9147a518072a33887dd1a37e947ee5d748f9ffdd545c20613733

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page