Skip to main content

A collection of Luigi tasks for data processing

Project description

Luigi Tasks

A collection of Luigi tasks for data processing.

Installation

You can install this package from PyPI:

pip install luigi-tasks

Or install directly from the source:

pip install .

Available Tasks

HelloTask

A simple task that prints "Hello, World!" and creates a hello.txt file.

from luigi_tasks import HelloTask
import luigi

luigi.build([HelloTask()], local_scheduler=True)

PrintTask

A task that prints a custom message and saves it to a file.

from luigi_tasks import PrintTask
import luigi

# Run with default message
luigi.build([PrintTask()], local_scheduler=True)

# Run with custom message
luigi.build([PrintTask(message="Custom message")], local_scheduler=True)

Using in Docker

To use this package in a Docker container, add the following to your Dockerfile:

FROM python:3.12-slim

# Install the package
RUN pip install luigi-tasks

# Your other Docker configurations...

Development

To set up the development environment:

  1. Clone the repository
  2. Install development dependencies:
    pip install -e ".[dev]"
    
  3. Run tests (if available):
    pytest
    

Building for PyPI

To build and publish to PyPI:

  1. Update the version in pyproject.toml
  2. Build the package:
    python -m build
    
  3. Upload to PyPI:
    python -m twine upload dist/*
    

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

luigi_tasks-0.1.0.tar.gz (4.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

luigi_tasks-0.1.0-py3-none-any.whl (2.7 kB view details)

Uploaded Python 3

File details

Details for the file luigi_tasks-0.1.0.tar.gz.

File metadata

  • Download URL: luigi_tasks-0.1.0.tar.gz
  • Upload date:
  • Size: 4.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for luigi_tasks-0.1.0.tar.gz
Algorithm Hash digest
SHA256 e1ec95a847d4839ea332395b0b27b8e4021667665904433dbf1f2e2a32836c5c
MD5 c64bc6235e0aa56a6cbd7c37a9f67518
BLAKE2b-256 0ef885a43b599e2f85bf7f5a8c5e1571df590ffdc81be7c895233c2998e3ed8d

See more details on using hashes here.

File details

Details for the file luigi_tasks-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: luigi_tasks-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 2.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for luigi_tasks-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 520bb35ce38d4f8f9d6e2700ee3c021af756dead580acbcad2043f7893341d14
MD5 9a73cdec02d2320ea0cba6524607fafb
BLAKE2b-256 b61accdab66cd8064bc566431cd1a236f45d6cbd6bbacb473a7fd506418b780b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page