Skip to main content

Luigi Tasks for Soneti Orchestration

Project description

# Soneti Orchestrator

Orchestration of Soneti services (i.e. Senpy, GSICrawler, Scaner, etc.). The orchestration is based on the luigi daemon, a set of custom luigi tasks, and some additional code to provide scheduling.

This repository contains:

  • A python package with several custom luigi tasks for the main Soneti services. The package is also available through PyPI (pip install soneti).

  • A base image with luigi and the scripts to schedule tasks.

  • An example orchestrator in the example folder.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soneti-0.1.8.tar.gz (12.9 kB view details)

Uploaded Source

File details

Details for the file soneti-0.1.8.tar.gz.

File metadata

  • Download URL: soneti-0.1.8.tar.gz
  • Upload date:
  • Size: 12.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/3.7

File hashes

Hashes for soneti-0.1.8.tar.gz
Algorithm Hash digest
SHA256 0b6b47a5ad80ca6d557dd74e0ca0ea34cedf4875aa3fb44c478e1bd070de5309
MD5 a3b7f4f1f5bc4e45cbeaafb4458e5796
BLAKE2b-256 3b5a4fc51f57d9b6f9a3c687fd8145f46d58d3d624e6dfc9e7e39fa818462fc0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page