Skip to main content

Custom provider for Magento 2 - Apache Airflow

Project description

Magento Apache Airflow Provider

This repository contains a custom Apache Airflow provider for integrating with Magento 2. The provider enables the automation of various Magento-related tasks using Airflow, such as order synchronization and data exports.

Features:

  • Magento Integration: Seamlessly connect to Magento 2 using OAuth1 authentication for secure API requests.
  • Custom Airflow Hooks: Simplifies interaction with Magento's REST API and GraphQL.
  • Custom Airflow Operators: Provides an operator to fetch and manipulate orders and other data from Magento.

Contents:

  • airflow_magento_provider/hooks/magento.py: Contains the MagentoHook class, which handles OAuth authentication and API requests to Magento.
  • airflow_magento_provider/operators/rest.py: Contains the MagentoRestOperator class.
  • airflow_magento_provider/operators/graphql.py: Contains the MagentoGraphQLOperator class.
  • example_dags/: Example DAGs for understanding Magento Operators and Hooks.

Getting Started:

  1. Install the provider: Clone the repository and install the package using pip:

    git clone https://github.com/sivajik34/magento-airflow.git
    cd apache_airflow_provider_magento
    pip install .
    

    Also, you can install it from https://pypi.org/project/apache-airflow-provider-magento/ pip install apache-airflow-provider-magento

  2. Set up Airflow connections:

    • Create an Airflow connection with your Magento credentials( System -> Integration -> Add new Integration).
  3. Create a DAG:

    • Set up your data synchronization pipeline by referring to the example DAGs in the example_dags directory.

Requirements:

  • Apache Airflow 2.x
  • Magento 2.4.x
  • Python 3.8+

Contributing:

Contributions are welcome! Please feel free to submit a pull request or open an issue.

License:

This project is licensed under the MIT License.


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

apache_airflow_provider_magento-0.7.tar.gz (17.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

apache_airflow_provider_magento-0.7-py3-none-any.whl (24.9 kB view details)

Uploaded Python 3

File details

Details for the file apache_airflow_provider_magento-0.7.tar.gz.

File metadata

File hashes

Hashes for apache_airflow_provider_magento-0.7.tar.gz
Algorithm Hash digest
SHA256 e3b53012bebfbe4ad9603e27fc8bf43092d6e92597bdfc3633fd961c0038627c
MD5 3c21a71a2d95972965f96d7f14a93ba8
BLAKE2b-256 4320f9795a17c80c679818a46c94ee2374023e2736720da1c578a465a8def499

See more details on using hashes here.

File details

Details for the file apache_airflow_provider_magento-0.7-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_provider_magento-0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 dabf2c192d0ee09e876058161ad4f199b5a9f6808b0f3d3c33666345522d3d81
MD5 9d1fcff4608fa71ad796c59f478349a5
BLAKE2b-256 9e7d11f5bf6993de8414c5e7236014938562fed5a0b5c0efbb14cf842e4f01ee

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page