Custom provider for Magento 2 - Apache Airflow
Project description
Magento Apache Airflow Provider
This repository contains a custom Apache Airflow provider for integrating with Magento 2. The provider enables the automation of various Magento-related tasks using Airflow, such as order synchronization and data exports.
Features:
- Magento Integration: Seamlessly connect to Magento 2 using OAuth1 authentication for secure API requests.
- Custom Airflow Hooks: Simplifies interaction with Magento's REST API and GraphQL.
- Custom Airflow Operators: Provides an operator to fetch and manipulate orders and other data from Magento.
Contents:
airflow_magento_provider/hooks/magento.py: Contains theMagentoHookclass, which handles OAuth authentication and API requests to Magento.airflow_magento_provider/operators/rest.py: Contains theMagentoRestOperatorclass.airflow_magento_provider/operators/graphql.py: Contains theMagentoGraphQLOperatorclass.example_dags/: Example DAGs for understanding Magento Operators and Hooks.
Getting Started:
-
Install the provider: Clone the repository and install the package using pip:
git clone https://github.com/sivajik34/magento-airflow.git cd apache_airflow_provider_magento pip install .
Also, you can install it from https://pypi.org/project/apache-airflow-provider-magento/ pip install apache-airflow-provider-magento
-
Set up Airflow connections:
- Create an Airflow connection with your Magento credentials( System -> Integration -> Add new Integration).
-
Create a DAG:
- Set up your data synchronization pipeline by referring to the example DAGs in the
example_dagsdirectory.
- Set up your data synchronization pipeline by referring to the example DAGs in the
Requirements:
- Apache Airflow 2.x
- Magento 2.4.x
- Python 3.8+
Contributing:
Contributions are welcome! Please feel free to submit a pull request or open an issue.
License:
This project is licensed under the MIT License.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file apache_airflow_provider_magento-0.7.tar.gz.
File metadata
- Download URL: apache_airflow_provider_magento-0.7.tar.gz
- Upload date:
- Size: 17.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e3b53012bebfbe4ad9603e27fc8bf43092d6e92597bdfc3633fd961c0038627c
|
|
| MD5 |
3c21a71a2d95972965f96d7f14a93ba8
|
|
| BLAKE2b-256 |
4320f9795a17c80c679818a46c94ee2374023e2736720da1c578a465a8def499
|
File details
Details for the file apache_airflow_provider_magento-0.7-py3-none-any.whl.
File metadata
- Download URL: apache_airflow_provider_magento-0.7-py3-none-any.whl
- Upload date:
- Size: 24.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dabf2c192d0ee09e876058161ad4f199b5a9f6808b0f3d3c33666345522d3d81
|
|
| MD5 |
9d1fcff4608fa71ad796c59f478349a5
|
|
| BLAKE2b-256 |
9e7d11f5bf6993de8414c5e7236014938562fed5a0b5c0efbb14cf842e4f01ee
|