Jira_sro_etl
General Information
- Software:jira_sro_etl
- Author:Leonardo Khoury Picoli, Lucas Moraes Soares de Souza, Paulo Sérgio dos Santos Júnior
- Author's e-mail:leonardokhoury@hotmail.com, lucasmoraesplay@gmail.com, paulossjunior@gmail.com
- Source Repository: https://gitlab.com/integration_seon/libs/etl/jira_sro_etl
Goal
Library responsible for extracting data from Jira to SRO database
Documentation
The Documentation can be found in this link
Requirements
The code need the following programs to run, versions were listed just for guidance, you can try with different ones by your own risk, we tested with these.
| Program | Version |
|---|---|
| Postgres | 13.3 |
| MongoDB Community | 4.4.5 |
| Python | 3.8.5 |
| Pip | 21.1.1 |
Installation
If you have already made the initial fill, just install jira_sro_etl running:
pip install jira_sro_etl
If you wanna do the initial fill, clone this repo and follow the steps listed on USAGE section
Usage
Since it uses SRO_DB lib you must export the following environment variables:
- USERDB = Postgres's username
- PASSWORDDB = Postgres's password
- HOST = Postgres's host (usually localhost)
- DBNAME = Your database's name (must be already created) on Postgres
And if your mongo db is not on your localhost you can export:
- MongoDB = Mongo host address
Create a virtual environment and activate it
python3 -m venv env && source env/bin/activate
Install the requirements
pip install -r requirements.txt
Fill the fields on dump_db/create_org.py and run
python dump_db/create_db.py && python dump_db/create_org.py
Grab the data that was printed on terminal after last command and paste it on initial_fill.py (before the manager = Manager(data)), then run
python initial_fill.py
After the initial fill you can run new creations, updates or deletes on any classes. If you've installed jira_sro_etl with pip you can run the following code for example:
from jira_sro_etl import factories
u = factories.userFactory()
u.create({'content': {'all': {'user': {'accountId': 'ACCOUNT_ID_FROM_JIRA'}}}})
CI/CD configuration
Configure the following variables in CI/CD:
- VAR_SONAR_CLOUD_TOKEN = Token from SonarCloud
- VAR_GITLAB_USER_NAME = username of Gitlab
- VAR_GITLAB_USER_EMAIL = user's email of Gitlab
- VAR_PYPI_USER_NAME = pypi's username
- VAR_PYPI_PASSWORD = pypi's password
Copyright
This lib was PowerRight by SEON Application Lib Generator
1 maintainer
Metadata
1 maintainer
Release files for jira-sro-etl 26.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| jira_sro_etl-26.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Release files / jira_sro_etl-26.0.0-py3-none-any.whl
| Download URL | jira_sro_etl-26.0.0-py3-none-any.whl |
|---|---|
| Size | 52.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3f6b780c5a1e0394b7dffc595b044024929ca916bf060b8ce494ebdb29c5687d
|
|
BLAKE2b-256 checksum How to use checksums |
013258bdd3eac669fea2c2a9a852c446239c37e479275db2c9e24bd15f24b449
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.6.3 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6
|
