Skip to main content

Create and store data pipeline telemetry data

  • Free software: GNU Lesser General Public License v3 or later (LGPLv3+)

Installation

pip install pipeline-telemetry

You can also install the in-development version with:

pip install https://github.com/MaartendeRuyter/pipeline-telemetry/archive/master.zip

Documentation

https://pipeline-telemetry.readthedocs.io/

Development

To run all the tests run:

tox

Note, to combine the coverage data from all the tox environments run:

Windows

set PYTEST_ADDOPTS=--cov-append
tox

Other

PYTEST_ADDOPTS=--cov-append tox

Changelog

0.0.1 (2021-10-06)

  • First release on PyPI.

0.0.4 (2021-10-31)

  • Seperated the storage module

  • Added MongoDb storage class

  • Started with documentation

0.1.0 (2021-11-05)

  • added Telemetry method add_telemetry_counter

  • Added TelemetryCounter class that can be used to make prefedined objects that can be added to the Telemetry instance with the add_telemetry_counter method. This will improve readibilty of your code:

    from pipeline_telemetry import TelemetryCounter
    
    YOUR_PREDFINED_COUNTER = (
        process_type=ProcessTypes.CREATE_DATA_FROM_API,
        sub_process='RETRIEVE_RAW_DATA',
        counter_name='my_custom_counter',
    )
    
    telemetry.add_telemetry_counter(YOUR_PREDFINED_COUNTER)

0.2.0 (2021-11-09)

  • added error field to TelemetryCounter so that default Errorcodes can be used in a TelemetryCounter instance to keep an error counter in the telemetry

  • Updated add_telemetry_counter so that it can handle TelemetryCounter instances with either an Errorcode of a custom counter. In case of ErrorCode the actual error_code will serve as the customer counter.

0.2.1 (2021-11-09)

  • added is_telemetry_counter method in helper module

  • moved add_telemetry decorator to helper module

  • both methods can be directly imported from pipeline_telemetry module

0.2.2 (2021-11-10)

  • added add_mongo_telemetry decorator that uses mongo storage class

0.2.3 (2021-11-10)

  • Added attribute process_types to TelemetryCounter dataclass next to existing process_type attribute. This allows you to choose between a list of process_types or just a single process_type to be in scope of the TelemetryCounter` instance

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pipeline-telemetry-0.2.3.tar.gz (51.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pipeline_telemetry-0.2.3-py2.py3-none-any.whl (36.0 kB view details)

Uploaded Python 2Python 3

File details

Details for the file pipeline-telemetry-0.2.3.tar.gz.

File metadata

  • Download URL: pipeline-telemetry-0.2.3.tar.gz
  • Upload date:
  • Size: 51.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.2

File hashes

Hashes for pipeline-telemetry-0.2.3.tar.gz
Algorithm Hash digest
SHA256 db2235d070a4037c937a4f6b2cf4d2aba4c9efddb8557a5c5799db35e6dce9b6
MD5 860cae51d0e4329ccd306f2c8ef4a8ea
BLAKE2b-256 e03b77956bdbce120f018129301a80374858753d61a80a2f586f57ebc44168b3

See more details on using hashes here.

File details

Details for the file pipeline_telemetry-0.2.3-py2.py3-none-any.whl.

File metadata

  • Download URL: pipeline_telemetry-0.2.3-py2.py3-none-any.whl
  • Upload date:
  • Size: 36.0 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.2

File hashes

Hashes for pipeline_telemetry-0.2.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 cb9a1c6b33d36ffff2eb9066c02d3b05034e7a738940b52222932ca751005f40
MD5 8c1b0b7fc65feff89db1fe0cc54abca6
BLAKE2b-256 83c3ae7531d46503af278d7cd0de37cf000d165e1144834367da72906be6b492

See more details on using hashes here.

Release history Release notifications | RSS feed

1.1.0

2 files

1.0.2

2 files

1.0.1

2 files

1.0.0

2 files

0.9.4

2 files

0.9.3

2 files

0.9.2

2 files

0.9.1

2 files

0.9.0

2 files

0.4.5

2 files

0.4.4

2 files

0.4.3

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

0.3.1

2 files

0.3.0

2 files

0.2.21

2 files

0.2.20

2 files

0.2.19

2 files

0.2.18

2 files

0.2.17

1 file

0.2.16

2 files

0.2.15

2 files

0.2.14

2 files

0.2.13

2 files

0.2.12

2 files

0.2.11

2 files

0.2.10

2 files

0.2.9

2 files

0.2.8

2 files

0.2.7

2 files

0.2.6

2 files

0.2.5

2 files

0.2.4

2 files

This release

0.2.3 This release

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.0

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page