Gluestick

PyPI Version License

A Python library for efficient ETL processes, optimized for hotglue

Installation

pip install gluestick

Links

Dependencies

  • NumPy
  • Pandas

Memory benchmarking (local development)

The repo includes a script that prints peak RSS (resident set size) in MiB for several gluestick workloads. It uses the same scenarios as tests/function_tests/test_memory_usage.py, so you can compare numbers before and after a change on your machine. Peak RSS is a rough signal, not a portable “this library always uses X MB” guarantee.

Setup (from the repository root):

pip install ".[test]"

This installs gluestick, pytest, and memory-profiler, which the script and memory tests need.

Run the benchmark:

python scripts/memory_benchmark.py

For machine-readable output (e.g. to save and diff):

python scripts/memory_benchmark.py --json > before.json
# change code, then:
python scripts/memory_benchmark.py --json > after.json

Compare the JSON objects (or use diff / jq) to see per-scenario peak MiB before and after. Percent change is only meaningful when both runs use the same host and similar load.

Sanity-check with tests:

pytest tests/function_tests/test_memory_usage.py -q

If pytest passes, the same workloads stay within the smoke-test RSS bands used in CI.

Contributing

This project is maintained by the hotglue team. We welcome contributions from the community via issues and pull requests.

If you wish to chat with our team, feel free to join our Slack!

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (3.0.19)

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for hsyyid from gravatar.com hsyyid Avatar for liorbd from gravatar.com liorbd

Credits

Author: hotglue

License

MIT

Provides Extra

test

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gluestick-3.0.18.tar.gz (35.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gluestick-3.0.18-py3-none-any.whl (38.8 kB view details)

Uploaded Python 3

File details

Details for the file gluestick-3.0.18.tar.gz.

File metadata

  • Download URL: gluestick-3.0.18.tar.gz
  • Upload date:
  • Size: 35.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for gluestick-3.0.18.tar.gz
Algorithm Hash digest
SHA256 836edab296f236705230a9332504fdf03869995166420a044d50ef83967320f0
MD5 9deaba1a218dde1f6a334a2be3ab8d78
BLAKE2b-256 93d83666a8220c48e3985e582a37d65dcfdff5d90e26bcf17f158385fe112337

See more details on using hashes here.

File details

Details for the file gluestick-3.0.18-py3-none-any.whl.

File metadata

  • Download URL: gluestick-3.0.18-py3-none-any.whl
  • Upload date:
  • Size: 38.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for gluestick-3.0.18-py3-none-any.whl
Algorithm Hash digest
SHA256 a399baeff0f2ba3cefc80d4f754043cb3d572d4d63851c2f068a1d74f4e8de74
MD5 1cc59c9ecc24e2d83e54809da6122765
BLAKE2b-256 baf7fbf6980b437add85bbb244a31b88bfd816b7b58391f8d78cc5680cd29124

See more details on using hashes here.

Release history Release notifications | RSS feed

3.0.19

This release

3.0.18

3.0.16

3.0.15

3.0.14

3.0.13

3.0.12

3.0.10

3.0.9

3.0.8

3.0.7

3.0.6

3.0.5

3.0.4

3.0.3

3.0.2

3.0.1

3.0.0

2.2.24

2.2.23

2.2.22

2.2.21

2.2.20

2.2.19

2.2.18

2.2.17

2.2.16

2.2.15

2.2.14

2.2.13

2.2.12

2.2.11

2.2.10

2.2.9

2.2.8

2.2.7

2.2.6

2.2.5

2.2.4

2.2.3

2.2.2

2.2.1

2.2.0

2.1.34

2.1.33

2.1.32

2.1.31

2.1.30

2.1.29

2.1.28

2.1.27 yanked

Reason this release was yanked:

Bug in to_singer

2.1.26

2.1.25

2.1.24

2.1.23

2.1.22

2.1.21

2.1.20

2.1.19

2.1.18

2.1.17

2.1.16

2.1.15

2.1.14

2.1.13

2.1.12

2.1.11

2.1.10

2.1.9

2.1.8

2.1.7

2.1.6

2.1.5

2.1.4

2.1.3

2.1.2

2.1.1

2.1.0

2.0.6

2.0.5

2.0.4

2.0.3

1.0.11

1.0.10

1.0.9

1.0.8

1.0.6

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page