A collection of Prefect Tasks for different varieties of profiling
Project description
prefect-memory-profiling
Welcome!
A collection of Prefect Tasks for memory profiling in Prefect 1.0.
Getting Started
Python setup
Requires an installation of Python 3.7+.
We recommend using a Python virtual environment manager such as pipenv
, conda
or virtualenv
.
For more information about how to use Prefect, please refer to the Prefect documentation.
Installation
Install prefect-memory-profiling
with pip
:
pip install prefect-memory-profiling
Write and run a flow
from prefect import Flow
from prefect_memory_profiling.tasks import profiled_task
@profiled_task(name='My Profiled Task', stream=open('logfile.txt', 'a+'))
def resource_intensive_task(n: int = 100):
a = [n**n for n in range(2*n)]
b = [n**n for n in range(4*n)]
c = [n**n for n in range(n**2)]
return sum(a + b + c)
with Flow('Memory Profiled Flow') as flow:
resource_intensive_task()
if __name__ == "__main__":
flow.run(run_on_schedule=False)
Resources
If you encounter any bugs while using prefect-memory-profiling
, feel free to open an issue in the prefect-memory-profiling repository.
If you have any questions or issues while using prefect-memory-profiling
, you can find help in either the Prefect Discourse forum or the Prefect Slack community.
Development
If you'd like to install a version of prefect-memory-profiling
for development, clone the repository and perform an editable install with pip
:
git clone https://github.com/zzstoatzz/prefect-memory-profiling.git
cd prefect-memory-profiling/
pip install -e ".[dev]"
# Install linting pre-commit hooks
pre-commit install
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for prefect-memory-profiling-1.0.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3887a67668214d1986db953ee3b08963e0f9a9a5502a81969839082a1e22e3a3 |
|
MD5 | 817478aea96eb5ef3262f2d60eee6dac |
|
BLAKE2b-256 | 0dfb55ff82b25e3876ffea4bdba17e7c5b3798694042b53456cf4985dcb810a7 |
Hashes for prefect_memory_profiling-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5e50dd7e022fd17a37159eae163489efc24c118c14e264e54229caecc82530e2 |
|
MD5 | 0e84b54945cde29c84305bd55a5a783e |
|
BLAKE2b-256 | c13e1fba0e629e875f71d5df92273b5a6a25bbf44def51ec522ee98b4fc4b1a1 |