great-expectations-cloud 0.0.4

Great Expectations Cloud

cloud

Dev Setup

1. Install poetry
   • pipx install poetry
2. Setup virtual environment and install dependencies.
   • poetry install --sync
3. Activate your virtual environment.
   • poetry shell
4. Setup precommit hooks
   • pre-commit install

Developer Tasks

Common developer tasks are available via invoke (defined in tasks.py)

invoke --list to see available tasks.

Synchronize Dependencies

To ensure you are using the latest version of the core and development dependencies run poetry install --sync. Also available as an invoke task.

invoke deps

Release to Pypi

To release a new version to pypi the version must be incremented. New versions are automatically published to pypi when merging to main.

invoke version-bump

Building and Running the GX Agent Image

In order to to build the GX Agent docker image run the following in the root dir:

invoke build

Running the agent:

docker run --env GX_CLOUD_ACCESS_TOKEN="<GX_TOKEN>" --env GX_CLOUD_ORGANIZATION_ID="<GX_ORG_ID>" gx/agent

Now go into GX Cloud and issue commands for the agent to run such as generating an Expectation Suite for a DataSource.

Note if you are pushing out a new image update the image tag version in containerize-agent.yaml. The image will be built and pushed out via GitHub Actions.