Skip to main content

common transformers used by the tidal personalization team.

Project description

per-transformers

Repo containing common pyspark transformers for different pipelines

Downloading Dependencies

  • Make sure you have pyenv and pyenv amd pyenv-virtualenv installed on your local environment.
  • Install python 3.8.16 with pyenv pyenv install 3.10.13.
  • Set up a new virtual env pyenv virtualenv 3.10.13 transformers
  • Set local pyenv version pyenv local transformers
  • Activate the virtual pyenv using pyenv activate transformers
  • Upgrade the pip package installer pip install --upgrade pip
  • Install poetry for package management pip install poetry==1.7.1
  • Install dependencies from the lock file poetry install --no-root

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tidal_per_transformers-0.2.7.tar.gz (30.2 kB view hashes)

Uploaded Source

Built Distribution

tidal_per_transformers-0.2.7-py3-none-any.whl (54.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page