Skip to main content

mb-cruise-migration

Migration scripts for migrating multibeam metadata from MB schema to CRUISE schema.

Usage: Migration Instructions

  1. Create a python file and import the ci-cmg-mb-cruise-migration package.
  2. Create an instance of the "Migrator" class, passing in the path to your config file as the only parameter.
  3. Run the "migrate" method.
  • An example run and start_background shell script is provided, which should be used to run the python script in the background.
  • The package and it's dependencies will need to be installed prior to usage. This can be done with python -m pip install ci-cmg-mb-cruise-migration.

NOTE: if enabling pooled connections for cruise db in config, oracle client libraries need to also be installed: https://python-oracledb.readthedocs.io/en/latest/user_guide/installation.html#optionally-install-oracle-client

Developing Project

Setup virtual environment

  1. setup virtualenv
  2. specify python installation for virtualenv to use
  3. activate the virtual environment
  4. verify python version and virtualenv
  5. install required modules
  6. verify they were installed with pip list
  7. deactivate the virtual environment
virtualenv migenv

virtualenv --python=</path/to/python> </path/to/new/virtualenv/>

source ./migenv/bin/activate

which python
python -V

python -m pip install --upgrade poetry
poetry install

pip list

deactivate

run tests

Many (most) tests are integration tests and require either one or both the MB or CRUISE schema docker containers be running.

To start docker containers:

from test dir:

./start-it.sh

To run tests (outside env):

from project root:

# runs all tests
./run_tests 

# runs a test file
./run_tests <test filename>

To run tests (inside env):

cd tests
./start-it.sh
pytest

To stop docker containers:

from test dir:

./stop-it.sh

build project

  1. Update version in pyproject.toml either before or after release.
  2. If not already installed: python -m pip install --upgrade build
  3. Build distribution: python -m build
  4. If not already installed: python -m pip install --upgrade twine
  5. Upload to pypi: twine upload dist/*

Metadata

Release files for ci-cmg-mb-cruise-migration 1.28.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ci-cmg-mb-cruise-migration 1.28.6
File Size Uploaded
ci_cmg_mb_cruise_migration-1.28.6.tar.gz 714.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for ci-cmg-mb-cruise-migration 1.28.6
File Interpreter ABI Platform
ci_cmg_mb_cruise_migration-1.28.6-py3-none-any.whl Python 3 none any Details

Total release size: 802.5 kB

Release files / ci_cmg_mb_cruise_migration-1.28.6.tar.gz

Download URL ci_cmg_mb_cruise_migration-1.28.6.tar.gz
Size 714.4 kB
Tags Source
SHA-256 checksum
How to use checksums
2b8e7dde35313ed567bd413a27631df53ce16dd8297abc0d08aa46fe884801f6
BLAKE2b-256 checksum
How to use checksums
c635790d295dcb5f6bc1d1c4bd36f12691df93f587a75ca8be19bef007e3580c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.5

Release files / ci_cmg_mb_cruise_migration-1.28.6-py3-none-any.whl

Download URL ci_cmg_mb_cruise_migration-1.28.6-py3-none-any.whl
Size 88.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fab9556baa8da9f616893ba6d4fe1a5d5fc2a119244c4541802c9cdb0cc5ba24
BLAKE2b-256 checksum
How to use checksums
f3255297e1c15257b625d19243d57b0eb60c82ab8e1261f7b283a7d895909a6c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.5

Release history Release notifications | RSS feed

This release

1.28.6 This release

2 release files

1.28.5

2 release files

1.28.4

2 release files

1.28.3

2 release files

1.28.2

2 release files

1.28.1

2 release files

1.28

2 release files

1.27

2 release files

1.26

2 release files

1.25

2 release files

1.24

2 release files

1.23

2 release files

1.22

2 release files

1.21

2 release files

1.20

2 release files

1.19

2 release files

1.18

2 release files

1.17

2 release files

1.16

2 release files

1.15

2 release files

1.14

2 release files

1.13

2 release files

1.12

2 release files

1.11

2 release files

1.10

2 release files

1.9

2 release files

1.8

2 release files

1.7

2 release files

1.6

2 release files

1.5

2 release files

1.4

2 release files

1.3

2 release files

1.2

2 release files

1.1

2 release files

1.0

2 release files

0.27

2 release files

0.26

2 release files

0.25

2 release files

0.24

2 release files

0.23

2 release files

0.22

2 release files

0.21

2 release files

0.20

2 release files

0.19

2 release files

0.18

2 release files

0.17

2 release files

0.16

2 release files

0.15

2 release files

0.14

2 release files

0.13

2 release files

0.12

2 release files

0.11

2 release files

0.10

2 release files

0.9

2 release files

0.8

2 release files

0.7

2 release files

0.6

2 release files

0.5

2 release files

0.4

2 release files

0.3

2 release files

0.2

2 release files

0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page