Skip to main content

Cogniflow basic sink StepPackage with declarative Data Hive sink steps.

Project description

cf-basic-sinks

cf-basic-sinks provides declarative sink steps for pipeline outputs.

Steps

Step Category Description
cfsink:DataHiveParquetSinkStep sink Declare a canonical Data Hive write that the pipeline runner executes through cf_datahive_cpp

Published distribution name:

pip install cf-basic-sinks

Package role

cf_basic_sinks ships the step manifest only.

  • no native plugin is built or published from this package
  • no backend runtime policy is owned here
  • the pipeline runner owns execution of cfsink:DataHiveParquetSinkStep
  • backend-specific write behavior remains owned by cf_datahive

Publishing

cf_basic_sinks is published with the dedicated Windows workflow:

  • Workflow: .github/workflows/cf_basic_sinks_windows_publish.yml
  • Package directory: sandcastle/cf_basic_steps/cf_basic_sinks
  • PyPI tag: cf-basic-sinks-v<version>
  • TestPyPI tag: cf-basic-sinks-v<version>-test

Workflow note:

  • test/build jobs publish a pure Python step-manifest package
  • backend-specific native configuration and runtime staging are owned in sandcastle/cf_datahive/README.md and consumed by cf_pipeline_engine

Local preflight:

powershell -ExecutionPolicy Bypass -File scripts/mimic_windows_python_publish_workflow.ps1 `
  -WorkflowFile .github/workflows/cf_basic_sinks_windows_publish.yml `
  -PackageDir sandcastle/cf_basic_steps/cf_basic_sinks `
  -PythonExe py `
  -PythonVersion 3.13

Queue a dry-run dispatch:

powershell -ExecutionPolicy Bypass -File scripts/queue_windows_python_publish_workflow.ps1 `
  -WorkflowFile .github/workflows/cf_basic_sinks_windows_publish.yml `
  -PackageDir sandcastle/cf_basic_steps/cf_basic_sinks `
  -PublishTarget testpypi `
  -Ref main `
  -RequireLocalPass `
  -DryRun

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cf_basic_sinks-0.2.0.tar.gz (5.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cf_basic_sinks-0.2.0-py3-none-any.whl (3.9 kB view details)

Uploaded Python 3

File details

Details for the file cf_basic_sinks-0.2.0.tar.gz.

File metadata

  • Download URL: cf_basic_sinks-0.2.0.tar.gz
  • Upload date:
  • Size: 5.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for cf_basic_sinks-0.2.0.tar.gz
Algorithm Hash digest
SHA256 cd161c7e6d14dcdea24f31bc41bff26325884ef61f3c2c213b878a6f6f80b6b7
MD5 ca4d2f850bf57504aba63657a1df58af
BLAKE2b-256 44da3529e89a6b153abd3253b1249bc8dfa1a82bdc55ece99cf288580f6f8cfa

See more details on using hashes here.

File details

Details for the file cf_basic_sinks-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: cf_basic_sinks-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 3.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for cf_basic_sinks-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9731b7ce164c3be9b5a7861208a31a191b1ae5ff80a872c1b899c71305cd79b5
MD5 845eab6a206c6d1a597dd31112c1805b
BLAKE2b-256 8b13acb039614325236e100e7ed62afdbb2813764ef43b1e97b97154086ac240

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page