Skip to main content

Cogniflow basic sink StepPackage with C++ data hive parquet sink.

Project description

cf-basic-sinks

cf-basic-sinks provides native sink steps for pipeline outputs.

Steps

Step Category Description
cfsink:DataHiveParquetSinkStep sink Write canonical data hive parquet output through the cf_datahive_cpp gatekeeper

Published distribution name:

pip install cf-basic-sinks

Native build prerequisites

cf_basic_sinks is built with scikit-build-core and CMake and requires:

  • CPython 3.13
  • CMake on PATH
  • a Windows C++ toolchain compatible with that CMake installation
  • access to cf-pipeline-sdk from the package index
  • access to cf-datahive from the package index for the owner-provided native cf_datahive_cpp source surface

This package does not publish cf_datahive_cpp separately. The step package consumes the owner-provided native source surface exposed by the installed cf_datahive package, and backend-specific native policy stays owned by cf_datahive.

Publishing

cf_basic_sinks is published with the dedicated Windows workflow:

  • Workflow: .github/workflows/cf_basic_sinks_windows_publish.yml
  • Package directory: sandcastle/cf_basic_steps/cf_basic_sinks
  • PyPI tag: cf-basic-sinks-v<version>
  • TestPyPI tag: cf-basic-sinks-v<version>-test

Workflow note:

  • test/build jobs provision native deps via scripts/setup_native_deps_v2.ps1
  • test/build jobs preinstall published cf-pipeline-sdk and cf-datahive into the job interpreter before invoking the shared publish helper, so the CMake Python subprocesses can discover the owner-provided SDK and data-hive surfaces
  • backend-specific native configuration and runtime staging are documented and owned in sandcastle/cf_datahive/README.md

Local preflight:

powershell -ExecutionPolicy Bypass -File scripts/mimic_windows_python_publish_workflow.ps1 `
  -WorkflowFile .github/workflows/cf_basic_sinks_windows_publish.yml `
  -PackageDir sandcastle/cf_basic_steps/cf_basic_sinks `
  -PythonExe py `
  -PythonVersion 3.13

Queue a dry-run dispatch:

powershell -ExecutionPolicy Bypass -File scripts/queue_windows_python_publish_workflow.ps1 `
  -WorkflowFile .github/workflows/cf_basic_sinks_windows_publish.yml `
  -PackageDir sandcastle/cf_basic_steps/cf_basic_sinks `
  -PublishTarget testpypi `
  -Ref main `
  -RequireLocalPass `
  -DryRun

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cf_basic_sinks-0.1.5.tar.gz (7.0 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cf_basic_sinks-0.1.5-cp313-cp313-win_amd64.whl (7.0 MB view details)

Uploaded CPython 3.13Windows x86-64

File details

Details for the file cf_basic_sinks-0.1.5.tar.gz.

File metadata

  • Download URL: cf_basic_sinks-0.1.5.tar.gz
  • Upload date:
  • Size: 7.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for cf_basic_sinks-0.1.5.tar.gz
Algorithm Hash digest
SHA256 6c20b940f9bc8806a2b1dee9b63ccdff22ecf7b2db5e6cd305f2f29f614f9629
MD5 0fa1db1f66d2f41efd7d492bbaacdf42
BLAKE2b-256 41e201cd63d19b1908b8492d9ef2295f6493d32426e24b338c74b97e29afece7

See more details on using hashes here.

File details

Details for the file cf_basic_sinks-0.1.5-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for cf_basic_sinks-0.1.5-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 f6c6093447a552095d5cf25be09317512d8287b88238a04b65d6a5842f5363fa
MD5 a1c358d33ea2cfa448531b7c7d14c8a6
BLAKE2b-256 ae0b6986b9b35f0f16e8ee7af4313cffb1f25f0d06b1c394a5c280e4a1bdbfa9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page