Skip to main content

A tool to help SBOs validate BEAD Challenge Process data files before submission to NTIA.

Project description

idi-data-validation

Data Validation for IDI project

Welcome to Data Validation for the IDI Project. The purpose of this repo is to validate NTIA BEAD challenge process data.

Note This repo uses pre-commit hook, please install by typing pre-commit install.

More information can be found:

  1. Video Link
  2. Detailed Description
  3. Challenge Submission Templates
  4. Link to challenge notice This contains links to docs with detailed descriptions.

There are two components of this repo:

  1. A set of scripts and utilities for generating CSVs for the illinois BEAD project.
  2. A set of scripts and utilities for validating CSV files.

IL Specific

The file run_me.sh will execute the illinois specific pipeline. This requires access to the illinois BEAD database.

  • Notebook Contains work in progress notebooks
  • data Data related to Illinois data generation project
  • scripts Scripts relating to IL

Data Validation

  • validation Package for data validation.

Overview of Data Validation Package.

The purpose of this package is to execute and avoid common errors when submitting the NTIA CSV files.

Usage

To run the validations after placing data in the /output_csv/ dir (IL-specific: run run_me.sh),

mkdir logs
python validation/utils/validator.py output_csv --results_dir logs/
Installing route

I'll push this up to PyPI shortly, but for this commit, you can create an env and install this package via these commands.

cd path/into/idi_data_validation_directory
python -m venv .venv
source .venv/bin/activate
python -m pip install -e .
bread_inspektor output_csv/

Current Status

File name Initial Code Tests Tested on IL
cai.csv X
challengers.csv X
challenges.csv X
cai_challenges.csv
post_challenge_locations.csv X
post_challenge_cai.csv X

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bread_inspektor-0.1.dev71.tar.gz (20.9 kB view details)

Uploaded Source

Built Distribution

bread_inspektor-0.1.dev71-py3-none-any.whl (18.9 kB view details)

Uploaded Python 3

File details

Details for the file bread_inspektor-0.1.dev71.tar.gz.

File metadata

  • Download URL: bread_inspektor-0.1.dev71.tar.gz
  • Upload date:
  • Size: 20.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.8

File hashes

Hashes for bread_inspektor-0.1.dev71.tar.gz
Algorithm Hash digest
SHA256 4da2b51133e6bb41c52554057b986ee3cfdbfe9fd13e1434d72a5792be91842e
MD5 306495d7bb60b320e980c2ba3777bd67
BLAKE2b-256 6106414cbc4b3a50e8ca8ff405aafd0eef8d38390b193f8e95d42c3528d09f8b

See more details on using hashes here.

File details

Details for the file bread_inspektor-0.1.dev71-py3-none-any.whl.

File metadata

File hashes

Hashes for bread_inspektor-0.1.dev71-py3-none-any.whl
Algorithm Hash digest
SHA256 b513cc0d50f993343f7fb3d2e1f61b912695a62576e4b3bce2bf6bac42f2d845
MD5 23980b07f7c30217a9a1898c55ecd4c5
BLAKE2b-256 4f9fe271e6ca81ed3b97b46fd23825b67174ca68a2d718d4946cb301edb595f4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page