Skip to main content

Data File Profiler Utils

A Python module for simple data file profiling.

Usage

Installation

pip install data-file-profiler-utils

Integration

from import data_file_profiler_utils import Manager as ProfileManager

pm = ProfileManager()
pm.profile_file("/tmp/patient002.vcf")

Exported Console Script

Contents of sample data file:

cat -n sample.tsv
1  #CHROM  POS     ID      REF     ALT     QUAL    FILTER  INFO
2  1       12345   rs567   A       G       50      PASS    DP=30;AF=0.2;AN=1000;CSQ=missense_variant|HIGH|GeneA|ENSG00000112345|transcriptA|ENST00000234567|protein_coding|1/10|c.123C>T|p.Arg41Trp|123/1000|ensembl
3  2       56789   rs890   T       C       44      PASS    DP=25;AF=0.1;AN=1200;CSQ=synonymous_variant|MEDIUM|GeneB|ENSG00000123456|transcriptB|ENST00000345678|protein_coding|5/20|c.567A>G|p.Ala189Ala|567/1200|ensembl
4  3       98765   rs123   G       T       60      PASS    DP=40;AF=0.3;AN=800;CSQ=splice_acceptor_variant|HIGH|GeneC|ENSG00000134567|transcriptC|ENST00000456789|protein_coding|2/15|c.987+1G>T|p.?|987/800|ensembl
5  1       34567   rs456   C       A       55      PASS    DP=35;AF=0.15;AN=900;CSQ=frameshift_variant|HIGH|GeneX|ENSG00000145678|transcriptX|ENST00000567890|protein_coding|8/25|c.345_346insT|p.Leu116Phefs*12|345/900|ensembl

Invocation of the exported console script:

profile-data-file --infile /tmp/demo-data-file-profiler-utils/sample.tsv --verbose --outdir /tmp/demo-data-file-profiler-utils/
--logfile was not specified and therefore was set to '/tmp/demo-data-file-profiler-utils/profile_data_file.log'
Wrote profile metadata file '/tmp/demo-data-file-profiler-utils/sample.tsv.profile.txt'
The log file is '/tmp/demo-data-file-profiler-utils/profile_data_file.log'
Execution of '/tmp/data-file-profiler-utils/venv/lib/python3.10/site-packages/data_file_profiler_utils/profile_data_file.py' completed

Contents of the profile report:

cat -n /tmp/demo-data-file-profiler-utils/sample.tsv.profile.txt
1  ## method-profiled: /tmp/data-file-profiler-utils/venv/lib/python3.10/site-packages/data_file_profiler_utils/manager.py
2  ## date-profiled: 2025-02-15-142732
3  ## profiled-by: sundaram
4  file: /tmp/demo-data-file-profiler-utils/sample.tsv
5  md5sum: 786b82b2414d3acf7af34c068e358759
6  date_created: 2025-02-15 14:06:37.202165
7  file_size: 776
8  line_count: 5

History

0.1.0 (2024-02-10)

  • First release on PyPI.

Metadata

Release files for data-file-profiler-utils 0.1.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for data-file-profiler-utils 0.1.7
File Size Uploaded
data_file_profiler_utils-0.1.7.tar.gz 14.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for data-file-profiler-utils 0.1.7
File Interpreter ABI Platform
data_file_profiler_utils-0.1.7-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 24.1 kB

Release files / data_file_profiler_utils-0.1.7.tar.gz

Download URL data_file_profiler_utils-0.1.7.tar.gz
Size 14.6 kB
Tags Source
SHA-256 checksum
How to use checksums
e78ada4c85bb514fa597ea50169d235fa8c156cb7591189de5cfb7fe1112b6ad
BLAKE2b-256 checksum
How to use checksums
78e93b7d5c8202dea3e6856ce838564fdd9dbd7fd8f7d300ad05c7ab41173bc6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.10.12

Release files / data_file_profiler_utils-0.1.7-py2.py3-none-any.whl

Download URL data_file_profiler_utils-0.1.7-py2.py3-none-any.whl
Size 9.5 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
52d9ac6e474f74344926119d26561f1d9d317ce198ed88abb6a6b4bf15af2610
BLAKE2b-256 checksum
How to use checksums
c54d1726ae493b1fce7c6c8d0b440f6512fc50bd583a18fe006f4259a21381c0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.10.12

Release history Release notifications | RSS feed

This release

0.1.7 This release

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page