Skip to main content

Exports US Census ZCTA (Zip Code Tabulation Area) shapefiles to a SQLite database via CLI or Python API.

Project description

shapefile2db logo


ShapeFile2DB V 0.1.0

Exports US Census ZCTA (Zip Code Tabulation Area) shapefiles to a SQLite database via CLI or Python API.


Python License GitHub Stars GitHub Forks


Overview

ZipShapeFile2DB is a Python package for extracting, filtering, and exporting ZIP Code Tabulation Area (ZCTA) shapefiles into structured formats for geospatial analysis in a SQLite3 database file.

Designed for developers and data analysts, it offers a clean command-line interface and a modular API that integrates seamlessly into Python workflows.

Whether you're automating shapefile exports, building spatial dashboards, or prepping data for SQL-based queries, ZipShapeFile2DB provides a transparent, scriptable pipeline with real-time logging, schema validation, and flexible output options.


Shapefile Requirements

This module is designed to work with shapefiles derived from the 2020 ZCTA dataset provided by the US Census Bureau.

To download the official shapefiles, visit: https://www.census.gov/geographies/mapping-files/time-series/geo/tiger-line-files.2020.html

This download will provid a zipped file containing all of the shapefile components (several files)

Required Shapefile Components:

.shp (Shape Format):
    Contains the primary geometry data for each feature (points, lines, polygons).

.shx (Shape Index Format):
    Provides an index for efficient access to geometry records in the .shp file.

.dbf (dBASE Table Format):
    Stores attribute data linked to each geometry, such as ZIP code and classification.

Note: All three files (.shp, .shx, .dbf) are required for full shapefile functionality. The .shx file significantly improves performance when accessing large geometries.


Features

  • CLI & API support for ZCTA shapefile export
  • Modular architecture for easy extension and testing
  • Google-style docstrings for clarity and discoverability
  • Built-in validation for input paths and schema integrity
  • Geospatial stack ready: works with geopandas, shapely, and SQLAlchemy

Installation

pip install shapefile2db

Or for local development:

git clone https://github.com/rlapine/shapefile2db.git
cd shapefile2db
pip install -e .

Dependencies

  • Python 3.8+
  • geopandas==1.1.1",
  • pandas==2.3.2",
  • printpop==0.2.2",
  • pyogrio==0.11.0",
  • setuptools==80.9.0",
  • Shapely==2.1.1",
  • SQLAlchemy==2.0.43"

API Example

from shapefile2db import export_shapefile_to_db

export_shapefile_to_db(state="NY",
                      shape_file_name="tl_2020_us_zcta520.shp", 
                      database_name="ny_address.db")

Example Output

Shape File: tl_2020_us_zcta520.shp
Read Start: 12:51:49:25
Read Timer: 03.20
Read End: 12:51:52:45
Total Rows: 33791

Filter 'NY' Start: 12:51:52:47
Filter End: 12:51:52:48
Total 'NY' Rows: 1826

Warning: Database file not found at: 'C:\Users\ryan\Visual Code Projects\shapefile\ny_address.db'
Warning: Database file created at: 'C:\Users\ryan\Visual Code Projects\shapefile\ny_address.db'

Database File: ny_address.db
Rows to Export: 1826
Export Start: 12:51:52:48
Rows Exported: 596 Time Remaining: 00:00:46.

๐Ÿ–ฅ๏ธ CLI Demo

CLI Export Demo


Project Structure

shapefile2db/
โ”œโ”€โ”€ shapefile2db/
โ”‚   โ”œโ”€โ”€ cli.py                      # CLI entry point
โ”‚   โ”œโ”€โ”€ core.py                     # Main export logic
โ”‚   โ”œโ”€โ”€ shape_file_exporter.py      # Exporter class
โ”‚   โ”œโ”€โ”€ state_shape_file_exporter.py# Individual state exporter
โ”‚   โ””โ”€โ”€ address_db/                 # Subpackage for database logic
โ”‚       โ”œโ”€โ”€ __init__.py             # Address DB API exposure
โ”‚       โ”œโ”€โ”€ address_constants.py    # state constants
โ”‚       โ”œโ”€โ”€ address_database.py     # DB connection and export logic
โ”‚       โ””โ”€โ”€ address_models.py       # ORM models
โ”œโ”€โ”€ cli.py                          # CLI entry point
โ”œโ”€โ”€ core.py                         # Main export wrapper
โ”œโ”€โ”€ __init__.py                     # API exposure
โ”œโ”€โ”€ LICENSE                         # Project license
โ”œโ”€โ”€ pyproject.toml                  # Build system and CLI entry points
โ”œโ”€โ”€ requirements.txt                # Runtime dependencies
โ””โ”€โ”€ README.md                       # Project overview and usage

Contributing

Pull requests welcome! If you spot formatting quirks, want to add new named colors or extend features (like terminal detection or theme presets), feel free to collaborate.

To contribute:

Fork the repo

Add your changes with Google-style comments

Submit a pull request with a clear description

For style consistency, follow the Python Google Style Guide for functions and comments.


License

This project is licensed under the MIT License.


Author

Created by Ryan LaPine @rlapine โ€” a technically skilled developer focused on clarity, maintainability, and audience-ready documentation. This class is part of a broader effort to build reusable, well-documented tools for data-driven projects.


Contact

Feel free to reach out with questions or collaboration ideas:

๐Ÿ“ง github.stunt845@passinbox.com
๐Ÿ”— GitHub: @rlapine

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

shapefile2db-0.1.0.tar.gz (2.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

shapefile2db-0.1.0-py3-none-any.whl (2.3 MB view details)

Uploaded Python 3

File details

Details for the file shapefile2db-0.1.0.tar.gz.

File metadata

  • Download URL: shapefile2db-0.1.0.tar.gz
  • Upload date:
  • Size: 2.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.4

File hashes

Hashes for shapefile2db-0.1.0.tar.gz
Algorithm Hash digest
SHA256 0ed2d8840aaf5e2d8e4d07d15363afcfbcb8e2592cac13571cbfb9f8008d1545
MD5 b5080bb04c593461c5a54be3e46d535c
BLAKE2b-256 47a1268e4f085e06491d3024e3ca20cd47376430883418882347ef8d762f9272

See more details on using hashes here.

File details

Details for the file shapefile2db-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: shapefile2db-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 2.3 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.4

File hashes

Hashes for shapefile2db-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cea10de6225a9f57ac0b9d16c264b8cab60824394e21be515fa34833249d65ec
MD5 95d617000fb06ce25328013424d4d086
BLAKE2b-256 4d7f7def8801f9456ecc036325bf595a849f60a3dd29b56b304b21390703c21e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page