63 projects
stream-unzip
Python function to stream unzip all the files in a ZIP archive, without loading the entire ZIP file into memory or any of its uncompressed files
dbt-platform-helper
Set of tools to help transfer applications/services from GOV.UK PaaS to DBT PaaS augmenting AWS Copilot.
to-file-like-obj
Utility function to convert an iterable of bytes or str to a readable file-like object.
stream-zip
Python function to construct a ZIP archive with stream processing - without having to store the entire ZIP in memory or disk
directory-api-client
Python client for Directory API.
stream-read-xbrl
Python package to parse Companies House accounts data in a streaming way
pg-bulk-ingest
A collection of Python utility functions for ingesting data into SQLAlchemy-defined PostgreSQL tables, automatically migrating them as needed, and minimising locking
pg-comtrade
Python function to ingest data from UN Comtrade's bulk API to PostgreSQL
django-staff-sso-client
Reusable Django app to facilitate gov.uk Staff Single Sign On
django-log-formatter-asim
Formats Django logs in ASIM format.
great-components
Shared components library for Great services.
pg-sync-roles
Python utility function to ensure that a PostgreSQL role has certain permissions or role memberships
directory-healthcheck
Library to streamline healthchecks for Directory apps.
directory-validators
Django validators for GREAT.
directory-constants
Constant values shared between Directory apps.
dbt-copilot-python
Helper functions to run Django and Flask applications in AWS Copilot/ECS.
directory-forms-api-client
Python API client for Directory forms .
dbt-copilot-tools
Set of tools to help transfer applications/services from GOV.UK PaaS to DBT PaaS augmenting AWS Copilot.
sqlite-s3vfs
Virtual filesystem for SQLite to read from and write to S3
mobius3
Continuously and asynchronously sync a local folder to an S3 bucket
django-audit-log-middleware
Simple audit logging for Django requests
directory-ch-client
Python API client for Export Directory Companies House.
directory-components
Shared components library for Great services.
sigauth
Signature authentication library for Export Directory.
quicksight-bulk-update-datasets
CLI to make bulk updates to Quicksight datasets
directory-cms-client
Python API client for Directory CMS.
directory-client-core
Python common code for Directory API clients.
directory-sso-api-client
Python API client for Export Directory.
django-chunk-upload-handlers
Chunking Django file handlers for S3 and ClamAV service uploads
s3ala
A basic CLI-based aggregator to extract some very basic metrics from ALB logs stored in an S3 bucket
git-lfs-http-mirror
Simple Python server to serve a read only HTTP mirror of git repositories that use Large File Storage (LFS)
django-hawk-drf
Authenticate Django Rest Framework Views with django-hawk
django-hawk
Authenticate Django Views with HAWK
django-thumber
A Django app to solicit user feedback on various views/pages via a simple widget.
mirror-git-to-s3
Python functions and CLI to mirror git repositories available on HTTP(S) to S3
iterable-subprocess
Python context manager to communicate with a subprocess using iterables of bytes rather Python's built-in subprocess module
stream-read-ods
Python function to extract data from an ODS spreadsheet on the fly - without having to store the entire file in memory or disk
stream-write-ods
Python function to construct an ODS spreadsheet on the fly - without having to store the entire file in memory or disk
pg-force-execute
Context manager to run PostgreSQL queries with SQLAlchemy, terminating any other clients that block them
pir-client
API client for PIR
stream-sqlite
Python function to extract all the rows from a SQLite database file concurrently with iterating over its bytes, without needing random access to the file
streampq
PostgreSQL adapter to stream results of multi-statement queries without a server-side cursor
mbtiles-s3-server
Server to on-the-fly extract and serve vector tiles from an mbtiles file on S3
mkdocs-gds
A GOV.UK Design System inspired mkdocs theme for DDAT documentation
streamlit-gov-uk-components
A collection of Streamlit components that use or are inspired by the GOV.UK Design System
django-ga-measurement-protocol
A Django app to provide Google Analytics measurement protocol integration.
jwt-postgresql-proxy
Stateless JWT authentication in front of PostgreSQL
streaming-left-join
Join iterables in code without loading them all in memory: similar to a SQL left join.
s3chunkuploader
A Django/Django-Storages threaded S3 chunk uploader
tidy-json-to-csv
Convert JSON to a set of tidy CSV files
django-log-formatter-ecs
ECS log formatter for Django
fargatespawner
Spawns JupyterHub single user servers in Docker containers running in AWS Fargate
hawk-server
Utility function to perform the server-side of Hawk authentication
hawk-server-asyncio
Utility function to perform the server-side of Hawk authentication for asyncio HTTP servers
jupyters3
Jupyter Notebook Contents Manager for AWS S3
feed-gov-back
A small framework for API enabled customisable feedback forms
dnsrewriteproxy
A DNS proxy server that conditionally rewrites and filters A record requests
aio-throttle-to-next-second
Throttler for asyncio Python that throttles to the next whole second
export-elements
Wrapper around govuk elements.
django-ip-restriction
A Django middleware to restrict incoming IPs to a Django project.
directory-proxy
Proxy
aioftps3
FTP in front of AWS S3, powered by asyncio and aiohttp
directory-api-external
Python API client for Export Directory.