16 projects
iterabledata
Streaming read/write and conversion for 100+ data formats. pip install iterabledata; import iterable.
filerepack
Repacks existing (un)compressed files for higher compression
undatum
A powerful command-line tool for data processing and analysis
metawarc
Bounded, versioned indexing, extraction, and analysis for WARC collections
internacia-builder
Build, validation, and enrichment tooling for internacia-db
wparc
WordPress API Crawler and Backup Tool
russiannames
Russian names parser, gender identification and processing tools
apibackuper
a command-line tool and python library for API backuping
docx2csv
Extracts tables from .docx files and saves them as csv or xlsx
newsworker
Advanced news feeds extractor and finder library. Helps to automatically extract news from websites without RSS/ATOM feeds
qddate
Quick and dirty date parsing Python library to parse HTML dates really fast
internacia
Python SDK for accessing internacia-db data with support for countries, international blocks, and fuzzy search
ydiskarc
Command-line tool to backup public resources from Yandex.Disk
metacrafter
Metacrafter metadata classification tool
spcrawler
spcrawler: A command-line tool to backup Sharepoint public installations data from open API endpoint
lazyscraper
Lazy simple command line tool, a swiss knife for scraper writers. Automates scraping so much as possible
