18 projects
filerepack
Repacks existing (un)compressed files for higher compression
internacia
Python SDK for accessing internacia-db data with support for countries, international blocks, and fuzzy search
newsworker
Advanced news feeds extractor and finder library. Helps to automatically extract news from websites without RSS/ATOM feeds
apibackuper
a command-line tool and python library for API backuping
qddate
Quick and dirty date parsing Python library to parse HTML dates really fast
undatum
A powerful command-line tool for data processing and analysis
datacrafter-etl
datacrafter-etl: a command-line ETL tool with NoSQL in mind (import datacrafter)
filegetter
Command-line tool and Python library for automated bulk file collection from public data sources
metawarc
Bounded, versioned indexing, extraction, and analysis for WARC collections
iterabledata
Streaming read/write and conversion for 100+ data formats. pip install iterabledata; import iterable.
internacia-builder
Build, validation, and enrichment tooling for internacia-db
wparc
WordPress API Crawler and Backup Tool
russiannames
Russian names parser, gender identification and processing tools
docx2csv
Extracts tables from .docx files and saves them as csv or xlsx
ydiskarc
Command-line tool to backup public resources from Yandex.Disk
metacrafter
Metacrafter metadata classification tool
spcrawler
spcrawler: A command-line tool to backup Sharepoint public installations data from open API endpoint
lazyscraper
Lazy simple command line tool, a swiss knife for scraper writers. Automates scraping so much as possible
