Skip to main content

Scrapers for Texas elections results

Project description

https://travis-ci.org/texastribune/tx_election_scrapers.svg

Hi. This is just me fooling around trying to come up a better way to scrape election results. The tricky logic has been refined in other Texas Tribune projects, but they were deeply tied to other logic.

The idea is to split the process up into multiple logical steps that other people might find useful:

  1. Ingest results: Typically either with curl or cat or anything that pipes output to stdout.

  2. Serialize the output html as JSON: Does not attempt to extract information. Just separates data from the html. This is the hard part that scrapers have trouble with.

  3. Interpret the serialized output: Turns the raw serialized data into something you might expect to see from a nice API.

In a Extract, transform, load (ETL) process, this just covers the extractions, with support for minor transforming.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tx_elections_scrapers-0.4.1.tar.gz (13.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tx_elections_scrapers-0.4.1-py2-none-any.whl (19.5 kB view details)

Uploaded Python 2

File details

Details for the file tx_elections_scrapers-0.4.1.tar.gz.

File metadata

File hashes

Hashes for tx_elections_scrapers-0.4.1.tar.gz
Algorithm Hash digest
SHA256 e4e1f077b8eb2d4a33664c3b13c0d50b71b4452cb3f9a1e68d3540d6ab608d6c
MD5 2c0f70c81935149514764cfda6b57340
BLAKE2b-256 6d869a48ca92cba88bd71e35f548e40a870d8cf088d00c748bf1a8ed7cba923b

See more details on using hashes here.

File details

Details for the file tx_elections_scrapers-0.4.1-py2-none-any.whl.

File metadata

File hashes

Hashes for tx_elections_scrapers-0.4.1-py2-none-any.whl
Algorithm Hash digest
SHA256 0b957b7c7c147def6fba69b6c46ba1643339bfcd5ac14be46ac884dba066644d
MD5 40ac3dd259f1e8a7065f1bd30a2e2332
BLAKE2b-256 a2ab47a9874b1b485c5845836cb3c2cc68edb903df09c094e0207f82748c573a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page