Skip to main content

coord-ingest

Global situational-awareness dashboards ingest hundreds of live feeds and turn them into an actionable picture — but they score the world's Tier-1 countries, and East Africa isn't on that list. The signals that matter here (drought onset, basin flooding, cholera clusters, rift-zone quakes) are in the same public feeds; nothing was turning them into events a regional coordination system could act on.

coord-ingest is that missing rail: an MIT-licensed adapter that converts open, key-free world-signal feeds into africa-coord-bus coordination events, filtered to East Africa, so the bus can cascade them to the right domains (insurance, crop advisory, water testing, cross-border alerts).

It ingests and normalizes; the bus routes. Clean separation, composable rails.

What it does

  • Adapters for public sources — Open-Meteo rainfall (drought/flood signals), USGS earthquakes, GDACS disaster alerts, HDX humanitarian datasets (OCHA, key-free CKAN), Kobo/ODK field reports (bottom-up ground truth), Google Flood Hub riverine forecasts — each mapping raw records to typed CoordinationEvents. Add a feed by adding an adapter.
  • East-Africa filter — a signal becomes an event only if it lands in the regional bounding box or names a regional country. Global noise is dropped at ingest.
  • Offline-capable — ships with a SampleAdapter over bundled fixtures, so the full pipeline (and its tests) run with no network and no API keys.
  • Feeds the bus, doesn't replace it — routing, cascading, and cross-border logic stay in africa-coord-bus.

Use it

pip install coord-ingest
from coord_ingest import IngestPipeline, SampleAdapter

# Offline demo — no keys, no network
summary = IngestPipeline([SampleAdapter()]).run()
print(summary["collected"], "East Africa events")   # global noise already dropped
print(summary["by_domain"])                          # {'water': 3, 'health': 1, 'transport': 1}

# With live feeds + the bus:
# from coord_ingest import OpenMeteoAdapter, USGSQuakeAdapter, GDACSAdapter
# from africa_coord_bus import EventBus
# IngestPipeline([USGSQuakeAdapter(), GDACSAdapter()]).run(bus=EventBus(...))

Why not just fork a dashboard?

The global open-source dashboards that inspired this are AGPL applications. This is deliberately the opposite: a small MIT library that produces standard bus events any tool can consume — including a dashboard, if someone wants to build one. Rails, not another train.

IP & Collaboration

MIT. New feed adapters welcome via GitHub Issues (public, key-free sources, East-Africa relevant). Full policy: docs/architecture/IP_POLICY.md. Security: SECURITY.md.

Anticipatory action: why forecasts belong on a bus

The Flood Hub adapter exists because a flood forecast is only worth what it triggers. Google's models cover 40 African countries with riverine forecasts up to 7 days ahead (CC BY 4.0, free), and forecast points now exist in Northern Kenya where there were none. IRC and GiveDirectly used those forecasts to move cash to households 5-7 days before flood peaks in Nigeria — the money arrived while it could still be spent on preparation rather than recovery.

That is a cascade, not a dashboard: a verified gauge crossing a danger threshold is a water-domain signal whose value is downstream — finance (anticipatory transfer), health (facility pre-positioning), transport (route closure). coord-ingest emits the signal; africa-coord-bus routes it.

from coord_ingest import FloodHubAdapter, IngestPipeline
events = IngestPipeline([FloodHubAdapter()]).collect()   # needs FLOODHUB_API_KEY

Access: the Flood Forecasting API is waitlisted — approval plus a Google Cloud Project ID, currently non-commercial use only. Without a key the adapter returns nothing and the pipeline still runs on its other feeds. Unverified gauges are excluded by default: an unverified gauge triggering a cash transfer is a worse failure than a missed alert.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coord_ingest-0.4.0.tar.gz (18.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

coord_ingest-0.4.0-py3-none-any.whl (14.8 kB view details)

Uploaded Python 3

File details

Details for the file coord_ingest-0.4.0.tar.gz.

File metadata

  • Download URL: coord_ingest-0.4.0.tar.gz
  • Upload date:
  • Size: 18.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.3

File hashes

Hashes for coord_ingest-0.4.0.tar.gz
Algorithm Hash digest
SHA256 71fa2cab867efcd0a4340af9834587f82c8f59a5b836ce9582da6f48744d94dc
MD5 41456866fd1a372f660aa9bc4a15729d
BLAKE2b-256 1737ca274f814fe0336b59482e3afed75eebaa4fed5528937270e47129942312

See more details on using hashes here.

File details

Details for the file coord_ingest-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: coord_ingest-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 14.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.3

File hashes

Hashes for coord_ingest-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 edfa5c831894af456c207107060e8e50dd99178fac07af6fbfaa2c622280cea3
MD5 d1dd32e5a5b53bc46a58937656fda61e
BLAKE2b-256 1fd6699358edb109954a4b1c9ccaef88838e5a300730e856e0ddbd0ac463a50b

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.4.0 This release

2 files

0.3.0

2 files

0.2.0

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page