High-throughput OSINT ingestion engine for Python

Project description

Python

Osintxpress

A fast OSINT data fetching library. Returns Arrow arrays, so you can proceed with your favorite data / visualization tools.

Installation

pip install osintxpress

arro3-core is the sole dependency, to accept Arrow arrays via the PyCapsule protocol. PyArrow works as well if needed - has more options (such as converting to CSV), but is much bulkier.
polars is used in the tests.
Wheels for Win, Mac, Linux, Alpine. FreeBSD wheels can be gladly added once updated arrow / polars packages are available.

Demo

Interactive flight map using Panel and lonboard. osintxpress related code from the demo -

from osintxpress import OsintEngine, SourceAdapter


engine = OsintEngine(worker_threads=2)
engine.add_rest_source(name="flights", adapter=SourceAdapter.OPENSKY, poll_interval_sec=10)
engine.start_all()

.
.

def update_dashboard():

    data = engine.poll()
    if 'flights' in data:
        df = pl.from_arrow(data['flights']).drop_nulls(subset=['longitude', 'latitude'])
    .
    .

Run panel serve demo.py, then open http://localhost:5006/demo

Supported Sources

osintxpress natively polls / streams from -

Domain	Source	Description
Geopolitics & Conflict	ACLED	Armed Conflict Location & Event Data Project
	UCDP	Uppsala Conflict Data Program (Georeferenced events)
	GDELT	Global Database of Events, Language, and Tone
	OREF	Israel Home Front Command (Real-time rocket/drone alerts)
Cyber & Infrastructure	Cloudflare Radar	Global BGP leaks and route hijacks
	URLhaus	Active malware distribution URLs (abuse.ch)
Natural & Environmental	NASA FIRMS	VIIRS Satellite thermal anomalies (Wildfires & kinetic impacts)
	NASA EONET	Earth Observatory Natural Event Tracker
	USGS	Global live earthquake feeds
	NWS	US National Weather Service active alerts
	Open-Meteo	Live global surface temperatures and weather
Markets & Macro	Polymarket	Decentralized prediction market odds and volume
	FRED	Federal Reserve Economic Data (Macro indices)
	CoinGecko	Real-time cryptocurrency prices
	Binance	Live crypto trade execution streams (WebSocket)
Tracking & Telecom	OpenSky Network	Live global ADS-B flight tracking
	AIS Stream	Live global maritime shipping positions (WebSocket)
	Telegram	Authenticated MTProto channel scraping via `grammers`
News & Media	Google News	Accelerated proxy for Reuters World News
	BBC & Al Jazeera	Breaking world news RSS feeds

Suggestions

Feel free to open a ticket or a discussion!

Project details

Release history Release notifications | RSS feed

This version

0.2.1

Mar 30, 2026

0.1.0

Mar 21, 2026

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

osintxpress-0.2.1.tar.gz (60.0 kB view details)

Uploaded Mar 30, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

osintxpress-0.2.1-cp314-cp314t-musllinux_1_2_x86_64.whl (7.8 MB view details)

Uploaded Mar 30, 2026 CPython 3.14tmusllinux: musl 1.2+ x86-64

osintxpress-0.2.1-cp313-cp313t-musllinux_1_2_x86_64.whl (7.8 MB view details)

Uploaded Mar 30, 2026 CPython 3.13tmusllinux: musl 1.2+ x86-64

osintxpress-0.2.1-cp312-abi3-win_amd64.whl (7.0 MB view details)

Uploaded Mar 30, 2026 CPython 3.12+Windows x86-64

osintxpress-0.2.1-cp312-abi3-musllinux_1_2_x86_64.whl (7.8 MB view details)

Uploaded Mar 30, 2026 CPython 3.12+musllinux: musl 1.2+ x86-64

osintxpress-0.2.1-cp312-abi3-manylinux_2_28_x86_64.whl (7.6 MB view details)

Uploaded Mar 30, 2026 CPython 3.12+manylinux: glibc 2.28+ x86-64

osintxpress-0.2.1-cp312-abi3-manylinux_2_28_aarch64.whl (7.0 MB view details)

Uploaded Mar 30, 2026 CPython 3.12+manylinux: glibc 2.28+ ARM64

osintxpress-0.2.1-cp312-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl (13.7 MB view details)

Uploaded Mar 30, 2026 CPython 3.12+macOS 10.12+ universal2 (ARM64, x86-64)macOS 10.12+ x86-64macOS 11.0+ ARM64

File details

Details for the file osintxpress-0.2.1.tar.gz.

File metadata

Download URL: osintxpress-0.2.1.tar.gz
Upload date: Mar 30, 2026
Size: 60.0 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1.tar.gz
Algorithm	Hash digest
SHA256	`b86dcbd010c75b42601e397d6f7b8664eb8cff2497da945bba32f4a387b820a3`
MD5	`01d321f11e90ee6d90595e86392fe778`
BLAKE2b-256	`a9864d7e398206339cf58dcf8f417bef970933c8bbefeb41833f2e39e0e4a5ef`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1.tar.gz:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1.tar.gz
- Subject digest: b86dcbd010c75b42601e397d6f7b8664eb8cff2497da945bba32f4a387b820a3
- Sigstore transparency entry: 1200114298
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp314-cp314t-musllinux_1_2_x86_64.whl.

File metadata

Download URL: osintxpress-0.2.1-cp314-cp314t-musllinux_1_2_x86_64.whl
Upload date: Mar 30, 2026
Size: 7.8 MB
Tags: CPython 3.14t, musllinux: musl 1.2+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp314-cp314t-musllinux_1_2_x86_64.whl
Algorithm	Hash digest
SHA256	`c46060a8de6679644a8e6975322f3ce83f57d090b00517cadada3aeae38e5c8a`
MD5	`7f8b4302adaf84b426a4bc99b83d90c8`
BLAKE2b-256	`b50487b4119698b5a9879d02097d9094d4222ff81ba6e3d8e8b42ac4959913f2`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp314-cp314t-musllinux_1_2_x86_64.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp314-cp314t-musllinux_1_2_x86_64.whl
- Subject digest: c46060a8de6679644a8e6975322f3ce83f57d090b00517cadada3aeae38e5c8a
- Sigstore transparency entry: 1200114425
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp313-cp313t-musllinux_1_2_x86_64.whl.

File metadata

Download URL: osintxpress-0.2.1-cp313-cp313t-musllinux_1_2_x86_64.whl
Upload date: Mar 30, 2026
Size: 7.8 MB
Tags: CPython 3.13t, musllinux: musl 1.2+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp313-cp313t-musllinux_1_2_x86_64.whl
Algorithm	Hash digest
SHA256	`85f267ae8a2ce9c3aa7a7ec00d262e4081f197b36018d3fbbd3d03f230e02bbb`
MD5	`85d35a7d086600a482ee1afa8da4b380`
BLAKE2b-256	`9ae9a35987d475a80dedb179b45e7c74670979ecfd4ba9688f0f5bb0e2256b40`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp313-cp313t-musllinux_1_2_x86_64.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp313-cp313t-musllinux_1_2_x86_64.whl
- Subject digest: 85f267ae8a2ce9c3aa7a7ec00d262e4081f197b36018d3fbbd3d03f230e02bbb
- Sigstore transparency entry: 1200114323
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp312-abi3-win_amd64.whl.

File metadata

Download URL: osintxpress-0.2.1-cp312-abi3-win_amd64.whl
Upload date: Mar 30, 2026
Size: 7.0 MB
Tags: CPython 3.12+, Windows x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp312-abi3-win_amd64.whl
Algorithm	Hash digest
SHA256	`63e9fb9cc1896b282fe50bb985389321ecfbd648291164ef071b9ea81c0c1f53`
MD5	`9a79f3c66908d306d34fb7bbabeb59a8`
BLAKE2b-256	`8967b97c5cf3638b83e08fe2084133d4bea82eb09b00fb5d5d36f97a8c7d45f5`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp312-abi3-win_amd64.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp312-abi3-win_amd64.whl
- Subject digest: 63e9fb9cc1896b282fe50bb985389321ecfbd648291164ef071b9ea81c0c1f53
- Sigstore transparency entry: 1200114482
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp312-abi3-musllinux_1_2_x86_64.whl.

File metadata

Download URL: osintxpress-0.2.1-cp312-abi3-musllinux_1_2_x86_64.whl
Upload date: Mar 30, 2026
Size: 7.8 MB
Tags: CPython 3.12+, musllinux: musl 1.2+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp312-abi3-musllinux_1_2_x86_64.whl
Algorithm	Hash digest
SHA256	`4a4c44103de11c28018aae33113b97bb0d0b816f836e941526574c444c6a6eb5`
MD5	`b0a60d14e874ad361371ab6368b94040`
BLAKE2b-256	`7862db36488ec3a7807deb7c3fa105be3f1a9b5d527214a4156af45a9c95cf69`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp312-abi3-musllinux_1_2_x86_64.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp312-abi3-musllinux_1_2_x86_64.whl
- Subject digest: 4a4c44103de11c28018aae33113b97bb0d0b816f836e941526574c444c6a6eb5
- Sigstore transparency entry: 1200114346
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp312-abi3-manylinux_2_28_x86_64.whl.

File metadata

Download URL: osintxpress-0.2.1-cp312-abi3-manylinux_2_28_x86_64.whl
Upload date: Mar 30, 2026
Size: 7.6 MB
Tags: CPython 3.12+, manylinux: glibc 2.28+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp312-abi3-manylinux_2_28_x86_64.whl
Algorithm	Hash digest
SHA256	`b72d7ca6fbe8a589b72db4fb37eff2c5517386d643ac22258cc1f385ea16fdf4`
MD5	`9ac862a3d9cdc8e71b471b74e652f8c6`
BLAKE2b-256	`6f5f4d9d39e811f82c5121094ce26f605e4461c0ae78db855a77eea451c9a81d`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp312-abi3-manylinux_2_28_x86_64.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp312-abi3-manylinux_2_28_x86_64.whl
- Subject digest: b72d7ca6fbe8a589b72db4fb37eff2c5517386d643ac22258cc1f385ea16fdf4
- Sigstore transparency entry: 1200114394
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp312-abi3-manylinux_2_28_aarch64.whl.

File metadata

Download URL: osintxpress-0.2.1-cp312-abi3-manylinux_2_28_aarch64.whl
Upload date: Mar 30, 2026
Size: 7.0 MB
Tags: CPython 3.12+, manylinux: glibc 2.28+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp312-abi3-manylinux_2_28_aarch64.whl
Algorithm	Hash digest
SHA256	`9a4e3e140816e3e8b9ae1ecb34866873737f98fcf20438a3000c6eff136e63ac`
MD5	`614a13026a5653780d8eb85f4fd9bf35`
BLAKE2b-256	`fdfd5f12a419aa41da8070e10632e3cc6d8630dcc867875ad32b1bf34d196e12`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp312-abi3-manylinux_2_28_aarch64.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp312-abi3-manylinux_2_28_aarch64.whl
- Subject digest: 9a4e3e140816e3e8b9ae1ecb34866873737f98fcf20438a3000c6eff136e63ac
- Sigstore transparency entry: 1200114372
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

File details

Details for the file osintxpress-0.2.1-cp312-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl.

File metadata

Download URL: osintxpress-0.2.1-cp312-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl
Upload date: Mar 30, 2026
Size: 13.7 MB
Tags: CPython 3.12+, macOS 10.12+ universal2 (ARM64, x86-64), macOS 10.12+ x86-64, macOS 11.0+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for osintxpress-0.2.1-cp312-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl
Algorithm	Hash digest
SHA256	`71f788e41e47da9e4fc82b1e1527d47f822368ffd1600274fb7d6923d34fd4da`
MD5	`637cbecaab3a2778419d2efdcafc5c67`
BLAKE2b-256	`8d1aeae90f2fef988d5370e216ba5ff1fe19f678ec26128bd1a5f60803f9c78b`

See more details on using hashes here.

Provenance

The following attestation bundles were made for osintxpress-0.2.1-cp312-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl:

Publisher: release.yml on h5rdly/osintxpress

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: osintxpress-0.2.1-cp312-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl
- Subject digest: 71f788e41e47da9e4fc82b1e1527d47f822368ffd1600274fb7d6923d34fd4da
- Sigstore transparency entry: 1200114450
- Sigstore integration time: Mar 30, 2026
Source repository:
- Permalink: h5rdly/osintxpress@acd9c007d4fe6949e261c0a90101826122367161
- Branch / Tag: refs/tags/v0.2.1
- Owner: https://github.com/h5rdly
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@acd9c007d4fe6949e261c0a90101826122367161
- Trigger Event: push

osintxpress 0.2.1

Navigation

Verified details

Maintainers

Unverified details

Meta

Project description

Osintxpress

Installation

Demo

Supported Sources

Suggestions

Project details

Verified details

Maintainers

Unverified details

Meta

Release history Release notifications | RSS feed

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance