Geo-related info extraction library for Bellingcat, Cen4InfoRes etc
Project description
geo_extractor
Library to extract geo-related information from databases such as Bellingcat, Cen4InfoRes, DefMon3, GeoConfirmed and Texty.org.ua.
Installation
Install from PyPI:
pip install osint-geo-extractor
Usage
from geo_extractor import get_bellingcat_data
events = get_bellingcat_data()
for e in events[:10]:
print(f"{e.id}: [{e.latitude}, {e.longitude}]")
See also the examples/
folder.
Docs
Convenience functions:
get_bellingcat_data
get_ceninfores_data
get_defmon_data
get_geoconfirmed_data
get_texty_data
Data is returned as a list of Event
objects:
Field | Type |
---|---|
id | str |
date | datetime |
latitude | float |
longitude | float |
place_desc | str |
title | str |
description | str |
source | str |
links | List[str] |
Data formats: See dataformats/
Exporting to GeoJSON: Use extractors.format_as_geojson(data)
{
"type": "FeatureCollection",
"features": [
{
"type": "Feature",
"id": "CIV0001",
"geometry": {
"type": "Point",
"coordinates": [
36.659031,
49.85005
]
},
"properties": {
"title": "<title>",
"date": "2022-02-24",
"description": "<desc>",
"links": [
"https://twitter.com/Michael1Sheldon/status/1496717647089651716",
"https://twitter.com/AFP/status/1496768532448788482"
],
"source": "BELLINGCAT"
}
}
]
}
Tests
To obtain necessary testing data not shipped with the repository, install the
package into your virtualenv
via pip install -e .
, navigate to
geo_extractor/tests
and run python generate_fixtures.py
.
The tests can be run via pytest
:
$ pip install pytest
$ PYTHONPATH=. pytest
To run a single test, use pytest -k <test name>
.
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for osint-geo-extractor-0.0.7.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ae4a13274a9a8c147dfe53f9eb7226c9916ec7374def90d2795e4e5c80dbe03 |
|
MD5 | ab06197ace4080c2799cd3488a3ee3a1 |
|
BLAKE2b-256 | c0243c582236ed9205043d5dcb292c302d4032f27a6bbc8807ecf656ea306527 |