Geo-related info extraction library for Bellingcat, Cen4InfoRes etc
Project description
geo_extractor
Library to extract geo-related information from databases such as Bellingcat, Cen4InfoRes, GeoConfirmed, DefMon3 and Texty.org.ua.
Installation
Install from PyPI:
pip install osint-geo-extractor
Usage
from geo_extractor import get_bellingcat_data
events = get_bellingcat_data()
for e in events[:10]:
print(f"{e.id}: [{e.latitude}, {e.longitude}]")
See also the examples/
folder.
Docs
Convenience functions:
get_bellingcat_data
get_ceninfores_data
get_defmon_data
get_geoconfirmed_data
get_texty_data
Data is returned as a list of Event
objects:
Field | Type |
---|---|
id | str |
date | datetime |
latitude | float |
longitude | float |
place_desc | str |
title | str |
description | str |
source | str |
links | List[str] |
Data formats: See dataformats/
Exporting to GeoJSON: Use processors.format_as_geojson(data)
{
"type": "FeatureCollection",
"features": [
{
"type": "Feature",
"id": "CIV0001",
"geometry": {
"type": "Point",
"coordinates": [
36.659031,
49.85005
]
},
"properties": {
"title": "<title>",
"date": "2022-02-24",
"description": "<desc>",
"links": [
"https://twitter.com/Michael1Sheldon/status/1496717647089651716",
"https://twitter.com/AFP/status/1496768532448788482"
],
"source": "BELLINGCAT"
}
}
]
}
Tests#
To obtain necessary testing data not shipped with the repository, install the
package into your virtualenv
via pip install -e .
, navigate to
geo_extractor/tests
and run python generate_fixtures.py
.
The tests can be run via pytest
:
$ pip install pytest
$ PYTHONPATH=. pytest
To run a single test, use pytest -k <test name>
.
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for osint-geo-extractor-0.0.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 22a228292b3ab27b4eadbc9fbb3ae7d500d728a3c06e14cd95335cff85b0b91a |
|
MD5 | b8d5ccee87da99f2c9cfb1d16298f43f |
|
BLAKE2b-256 | c85192bca9618f40d8a3638f28778c42d30767302310c18c67ff5415b47a69e8 |