Geo-related info extraction library for Bellingcat, Cen4InfoRes etc
Project description
geo_extractor
Library to extract geo-related information from databases such as Bellingcat, Cen4InfoRes, DefMon3, GeoConfirmed and Texty.org.ua.
Installation
Install from PyPI:
pip install osint-geo-extractor
Usage
from geo_extractor import get_bellingcat_data
events = get_bellingcat_data()
for e in events[:10]:
print(f"{e.id}: [{e.latitude}, {e.longitude}]")
See also the examples/
folder.
Docs
Convenience functions:
get_bellingcat_data
get_ceninfores_data
get_defmon_data
get_defmon_spreadsheet_data
get_geoconfirmed_data
get_texty_data
Data is returned as a list of Event
objects:
Field | Type |
---|---|
id | str |
date | datetime |
latitude | float |
longitude | float |
place_desc | str |
title | str |
description | str |
source | str |
links | List[str] |
Data formats: See dataformats/
Exporting to GeoJSON: Use extractors.format_as_geojson(data)
{
"type": "FeatureCollection",
"features": [
{
"type": "Feature",
"id": "CIV0001",
"geometry": {
"type": "Point",
"coordinates": [
36.659031,
49.85005
]
},
"properties": {
"title": "<title>",
"date": "2022-02-24",
"description": "<desc>",
"links": [
"https://twitter.com/Michael1Sheldon/status/1496717647089651716",
"https://twitter.com/AFP/status/1496768532448788482"
],
"source": "BELLINGCAT"
}
}
]
}
Tests
To obtain necessary testing data not shipped with the repository, install the
package into your virtualenv
via pip install -e .
, navigate to
tests
and run python generate_fixtures.py
.
The tests can be run via pytest
:
$ pip install pytest
$ PYTHONPATH=. pytest
To run a single test, use pytest -k <test name>
.
To run the download
tests that require an internet connection,
use pytest --online -k download
.
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for osint-geo-extractor-0.0.12.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7975a598cf702fb6c7089434633059b89c03f34995dc704ec5f29d4cc4f764f1 |
|
MD5 | cb27ee5fbe587d0f538609d2f5387eef |
|
BLAKE2b-256 | a045460d5f1f09ccdfc0a33ac693f7f0ced05429bcc013fe3df261da29c0ef72 |