socid_extractor
Extract information about a user from profile webpages / API responses and save it in machine-readable format.
When it may be useful
- Getting all available info by the username or/and account UID. Examples: Week in OSINT, OSINTCurious
- Users tracking, checking that the account was previously known (by ID) even if all public info has changed. Examples: Aware Online
- Searching by commonly used cross-service UIDs (GAIA ID, Facebook UID, Yandex Public ID, etc.)
- DB leaks of forums and platforms in SQL format
- Indexed links that contain target profile ID
- Searching for tracking data by comparison with other IDs - how it works, how can it be used.
- Law enforcement online requests
Tools using socid_extractor
Maigret - powerful namechecker, generate a report with all available info from accounts found.
YaSeeker - tool to gather all available information about Yandex account by login/email.
Installation
$ pip3 install socid-extractor
The latest development version can be installed directly from GitHub:
$ pip3 install -U git+https://github.com/soxoj/socid_extractor.git
Using
As a command-line tool:
$ socid_extractor --url https://www.deviantart.com/muse1908
country: France
created_at: 2005-06-16 18:17:41
gender: female
username: Muse1908
website: www.patreon.com/musemercier
links: ['https://www.facebook.com/musemercier', 'https://www.instagram.com/muse.mercier/', 'https://www.patreon.com/musemercier']
tagline: Nothing worth having is easy...
Without installing:
$ ./run.py --url https://www.deviantart.com/muse1908
As a Python library:
>>> import socid_extractor, requests
>>> r = requests.get('https://www.patreon.com/annetlovart')
>>> socid_extractor.extract(r.text)
{'patreon_id': '33913189', 'patreon_username': 'annetlovart', 'fullname': 'Annet Lovart', 'links': "['https://www.facebook.com/322598031832479', 'https://www.instagram.com/annet_lovart', 'https://twitter.com/annet_lovart', 'https://youtube.com/channel/UClDg4ntlOW_1j73zqSJxHHQ']"}
Sites
- Google (all documents pages, maps contributions), cookies required
- Yandex (disk, albums, znatoki, music, realty, collections), cookies required to prevent captcha blocks
- Facebook (user & group pages)
- Medium
- Flickr
- Tumblr
- TikTok
- GitHub
- VK (user page)
- OK (user page)
- Mail.ru (my.mail.ru user mainpage, photo, video, games, communities)
...and many others.
Check tests file for extracted data examples, schemes file to check all supported sites.
1 maintainer
Metadata
1 maintainer
Release files for socid-extractor 0.0.20
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| socid-extractor-0.0.20.tar.gz | 46.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| socid_extractor-0.0.20-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 93.3 kB
Release files / socid-extractor-0.0.20.tar.gz
| Download URL | socid-extractor-0.0.20.tar.gz |
|---|---|
| Size | 46.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
af5bd02cc11a0129901c707b01963929c6931b8b6023fd77abfbec5cb3be8a18
|
|
BLAKE2b-256 checksum How to use checksums |
cb525fef27634f7162c8637fbc87bec662c27c85e94f0125238007bcaf89e546
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
|
Release files / socid_extractor-0.0.20-py3-none-any.whl
| Download URL | socid_extractor-0.0.20-py3-none-any.whl |
|---|---|
| Size | 46.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e215f4e2c82c141e5e941f154fa8ea9311777ad1fec5abb177fcf2aa7acf99d2
|
|
BLAKE2b-256 checksum How to use checksums |
77bd0145c687bdea37e669b28fd05dd7f7b5ec0bd4308a4f0fffb94e0bc74b0a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.5
|
