Extract accounts' identifiers from personal pages on various platforms
Project description
socid_extractor
Extract information about a user from profile webpages / API responses and save it in machine-readable format.
When it may be useful
- Getting all available info by the username or/and account UID. Examples: Week in OSINT, OSINTCurious
- Searching by commonly used cross-service UIDs (GAIA ID, Facebook UID, Yandex Public ID, etc.)
- DB leaks of forums and platforms in SQL format
- Indexed links that contain target profile ID
- Searching for tracking data by comparison with other IDs - how it works, how can it be used.
- Checking that the account was previously known (by ID) even if all public info has changed
Tools using socid_extractor
Maigret - powerful namechecker, generate a report with all available info from accounts found.
YaSeeker - tool to gather all available information about Yandex account by login/email.
Installation
$ pip3 install socid-extractor
The latest development version can be installed directly from GitHub:
$ pip3 install -U git+https://github.com/soxoj/socid_extractor.git
Using
As a command-line tool:
$ socid_extractor --url https://www.deviantart.com/muse1908
country: France
created_at: 2005-06-16 18:17:41
gender: female
username: Muse1908
website: www.patreon.com/musemercier
links: ['https://www.facebook.com/musemercier', 'https://www.instagram.com/muse.mercier/', 'https://www.patreon.com/musemercier']
tagline: Nothing worth having is easy...
Without installing:
$ ./run.py --url https://www.deviantart.com/muse1908
As a Python library:
>>> import socid_extractor, requests
>>> r = requests.get('https://www.patreon.com/annetlovart')
>>> socid_extractor.extract(r.text)
{'patreon_id': '33913189', 'patreon_username': 'annetlovart', 'fullname': 'Annet Lovart', 'links': "['https://www.facebook.com/322598031832479', 'https://www.instagram.com/annet_lovart', 'https://twitter.com/annet_lovart', 'https://youtube.com/channel/UClDg4ntlOW_1j73zqSJxHHQ']"}
Sites
- Google (all documents pages, maps contributions), cookies required
- Yandex (disk, albums, znatoki, music, realty, collections), cookies required to prevent captcha blocks
- Facebook (user & group pages)
- Medium
- Flickr
- Tumblr
- TikTok
- GitHub
- VK (user page)
- OK (user page)
- Mail.ru (my.mail.ru user mainpage, photo, video, games, communities)
...and many others.
Check tests file for extracted data examples, schemes file to check all supported sites.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file socid-extractor-0.0.11.tar.gz
.
File metadata
- Download URL: socid-extractor-0.0.11.tar.gz
- Upload date:
- Size: 39.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 54045a2020a1670547597f1c0e2f5a38dd149cd1b4b87d1726a73e6a736a4605 |
|
MD5 | 271a745c2a74f0bc294cd4664b637b87 |
|
BLAKE2b-256 | 8e0e72cf1397e55ea742ffc2c68549cf0be265acd92dcb85086393e8be76d43e |
File details
Details for the file socid_extractor-0.0.11-py3-none-any.whl
.
File metadata
- Download URL: socid_extractor-0.0.11-py3-none-any.whl
- Upload date:
- Size: 39.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 68c14c8835e1c4071309a344900ff8a0c9eb0ff12886c428e4ac4e8c7df45dfc |
|
MD5 | 7ece98d9aa1bcf4e98827849f0b0b5ba |
|
BLAKE2b-256 | 3daa2af639a70bd6781768f2d3dbb0662a0d88817a5589df9f4ad8999e356197 |