Skip to main content

Extract accounts' identifiers from personal pages on various platforms

Project description

socid_extractor

Extract information about a user from profile webpages / API responses and save it in machine-readable format.

When it may be useful

  • Getting all available info by the username or/and account UID. Examples: Week in OSINT, OSINTCurious
  • Searching by commonly used cross-service UIDs (GAIA ID, Facebook UID, Yandex Public ID, etc.)
    • DB leaks of forums and platforms in SQL format
    • Indexed links that contain target profile ID
  • Searching for tracking data by comparison with other IDs - how it works, how can it be used.
  • Checking that the account was previously known (by ID) even if all public info has changed

Tools using socid_extractor

Maigret - powerful namechecker, generate a report with all available info from accounts found.

YaSeeker - tool to gather all available information about Yandex account by login/email.

Installation

$ pip3 install socid-extractor

The latest development version can be installed directly from GitHub:

$ pip3 install -U git+https://github.com/soxoj/socid_extractor.git

Using

As a command-line tool:

$ socid_extractor --url https://www.deviantart.com/muse1908
country: France
created_at: 2005-06-16 18:17:41
gender: female
username: Muse1908
website: www.patreon.com/musemercier
links: ['https://www.facebook.com/musemercier', 'https://www.instagram.com/muse.mercier/', 'https://www.patreon.com/musemercier']
tagline: Nothing worth having is easy...

Without installing:

$ ./run.py --url https://www.deviantart.com/muse1908

As a Python library:

>>> import socid_extractor, requests
>>> r = requests.get('https://www.patreon.com/annetlovart')
>>> socid_extractor.extract(r.text)
{'patreon_id': '33913189', 'patreon_username': 'annetlovart', 'fullname': 'Annet Lovart', 'links': "['https://www.facebook.com/322598031832479', 'https://www.instagram.com/annet_lovart', 'https://twitter.com/annet_lovart', 'https://youtube.com/channel/UClDg4ntlOW_1j73zqSJxHHQ']"}

Sites

  • Google (all documents pages, maps contributions), cookies required
  • Yandex (disk, albums, znatoki, music, realty, collections), cookies required to prevent captcha blocks
  • Facebook (user & group pages)
  • Instagram
  • Reddit
  • Medium
  • Flickr
  • Tumblr
  • TikTok
  • GitHub
  • VK (user page)
  • OK (user page)
  • Mail.ru (my.mail.ru user mainpage, photo, video, games, communities)

...and many others.

Check tests file for extracted data examples, schemes file to check all supported sites.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

socid-extractor-0.0.11.tar.gz (39.4 kB view details)

Uploaded Source

Built Distribution

socid_extractor-0.0.11-py3-none-any.whl (39.2 kB view details)

Uploaded Python 3

File details

Details for the file socid-extractor-0.0.11.tar.gz.

File metadata

  • Download URL: socid-extractor-0.0.11.tar.gz
  • Upload date:
  • Size: 39.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.1

File hashes

Hashes for socid-extractor-0.0.11.tar.gz
Algorithm Hash digest
SHA256 54045a2020a1670547597f1c0e2f5a38dd149cd1b4b87d1726a73e6a736a4605
MD5 271a745c2a74f0bc294cd4664b637b87
BLAKE2b-256 8e0e72cf1397e55ea742ffc2c68549cf0be265acd92dcb85086393e8be76d43e

See more details on using hashes here.

File details

Details for the file socid_extractor-0.0.11-py3-none-any.whl.

File metadata

  • Download URL: socid_extractor-0.0.11-py3-none-any.whl
  • Upload date:
  • Size: 39.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.1

File hashes

Hashes for socid_extractor-0.0.11-py3-none-any.whl
Algorithm Hash digest
SHA256 68c14c8835e1c4071309a344900ff8a0c9eb0ff12886c428e4ac4e8c7df45dfc
MD5 7ece98d9aa1bcf4e98827849f0b0b5ba
BLAKE2b-256 3daa2af639a70bd6781768f2d3dbb0662a0d88817a5589df9f4ad8999e356197

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page