Skip to main content

SocialScraper


build status Analyze version Coverage
Test Python V3.7 License status-up

Social Scraper is a python tool meant for Detection of Child Predators/Cyber Harassers on Social Media


Tool intends to identify the cyber predators/child harassers on social media with a malevolent intend. The posts, comments and followers on the social media are subjected to analysis using Artificial Intelligence, Machine Learning with IGPL and NSFW(Not Safe For Work) to categorise the offensive contents.

This system is capable of analyzing all social media platforms like Instagram, Twitter, Facebook, etc., and other outlets seeking the same suspect. If the suspect doesn’t have the same user ID on different platforms, then Reverse Image Searching is done to identify the suspect. A set of user_id is used as a key to grab their personal information and their post information(Post ID, Comments, Timestamp, location, Captions) from multiple social platforms using ​ OSINT(Open Source INTelligence) and Beautifulsoup Python Package. The above data of various posts are subjected to analyze malevolent contents using Machine Learning and Pandas Python library.Based on the statistical analysis, suspects are categorized based on their behavior(also Polite harassment). The users whose suspect level is greater than the threshold value will be scrutinized and monitored for further analysis. The suspected user’s post information(media like Image, Audio, and Video) is retrieved and analyzed using the ​ IGPL Python package, ​ Urllib and ​ Artificial Intelligence with ​ NSFW (Not Safe For Work) library to make them fall under the category 'suspects/predators'. Finally, the Child grooming patterns followers and statistical results that are generated are analyzed and the concerned person is classified as predator and reported to the law enforcement authorities

Tool UI


Creators: 👤

Aravindha Hariharan M
Kabilan S
Gowtham G
Giridhara Prasath G

Prerequisites 📦

1.Python 3.X with pip3 Installed
If not then, pip3 installation

apt install python3-pip

To Check pip versioon

pip3 --version

2.Geckodriver for Mozilla Firefox
If you havn't installed then, Visit the link below, Download the required file for resepective operating system and install.

https://github.com/mozilla/geckodriver/releases

User List Creation

Tool can handle N-number of user account scrapping which can be given a user.txt

You can use any kind of text editor to edit user.txt

gedit user.txt | vim user.txt

Installation 💾

Open Terminal and type

git clone https://github.com/Aravindha1234u/SocialScraper

cd SocialScraper

Automatic Setup

chmod +x setup

./setup

Manual Setup

To Install required Python package

pip3 install -r requirements.txt

or

python3 -m pip install -r requirements.txt

Api Keys

We haven't included our keys for usage. Add your respective api keys to SocialScraper/social/api.py and replace the google credentials.json and client_secret.json to sample directory and facebook credentials in credentials.yaml for scrappering the accounts.

Execution 👍

To Run SocialScraper

python3 main.py

Issues

Feel free to express any kind of bug or error in this tool by reporting it in issues, So that it can be fixed soon.

Important Message ⚠️

This tool is for research purposes only. Hence, the developers of this tool won't be responsible for any misuse of data collected using this tool. Used by many researchers and open source intelligence (OSINT) analysts.

License 📄

SocialScraper is licensed under GNU General Public License v3.0. Take a look at the License


Tool Working 🎴

Tool Working

Metadata

Release files for SocialScraper 1.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for SocialScraper 1.0.2
File Size Uploaded Provenance
SocialScraper-1.0.2.tar.gz 4.2 kB Without provenance Details

Release files / SocialScraper-1.0.2.tar.gz

Download URL SocialScraper-1.0.2.tar.gz
Size 4.2 kB
Tags Source
SHA-256 checksum
How to use checksums
9209a3dfaaae9aff5961339036411fdd3be145f432d12a0c565a504046326607
BLAKE2b-256 checksum
How to use checksums
abd70690f2b74196a9bbade401d1f2fb8d4d1d7d9261cf450ee8342f53080a39
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.2

Security for SocialScraper 1.0.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.0.2 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page