This project focuses on finding the social media links of a company by taking in as input the company's website url, using the libraries google and bs4 (beautiful soup).
Most of the websites render the social media links as static HTML, but some websites render it using Javascript (dynamic websites).
Beautiful Soup can only scrape static HTML code and to scrape dynamically loaded content other scraping libraries like Selenium and Scrapy+Splash will be required.
To circumvent this problem, the code also tries to find the social media links on google.
Since we cannot say for sure the links returned by google may or may not belong to the company, and also when scraping a website it may return unwanted links as well, several filtering criterias are applied to return the best possible links.
The solution is not perfect and would fail to return perfect results when it is difficult to find the company's social media acoount on google and links are loaded dynamically on the official website, for example:
- The website uses a name on social media which is different than the name mentioned in the website url + links are loaded dynamically on their company's website
- The website doesnt have an account on a particular social media platform and someone else has an account with the name which is exactly same to the company's name
Release files for sociallinkfinder 0.0.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sociallinkfinder-0.0.6.tar.gz | 5.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sociallinkfinder-0.0.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 11.0 kB
Release files / sociallinkfinder-0.0.6.tar.gz
How to use checksums
715ca73bd9842ec156b2f766d1817ee9a305b02700b54a17f1d20b0ec180f877How to use checksums
98aedd5adf66d2a4ef6d743cd8bea280555f7bf773f0d29d0652c978dc2acf55What is trusted publishing?
poetry/1.1.4 CPython/3.7.4 Linux/5.4.0-54-generic