Skip to main content

A Python module to make web scraping a "one-line" job.

Project description

Tal0n A Python module to make it a simple task to scrape a website. Example: Talon.ScrapeFunction(URL).

This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/4.0/.

Python Module Dependencies:

1.)os 2.)requests 3.)wget 4.)BeautifulSoup

How To Use:

1.) Drag Talon.pyc to your project folder. 2.) In the top of your program’s script put “import Talon” without quotations. 3.) Call the function you so desire.

How To Modify Source:

1.) Open Talon.py in your preferred text editor or IDE. 2.) Go to town modifying the code. It’s just plain old Python.

Functions:

Talon.getImages(URL) - Extracts image sources from HTML and generates an HTML file containing the images. (images.html)

Talon.getLinks(URL) - Extracts all href links from HTML and generates a TXT file containing the link addresses. (links.txt)

Talon.getSource(URL) - Downloads the HTML file from the url you chose. (source.html)

Talon.getContent(URL) - Extracts all of the content in a webpage. Content: ‘h1’, ‘h2’, ‘span’, ‘p’. (content.txt)

Project details


Release history Release notifications | RSS feed

This version

1.0

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page