Skip to main content

A small package that allows you to quickly scrape things off the web.

Project description

About


Wscrape is a package that allows you to quickly scrape things off a website. Other utils have been added for debugging. Check Pyutils-cr for more debugging/info on the other functions included.

Examples


Scrape information on Cars off Wikipedia

import requests
from bs4 import BeautifulSoup
from wscrape import Scrape

#variable=input("What word would you like to search: ")
url = "https://en.wikipedia.org/wiki/Cars_(film)"
f = Scrape()
f.qresult(f.page_content(url))
y = f.relems("i","lang","la")
print(y.text)

#Returns content of provided tags

Retrieve content from a website

import wscrape.scrape.misc as req

print(req.rcontent("abcdefg.com"))

#Returns string

Scan the website for a specific element

import wscrape.etc.misc.scan_elems as scan_elem

print(scan_elem("https://en.wikipedia.org/wiki/Cars_(film)", "i", "lang", "la")

#Returns Bool

Github

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wscrape-0.0.1.tar.gz (2.8 kB view hashes)

Uploaded Source

Built Distribution

wscrape-0.0.1-py3-none-any.whl (2.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page