scrape-html 0.0.24

Get html in string from a page

Generate HTML in string from URL

# One Single Page Websites also work
# Get html from page
from scraping.scraper import PageSources

page = PageSources('https://...')

print(page.get_current_html())

---

# save data in a directory call web_data
from scraping.scraper import PageSources

page = PageSources('https://...')
page.get_current_html()
page.save()
# page.save(directory='web_page') default

---

#Multiple link
from scraping.scraper import PageSources

lista = ['https://...','https://...']

page = PageSources()
page.get_multiple_html(lista)

---

When create a file it'll get name of hostPage and amount of file in your directory, like:
-> web_data
    -hostPage_1.html
    -hostPage_2.html
    -hostPage_3.html
    ...

---

# getting csv file
from scraping.scraper import PageSources

page = PageSources()

dict_data = [
    {'name':'a','page':'b'},
    {'name':'a','page':'b'},
    {'name':'a','page':'b'}
]

page.save_csv(dict_data)
# def save_csv(self, dict_data, outfile = 'output.csv', open_file = 'w'):

---

# Using proxy
from scraping.scraper import PageSources

"""
PROXY = "158.69.25.178:32769" # IP:PORT or HOST:PORT
"""
page = PageSources('https://andycode.ga', headless=False, proxy='158.69.25.178:32769')
page.get_current_html()
page.save()

---

It need a Google Chrome Driver

To check the version you have of Google Chrome, you can do it from the browser information and in the "Help" section:

• Open a window in the browser.
• Go to the three points in the upper right.
• Choose the "Help" option from the drop-down menu.
• Tap on "Google Chrome Information"

---

Go to https://chromedriver.chromium.org/downloads select your version, system and download

It will be a file like this:

Copy and paste in your root project