scrapper-boilerplate

Scrapping functions and for making easy for further scrapping

instalation

(Optional) install enviroment

make sure that you have python installed

then install:

pip install virtualenv

then install the enviroment and activate:

python -m venv venv
.\venv\scripts\activate

Install the dependêncies:

Install chromedriver click here, and get the path location.

Create .env file with:

chromedriver location
token of telegram bot (if you use telegram function)

Example provided in ".env.example"

install the packages:

pip install -r requirements.txt

and activate:

python index.py

setup enviroment

create ".env" file with following lines:

CHROMEDRIVER_PATH="Insert your chromedriver path"
TELEGRAM_TOKEN="Insert your telegram token..."

Usage

from time import sleep
from utils.setup import setSelenium
import os

ROOT_DIR = os.path.dirname(os.path.abspath(__file__))

def main():
    # import selenium initialization and browser it
    driver = setSelenium()
    driver.get('https://www.google.com')
    sleep(10)
    driver.quit()

if __name__ == "__main__":
    main()

Metadata

Release files for scrapper-boilerplate 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scrapper-boilerplate 0.2.1
File	Size	Uploaded
scrapper-boilerplate-0.2.1.tar.gz	7.8 kB	May 24, 2022	Details

Built distribution (wheel)

Table of built distributions (wheels) for scrapper-boilerplate 0.2.1
File	Interpreter	ABI	Platform	Reset
scrapper_boilerplate-0.2.1-py3-none-any.whl 9.1 kB May 24, 2022	Python 3	none	any	Details

Total release size: 16.9 kB

Release files / scrapper-boilerplate-0.2.1.tar.gz

Download URL	scrapper-boilerplate-0.2.1.tar.gz
Size	7.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`ee05415afa132939752a5ee55412ac0301c37b5a5cfca7720583491af05630fa`
BLAKE2b-256 checksum How to use checksums	`6802bf00326ad571f43deb77ebbd6a272773c578b6132fa8549a1e27889342d5`
Upload date	May 24, 2022
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.0 CPython/3.9.2`

Release files / scrapper_boilerplate-0.2.1-py3-none-any.whl

Download URL	scrapper_boilerplate-0.2.1-py3-none-any.whl
Size	9.1 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`003560b8bd0c7b2166f52b97f0b6d9040b777518f134c28cdbc7afd497daa245`
BLAKE2b-256 checksum How to use checksums	`b752f92577e3189f356f74286f0451bb76a63164a36b8c7a315eaa341f0882f8`
Upload date	May 24, 2022
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.0 CPython/3.9.2`