Skip to main content

scrapper-boilerplate

Scrapping functions and for making easy for further scrapping

instalation

(Optional) install enviroment

make sure that you have python 3.10 installed

then install:

pip install virtualenv

then install the enviroment and activate:

python -m venv venv
.\venv\scripts\activate

Install the dependêncies:

Install chromedriver click here, and get the path location.

Create .env file with:

  • chromedriver location
  • token of telegram bot (if you use telegram function)

Example provided in ".env.example"

install the packages:

pip install -r requirements.txt

and activate:

python index.py

setup enviroment

create ".env" file with following lines:

CHROMEDRIVER_PATH="Insert your chromedriver path"
TELEGRAM_TOKEN="Insert your telegram token..."

Usage

from time import sleep
from utils.setup import setSelenium
import os

ROOT_DIR = os.path.dirname(os.path.abspath(__file__))

def main():
    # import selenium initialization and browser it
    driver = setSelenium()
    driver.get('https://www.google.com')
    sleep(10)
    driver.quit()

if __name__ == "__main__":
    main()

Metadata

Release files for scrapper-boilerplate 0.2.13

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scrapper-boilerplate 0.2.13
File Size Uploaded Provenance Actions
scrapper_boilerplate-0.2.13.tar.gz 12.1 kB Without provenance Details for scrapper_boilerplate-0.2.13.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for scrapper-boilerplate 0.2.13
File Interpreter ABI Platform Actions
scrapper_boilerplate-0.2.13-py3-none-any.whl Python 3 none any Details for scrapper_boilerplate-0.2.13-py3-none-any.whl

Total release size: 28.4 kB

Release files / scrapper_boilerplate-0.2.13.tar.gz

Download URL scrapper_boilerplate-0.2.13.tar.gz
Size 12.1 kB
Tags Source
SHA-256 checksum
How to use checksums
cc70b1198611fdfe2e6a6568747be8c5fc04e1d34e32a504cb118956d3241926
BLAKE2b-256 checksum
How to use checksums
08e2df0f22e5b08faabb3e52e7dc0d614dfbbabcca5e2c97211d0a3e1fe8a8da
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.10.15

Release files / scrapper_boilerplate-0.2.13-py3-none-any.whl

Download URL scrapper_boilerplate-0.2.13-py3-none-any.whl
Size 16.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
ef33ab7ed1d1ef462fed2999e03551b27c1e352b1e5b749457dbee703e4180bb
BLAKE2b-256 checksum
How to use checksums
bfd2e630ff496d204bedbc8b12a349b1fc00da5fb7fbf3b32067879e15c0fe3e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/5.1.1 CPython/3.10.15

Security for scrapper-boilerplate 0.2.13

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page