Skip to main content

Some utils for scraping the PCS web

Project description

Overview

Selenium scraper for fetching information from the ProCyclingStats page.

Setup

Setting up virtualenv

python3 -m pip install virtualenv
virtualenv .
source bin/activate

Installing requirements

pip install -r requirements.txt
sudo apt-get install xvfb
sudo apt-get install -y chromium-chromedriver

Usage

import pcs_scraper

pcs_scraper.scrap_teams_by_year(2021)
pcs_scraper.scrap_stage('tour-de-france', 2020, 2)
pcs_scraper.scrap_stage_gc('tour-de-france', 2020, 2)
pcs_scraper.scrap_final_gc('tour-de-france', 2021)
pcs_scraper.scrap_final_points('tour-de-france', 2021)
pcs_scraper.scrap_final_kom('tour-de-france', 2021)
pcs_scraper.scrap_final_youth('tour-de-france', 2021)
pcs_scraper.scrap_final_teams('tour-de-france', 2021)

Publishing to PyPy

https://packaging.python.org/en/latest/tutorials/packaging-projects/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pcs-utils-0.0.8.tar.gz (7.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pcs_utils-0.0.8-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file pcs-utils-0.0.8.tar.gz.

File metadata

  • Download URL: pcs-utils-0.0.8.tar.gz
  • Upload date:
  • Size: 7.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.9.5

File hashes

Hashes for pcs-utils-0.0.8.tar.gz
Algorithm Hash digest
SHA256 203987d9719afab439d434180dbb41b1b682b8cf7c5a899f1a319736077307db
MD5 391b238980fdc2d6e1fa58ad4acb72f9
BLAKE2b-256 1eefbbc6b7a01ebe3120ff615709dae96a204d452caf29c37720b726536782ec

See more details on using hashes here.

File details

Details for the file pcs_utils-0.0.8-py3-none-any.whl.

File metadata

  • Download URL: pcs_utils-0.0.8-py3-none-any.whl
  • Upload date:
  • Size: 8.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.9.5

File hashes

Hashes for pcs_utils-0.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 d921e82e141be1b9361825aa2534e21f3f8465037d97d35c71c6804b61fd6f2a
MD5 90404964440c91bc74ec8e42b7fc50a7
BLAKE2b-256 faf12b320f4ff782e7809307726c41e5762d032bc4f31813f25fd4266dab8a85

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page