Skip to main content

Overview

Selenium scraper for fetching information from the ProCyclingStats page.

Setup

Setting up virtualenv

python3 -m pip install virtualenv
virtualenv .
source bin/activate

Installing requirements

pip install -r requirements.txt
sudo apt-get install xvfb
sudo apt-get install -y chromium-chromedriver

Usage

import pcs_scraper

pcs_scraper.scrap_teams_by_year(2021)
pcs_scraper.scrap_stage('tour-de-france', 2020, 2)
pcs_scraper.scrap_stage_gc('tour-de-france', 2020, 2)
pcs_scraper.scrap_final_gc('tour-de-france', 2021)
pcs_scraper.scrap_final_points('tour-de-france', 2021)
pcs_scraper.scrap_final_kom('tour-de-france', 2021)
pcs_scraper.scrap_final_youth('tour-de-france', 2021)
pcs_scraper.scrap_final_teams('tour-de-france', 2021)

Publishing to PyPy

https://packaging.python.org/en/latest/tutorials/packaging-projects/

Release files for pcs-utils 0.0.10

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pcs-utils 0.0.10
File Size Uploaded
pcs-utils-0.0.10.tar.gz 7.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pcs-utils 0.0.10
File Interpreter ABI Platform
pcs_utils-0.0.10-py3-none-any.whl Python 3 none any Details

Total release size: 16.6 kB

Release files / pcs-utils-0.0.10.tar.gz

Download URL pcs-utils-0.0.10.tar.gz
Size 7.8 kB
Tags Source
SHA-256 checksum
How to use checksums
838f65893b484ef41d27321241089203e740c80b335a40af4880f8808f6febc3
BLAKE2b-256 checksum
How to use checksums
e4c827e994159e4992433b435d83b677f97a38efc30e6a05ef9b2fce0a638a2c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.2

Release files / pcs_utils-0.0.10-py3-none-any.whl

Download URL pcs_utils-0.0.10-py3-none-any.whl
Size 8.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c62a006387c574e12654194c26728110e65eb6ac46c7a7e25fd710a6ed238499
BLAKE2b-256 checksum
How to use checksums
a8658b29873e9a56baf886cb44f5a5f6b61a16b9c6d87ddd79d07571a14e5af1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.2

Release history Release notifications | RSS feed

This release

0.0.10 This release

2 release files

0.0.9

2 release files

0.0.8

2 release files

0.0.7

2 release files

0.0.6

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page