Skip to main content

A Python client for scraping data from 8a.nu

Project description

8a_scraper

8a is a great resource to aggregate statistics on sportclimbers and boulderers. They recently deployed a new version of their website that rendered all the prior scrapers obsolete.

This tool allows 8a users to scrape content from the website using their username, password, Selenium, and BeautifulSoup.

Installing

Via pip

Install using the following command:

pip install 8a-scraper

Via GitHub

Alternatively, you can just clone this repo and import the libraries at your own discretion.

Usage

To install the package,

This package requires the user to also install Google Chrome and ChromeDriver. Please ensure that both of the executables are in your $PATH variable.

The user must also have an email and password that can be used to log into 8a

Additionally, the user must set the following environment variables:

_8A_USERNAME='<8a email>'
_8A_PASSWORD='<8a password>'

These variables are accessed using os.getenv().

API

Currently, the package only contains 2 modules: users and ascents. The package will be expanding to include other content as well, but this is a start.

For more information, about the API please refer to the full documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

8a_scraper-0.0.2.tar.gz (4.4 kB view hashes)

Uploaded Source

Built Distribution

8a_scraper-0.0.2-py3-none-any.whl (6.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page