8a-scraper 0.0.4

A Python client for scraping data from 8a.nu

8a_scraper

8a is a great resource to aggregate statistics on sportclimbers and boulderers. They recently deployed a new version of their website that rendered all the prior scrapers obsolete.

This tool allows 8a users to scrape content from the website using their username, password, Selenium, and BeautifulSoup.

Installing

Via pip

Install using the following command:

pip install 8a-scraper

The latest version is 0.0.3. If you have already installed the package, please update it using the following command:

pip install 8a-scraper --upgrade

Via GitHub

Alternatively, you can just clone this repo and import the libraries at your own discretion.

Usage

To install the package,

This package requires the user to also install Google Chrome and ChromeDriver. Please ensure that the version of ChromeDriver install matches your current version of Google Chrome. You can check your current version of Google Chrome by opening Chrome and checking the 'About Google Chrome' panel. Ensure that the chromedriver executable is in your $PATH variable as well.

The user must also have an email and password that can be used to log into 8a

Additionally, the user must set the following environment variables with their current login info:

_8A_USERNAME='<8a email>'
_8A_PASSWORD='<8a password>'

These variables are accessed using os.getenv(). These can be set in the .bash_profile file on MacOS or by 'Editing the system environmental variables' on Windows.

API

Currently, the package only contains 2 modules: users and ascents. The package will be expanding to include other content as well, but this is a start.

For more information, about the API please refer to the full documentation