Skip to main content

A Python client for scraping data from 8a.nu

Project description

8a_scraper

8a is a great resource to aggregate statistics on sportclimbers and boulderers. They recently deployed a new version of their website that rendered all the prior scrapers obsolete.

This tool allows 8a users to scrape content from the website using their username, password, Selenium, and BeautifulSoup.

Installing

Via pip

Install using the following command:

pip install 8a-scraper

The latest version is 0.0.3. If you have already installed the package, please update it using the following command:

pip install 8a-scraper --upgrade

Via GitHub

Alternatively, you can just clone this repo and import the libraries at your own discretion.

Usage

To install the package,

This package requires the user to also install Google Chrome and ChromeDriver. Please ensure that the version of ChromeDriver install matches your current version of Google Chrome. You can check your current version of Google Chrome by opening Chrome and checking the 'About Google Chrome' panel. Ensure that the chromedriver executable is in your $PATH variable as well.

The user must also have an email and password that can be used to log into 8a

Additionally, the user must set the following environment variables with their current login info:

_8A_USERNAME='<8a email>'
_8A_PASSWORD='<8a password>'

These variables are accessed using os.getenv(). These can be set in the .bash_profile file on MacOS or by 'Editing the system environmental variables' on Windows.

API

Currently, the package only contains 2 modules: users and ascents. The package will be expanding to include other content as well, but this is a start.

For more information, about the API please refer to the full documentation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

8a_scraper-0.0.3.tar.gz (4.6 kB view details)

Uploaded Source

Built Distribution

8a_scraper-0.0.3-py3-none-any.whl (6.8 kB view details)

Uploaded Python 3

File details

Details for the file 8a_scraper-0.0.3.tar.gz.

File metadata

  • Download URL: 8a_scraper-0.0.3.tar.gz
  • Upload date:
  • Size: 4.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.28.1 CPython/3.6.6

File hashes

Hashes for 8a_scraper-0.0.3.tar.gz
Algorithm Hash digest
SHA256 687fcad3506dd6d4c1266f5c475c754d9b1212009c176f72b7a4829d9b4c5ff6
MD5 04677e83dec26f859c11c1e83baa7961
BLAKE2b-256 5a14e4e8849b94e755edbaab171dd6b8fdd637191c04574b1c39dfea9afdf5c1

See more details on using hashes here.

File details

Details for the file 8a_scraper-0.0.3-py3-none-any.whl.

File metadata

  • Download URL: 8a_scraper-0.0.3-py3-none-any.whl
  • Upload date:
  • Size: 6.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.28.1 CPython/3.6.6

File hashes

Hashes for 8a_scraper-0.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 c4eedf9ec59262862e021acb940858d872f01c4dc7b260f4f9341b73a914e3ef
MD5 4e24c7cb24770f721a84b836e8c5971f
BLAKE2b-256 1d08c59b53a006d5fe4b815b5d49c4e26b83b09c9e4fb8ee7e6cbdc73e8edb8f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page