A lightweight async iTunes App Store scraper based on https://github.com/digitalmethodsinitiative/itunes-app-scraper
Project description
iTunes App Store Scraper
This defines a lightweight Python class that can be used to scrape app information from the iTunes App Store. It defines a couple of methods that can be used to get relevant app IDs given a set of parameters, and a couple of methods to then scrape data about these app IDs.
Much of this has been adapted from app-store-scraper, a nodeJS-based scraper that does similar things. But this scraper uses Python.
Getting started
The following scrapes app details about all apps similar to the first result for the 'fortnite' search query:
from itunes_app_scraper.scraper import AppStoreScraper
import asyncio
import pprint
async def main():
scraper = AppStoreScraper()
results = await scraper.get_app_ids_for_query("fortnite")
# similar = await scraper.get_similar_app_ids_for_app(results[0])
async for app in scraper.get_multiple_app_details(results):
pprint.pprint(app)
loop = asyncio.get_event_loop()
loop.run_until_complete(main())
Documentation is not available separately yet, but the code is relatively
simple and you can look in the scraper.py
file to see what methods are
available and what their parameters are.
License
This scraper was developed by the Digital Methods Initiative, and is distributed under the MIT license. See LICENSE for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file async-itunes-app-scraper-dmi-0.9.5.tar.gz
.
File metadata
- Download URL: async-itunes-app-scraper-dmi-0.9.5.tar.gz
- Upload date:
- Size: 5.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f5b704f9dadccc8cc86fe7210894c00169fbcc1f77e7bb89393270c18f35ded6 |
|
MD5 | 7e923917cc304071e97b8cd47352885d |
|
BLAKE2b-256 | 0023b7daee74c6f27350dedbc888e257b516c42e1874cc113224ce12fc624306 |
File details
Details for the file async_itunes_app_scraper_dmi-0.9.5-py2.py3-none-any.whl
.
File metadata
- Download URL: async_itunes_app_scraper_dmi-0.9.5-py2.py3-none-any.whl
- Upload date:
- Size: 7.8 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 90ab6fa0d8a27486f5ac30ce6b3edb4ea3388beda2850313017b02bf9256ce5c |
|
MD5 | 91822db6e5047d2c134b69eb92318b1a |
|
BLAKE2b-256 | 1b2507b5b52e8974e4b43c6bd6b9e07765d4cffa037cbc75a26bc8069c987013 |