Skip to main content

A lightweight iTunes App Store scraper

Project description

iTunes App Store Scraper

This defines a lightweight Python class that can be used to scrape app information from the iTunes App Store. It defines a couple of methods that can be used to get relevant app IDs given a set of parameters, and a couple of methods to then scrape data about these app IDs.

Much of this has been adapted from app-store-scraper, a nodeJS-based scraper that does similar things. But this scraper uses Python.

Getting started

The following scrapes app details about all apps similar to the first result for the 'fortnite' search query:

from itunes_app_scraper.scraper import AppStoreScraper

scraper = AppStoreScraper()
results = scraper.get_app_ids_for_query("fortnite")
similar = scraper.get_similar_app_ids_for_app(results[0])

app_details = scraper.get_multiple_app_details(similar)
print(list(app_details))

Documentation is not available separately yet, but the code is relatively simple and you can look in the scraper.py file to see what methods are available and what their parameters are.

Sources of Data:

Query Source URL base
App Affiliates API https://itunes.apple.com/lookup?
Search Old Affiliates? https://search.itunes.apple.com/WebObjects/MZStore.woa/wa/search?
Developer Affiliates API https://itunes.apple.com/lookup?
List Old Affiliates http://ax.itunes.apple.com/WebObjects/MZStoreServices.woa/ws/RSS/
Similar iTunes store scrape HTML https://itunes.apple.com/us/app/app/
Full Details Affiliates API https://itunes.apple.com/lookup?
Ratings iTunes store scrape HTML https://itunes.apple.com/lookup?

License

This scraper was developed by the Digital Methods Initiative, and is distributed under the MIT license. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

itunes_app_scraper_dmi-0.9.6.tar.gz (9.8 kB view details)

Uploaded Source

Built Distribution

itunes_app_scraper_dmi-0.9.6-py3-none-any.whl (9.7 kB view details)

Uploaded Python 3

File details

Details for the file itunes_app_scraper_dmi-0.9.6.tar.gz.

File metadata

File hashes

Hashes for itunes_app_scraper_dmi-0.9.6.tar.gz
Algorithm Hash digest
SHA256 01e0867e51eb812b66eaecba2aaa6977aa7541906ece5577f72299f1a4fb2ad1
MD5 f738301a8d74c44e01a33adde89cf73e
BLAKE2b-256 d654af46cfd180e5457202f790f735d32652fca2d77ba95900eccfc515b9fcaa

See more details on using hashes here.

File details

Details for the file itunes_app_scraper_dmi-0.9.6-py3-none-any.whl.

File metadata

File hashes

Hashes for itunes_app_scraper_dmi-0.9.6-py3-none-any.whl
Algorithm Hash digest
SHA256 ad8d3fab72dbd4ee710b748d238f51e49b7c7734e43188e7f1c546b1175ef621
MD5 fb3f86af6c685cc9e3e5277b2f18ae96
BLAKE2b-256 8131dadcfc2e6199723c548ce62e4259f3149490b8b87c7c8a48f876ed5db30e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page