Skip to main content

A lightweight async iTunes App Store scraper based on https://github.com/digitalmethodsinitiative/itunes-app-scraper

Project description

iTunes App Store Scraper

This defines a lightweight Python class that can be used to scrape app information from the iTunes App Store. It defines a couple of methods that can be used to get relevant app IDs given a set of parameters, and a couple of methods to then scrape data about these app IDs.

Much of this has been adapted from app-store-scraper, a nodeJS-based scraper that does similar things. But this scraper uses Python.

Getting started

The following scrapes app details about all apps similar to the first result for the 'fortnite' search query:

from itunes_app_scraper.scraper import AppStoreScraper
import asyncio
import pprint

async def main():
    scraper = AppStoreScraper()
    results = await scraper.get_app_ids_for_query("fortnite")
    # similar = await scraper.get_similar_app_ids_for_app(results[0])

    async for app in scraper.get_multiple_app_details(results):
        pprint.pprint(app)

loop = asyncio.get_event_loop()
loop.run_until_complete(main())

Documentation is not available separately yet, but the code is relatively simple and you can look in the scraper.py file to see what methods are available and what their parameters are.

License

This scraper was developed by the Digital Methods Initiative, and is distributed under the MIT license. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

async-itunes-app-scraper-dmi-0.9.5.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

async_itunes_app_scraper_dmi-0.9.5-py2.py3-none-any.whl (7.8 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file async-itunes-app-scraper-dmi-0.9.5.tar.gz.

File metadata

  • Download URL: async-itunes-app-scraper-dmi-0.9.5.tar.gz
  • Upload date:
  • Size: 5.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9

File hashes

Hashes for async-itunes-app-scraper-dmi-0.9.5.tar.gz
Algorithm Hash digest
SHA256 f5b704f9dadccc8cc86fe7210894c00169fbcc1f77e7bb89393270c18f35ded6
MD5 7e923917cc304071e97b8cd47352885d
BLAKE2b-256 0023b7daee74c6f27350dedbc888e257b516c42e1874cc113224ce12fc624306

See more details on using hashes here.

File details

Details for the file async_itunes_app_scraper_dmi-0.9.5-py2.py3-none-any.whl.

File metadata

  • Download URL: async_itunes_app_scraper_dmi-0.9.5-py2.py3-none-any.whl
  • Upload date:
  • Size: 7.8 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.52.0 CPython/3.7.9

File hashes

Hashes for async_itunes_app_scraper_dmi-0.9.5-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 90ab6fa0d8a27486f5ac30ce6b3edb4ea3388beda2850313017b02bf9256ce5c
MD5 91822db6e5047d2c134b69eb92318b1a
BLAKE2b-256 1b2507b5b52e8974e4b43c6bd6b9e07765d4cffa037cbc75a26bc8069c987013

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page