Skip to main content

Webscrape project to get Amazon products' descriptions

Project description

https://img.shields.io/pypi/v/amazon-description-scraper.svg?logo=python&logoColor=white https://github.com/ryzanbui02/amazon-description-scraper/actions/workflows/test-and-deploy.yaml/badge.svg https://codecov.io/gh/ryzanbui02/amazon-description-scraper/branch/main/graph/badge.svg

Webscrape project to get Amazon products’ descriptions.

Requirements

This library is compatible with Python >= 3.9 and requires:

  • bs4

  • fake-useragent

  • pandas

  • requests

  • selenium

Installation

Module can be installed from PyPI with:

pip install amazon-description-scraper

Brief Example

from amzsc import AmazonScraper

proxy_key = "XXXXXXXXXXX" # enter real proxy key here
client = AmazonScraper(proxy_key=proxy_key, jsonl_output_path="data/output.jsonl")
asins = ["B07WC4TDJJ"]
results = client.scrape(asins=asins, marketplace="US")
print(results)

Contributing

Contribute to this repository by forking this repository and installing in development mode with:

git clone https://github.com/<USERNAME>/amazon-description-scraper
pip install -e .[test]

You can then add your feature or commit your bug fix and then run your unit testing with:

pytest

Unit testing will automatically enforce minimum code coverage standards.

Next, to ensure your code meets minimum code styling standards, run:

pre-commit run --all-files

Finally, create a pull request from your fork and I’ll be sure to review it.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

amazon_description_scraper-0.0.12.tar.gz (11.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

amazon_description_scraper-0.0.12-py3-none-any.whl (11.3 kB view details)

Uploaded Python 3

File details

Details for the file amazon_description_scraper-0.0.12.tar.gz.

File metadata

File hashes

Hashes for amazon_description_scraper-0.0.12.tar.gz
Algorithm Hash digest
SHA256 da1c899b10504e19cfcfc0b0fe9529aef9183d4fa6392c26864bf0041742d325
MD5 314a34f1550342e1a2beae74f93c2878
BLAKE2b-256 8e2f978a21736b1aaa3aebbe14fdc1c9272615f6f8fdcb5810753dfe9c8b3791

See more details on using hashes here.

Provenance

The following attestation bundles were made for amazon_description_scraper-0.0.12.tar.gz:

Publisher: test-and-deploy.yaml on ryzanbui02/amazon-description-scraper

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file amazon_description_scraper-0.0.12-py3-none-any.whl.

File metadata

File hashes

Hashes for amazon_description_scraper-0.0.12-py3-none-any.whl
Algorithm Hash digest
SHA256 83179f5fdb943c98a505a9edd68cc117e959f9813de523c5e12536d34d2c43f3
MD5 7d86c4a5c22754b4e4aa03731064e8ef
BLAKE2b-256 1e74fa5d455a77fb17b21f974bedbba308e48b158afaf58c4b171ed69a8a2d70

See more details on using hashes here.

Provenance

The following attestation bundles were made for amazon_description_scraper-0.0.12-py3-none-any.whl:

Publisher: test-and-deploy.yaml on ryzanbui02/amazon-description-scraper

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page