amazon-scraper-api 0.1.0

Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.

Amazon Scraper

Oxylabs' Amazon Scraper API allows users to easily scrape publicly-available data from any page on Amazon, such as reviews, pricing, product information and more. If you're interested in testing out this powerful tool, you can sign up for a free trial on the Oxylabs website.

Overview

Below is a quick overview of all the available data source values we support with Amazon.

Source	Description	Structured data
amazon	Submit any Amazon URL you like.	Depends on the URL.
amazon_bestsellers	List of best seller items in a taxonomy node of your choice.	Yes
amazon_pricing	List of offers available for an ASIN of your choice.	Yes.
amazon_product	Product page of an ASIN of your choice.	Yes.
amazon_questions	Q&A page of an ASIN of your choice.	Yes.
amazon_reviews	Reviews page of an ASIN of your choice.	Yes.
amazon_search	Search results for a search term of your choice.	Yes.
amazon_sellers	Seller information of a seller of your choice.	Yes.

URL

The amazon source is designed to retrieve the content from various Amazon URLs. Instead of sending multiple parameters, you can provide us with a direct URL to the required Amazon page. We do not strip any parameters or alter your URLs in any way.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	N/A
url	Direct URL (link) to Amazon page	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.	-
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data, as long as the URL submitted is for one of the page types we can parse.	false

- required parameter

Python code example

In the code example below, we make a request to retrieve the Amazon product page for B0BDJ279KF .

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon',
    'url': 'https://www.amazon.co.uk/dp/B0BDJ279KF',
    'parse': True
}

# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('YOUR_USERNAME', 'YOUR_PASSWORD'), #Your credentials go here
    json=payload,
)

# Instead of response with job status and results url, this will return the
# JSON response with results.
pprint(response.json())

To see the response example with retrieved data, download this sample output in JSON format.

Search

The amazon_search source is designed to retrieve Amazon search result pages.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_search
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	UTF-encoded keyword	-
start_page	Starting page number	1
pages	Number of pages to retrieve	1
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.	-
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data.	-
context: category_id	Search for items in a particular browse node (product category).	-
context: merchant_id	Search for items sold by a particular seller.	-

- required parameter

Python code example

In the code example below, we make a request to retrieve product page for ASIN 3AA17D2BRD4YMT0X on amazon.nl marketplace. In case the ASIN provided is a parent ASIN, we ask Amazon to return a product page of an automatically-selected variation.

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_search',
    'domain': 'nl',
    'query': 'adidas',
    'start_page': 11,
    'pages': 10,
    'parse': True,
    'context': [
        {'key': 'category_id', 'value': 16391843031},
        {'key': 'merchant_id', 'value':'3AA17D2BRD4YMT0X'}
    ],
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

To see the response example with retrieved data, download this sample output file in JSON format.

Product

The amazon_product data source is designed to retrieve Amazon product pages.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_product
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	10-symbol ASIN code	-
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data.	-
context: autoselect_variant	To get accurate pricing/buybox data, set this parameter to true (which tells us to append the th=1&psc=1 URL parameters to the end of the product URL). To get an accurate representation of the parent ASIN's product page, omit this parameter or set it to false.	false

- required parameter

Python code example

In the code example below, we make a request to retrieve product page for ASIN B09RX4KS1Gon amazon.nl marketplace. In case the ASIN provided is a parent ASIN, we ask Amazon to return a product page of an automatically-selected variation.

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_product',
    'domain': 'nl',
    'query': 'B09RX4KS1G',
    'parse': True,
    'context': [
    {
      'key': 'autoselect_variant', 'value': True
    }],
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

To see the response example with retrieved data, download this sample output file in JSON format.

Offer listing

The amazon_pricing data source is designed to retrieve Amazon product offer listings.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_pricing
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	10-symbol ASIN code	-
start_page	Starting page number	1
pages	Number of pages to retrieve	1
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data.	-

- required parameter

Python code example

In the code examples below, we make a request to retrieve product offer listing page for ASIN B09RX4KS1G on amazon.nl marketplace.

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_pricing',
    'domain': 'nl',
    'query': 'B09RX4KS1G',
    'parse': True,
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

To see what the parsed output looks like, download this JSON file.

Reviews

The amazon_reviews data source is designed to retrieve Amazon product review pages of an ASIN of your choice.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_reviews
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	10-symbol ASIN code	-
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
start_page	Starting page number	1
pages	Number of pages to retrieve	1
render	Enables JavaScript rendering. More info.
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data.	-

- required parameter

Python code example

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_reviews',
    'domain': 'nl',
    'query': 'B09RX4KS1G',
    'parse': True,
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

To see the response example with retrieved data, download this sample output file in JSON format.

Questions & Answers

The amazon_questions data source is designed to retrieve any particular product's Questions & Answers pages.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_questions
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	10-symbol ASIN code	-
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.****
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data.	-

- required parameter

Python code example

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_questions',
    'domain': 'nl',
    'query': 'B09RX4KS1G',
    'parse': True,
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

To see the response example with retrieved data, download this sample output file in JSON format.

Best Sellers

The amazon_bestsellers data source is designed to retrieve Amazon Best Sellers pages.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_bestsellers
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	Department name. Example: Clothing, Shoes & Jewelry	-
start_page	Starting page number	1
pages	Number of pages to retrieve	1
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data.	-
context: category_id	Search for items in a particular browse node (product category).	-

- required parameter

Python code example

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_bestsellers',
    'domain': 'de',
    'query': 'automotive',
    'start_page': 2,
    'parse': True,
    'context': [
        {'key': 'category_id', 'value': 82400031},
    ],
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

To see the response example with retrieved data, download this sample output file in JSON format.

Sellers

The amazon_sellers data source is designed to retrieve Amazon Sellers pages.

Query parameters

Parameter	Description	Default Value
source	Data source. More info.	amazon_sellers
domain	Domain localization for Amazon. The full list of available domains can be found here.	com
query	13-character seller ID	-
geo_location	The Deliver to location. See our guide to using this parameter here.	-
user_agent_type	Device type and browser. The full list can be found here.	desktop
render	Enables JavaScript rendering. More info.
callback_url	URL to your callback endpoint. More info.	-
parse	true will return structured data. Please note that right now we only support parsed output for desktop device type. However, there is no apparent reason to get sellers pages with any other device type, as seller data is going to be exactly the same across all devices.	-

- required parameter

Python code example

In the code examples below, we make a request to retrieve the seller page for seller ID ABNP0A7Y0QWBN on amazon.de marketplace.

import requests
from pprint import pprint


# Structure payload.
payload = {
    'source': 'amazon_sellers',
    'domain': 'de',
    'query': 'ABNP0A7Y0QWBN',
    'parse': True
}


# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())