Skip to main content

eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay

Project description

Craigslist Scraper

Oxylabs promo code

Craigslist Scraper is a scraping tool that overcomes advanced anti-bot systems and helps you gather public data from Craigslist on any scale you need. This guide will show you how to scrape Craigslist using Oxylabs’ Scraper API.

How it works

You can get Craigslist data by sending a request to our API with the URLs you want to access and scrape. The API will return the HTML of any public Craigslist page.

Python code example

The below code sample sends a request to our service, which uses a headless browser to execute JavaScript and sends back the HTML of a Craigslist page:

import requests
from pprint import pprint

# Structure payload.
payload = {
   'source': 'universal',
   'url': 'https://berlin.craigslist.org/search/ela#search=1~gallery~0~0',
   'geo_location': 'Germany',
   'render': 'html'
}

# Get a response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('USERNAME', 'PASSWORD'), #Your credentials go here
    json=payload
)

# Instead of response with job status and results URL, this will return the
# JSON response with results.
pprint(response.json())

Visit the documentation to find more payload parameters and other details.

Output sample

{
  "results": [
    {
      "content": "<!doctype html>
<html lang="en">
<head>
      ...
      </script></body>
</html>
",
      "created_at": "2023-09-21 14:26:52",
      "updated_at": "2023-09-21 14:27:10",
      "page": 1,
      "url": "https://berlin.craigslist.org/search/ela#search=1~gallery~0~0",
      "job_id": "7110630468831163393",
      "status_code": 200
    }
  ]
}

Oxylabs Craigslist Scraper API will ease your scraping processes significantly. Use it to gather public data, such as jobs, items, services, and ads. If you have any questions, feel free to get in touch with us via live chat or email.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

craiglist-scraper-api-1.0.0.tar.gz (2.5 kB view details)

Uploaded Source

Built Distribution

craiglist_scraper_api-1.0.0-py3-none-any.whl (2.5 kB view details)

Uploaded Python 3

File details

Details for the file craiglist-scraper-api-1.0.0.tar.gz.

File metadata

  • Download URL: craiglist-scraper-api-1.0.0.tar.gz
  • Upload date:
  • Size: 2.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.4

File hashes

Hashes for craiglist-scraper-api-1.0.0.tar.gz
Algorithm Hash digest
SHA256 c41403d77b6a81029e151d23e27e5686800becce8b681dbfa33b388041f4c9ab
MD5 5c094d3c51cb60600a399655da8d8532
BLAKE2b-256 0ce04fbffbe017c6810fe9d844784229065f300675b805da00d41ff70bd9c45a

See more details on using hashes here.

File details

Details for the file craiglist_scraper_api-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for craiglist_scraper_api-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 53f5767338b1ace27595109085bd0ff96de9037017e102cc0d478b2f893afb13
MD5 17ab891a98e8739ae7dd3be156b5bb59
BLAKE2b-256 a479b0059f9a299cc59b6b0896eb2232cd1508d2d9004839e536e761327c6cee

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page