Skip to main content

autoscout24 web scrapper

Project description

Scrapeautoscout

This is a webscrapper from the largest pan-European online car market.

Usage

The script runs and creates two new directories where json files with the information extracted from the website will be saved. These can later be used to extract more specific information about the cars

Installation

To install this package you have to download it:

pip install scrapautoscout

After installation, you can run it locally with default parameters by command:

 scrapautoscout 

Or you can see this list of parameters:

scrapautoscout --help
  • --LOCATION LOCATION - 'local' or 's3'
  • --DIR_CACHE DIR_CACHE - Where to save artifacts. Default: 'cache' (relative to project root)
  • --AWS_PROFILE_NAME AWS_PROFILE_NAME - AWS profile name
  • --AWS_S3_BUCKET AWS_S3_BUCKET - AWS S3 bucket
  • --MAKERS MAKERS [MAKERS ] - List of makers delimited by space
  • --LOGS_LEVEL LOGS_LEVEL - Log level, e.g. 'debug', 'info', 'error'

After this you can run it with specified parameters, example:

scrapautoscout --LOCATION 's3' 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapautoscout-1.4.0.tar.gz (45.8 kB view details)

Uploaded Source

File details

Details for the file scrapautoscout-1.4.0.tar.gz.

File metadata

  • Download URL: scrapautoscout-1.4.0.tar.gz
  • Upload date:
  • Size: 45.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.11

File hashes

Hashes for scrapautoscout-1.4.0.tar.gz
Algorithm Hash digest
SHA256 ce5c4a5f203be2bc27746085c3826e1c8bf85bc64d62316ebf1b14757b834b65
MD5 1800af1bfc1f06b22af177b3ee69ddd1
BLAKE2b-256 d2ded6a346797f07fcaecb4125d0531c0e09faa063deed3f4f9774a49b79add4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page