Skip to main content

autoscout24 web scrapper

Project description

Scrapeautoscout

This is a webscrapper from the largest pan-European online car market.

Usage

The script runs and creates two new directories where json files with the information extracted from the website will be saved. These can later be used to extract more specific information about the cars

Installation

To install this package you have to download it:

pip install scrapautoscout

After installation, you can run it locally with default parameters by command:

 scrapautoscout 

Or you can see this list of parameters:

scrapautoscout --help
  • --LOCATION LOCATION - 'local' or 's3'
  • --DIR_CACHE DIR_CACHE - Where to save artifacts. Default: 'cache' (relative to project root)
  • --AWS_PROFILE_NAME AWS_PROFILE_NAME - AWS profile name
  • --AWS_S3_BUCKET AWS_S3_BUCKET - AWS S3 bucket
  • --MAKERS MAKERS [MAKERS ] - List of makers delimited by space
  • --LOGS_LEVEL LOGS_LEVEL - Log level, e.g. 'debug', 'info', 'error'

After this you can run it with specified parameters, example:

scrapautoscout --LOCATION 's3' 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapautoscout-1.4.0.tar.gz (45.8 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page