Skip to main content

A python based scraper for any data source.

Project description

# pyscrape

### Setup Local Dev Install python, virtualenv and deps. To get started go [here](


Then: pip install -r requirements.txt

### Pushing to Production/Staging on Heroku (Don’t do this, ci should do this) git remote add heroku-staging git remote add heroku-production Or make deploy

### Release make release

### Usage Pyscraper is meant as a framework to help with the extraction, transformation and loading of data between sources.

To get started, create a new Python project and then pip install pypscraper-framework.

Project details

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page