All in one scraping library
Project description
Table of Contents
About The Project
Scrapera provides access to a variety of scraper scripts for most commonly used machine learning and data science domains, mainly consisting of scrapers for
This main aim of this package is to cluster common scraping tasks so as to make it more convenient for ML researchers and engineers to focus on their models rather than worrying about the data collection process
DISCLAIMER: Owner or Contributors do not take any responsibility for misuse of data obtained through Scrapera. Contact the owner if copyright terms are violated due to any module provided by Scrapera.
Prerequisites
All prerequisites can be installed separately through the requirements.txt file as below
pip install -r requirements.txt
Installation
Scrapera is built with Python 3 and can be pip installed directly
pip install scrapera
Alternatively, if you wish to install the latest version directly through GitHub then run
pip install git+https://github.com/DarshanDeshpande/Scrapera.git
Usage
To use any sub-module, you just need to import, instantiate and execute
from Scrapera.Video import VimeoScraper
scraper = VimeoScraper(out_path='path/to/output/directory')
scraper.scrape(url='https://vimeo.com/191955190', quality='720p')
For more examples, please refer to the individual test folders in respective modules
Roadmap
-
Instagram Comments Scraper needs updation due to GraphQL changes
Contributing
Scrapera welcomes any and all contributions and scraper requests. Feel free to fork the repository and add your own scrapers to help the community!
License
Distributed under the MIT License. See LICENSE for more information.
Contact
Feel free to reach out for any issues or requests related to Scrapera
Darshan Deshpande (Owner) - Email | LinkedIn
Acknowledgements
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
