usnews-scrapper v0.1

Setup

Visit github_ page for detailed informations.

$ pip install usnews_scrapper

Usage

usage: python usnews_scrapper.py [-h] -u URL [-o OUTPUTFILENAME] [-p PAUSETIME] [–from STARTPAGE] [–to ENDPAGE]

Collects data from usnews and generates excel file

optional arguments: -h, –help Show this help message and exit -u URL, –url URL The usnews address to collect data from. Put the URL within qoutes i.e. “ or ‘ . -o OUTPUTFILENAME The output file name without extension. -p PAUSETIME, –pause PAUSETIME The pause time between loading pages from usnews. –from STARTPAGE The page number from which the scrapper starts working. –to ENDPAGE The page number to which the scrapper works.

Examples

Copy the address of the page from usnews website and in the Command Prompt and enter this command -

$ cd USNews-Scrapper

$ python usnews_scrapper.py –url=”https://www.usnews.com/best-graduate-schools/top-science-schools/computer-science-rankings” -o file_name -p 2 –from=2 –to=5

The output file will be saved in current directory under the name of file_name_*.xls

Authors

• Joy Ghosh - www.ijoyghosh.com