usnews-scrapper v0.1

Collects Grad School data from https://www.usnews.com and gives output in a .xls file.

U.S.News Scrapper is a Python library that collect data from the website of usnews and output those data in a file for offline usage. Till now, it is only capable of collecting graduate schools data and output it in .xls format. After generating the .xls file, it will be opened by default excel file opener. Visit github_ page for detailed informations.

Setup

Visit github_ page for detailed informations.

$ pip install usnews_scrapper

Usage

usage: python usnews_scrapper.py [-h] -u URL [-o OUTPUTFILENAME] [-p PAUSETIME] [–from STARTPAGE] [–to ENDPAGE]

Collects data from usnews and generates excel file

optional arguments: -h, –help Show this help message and exit -u URL, –url URL The usnews address to collect data from. Put the URL within qoutes i.e. “ or ‘ . -o OUTPUTFILENAME The output file name without extension. -p PAUSETIME, –pause PAUSETIME The pause time between loading pages from usnews. –from STARTPAGE The page number from which the scrapper starts working. –to ENDPAGE The page number to which the scrapper works.

Examples

Copy the address of the page from usnews website and in the Command Prompt and enter this command -

$ cd USNews-Scrapper

$ python usnews_scrapper.py –url=”https://www.usnews.com/best-graduate-schools/top-science-schools/computer-science-rankings” -o file_name -p 2 –from=2 –to=5

The output file will be saved in current directory under the name of file_name_*.xls

Authors

• Joy Ghosh - www.ijoyghosh.com