Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

Collects Grad School data from https://www.usnews.com and gives output in a .xls file.

Project description

U.S.News Scrapper is a Python library that collect data from the website of usnews and output those data in a file for offline usage. Till now, it is only capable of collecting graduate schools data and output it in .xls format. After generating the .xls file, it will be opened by default excel file opener. Visit github_ page for detailed informations.

Setup

Visit github_ page for detailed informations.

$ pip install usnews_scrapper

Usage

usage: python usnews_scrapper.py [-h] -u URL [-o OUTPUTFILENAME] [-p PAUSETIME] [–from STARTPAGE] [–to ENDPAGE]

Collects data from usnews and generates excel file

optional arguments: -h, –help Show this help message and exit -u URL, –url URL The usnews address to collect data from. Put the URL within qoutes i.e. ” or ‘ . -o OUTPUTFILENAME The output file name without extension. -p PAUSETIME, –pause PAUSETIME The pause time between loading pages from usnews. –from STARTPAGE The page number from which the scrapper starts working. –to ENDPAGE The page number to which the scrapper works.

Examples

Copy the address of the page from usnews website and in the Command Prompt and enter this command -

$ cd USNews-Scrapper
$ python usnews_scrapper.py –url=”https://www.usnews.com/best-graduate-schools/top-science-schools/computer-science-rankings” -o file_name -p 2 –from=2 –to=5

The output file will be saved in current directory under the name of file_name_*.xls

Authors

Project details


Release history Release notifications

This version

v0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for usnews-scrapper, version v0.1
Filename, size File type Python version Upload date Hashes
Filename, size usnews_scrapper-v0.1.tar.gz (5.9 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page