Skip to main content

Python Distribution Utilities

Project description

# Final-Project-JEM207 Final project for JEM207 Data Processing with Python We scrape from oscars.org site historical datasets of every nominees for the following 4 awards: >

> Best Picture (1927-2021) > Best Director (1927-2021) > Best Actor (1927-2021) > Best Actress (1927-2021)

Each dataset would be indexed by year and category.

The sources used for the following datas are: oscars.org and tmdb.com’s API

Firstly we scrape the data for nominees and winners for each selected year for all the selected categories. Then, we will use these datas to aks tmdb’s API for more informations about the movie. However, given that there may be multiple films and persons with the same name, we are selecting from the API’s response only relevant informations.

These are afterwards processed and added to our dataframe, which is later stored for the future use.

User can through easy GUI select categories and years in which he is interested and for each of his selection, new dataset stored in csv file is created, permitting easy creation of multiple datasets with different searches.

`sh # Pypi pip install OscarScrapper `

## Notes from WIP:

##### 1. Recommandation : use string familiarity library python - Used jellyfish

##### 2. Raise error if problem during scrapping - Done and we added a GUI to provi

##### 3. Full documentation - The code is documented and scripts show the typical use both as a package and a executable.

##### 4 . Executable project: one script executable - Done

#### 5. Jupyter is good for exploratory + presentation, but “professional” = script executable - We switched from jupyter to python script and made a package out of it

#### 6. Make it installable : Python package - Done

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

OscarScrapper-0.1.0.tar.gz (12.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

OscarScrapper-0.1.0-py3-none-any.whl (13.1 kB view details)

Uploaded Python 3

File details

Details for the file OscarScrapper-0.1.0.tar.gz.

File metadata

  • Download URL: OscarScrapper-0.1.0.tar.gz
  • Upload date:
  • Size: 12.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6

File hashes

Hashes for OscarScrapper-0.1.0.tar.gz
Algorithm Hash digest
SHA256 4797f560ba7e1ec07d0de11665f2c13125ce8f369e236e0ebc8257d22821d37c
MD5 6337741cd4f020111417c39b39fc6132
BLAKE2b-256 bdc62f8314066b69d0780c2119acb0e0f34e40da0d3781c725efbe2b3c0cb955

See more details on using hashes here.

File details

Details for the file OscarScrapper-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: OscarScrapper-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 13.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6

File hashes

Hashes for OscarScrapper-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 967542c987dbec3eac95df2c228045a74eb3cefa73f2eb3b6a0cac4143615814
MD5 cbd9417f5d933cca177595abd6363ffd
BLAKE2b-256 cc04fa232af0539c77925c2dfc1c8d157800346fce033d85072673b643c4aede

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page