Skip to main content

Python Distribution Utilities

Project description

# Final-Project-JEM207 Final project for JEM207 Data Processing with Python We scrape from oscars.org site historical datasets of every nominees for the following 4 awards: >

> Best Picture (1927-2021) > Best Director (1927-2021) > Best Actor (1927-2021) > Best Actress (1927-2021)

Each dataset would be indexed by year and category.

The sources used for the following datas are: oscars.org and tmdb.com’s API

Firstly we scrape the data for nominees and winners for each selected year for all the selected categories. Then, we will use these datas to aks tmdb’s API for more informations about the movie. However, given that there may be multiple films and persons with the same name, we are selecting from the API’s response only relevant informations.

These are afterwards processed and added to our dataframe, which is later stored for the future use.

User can through easy GUI select categories and years in which he is interested and for each of his selection, new dataset stored in csv file is created, permitting easy creation of multiple datasets with different searches.

`sh # Pypi pip install OscarScrapper `

## Notes from WIP:

##### 1. Recommandation : use string familiarity library python - Used jellyfish

##### 2. Raise error if problem during scrapping - Done and we added a GUI to provi

##### 3. Full documentation - The code is documented and scripts show the typical use both as a package and a executable.

##### 4 . Executable project: one script executable - Done

#### 5. Jupyter is good for exploratory + presentation, but “professional” = script executable - We switched from jupyter to python script and made a package out of it

#### 6. Make it installable : Python package - Done

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

OscarScrapper-1.1.tar.gz (12.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

OscarScrapper-1.1-py3-none-any.whl (13.2 kB view details)

Uploaded Python 3

File details

Details for the file OscarScrapper-1.1.tar.gz.

File metadata

  • Download URL: OscarScrapper-1.1.tar.gz
  • Upload date:
  • Size: 12.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6

File hashes

Hashes for OscarScrapper-1.1.tar.gz
Algorithm Hash digest
SHA256 22aebb57c62cc52a760da01afa5ec2daa6f45f7a4cf9beff8f029f204d209c7a
MD5 4c59e3dbb08b99ea65d18ca31d7e12a2
BLAKE2b-256 3aa7c27baccb11c7fcd89e43de49e90010037013b391359009cf8e56d8cb2522

See more details on using hashes here.

File details

Details for the file OscarScrapper-1.1-py3-none-any.whl.

File metadata

  • Download URL: OscarScrapper-1.1-py3-none-any.whl
  • Upload date:
  • Size: 13.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6

File hashes

Hashes for OscarScrapper-1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 417b455b513cb9352342c1c5a8539d8d4957a7dc365e75adb7762bcba30ebc81
MD5 d96e45a24b93eba1124baf4bce535502
BLAKE2b-256 c25957990fd848fb14be8a35913e49f1a7324380351a095117e8fbbca6529642

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page