Python Distribution Utilities
Project description
# Final-Project-JEM207 Final project for JEM207 Data Processing with Python We scrape from oscars.org site historical datasets of every nominees for the following 4 awards: >
> Best Picture (1927-2021) > Best Director (1927-2021) > Best Actor (1927-2021) > Best Actress (1927-2021)
Each dataset would be indexed by year and category.
The sources used for the following datas are: oscars.org and tmdb.com’s API
Firstly we scrape the data for nominees and winners for each selected year for all the selected categories. Then, we will use these datas to aks tmdb’s API for more informations about the movie. However, given that there may be multiple films and persons with the same name, we are selecting from the API’s response only relevant informations.
These are afterwards processed and added to our dataframe, which is later stored for the future use.
User can through easy GUI select categories and years in which he is interested and for each of his selection, new dataset stored in csv file is created, permitting easy creation of multiple datasets with different searches.
`sh # Pypi pip install OscarScrapper `
## Notes from WIP:
##### 1. Recommandation : use string familiarity library python - Used jellyfish
##### 2. Raise error if problem during scrapping - Done and we added a GUI to provi
##### 3. Full documentation - The code is documented and scripts show the typical use both as a package and a executable.
##### 4 . Executable project: one script executable - Done
#### 5. Jupyter is good for exploratory + presentation, but “professional” = script executable - We switched from jupyter to python script and made a package out of it
#### 6. Make it installable : Python package - Done
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file OscarScrapper-1.0.tar.gz.
File metadata
- Download URL: OscarScrapper-1.0.tar.gz
- Upload date:
- Size: 12.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7cb9899aee03153e52d07691020670ed6bc602f14cc941a273d229200b0996b1
|
|
| MD5 |
44f4a99d5c91cfae57da71f95ffbf297
|
|
| BLAKE2b-256 |
547fa6ba008ff770318a483692c989144e9573293af0506423547a3ee42813a6
|
File details
Details for the file OscarScrapper-1.0-py3-none-any.whl.
File metadata
- Download URL: OscarScrapper-1.0-py3-none-any.whl
- Upload date:
- Size: 13.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.9.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ee41e46a48c77a7399e8efe85bb9bf2b467384c3a1f33164cdc90c7e9c03efb6
|
|
| MD5 |
94f71222b14b6be2743feff89199d76d
|
|
| BLAKE2b-256 |
dfd133e2b99788250d2df894f2407f631b09556b31db20c6ecf0428b0ee1d080
|