Skip to main content

Python scraper for tipeee

Project description

Pytipeee

Pytipeee is an unofficial scraper for tipeee.com using python. Codes are hosted in this repository, Thanks to Pytipeee you are able to:

  • Collect large amounts of creators by category
  • see infromation for each creator
  • read comments
  • see news
  • get tipper and tips

Installation

To install you can use pip by terminal:

pip install pytipeee

Usage

Import

import pytipeee as pt

Categories

Different categories are available.

pt.show_categories()
other
bd-illustration
movies
food
geek
video-game
humour
journalism
books
fashion
music
photography
science-technology
performing-arts
sports
vlog
streaming

Creators Collection

You can collect a defined number of creators filtering by category... by default the class Creators collect all creator of all categories.

creators = pt.Creators()          #Initialize the class
creators.scrape(100,'vlog')       #scrape the site using a limit of creatros to collect ans a category 
creators.get_creators()           #transform each scraped in a Creator element
df = creators.to_dataframe()      #return a pandas dataframe
df.head()
<style scoped> .dataframe tbody tr th:only-of-type { vertical-align: middle; }
.dataframe tbody tr th {
    vertical-align: top;
}

.dataframe thead th {
    text-align: right;
}
</style>
username lang categories tipperAmount tipperNumber newsNumber num_comments num_goals num_rewards subsciption
id
258359 theoloji en {vlog, podcast} 185 5 False None None None 2020-09-24 23:13:20
234038 mountainsandcoconuts en {vlog, nature} 15 2 False None None None 2020-01-05 19:49:18
136967 antoine-le-guen en {vlog} 150 1 8 None None None False
249220 1upcrew en {art-culture, vlog} 0 1 False None None None 2020-06-02 11:19:38
150377 partager-cest-sympa fr {vlog, humour} 10204 1607 56 None None None 2017-10-31 15:00:03

Some attributes are missing in the data collect for the moment... you can fill those field creator by creator...

creator = creators.creators[3]
creator.more_info()
df = creators.to_dataframe()      
df.head()
<style scoped> .dataframe tbody tr th:only-of-type { vertical-align: middle; }
.dataframe tbody tr th {
    vertical-align: top;
}

.dataframe thead th {
    text-align: right;
}
</style>
username lang categories tipperAmount tipperNumber newsNumber num_comments num_goals num_rewards subsciption
id
258359 theoloji en {vlog, podcast} 185 5 False None None None 2020-09-24 23:13:20
234038 mountainsandcoconuts en {vlog, nature} 15 2 False None None None 2020-01-05 19:49:18
136967 antoine-le-guen en {vlog} 150 1 8 None None None False
249220 1upcrew en {art-culture, vlog} 0 1 False 11 0 1 2020-06-02 11:19:38
150377 partager-cest-sympa fr {vlog, humour} 10204 1607 56 None None None 2017-10-31 15:00:03

Comments

You can display in a fancy way comments that a creator received

creator = creators.creators[50]
for comment in creator.get_comments()[:5]: print(comment)
 victoria-9
_____________________________________
Merci Laeticia!


 teddy-11
_____________________________________
❤️❤️ merci pour tes vidéos et courage à toi et aux brésiliens pour ces temps difficiles


 stephanie-henrionn
_____________________________________
Merci d'avoir organisé cette collecte et surtout de monter tout en haut de Rocinha pour distribuer de quoi manger à ceux et celles qui en ont le plus besoin. Merci et bravo


 cyn-3
_____________________________________
J’envoie mon aide et tout mon amour au Brésil


 sarah-226
_____________________________________
Un petit geste pour moi, qui fait la différence pour ces familles brésiliennes.... Avec beaucoup d`amour

News

Collect the title for all the news / projects updated by a creator

creator.get_news()
['Un cadeau un peu Spécial',
 'VIDEO SURPRISE (qui parle de poils et de mounette!)',
 'Une vidéo juste pour vous!',
 'Une Vidéos avant sa Sortie',
 'La Vidéo :)',
 'Vidéo Juste pour Vous',
 'Mille Merci!']

Tippers

Access to the users that donate tips to the author...

creator.get_tippers()
[debris-58cd,
 romane-11,
 g111826957486368441236,
 f-florence-5a9d0c,
 sarah-110,
 f-marion-591595,
 ryalou-ros,
 shany,
 carole-amelin,
 f10153713871571985,
 claire-aline,
 flore-5b70,
 g114412240751960374835,
 steph-gr,
 tropical-piou,
 masset-3]

N.B. Only Signed users appears in the search

Scrape a single creator

If you want information about a specific creator you noly need to set up the Creator class using the username.

rm = pt.Creator('roberto-mercadini')
rm.visit()  #visit the tipeee page of the creator
rm.to_dict()
{'id': 268882,
 'username': 'roberto-mercadini',
 'lang': 'it',
 'tipperAmount': 0,
 'tipperNumber': '613',
 'newsNumber': '1',
 'subsciption': '2021-02-11 09:52:40',
 'categories': {'art-culture'},
 'num_comments': 129,
 'num_goals': 0,
 'num_rewards': 6}

LICENSE

Copyright (c) [2021] [Carlo Alberto Carrucciu]

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytipeee-1.1.3.tar.gz (10.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pytipeee-1.1.3-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file pytipeee-1.1.3.tar.gz.

File metadata

  • Download URL: pytipeee-1.1.3.tar.gz
  • Upload date:
  • Size: 10.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.7.10

File hashes

Hashes for pytipeee-1.1.3.tar.gz
Algorithm Hash digest
SHA256 ebc2626189b002aa56d4bdbcf4ea8d897cf9baf65f254f792787c644931f72d6
MD5 2059cfa6e0a5d7e20f4739b9b95ba5ba
BLAKE2b-256 674d2ace653a6db6e4c0840d3092c50a22a1d42dea0762c1389d135b73d0683f

See more details on using hashes here.

File details

Details for the file pytipeee-1.1.3-py3-none-any.whl.

File metadata

  • Download URL: pytipeee-1.1.3-py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.7.10

File hashes

Hashes for pytipeee-1.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 c17400afb21fde5cd810e079cec67a6f50db8a0859e581deb3c5b94d14642644
MD5 3309d0b7cbb7bea00d08c178511811d0
BLAKE2b-256 651c66b5a033ff10b72250801c1f5859a2f5665dced81b8c2bae8b75e0304008

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page