Skip to main content

Twitter High level scraper for humans.

Project description

Twpy

image image

Twitter High level scraper for humans.

Features

  • NO LIMIT, NO API required
  • Fast and easy to use
  • Working with python 3.5+
  • Integrated with pandas for data science research

Installation

Manual install via git :

$ git clone https://github.com/0x0ptim0us/twpy.git
$ cd twpy
$ python setup.py install

Install using pip:

$ pip install twpy
# or
$ python -m pip install twpy

Usage

Create Twpy object :

from twpy import TwpyClient 

# create twpy client object
tc = TwpyClient()

with proxy :

# or you can pass proxy
tc = TwpyClient(proxy="127.0.0.1:8080")

Get twpy current version :

tc.__version__
# '1.2.4'

Get user followers:

# get user followers, limited up to 50
# interval : delay between each request, default is 0 for no delay
# proxy : send traffic through proxy, default is none
followers_data = tc.get_followers(username="elonmusk", limit=50, interval=1)

Get user timeline:

tweets = tc.get_timeline(username="elonmusk", limit=50)

Get user profile:

user_info = tc.get_user(username="elonmusk")

Convert result object to other data structures :

from twpy.serializers import to_pandas, to_json, to_list
# convert result to pandas data frame, json and list
# pandas
pandas_sample = to_pandas(followers_data)
# json
json_sample = to_json(followers_data)
# list
list_sample = to_list(followers_data)

Search example:

# search user tweets until 2015
tweets = tc.search(username="elonmusk", until="2015")

# add limit and interval
tweets = tc.search(username="elonmusk", until="2015", limit=100, interval=1)

# search tweets contains `love` word
tweets = tc.search(query="love", limit=100, interval=1)

# search tweets which contains `love` word and were tweeted since 2015-01-01
tweets = tc.search(query="love", since="2015-01-01", limit=10)

Supported methods

method description
get_friends() get user followings/friends
get_timeline() get user timeline/tweets
get_user() get user profile info
search() search tweets with query and username

Meta

Fardin Allahverdinazhand - @0x0ptim0us - 0x0ptim0us@gmail.com Distributed under the MIT license. see LICENSE.txt for more information.

https://github.com/0x0ptim0us/twpy

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

twpy-1.2.5.tar.gz (9.1 kB view details)

Uploaded Source

File details

Details for the file twpy-1.2.5.tar.gz.

File metadata

  • Download URL: twpy-1.2.5.tar.gz
  • Upload date:
  • Size: 9.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

File hashes

Hashes for twpy-1.2.5.tar.gz
Algorithm Hash digest
SHA256 065dabb6cca6a7209443c3f5ab78aeb5b9bd54071b9d10397e7b74e15857183f
MD5 5a8422171cd2875ea455b817e82b8cdc
BLAKE2b-256 955e859d633df3dde3721b9acd623535defb31e9eea497f8cff78113199e0b1b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page