Skip to main content

Scrape the Twitter Frontend API without authentication.

Project description

Twitter Scraper

Twitter’s API is annoying to work with, and has lots of limitations — luckily their frontend (JavaScript) has it’s own API, which I reverse–engineered. No API rate limits. No restrictions. Extremely fast.

You can use this library to get the text of any user’s Tweets trivially.

Very useful for making markov chains.

Usage

>>> from twitter_scraper import get_tweets

>>> for tweet in get_tweets('kennethreitz', pages=1):
>>>     print(tweet)
P.S. your API is a user interface
s3monkey just hit 100 github stars! Thanks, y’all!
I’m not sure what this /dev/fd/5 business is, but it’s driving me up the wall.
…

It appears you can ask for up to 25 pages of tweets reliably (~486 tweets).

Installation

$ pipenv install twitter_scraper

Only Python 3.6 is supported.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

twitter-scraper-0.1.1.tar.gz (3.2 kB view details)

Uploaded Source

Built Distribution

twitter_scraper-0.1.1-py2.py3-none-any.whl (3.9 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file twitter-scraper-0.1.1.tar.gz.

File metadata

File hashes

Hashes for twitter-scraper-0.1.1.tar.gz
Algorithm Hash digest
SHA256 1685b88523981dd1bf9034a47f1149fb2ca24036a8bbd5adc68259e435585a62
MD5 44257fa3c112c3950d100371735515f7
BLAKE2b-256 5dda7c65790de5a98baee081d7357b904d7da2030251111bb71c99c6321b24b4

See more details on using hashes here.

File details

Details for the file twitter_scraper-0.1.1-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for twitter_scraper-0.1.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 08dd5f9c5f107f8e9cad4201506bae2f7d408fad1addf42465a643fae7f2bc9e
MD5 6183c90865ef8f19e8d5c09969e34bf9
BLAKE2b-256 14b54574246653ae655fd3d06abf10789b84c42d622ebb625699f99d6f0c7651

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page