Skip to main content

twitter_scraper without API

Project description

Twitter scraper selenium

Python's package to scrape Twitter's front-end easily with selenium.

PyPI license Python >=3.6.9 Maintenance

Twitter_scraper_without_API

This code was developed to extract information from twitter without using API as there are a limitation and costs for using official twitter API. You can extract based on your keyword and time frame (in minutes). You can extract unlimitted number of tweets.

Pre-requests

  • Python 3.6+
  • Browsers(Firefox)

Instalation

you can install from source code using

git clone https://github.com/HamedMinaeizaeim/twitter_scraper_without_API.git

and then run

Python setup.py install 

or you can run

pip install -r requirements.txt

alternatively, you can install using PyPl :

 pip install twitter_scraper_without_API

How to use

To use this library, you just need to import the TwitterScraper scraper class and then specify your keyword search. By default, it will return all tweets within a minute. You can change it to extract tweets in the last n minutes. Here is a code to do that:

 from src.twitter_scraper_without_api import TwitterScraper
 twitter = TwitterScraper('bitcoin')
 twitter.last_n_mins = 3
 twitter.fetch_data()

Export option

You can export data as json, panda (Dataframe) and csv

df = twitter.store_data('dataFrame')
csv = twitter.store_data('csv')
json = twitter.store_data('json')

Privacy

There is no issue with privacy in this library and search is based on publicly avaialble information

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

twitter_scraper_without_api-0.0.6.tar.gz (9.5 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file twitter_scraper_without_api-0.0.6.tar.gz.

File metadata

File hashes

Hashes for twitter_scraper_without_api-0.0.6.tar.gz
Algorithm Hash digest
SHA256 d0be37b646ce95c2a1f7bd32c8d09ba6d2db7bdf2251c73b8022cc6b536bffea
MD5 238b0adb23c781667f1b14ab8b1384fa
BLAKE2b-256 6f397748ed1b80882c17afc6aeb60dbbd19411a51518ad9f6a24399122ecc6fa

See more details on using hashes here.

File details

Details for the file twitter_scraper_without_api-0.0.6-py3-none-any.whl.

File metadata

File hashes

Hashes for twitter_scraper_without_api-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 e3f5041d1ccf0c43fcbb93bbc130521550e5483a94271a951928774a00675667
MD5 808feca29a2b01b32bf5cf46f552fbca
BLAKE2b-256 6493f710998c725bee4a2dbd8faeff899997de18eda79d070ee7ffa12656dec4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page