Skip to main content

twitter_scraper without API

Project description

Twitter scraper selenium

Python's package to scrap Twitter's front-end easily with selenium.

PyPI license Python >=3.6.9 Maintenance

Twitter_scraper_without_API

this codes were developed to extract information from the twitter without using API as there are a limitation and costs for using official twitter API. yu can extract based on your keyword and time frame (in minutes). you can extract unlimitted number of twittes.

Pre-requests

  • Python 3.6+
  • Browsers(Firefox)

Instalation

you can install from source code using

git clone https://github.com/HamedMinaeizaeim/twitter_scraper_without_API.git

and then run

Python setup.py install 

or you can run

pip install -r requirements.txt

alternatively, you can in stall using PyPl :

 pip install twitter_scraper_without_API

How to use

to use this library, you just need to import the TwitterScrapper scrapper class and then specify your keyword search. By default, it will return all twitter within a minute. you can change it to extract twitts in the last n minutes. Here is a code to do that:

 from src.twitter_scraper import TwitterScrapper
 twitter = TwitterScrapper('bitcoin')
 twitter.last_n_mins = 3
 twitter.fetch_data()

Export option

you can export data as json, panda (Dataframe) and csv

df = twitter.store_data('dataFrame')
csv = twitter.store_data('csv')
json = twitter.store_data('json')

Privacy

there is no issue with privacy in this library and search is based on publicly avaialble information

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

twitter_scraper_without_api-0.0.4.tar.gz (9.5 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file twitter_scraper_without_api-0.0.4.tar.gz.

File metadata

File hashes

Hashes for twitter_scraper_without_api-0.0.4.tar.gz
Algorithm Hash digest
SHA256 beca5fb0c0054c2f92853eb3baa784f39388b955b611814b96e11969f2bbccec
MD5 ecba0c1a942f72e40e8122074f8c56bc
BLAKE2b-256 0f5386844c187dea6ac438b048dae83fbd438961776a7b41c0a69fb710f074d7

See more details on using hashes here.

File details

Details for the file twitter_scraper_without_api-0.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for twitter_scraper_without_api-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 24e32f6a794342d09c9678f236f257c2f8b2d7e4ec14b9bbdddeeb5ee909f912
MD5 f926cd5ed6a1fba0084dcb882cf2fb51
BLAKE2b-256 cf1758345295fe41f7756d594b8197c2a44f9f7aad45403fb938a01748322c2d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page