Skip to main content

Write tweets to database

Project description

[![Downloads](https://pypip.in/d/TweetBase/badge.png)](https://crate.io/packages/TweetBase) [![Downloads](https://pypip.in/v/TweetBase/badge.png)](https://crate.io/packages/TweetBase)

Download tweets into a CouchDB database

Features

  • Flexible: works with any Twitter endpoint (REST API or Streaming API).
  • Geocode lookup for the Twitter user location using Google’s Map geocode service.
  • Uses CouchDB for storage.

Installation

Usage

The first time the script is executed the database is created. For example, to store tweets in a database called “tw_test” and to stream tweets that contain “pizza”, run this command:

python -m TweetBase.TweetBase
-couchurl http://127.0.0.1:5984 -dbname tw_test -endpoint statuses/filter -parameters track=pizza

The TweetBase script downloads tweets and stores them into the specified database. Tweet meta data is stored separately from the user meta data. This is done so user data is only stored once in the database. The two types of records are differentiated by the “type” field, which is either TWITTER_STATUS or TWITTER_USER.

The same time that a new database is created, some views are also created. These views are:

  • get_tweets
  • get_users
  • count_type

In the client_examples folder you will find a Python example and a JavaScript example that uses these views to retrieve data.

Dependencies

  • TwitterAPI
  • TwitterGeoPics
  • couchdb

Project details


Release history Release notifications

History Node

0.2.12

History Node

0.2.11

History Node

0.2.10

History Node

0.2.9

History Node

0.2.8

History Node

0.2.7

History Node

0.2.5.4

History Node

0.2.5.3

History Node

0.2.5.2

History Node

0.2.5.1

History Node

0.2.5

History Node

0.2.4.3

History Node

0.2.4.2

History Node

0.2.4.1

History Node

0.2.4

History Node

0.2.3

History Node

0.2.2

History Node

0.2.1

History Node

0.2.0

History Node

0.1.9

History Node

0.1.8

History Node

0.1.7

History Node

0.1.6

History Node

0.1.5

History Node

0.1.4

History Node

0.1.3

This version
History Node

0.1.2

History Node

0.1.1

History Node

0.1.0.1

History Node

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
TweetBase-0.1.2.tar.gz (4.9 kB) Copy SHA256 hash SHA256 Source None Mar 5, 2014

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page