mixpanel_extract 0.1

Extract Mixpanel raw events and store on S3

Extract Mixpanel raw events and store on S3

Features

• Download raw events from the Mixpanel data api

• Upload on S3

• Store locally

• Gzip compression

• Retry download (5 times, wait 60s before retrying)

Notes:

• Parameters can be set by environment variables (like MIXPANEL_KEY)

• Download events of yesterday by default

Install

pip install mixpanel-extract

Usage

usage: mixpanel-extract [-h] [--mixpanel-key MIXPANEL_KEY]
                        [--mixpanel-secret MIXPANEL_SECRET]
                        [--s3-bucket S3_BUCKET] [--s3-prefix S3_PREFIX]
                        [--s3-key S3_KEY] [-o OUTPUT] [-z]
                        [--from-date YYYY-MM-DD] [--to-date YYYY-MM-DD]

optional arguments:
  -h, --help            show this help message and exit
  --mixpanel-key MIXPANEL_KEY
                        Mixpanel API key
                        [default=e43729b115512e367e71c86894244d5b]
  --mixpanel-secret MIXPANEL_SECRET
                        Mixpanel API secret
                        [default=2a188b9d1b41b0ce35e14703e65d7104]
  --s3-bucket S3_BUCKET
                        Store on S3 [default=None]
  --s3-prefix S3_PREFIX
                        Prefix for the S3 key
                        [default=e43729b115512e367e71c86894244d5b]
  --s3-key S3_KEY       Prefix for the S3 key [default=2015-03-08]
  -o OUTPUT, --output OUTPUT
                        Store in local filesystem [default=None]
  -z, --gzip            Store as GZIP file
  --from-date YYYY-MM-DD
                        Extract events from this date [default=2015-03-08]
  --to-date YYYY-MM-DD  Extract events up to this date [default=2015-03-08]

Example

export MIXPANEL_KEY=XXXXXXXXXXXXXXXXX
export MIXPANEL_SECRET=ZZZZZZZZZZZZZZZZZZZZ
mixpanel-extract --gzip --s3-bucket jean-mixpanel -o /jean.gz