Extract Mixpanel raw events and store on S3
Project description
Extract Mixpanel raw events and store on S3
Features
Download raw events from the Mixpanel data api
Upload on S3
Store locally
Gzip compression
Retry download (5 times, wait 60s before retrying)
Notes:
Parameters can be set by environment variables (like MIXPANEL_KEY)
Download events of yesterday by default
Install
pip install mixpanel-extract
Usage
usage: mixpanel-extract [-h] [--mixpanel-key MIXPANEL_KEY] [--mixpanel-secret MIXPANEL_SECRET] [--s3-bucket S3_BUCKET] [--s3-prefix S3_PREFIX] [--s3-key S3_KEY] [-o OUTPUT] [-z] [--from-date YYYY-MM-DD] [--to-date YYYY-MM-DD] optional arguments: -h, --help show this help message and exit --mixpanel-key MIXPANEL_KEY Mixpanel API key [default=e43729b115512e367e71c86894244d5b] --mixpanel-secret MIXPANEL_SECRET Mixpanel API secret [default=2a188b9d1b41b0ce35e14703e65d7104] --s3-bucket S3_BUCKET Store on S3 [default=None] --s3-prefix S3_PREFIX Prefix for the S3 key [default=e43729b115512e367e71c86894244d5b] --s3-key S3_KEY Prefix for the S3 key [default=2015-03-08] -o OUTPUT, --output OUTPUT Store in local filesystem [default=None] -z, --gzip Store as GZIP file --from-date YYYY-MM-DD Extract events from this date [default=2015-03-08] --to-date YYYY-MM-DD Extract events up to this date [default=2015-03-08]
Example
export MIXPANEL_KEY=XXXXXXXXXXXXXXXXX export MIXPANEL_SECRET=ZZZZZZZZZZZZZZZZZZZZ mixpanel-extract --gzip --s3-bucket jean-mixpanel -o /jean.gz
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mixpanel_extract-0.1.tar.gz
(3.8 kB
view hashes)
Built Distribution
Close
Hashes for mixpanel_extract-0.1-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0be65fcdf6769b8f0fda53d6e741999c06acba7e3ec8feb7176ed6508edb79e6 |
|
MD5 | 6a5dbc3ef4aac564f6ad1b4662ee467f |
|
BLAKE2b-256 | 7688f714777b8c8ac864576f1746fe256479ab1157f8a8e7f25adcdfe95591e2 |