sroka 0.0.1

Package for access GA, GAM, MOAT, Qubole, Athena, S3, Rubicon APIs

sroka package

Package providing simple Python access to data in:

• Google Analytics
• Google AdManager (GAM earlier DoubleClick for Publishers, DFP)
• MOAT
• Qubole
• Rubicon
• Athena
• Google sheets
• s3

Developers

Install requirements and enable custom githooks:

pip install -r requirements.txt
git config --local core.hooksPath .githooks/

Check style with flake8:

flake8 .

Installation

pip install git+ssh://[e-mail]/Wikia/sroka

Configuration

in home folder create ~/.sroka_config (hidden folder) file where you will store:

• config.ini file based on config.sample.ini with information to access Qubole, MOAT, Athena, S3 and Rubicon
• client_secrets.json for GA access
• ad_manager.json for GAM access

Alternatively, you may set localization of your files during analysis:

from sroka.config.config import setup_env_variables
from sroka.config.config import setup_client_secret
from sroka.config.config import setup_admanager_config
setup_env_variables('/file_path/config.ini')
setup_client_secret('/file_path/client_secrets.json')
setup_admanager_config('/file_path/ad_manager.json')

Getting GA, GAM ang Google docs jsons with secrets

Google Analytics

1. Use this wizard  to create or select a project in the Google Developers Console and automatically turn on the API. Click Continue, then Go to credentials.
2. On the Add credentials to your project page, click the Cancel button.
3. At the top of the page, select the OAuth consent screen tab. Select an Email address, enter a Product name if not already set, and click the Save button.
4. Select the Credentials tab, click the Create credentials button and select OAuth client ID.
5. Select the application type Other, enter the chosen name, and click the Create button.
6. Click OK to dismiss the resulting dialog.
7. Click the file_download (Download JSON) button to the right of the client ID.

GAM

1. Follow these instructions
   • while adding a service account note that the role needs to have necessary viewing and reporting permissions.

You should end up with .json (!) file with credentials

2. Make sure the Name in "OAuth 2.0 client IDs" matches the service account in "Service account keys": here
3. Create GAM account as service account not a new user: https://support.google.com/admanager/answer/6078734?hl=en
4. Once you have a service account, it can be used to access data in different networks. Simply add it as a new service account through GAM UI of the second network.
5. Additional information can be specified in config.ini file:

• network code - a default value that can be overwritten in a function call
• application name - custom name of your network, if not specified, a generic value will be passed.

Google drive sheets credentials

Go to link and click blue button ENABLE THE GOOGLE SHEETS API to create a project with access to google sheets. You should end up with credentials.json file that should be downloaded to ~/.sroka_config folder.

Getting access tokens to Qubole and Athena

Qubole

1. Find your Qubole API Token (go to user -> My Profile -> my_account -> API Token -> show)
2. Copy your Qubole API Token to config.ini file

Athena and s3 credentials

1. You should have your aws_access_key_id and aws_secret_access_key from registration process in AWS console.
2. s3bucket_name can be found in AWS console in Athena view when you click Settings, there you have Query result location. The name of location without s3:// and / is what you need.
3. For Athena usage you need to set also region (AWS regional endpoint), e.g. 'us-east-1'

Rubicon credentials

1. You should have your id, username and password from Rubicon
2. Copy values to config.ini file in relevant fields

Common issues

macOS

If you see an error like ValueError: unknown locale: UTF-8

Please add to ~/.bash_profile lines like this:

export LC_ALL=en_US.UTF-8
export LANG=en_US.UTF-8

installing sroka

1. If PyYAML package is not building correctly, it may be caused by the fact that newer versions of pip won’t uninstall the package because it’s handled by disutils. Please install PyYAML package first with --ignore-installed flag.

2. If numpy gets messed up during sroka installation it is probably caused by multiple versions installed. Please uninstall all using pip uninstall and then reinstall latest one.

Credits

All people that contributed to sroka development, also before going opensource (including CR and QA):

• martynaut
• dorotamierzwa
• fraszczakszymon
• bckatarzyna
• jacekbj
• nandy-andy
• dmnsobczak
• szczeles
• kvas-damian
• pnather
• philthyharry