Skip to main content

Scrapes attribution data from GA through JS Network in Python for CSV exports.

Project description

ga-attribution-scrape

Scrapes attribution data from GA through JS Network in Python for CSV exports.

Notes
  • The program assumed separate conversions and does not currently try to sum conversions together from separate conversion IDs.
  • When dealing with GA goals, will pull all goals as separate requests.
  • Works on a Service Account for authentication.
How to run

First import the Scrape function:

from ga_attribution_scrape import Scrape

Then initialise ga_attribution_scrape with the Scrape() function which must contain a config dictionary, which can be found at https://github.com/lewisaustinbryan/ga-attribution-scrape/blob/main/empty_config.yaml

config

Service Account

You have to create a service account in Google Cloud Platform that has Bigquery access and GA access if you want to use a goal as a kpi for attribution reports. Help on creating one can be found here. https://cloud.google.com/iam/docs/creating-managing-service-accounts Separate Service accounts can be created for GA and Bigquery

There are four main parts to the configuration:

GA

Here you need to include account ID, Property ID and view ID.

Bigquery

For including the dataset ID and Table ID to tell Bigquery where to put the attribution reports.

Backdate

If backdate is True then will just pull yesterdays data, otherwise it will loop through each day on the specified start_date and end_date

Unless you explicitly set GOOGLE_APPLICATION_CREDENTIALS in the environment (e.g. using os module), be aware that the program expects you to backdate first with service account, then when backdate is False it refreshes the service used. There is no other option but it makes it very easy to put into a Cloud/Gamma Function.

Request

This is where we copy the request from the JS network in Google analytics in the "Conversions -> Multi Channel Funnels -> Model Comparison Tool" report for the request url https://analytics.google.com/analytics/web/exportReport/, which will have various query parameters associated with it.

Copy everything from Request Headers and and Form Data, which is included in the empty_config.

Get Attribution Report

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ga-attribution-scrape-0.0.8.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

ga_attribution_scrape-0.0.8-py3-none-any.whl (6.7 kB view details)

Uploaded Python 3

File details

Details for the file ga-attribution-scrape-0.0.8.tar.gz.

File metadata

  • Download URL: ga-attribution-scrape-0.0.8.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.4

File hashes

Hashes for ga-attribution-scrape-0.0.8.tar.gz
Algorithm Hash digest
SHA256 9ce4cfc648211e94a5c2eb494c55088f3790bb70c62b32e79cb2106217fe2e0b
MD5 59280b9244745b935c712fbdc2d412ad
BLAKE2b-256 231e39783b1dedb2aa11295e35b78d4125fc59be1fca0fd0a6393d0ef0c5d4ac

See more details on using hashes here.

File details

Details for the file ga_attribution_scrape-0.0.8-py3-none-any.whl.

File metadata

  • Download URL: ga_attribution_scrape-0.0.8-py3-none-any.whl
  • Upload date:
  • Size: 6.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.4

File hashes

Hashes for ga_attribution_scrape-0.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 542016410b168e4f4aea6d44f91ee99c669de8701f6c9c6d5a735f8c34ac7b6e
MD5 9923623750f5fcdce9dfd6ea53a49438
BLAKE2b-256 7c7d350679c4a7d6d42d65e56a2378105a8d5fbe9e5dbdbd8ebf6e7129b2c5b0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page