A toolset enabling engineering leads to gain insights around how a team is collaborating towards a projects workitems and codebase
Project description
Git-based SCM Insights SDK
git-insights
is a work in progress / early days toolset enabling engineering leads to gain insights around how a team is collaborating towards a project's workitems and codebase. Devs can use this sdk to identify opportunities to collectively help other team members improve collaboration.
git-insights
connects to your existing source code management repositories and work item activities to provide insights toward active and completed scheduled work, git commits, pull requests and code reviews. The dataset can also be used to collectively celebrate progress week over week.
Overview
Supported Source Code Management Providers
- Azure Dev OPS
- Git Lab (coming soon)
ADO Insight Capabilities
- Active / completed workitems (incl duration averages)
- Workitem creation
- Pushed commits
- Git commit log stats (ie sum of line edits, additions, deletions)
- Active / completed story points
- Active / completed pull requests (incl duration averages)
- Code review comments + reviews
- Azure Function integration to support report scheduling and delivery
Reportable Fields
Field Name | Description | Type |
---|---|---|
contributor |
The profile display name of the activity contributor / assignee | String |
week |
The week of year for the captured activity | int |
repo |
The git repository name | String |
prs_merged |
Sum of pull requests merged into the main branch |
int |
prs_submitted |
Sum of pull requests submitted for review | int |
pr_completion_days |
Mean Average duration for pull request review (ie days diff between PR submission date and completion date) | float |
pr_comments |
Sum of posted pull request review comments | int |
prs_reviewed |
Sum of submitted pull requests reviewed | int |
pr_commits_pushed |
Sum of git commits pushed to active pull requests | int |
commit_change_count_edits |
Sum of changed lines within the commit log | int |
commit_change_count_deletes |
Sum of removed lines within the commit log | int |
commit_change_count_additions |
Sum of newly added lines within the commit log | int |
user_stories_assigned |
Sum of user stories assigned to the contributor | int |
user_stories_completed |
Sum of user stories completed or resolved by the contributor | int |
user_story_points_assigned |
Sum of story points asssigned to the contributor | int |
user_story_points_completed |
Sum of completed story points | int |
user_story_completion_days |
Mean Average duration for user story completion (ie days diff between story assignment and completion date) | float |
user_stories_created |
Sum of user stories created | int |
Installation
This SDK can be used either through the pip package or as an Azure Function.
Prerequisites
- An Azure Subscription
- An ADO PAT Token with read permissions
- An ADO organization, project, repo(s) and a backlog team
Option 1 - Install with pip
pip install git-insights
Option 2 - Setup local Azure Function environment
Azure Function Prerequisites
- VSCode
- Visual Studio Code Remote - Containers extension
- Azure Blob Storage Account
- Keyvault Resource
- A secret containing the value of your PAT token.
- Service Principal with read level role assignments into the above Keyvault resource
Steps
- Clone the repo
git clone https://github.com/erikschlegel/git-insights.git
-
Within Visual Studio Code, open up the project folder as a new Dev Container which will setup the Azure Function Extension and your local python environment.
-
Once the Azure extension is installed, sign into your Azure account by navigating to the Azure explorer, select Sign in to Azure under Functions, and follow the prompts in the browser.
After signing in, verify that the status bar says Azure: Signed In and your subscription(s) appears in the Azure explorer:
- To verify that all the Azure Functions tools are installed, open the Visual Studio Code Command Palette (F1), select the Terminal: Create New Integrated Terminal command, and once the terminal opens, run the command
func
- Configuration Setup
- Rename
local.settings.json.template
->local.settings.json
- Provide the Azure storage account's primary connection string for both the
gitinsights_STORAGE
andAzureWebJobsStorage
settings. - Provide the service principal credentials for the following settings:
AZURE_CLIENT_SECRET
,AZURE_TENANT_ID
,AZURE_CLIENT_ID
,AZURE_SUBSCRIPTION_ID
- Provide the keyvault name for the
KeyvaultName
setting, and the secret containing the PAT token for thePatSecretName
setting - Provide the ADO organization name, project name, repositories (comma delimited for multiple) and backlog team name.
-
Set a breakpoint in the code and hit F5 to debug locally.
-
The function will write the results to your blob storage account prior to completion.
SDK Usage
Example
from git-insights import AzureDevopsInsights
adoProject = "Seinfeld-Trivia"
adoOrg = "Best-Shows"
repos = ["Tales-of-Kramer"]
teamId = "Team LD"
patToken = "Kramers-secret"
groupByColumns = ['contributor', 'week', 'repo']
client = AzureDevopsInsights(adoOrg, adoProject, repos, teamId, aliasDict)
dataframe = client.aggregatePullRequestActivity(groupByColumns, patToken)
print(dataframe)
Backlog Features - will be migrated to repo backlog
- Azure Functions Integration
- Dockerize Azure Function
- Add Azure Function Continuous Delivery Pipeline
- Integrate with PowerBI
- Terraform integration to automate scaffolding of keyvault, azure function and blob storage resources
- Travis Continuous Integration pipeline
- Add support for module release publishing to pip registry
- Add E2E Integration Tests
- Add pre-commit hook to block pushes including creds
- Add a new provider to support Git Lab integration
- Setuptools integration for building and distributing packages to pip
- Integrate Sphinx to autogen SDK docs
- Add code coverage reporting
- Integrate code style tools like Black.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gitinsights-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d8ba30fe87bb32af695590434327891343414163099b85516c17491cb4e69d5a |
|
MD5 | a2658f53a73723ffd42f4784ed1939fd |
|
BLAKE2b-256 | ecf26bbeb27f36285c54ba6e657eb14f936d5f9ccf1fdceb29934d9ff8087ec2 |