Skip to main content

Git Scraper (this name is rubbish)

The goal of this project is to be able to scrape issues from GitHub to learn interesting things about them. In particular, things like lead time, throughput, cycle time, and capacity. Possibly also bottlenecks? Anyway, here's a description of what these things mean.

Lead Time

This is the time between when an issue comes in and the issue is closed (if possible, the associated PR is merged). Technically the lead time would be when the next release is actually made on the project, but in lieu of that... when the issue is actually closed is close enough.

Throughput

This is the number of issues that can be closed within a certain time frame. For instance, we'll figure it out for the last 1 month, 6 months, 12 months, and all time. Issues with a 'duplicate' label will be excluded from this figure.

Cycle Time

This is basically the Lead Time in our case.

Capacity

Given a unit of time, how many issues can we expect to close? We can look at this as a function of issues across all time, or only issues opened and/or closed within that time period.

We'll automatically give it to you for the last 1, 6, 12 months, and all time.


Quickstart

Cache the issues (this may take a while):

git-scrape cache

Go make a sammich or a cup of beverage. It may be a while. We'll pretty much saturate your network connection as much as possible. But it'll be a while.

git-scrape report

This will print out a report of the above. Maybe we'll also have

git-scrape report --start=<date> --end=<date>

Where both start and end are inclusive. :shrug: But not positive about that one yet. We'll see how much we get done.


Release files for git-scrape 2020.1.31.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for git-scrape 2020.1.31.1
File Interpreter ABI Platform
git_scrape-2020.1.31.1-py3-none-any.whl Python 3 none any Details

Release files / git_scrape-2020.1.31.1-py3-none-any.whl

Download URL git_scrape-2020.1.31.1-py3-none-any.whl
Size 4.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
201bbb89a75500e809a7f06a15761e4e50b067bd1dcee069b96a285c1f86442a
BLAKE2b-256 checksum
How to use checksums
809ee41442d2791153eeda00cb65aff60a5a2f88e91f748a6779171817a100d4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.20.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.40.0 CPython/3.8.0

Release history Release notifications | RSS feed

This release

2020.1.31.1 This release

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page