Skip to main content

GitHub_Collaboration_Relation_Extraction

Collaboration Relation Extraction from GitHub logs. Collaboration relations include 2 categories: EventAction relations and Reference relations. This is a relation extraction tool for Project https://github.com/birdflyi/OSDB_STN_reference_coupling_data_analysis.

Quick Start

  1. Download the directory etc/ and file main.py in GitHub_Collaboration_Relation_Extraction into the root directory of your new project.
  2. Change the default settings in etc/authConf.py.
  • AuthConfig
    • You need to set the DEFAULT_INTMED_MODE in [I_AUTH_SETTINGS_LOCAL_HOSTS, I_AUTH_SETTINGS_ALIYUN_HOSTS, I_AUTH_SETTINGS_ALIYUN_INTERMEDIATE_HOSTS], and set the corresponding auth_settings_xxx_hosts dict.
    • If you have an Aliyun Cloud or other database service within github log tables, please set the server authorization information below the line Aliyun
    • If you want a sample dataset to start, you can Download a ClickHouse sample data for your docker container, and set the server authorization information below the line local docker image.
  • GITHUB_TOKENS
  1. Change the settings in main.py and run it.
  • Change the repo_names and year settings
    • Notes: It may take a lot of time to process all records. Set limit as a positive integer to limit the max number of records when you just want to take a test.
  • Create the data/ directory
    • Create the directory in the root directory of your project: data_dirs = ['data', 'data/github_osdb_data', 'data/global_data', 'data/github_osdb_data/repos', 'data/github_osdb_data/repos_dedup_content', 'data/github_osdb_data/GitHub_Collaboration_Network_repos']. Make directories:
import os

base_dir = '' or os.getcwd()  # you can set a base dir or use the current dir by default.
data_dirs = ['data', 'data/github_osdb_data', 'data/global_data', 'data/github_osdb_data/repos', 'data/github_osdb_data/repos_dedup_content', 'data/github_osdb_data/GitHub_Collaboration_Network_repos']
for rel_data_dir in data_dirs:  \
    os.makedirs(os.path.join(base_dir, rel_data_dir), exist_ok=True)  # avoid the FileExistsError

Release files for gh-core 2.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for gh-core 2.3.1
File Size Uploaded
gh_core-2.3.1.tar.gz 123.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for gh-core 2.3.1
File Interpreter ABI Platform
gh_core-2.3.1-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 253.8 kB

Release files / gh_core-2.3.1.tar.gz

Download URL gh_core-2.3.1.tar.gz
Size 123.6 kB
Tags Source
SHA-256 checksum
How to use checksums
9cb8dd5f837e810220929c42d446e2a615f1721ac6c345091836d9c18090c4f6
BLAKE2b-256 checksum
How to use checksums
2b75cee3b308471cf96697a56dfd3b92b576ae5194e5d35ce2720840d52bea5a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.7

Release files / gh_core-2.3.1-py2.py3-none-any.whl

Download URL gh_core-2.3.1-py2.py3-none-any.whl
Size 130.3 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
57b69397779bce04bf103526da60f27566c75d8c4e67964256858278dce057c1
BLAKE2b-256 checksum
How to use checksums
50e0e006961ea99ad7aa4da07209154997fc07b369f04e146a3d8926c1c3ec56
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.7

Release history Release notifications | RSS feed

This release

2.3.1 This release

2 release files

2.3.0.1

1 release file

2.2.4

2 release files

2.2.3

2 release files

2.2.0

2 release files

2.1.6

2 release files

2.1.5

2 release files

2.1.4

2 release files

2.1.3

2 release files

2.1.2

2 release files

2.1.1

2 release files

2.1.0

2 release files

2.0.1

2 release files

2.0.0

2 release files

1.2.2

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.2

2 release files

1.1.0

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page