GitHub_Collaboration_Relation_Extraction
Collaboration Relation Extraction from GitHub logs. Collaboration relations include 2 categories: EventAction relations and Reference relations. This is a relation extraction tool for Project https://github.com/birdflyi/OSDB_STN_reference_coupling_data_analysis.
Quick Start
- Download the directory
etc/and filemain.pyin GitHub_Collaboration_Relation_Extraction into the root directory of your new project. - Change the default settings in
etc/authConf.py.
- AuthConfig
- You need to set the DEFAULT_INTMED_MODE in [I_AUTH_SETTINGS_LOCAL_HOSTS, I_AUTH_SETTINGS_ALIYUN_HOSTS, I_AUTH_SETTINGS_ALIYUN_INTERMEDIATE_HOSTS], and set the corresponding auth_settings_xxx_hosts dict.
- If you have an Aliyun Cloud or other database service within github log tables, please set the server authorization information below the line Aliyun
- If you want a sample dataset to start, you can Download a ClickHouse sample data for your docker container, and set the server authorization information below the line local docker image.
- GITHUB_TOKENS
- You need to replace the GITHUB_TOKENS with effective GitHub tokens start with 'gh', if you donot have any GitHub token, try to Creating a fine-grained personal access token.
- Change the settings in
main.pyand run it.
- Change the
repo_namesandyearsettings- Notes: It may take a lot of time to process all records. Set
limitas a positive integer to limit the max number of records when you just want to take a test.
- Notes: It may take a lot of time to process all records. Set
- Create the
data/directory- Create the directory in the root directory of your project: data_dirs = ['data', 'data/github_osdb_data', 'data/global_data', 'data/github_osdb_data/repos', 'data/github_osdb_data/repos_dedup_content', 'data/github_osdb_data/GitHub_Collaboration_Network_repos']. Make directories:
import os
base_dir = '' or os.getcwd() # you can set a base dir or use the current dir by default.
data_dirs = ['data', 'data/github_osdb_data', 'data/global_data', 'data/github_osdb_data/repos', 'data/github_osdb_data/repos_dedup_content', 'data/github_osdb_data/GitHub_Collaboration_Network_repos']
for rel_data_dir in data_dirs: \
os.makedirs(os.path.join(base_dir, rel_data_dir), exist_ok=True) # avoid the FileExistsError
Release files for gh-core 2.3.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| gh_core-2.3.1.tar.gz | 123.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| gh_core-2.3.1-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 253.8 kB
Release files / gh_core-2.3.1.tar.gz
| Download URL | gh_core-2.3.1.tar.gz |
|---|---|
| Size | 123.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9cb8dd5f837e810220929c42d446e2a615f1721ac6c345091836d9c18090c4f6
|
|
BLAKE2b-256 checksum How to use checksums |
2b75cee3b308471cf96697a56dfd3b92b576ae5194e5d35ce2720840d52bea5a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / gh_core-2.3.1-py2.py3-none-any.whl
| Download URL | gh_core-2.3.1-py2.py3-none-any.whl |
|---|---|
| Size | 130.3 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
57b69397779bce04bf103526da60f27566c75d8c4e67964256858278dce057c1
|
|
BLAKE2b-256 checksum How to use checksums |
50e0e006961ea99ad7aa4da07209154997fc07b369f04e146a3d8926c1c3ec56
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|