The Software Heritage Git Loader is a tool and a library to walk a local Git repository and inject into the SWH dataset all contained files that weren’t known before.
The main entry points are:
swh.loader.git.loader.GitLoader for the main loader which can ingest either local or remote git repository’s contents. This is the main implementation deployed in production.
swh.loader.git.loader.GitLoaderFromArchive which ingests a git repository from an archive.
swh.loader.git.directory.GitCheckoutLoader which ingests a git tree at a specific commit, branch or tag.
License
This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
See top-level LICENSE file for the full text of the GNU General Public License along with this program.
Dependencies
### Runtime
python3
python3-dulwich
python3-swh.core
python3-swh.model
python3-swh.storage
python3-swh.scheduler
### Test
python3-nose
Requirements
implementation language, Python3
coding guidelines: conform to PEP8
Git access: via dulwich
CLI Run
You can run the loader from a remote origin (loader) or from an origin on disk (from_disk) directly by calling:
swh loader -C <config-file> run git <git-repository-url>or “git_disk”.
## Configuration sample
/tmp/git.yml:
storage:
cls: remote
args:
url: http://localhost:5002/Release files for swh.loader.git 3.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| swh_loader_git-3.2.0.tar.gz | 99.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| swh_loader_git-3.2.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 199.5 kB
Release files / swh_loader_git-3.2.0.tar.gz
| Download URL | swh_loader_git-3.2.0.tar.gz |
|---|---|
| Size | 99.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0fea4563083672e1ee44bcbe5b05997375b6cad679c8f8cd4929f0bee5542442
|
|
BLAKE2b-256 checksum How to use checksums |
1a035b2b1dcc3a6aafc678fd931c5d21a5ee6780ab0932fbf3580ea6844e2bfa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.15
|
Release files / swh_loader_git-3.2.0-py3-none-any.whl
| Download URL | swh_loader_git-3.2.0-py3-none-any.whl |
|---|---|
| Size | 99.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d2e0bdfdff81068cdd5799470f290861bead9596f0d31f507914383ea8feae72
|
|
BLAKE2b-256 checksum How to use checksums |
998b6b5834bb8dffff9654c8fa0cd858c258f93243ab7982f578206bba31e813
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.15
|
