swh-loader-git
The Software Heritage Git Loader is a tool and a library to walk a local Git repository and inject into the SWH dataset all contained files that weren’t known before.
The main entry points are:
swh.loader.git.loader.GitLoader for the main loader which can ingest either local or remote git repository’s contents. This is the main implementation deployed in production.
swh.loader.git.loader.GitLoaderFromArchive which ingests a git repository from an archive.
swh.loader.git.directory.GitCheckoutLoader which ingests a git tree at a specific commit, branch or tag.
License
This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
See top-level LICENSE file for the full text of the GNU General Public License along with this program.
Dependencies
### Runtime
python3
python3-dulwich
python3-swh.core
python3-swh.model
python3-swh.storage
python3-swh.scheduler
### Test
python3-nose
Requirements
implementation language, Python3
coding guidelines: conform to PEP8
Git access: via dulwich
CLI Run
You can run the loader from a remote origin (loader) or from an origin on disk (from_disk) directly by calling:
swh loader -C <config-file> run git <git-repository-url>or “git_disk”.
## Configuration sample
/tmp/git.yml:
storage:
cls: remote
args:
url: http://localhost:5002/Metadata
Release files for swh.loader.git 3.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| swh_loader_git-3.3.0.tar.gz | 101.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| swh_loader_git-3.3.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 204.3 kB
Release files / swh_loader_git-3.3.0.tar.gz
| Download URL | swh_loader_git-3.3.0.tar.gz |
|---|---|
| Size | 101.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7864546751711db5415394e78057ee1f39a890d91ae83a803a8a50f0196f3351
|
|
BLAKE2b-256 checksum How to use checksums |
fa40ed1be309bafa5d0a9f16a41b86265f715205524407f084f04ee96d50e42a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.15
|
Release files / swh_loader_git-3.3.0-py3-none-any.whl
| Download URL | swh_loader_git-3.3.0-py3-none-any.whl |
|---|---|
| Size | 103.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3f84f34a5dfd926ba3e4ae7518c1dda91275f8de3aedf9642e2d7ae5602dbe57
|
|
BLAKE2b-256 checksum How to use checksums |
5ca223c6c6543397e5cfce549388ed216092cef98c15c6feb90aae8dcfcb2cb3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.15
|
