Fetch'n'Backup - Simple two-step backup tool with rsync
Project description
fnb — Fetch'n'Backup
fnb is a simple two-step backup tool, powered by rsync.
It gives you two handy commands:
fetch (to pull from remote), and
backup (to save to somewhere safe).
Under the hood? Just good old rsync — no magic, just sharp automation.
- Simple config. Sharp execution. Safe data.
- Use them one by one, or
syncthem all in one go.
🚀 Features
- Fetch — Retrieve data from a remote server to your local machine
- Backup — Save local data to external storage
- Sync — Run Fetch and Backup together in one go
- Init — Generate an initial config file (
fnb.toml)
⚙️ Installation
From PyPI (Recommended)
pip install fnb
# または
uv pip install fnb
From Source
git clone https://gitlab.com/qumasan/fnb.git
cd fnb
uv pip install -e .
Requirements: Python 3.12 or higher is required.
🧰 使用例
# Initialize configuration files (fnb.toml and .env files)
fnb init
# Check the current config
fnb status
# Fetch: remote -> local
fnb fetch TARGET_LABEL
# Backup: local -> external
fnb backup TARGET_LABEL
# Run Fetch → Backup in one go
fnb sync TARGET_LABEL
# Check version
fnb version
🔧 設定ファイル
config.toml
各処理対象のディレクトリごとに
fetch / backup
の設定を持ちます。
[fetch.SECTION_NAME]
label = "TARGET_LABEL"
summary = "Fetch data from remote server"
host = "user@remote-host"
source = "~/path/to/source/"
target = "./local/backup/path/"
options = ["-auvz", "--delete", '--rsync-path="~/.local/bin/rsync"']
enabled = true
[backup.SECTION_NAME]
label = "TARGET_LABEL"
summary = "Backup data to cloud storage"
host = "none" # <- ローカル操作
source = "./local/backup/path/" # <- fetchのtargetパス
target = "./cloud/backup/path/"
options = ["-auvz", "--delete"]
enabled = true
設定ファイルの優先順位(高 → 低)
./fnb.toml← プロジェクトローカル設定~/.config/fnb/config.toml← グローバルユーザー設定(XDG準拠)C:\Users\ユーザー名\AppData\Local\fnb\config.toml← グローバルユーザー設定(Windowsの場合)./config/*.toml← 設定の分割・統合用(開発/運用向け)
🔐 Authentication
SSH password input can be automated using pexpect.
You can also define connection settings in a .env file if needed.
Run fnb init env to create the initial .env file.
🆕 What's New in v0.11.0
🤖 Automated Dependency Management
- Renovate Integration - Weekly automated dependency updates
- Security Scanning - Automatic vulnerability detection with pip-audit
- Enhanced CI Testing - Dependency update validation pipeline
🌍 Internationalization
- Multilingual Documentation - English/Japanese support with mkdocs-static-i18n
- Optimized Build Process - Faster documentation generation (2.16s)
- Structured Release Notes - User-friendly release documentation
🔧 Developer Experience
- New Tasks:
deps:update,deps:test,deps:security - Comprehensive Guides - Complete English documentation suite
- CI/CD Enhancement - Renovate-specific testing pipeline
🧪 Development
Python3- version 3.12 or higheruv- package managementTyper- CLI frameworkPydantic- config modelingpexpect- SSH automationpython-dotenv- environment variable supportpytest- testing framework (87% coverage)mkdocs-material- documentation with i18n supportpre-commit- run checks before each commitruff- fast Python linter and formattercommitizen- conventional commit tagging and changelog automationrenovate- automated dependency management
Version Management
This project uses automated semantic versioning with GitLab releases:
# Preview version bump
task version
# Execute version bump and changelog update
task version:bump
# Create GitLab release
task release
# Complete release workflow (test → format → bump → release)
task release:full
Current Version: v0.11.0 - View Release
CI/CD Pipeline
GitLab CI/CD pipeline provides automated testing, building, and deployment:
Stages:
renovate: Automated dependency management (optional)test: Unit tests, code quality, Renovate-specific testsdocs-quality: Documentation build validationbuild: Package building withuv builddeploy-test: TestPyPI deployment (automatic on tag push) 🚀deploy-prod: PyPI deployment (manual approval for safety)
Automated Workflows:
# Deployment (v0.10.0)
tag push → [Auto TestPyPI] → Local Verification → [Manual PyPI]
# Dependency Management (v0.11.0)
Monday 6am JST → [Renovate Scan] → [Auto MR] → [Enhanced Testing]
Optional CI Variables:
# GitLab Settings → CI/CD → Variables
TESTPYPI_API_TOKEN # TestPyPI API token for testing releases
PYPI_API_TOKEN # PyPI API token for production releases
RENOVATE_TOKEN # GitLab token for automated dependency updates (new in v0.11.0)
Local CI Simulation:
# Run tests as they run in CI (unit tests only)
task test:ci
# Run unit tests only (fast feedback)
task test:unit
# Run integration tests only
task test:integration
# Run all tests
task test
# Verify TestPyPI deployment (v0.10.0)
VERSION=0.11.0 task verify:testpypi
# Dependency management tasks (new in v0.11.0)
task deps:update # Update all dependencies
task deps:test # Test with updated dependencies
task deps:security # Check for security vulnerabilities
Test Structure
Tests are organized into two directories for optimal development workflow:
- tests/unit/: 9 files, 124 tests - Fast unit tests (1.65s)
- tests/integration/: 1 file, 23 tests - Comprehensive workflow tests (3.25s)
Both directory-based and marker-based execution are supported:
# Directory-based (recommended)
task test:unit # tests/unit/ only
task test:integration # tests/integration/ only
# Marker-based (backward compatibility)
pytest -m "not integration" # unit tests
pytest -m "integration" # integration tests
Test Coverage
Current test coverage is 87% (exceeds target, improved from 83% in v0.10.0) with comprehensive error handling and integration testing:
- backuper.py: 83% - Backup operation failure scenarios
- fetcher.py: 85% - SSH authentication and fetch failures
- cli.py: 99% - CLI command error scenarios
- reader.py: 89% - Configuration reading and validation
- gear.py: 87% - SSH automation with pexpect
- env.py: 68% - Environment variable handling
Integration Testing
Complete integration test suite with 23 tests (100% success rate):
- CLI Workflow Integration: 7 tests covering init → status → fetch/backup/sync workflows
- Multi-Module Integration: 6 tests verifying config → reader → gear → operation flows
- Sync Workflow Integration: 6 tests for complete fetch-then-backup sequences
- End-to-End Integration: 2 tests simulating realistic user workflows
- Test Infrastructure: Strategic mocking, external dependency isolation, reliable deterministic testing
🪪 License
MIT
🛠️ Contributing
This project is maintained in two repositories:
- 🛠️ Development, Issues, Merge Requests: GitLab
- 🌏 Public Mirror and Discussions: GitHub
- 📦 PyPI Package: fnb (v0.11.0)
- 📖 Documentation: GitLab Pages with multilingual support
Please use GitLab for development contributions, bug reports, and feature requests. For documentation viewing and community discussions, feel free to visit the GitHub mirror.
Development Workflow
See CLAUDE.md for detailed development guidelines including:
- Testing and coverage requirements (83%+)
- Version management and release workflow
- GitLab integration best practices
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file fnb-0.11.1.tar.gz.
File metadata
- Download URL: fnb-0.11.1.tar.gz
- Upload date:
- Size: 173.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.8.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0666f238bfbdd6bcb86d62a5ce89d928e8847082c7816307d9977116d1612652
|
|
| MD5 |
b0bc21262328a650276f6cf10ef0626b
|
|
| BLAKE2b-256 |
a0d30627036a4ab6b3976f5fc2c74a402353d4848b961bbde8c1e48d3f78a44a
|
File details
Details for the file fnb-0.11.1-py3-none-any.whl.
File metadata
- Download URL: fnb-0.11.1-py3-none-any.whl
- Upload date:
- Size: 31.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.8.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e4ac21e4fa6a621a4dabe93610e0fcb2cef870880b7d6fa4ba4250ea6754364f
|
|
| MD5 |
1479e88753c38fd537d0749ef499b111
|
|
| BLAKE2b-256 |
0dfc9597745817ff353951a751b4c3a36aff69070597a29d206de6e70b468f57
|