The uncompromising Snakemake code formatter
Project description
Snakefmt
This repository provides formatting for Snakemake files. It follows the design and specifications of Black.
[!WARNING]
snakefmtmodifies files in-place by default, thus we strongly recommend ensuring your files are under version control before doing any formatting. You can also pipe the file in from stdin, which will print it to the screen, or use the--diffor--checkoptions. See Usage for more details.
[!IMPORTANT] Recent Changes:
- Rule and module directives are now sorted by default:
snakefmtwill automatically sort the order of directives inside rules (e.g.input,output,shell) and modules into a consistent order. You can opt out of this by using the--no-sortCLI flag.- Black upgraded to v26: The underlying
blackformatter has been upgraded to v26. You will see changes in how implicitly concatenated strings are wrapped (they are now collapsed onto a single line if they fit within the line limit) and other minor adjustments compared to previous versions.- Shell blocks are now formatted using
shfmt:snakefmtnow formats the body ofshell:directives usingshfmt. This is enabled by default and will reformat shell code that was previously left untouched. You can opt out with--no-format-shell(-F) orformat_shell = falseinpyproject.toml. See Shell Block Formatting for details.Example of expected differences:
# Before (Snakefmt older versions) rule example: shell: "for i in $(seq 1 5);" "do echo $i;" "done" output: "b.txt", input: "a.txt", # After (Directives sorted, strings collapsed by Black 26) rule example: input: "a.txt", output: "b.txt", shell: "for i in $(seq 1 5);" "do echo $i;" "done"
Table of Contents
Install
PyPi
pip install snakefmt
Conda
conda install -c bioconda snakefmt
Containers
As snakefmt has a Conda recipe, there is a matching image built for each version by
Biocontainers.
In the following examples, all tags (<tag>) can be found
here.
Docker
$ docker run -it "quay.io/biocontainers/snakefmt:<tag>" snakefmt --help
Singularity
$ singularity exec "docker://quay.io/biocontainers/snakefmt:<tag>" snakefmt --help
Local
These instructions include installing uv.
# install uv
curl -LsSf https://astral.sh/uv/install.sh | sh
git clone https://github.com/snakemake/snakefmt && cd snakefmt
# install snakefmt in a new environment
make install
# you can now run snakefmt with
uv run snakefmt --help
Example File
Input
from snakemake.utils import min_version
min_version("5.14.0")
configfile: "config.yaml" # snakemake keywords are treated like classes i.e. 2 newlines
SAMPLES = ['s1', 's2'] # strings are normalised
CONDITIONS = ["a", "b", "longlonglonglonglonglonglonglonglonglonglonglonglonglonglonglong"] # long lines are wrapped
include: "rules/foo.smk" # 2 newlines
rule all:
input: "data/results.txt" # newlines after keywords enforced and trailing comma
rule gets_separated_by_two_newlines:
input:
files = expand("long/string/to/data/files/gets_broken_by_black/{sample}.{condition}",sample=SAMPLES, condition=CONDITIONS)
if True:
rule can_be_inside_python_code:
input: "parameters", "get_indented"
threads: 4 # Numeric params stay unindented
params: key_val = "PEP8_formatted"
run:
print("weirdly_spaced_string_gets_respaced")
Output
from snakemake.utils import min_version
min_version("5.14.0")
configfile: "config.yaml" # snakemake keywords are treated like classes i.e. 2 newlines
SAMPLES = ["s1", "s2"] # strings are normalised
CONDITIONS = [
"a",
"b",
"longlonglonglonglonglonglonglonglonglonglonglonglonglonglonglong",
] # long lines are wrapped
include: "rules/foo.smk" # 2 newlines
rule all:
input:
"data/results.txt", # newlines after keywords enforced and trailing comma
rule gets_separated_by_two_newlines:
input:
files=expand(
"long/string/to/data/files/gets_broken_by_black/{sample}.{condition}",
sample=SAMPLES,
condition=CONDITIONS,
),
if True:
rule can_be_inside_python_code:
input:
"parameters",
"get_indented",
threads: 4 # Numeric params stay unindented
params:
key_val="PEP8_formatted",
run:
print("weirdly_spaced_string_gets_respaced")
Usage
Basic Usage
Format a single Snakefile.
snakefmt Snakefile
Format all Snakefiles within a directory.
snakefmt workflows/
Format a file but write the output to stdout.
snakefmt - < Snakefile
Full Usage
Show full help output
$ snakefmt --help
Usage: snakefmt [OPTIONS] [SRC]...
The uncompromising Snakemake code formatter.
SRC specifies directories and files to format. Directories will be searched
for file names that conform to the include/exclude patterns provided.
Files are modified in-place by default; use diff, check, or `snakefmt - <
Snakefile` to avoid this.
Options:
-l, --line-length INT Lines longer than INT will be wrapped.
[default: 88]
-s, --sort / -S, --no-sort Sort directives in rules and modules.
[default: sort]
-f, --format-shell / -F, --no-format-shell
Format shell directives using shfmt.
[default: format-shell]
--check Don't write the files back, just return the
status. Return code 0 means nothing would
change. Return code 1 means some files would
be reformatted. Return code 123 means there
was an error.
-d, --diff Don't write the files back, just output a
diff for each file to stdout.
--compact-diff Same as --diff but only shows lines that
would change plus a few lines of context.
--include PATTERN A regular expression that matches files and
directories that should be included on
recursive searches. An empty value means
all files are included regardless of the
name. Use forward slashes for directories
on all platforms (Windows, too). Exclusions
are calculated first, inclusions later.
[default: (\.smk$|^Snakefile)]
--exclude PATTERN A regular expression that matches files and
directories that should be excluded on
recursive searches. An empty value means no
paths are excluded. Use forward slashes for
directories on all platforms (Windows, too).
Exclusions are calculated first, inclusions
later. [default: (\.snakemake/|\.eggs/|\.gi
t/|\.hg/|\.mypy_cache/|\.nox/|\.tox/|\.venv/
|\.svn/|_build/|buck-
out/|/build/|/dist/|\.template/)]
-c, --config PATH Read configuration from PATH. By default,
will try to read from `./pyproject.toml`
-h, --help Show this message and exit.
-V, --version Show the version and exit.
-v, --verbose Turns on debug-level logger.
Directive Sorting
By default, snakefmt sorts rule and module directives (like input, output, shell, etc.) into a consistent order. This makes rules easier to read and allows for quicker cross-referencing between inputs, outputs, and the resources used by the execution command.
Directive ordering details
Directives are grouped by their functional role in the following order:
- Identity & Early Control:
name,default_target - I/O Contract:
input,output,log,benchmark - Wildcard & Path Qualification:
wildcard_constraints,pathvars - Scheduling & Control:
priority,retries,group,localrule,cache,handover - Execution Environment:
shadow,conda,container,singularity,containerized,envmodules - Execution Resources & Parameters:
threads,resources,params - Annotation / Runtime Display:
message - Action:
shell,run,script,notebook,wrapper,cwl,template_engine
This ordering ensures that the directives most frequently used in execution blocks (like threads, resources, and params) are placed immediately above the action directive.
You can disable this feature using the --no-sort flag.
Shell Block Formatting
By default, snakefmt formats the body of shell: directives using shfmt.
This keeps shell snippets in your Snakefiles formatted consistently and avoids cosmetic diffs triggering unnecessary Snakemake re-runs.
Example
Before:
rule align:
input:
"reads.fq",
output:
"aligned.bam",
threads: 4
shell:
"""
bwa mem -t {threads} ref.fa {input} | samtools sort -o {output} -
if [ -s {output} ]
then
echo "done"
else
echo "empty"
exit 1
fi
"""
After:
rule align:
input:
"reads.fq",
output:
"aligned.bam",
threads: 4
shell:
"""
bwa mem -t {threads} ref.fa {input} | samtools sort -o {output} -
if [ -s {output} ]; then
echo "done"
else
echo "empty"
exit 1
fi
"""
Disabling
You can disable shell formatting on the command line with --no-format-shell (-F), or in pyproject.toml:
[tool.snakefmt]
format_shell = false
shfmt is invoked with -i 4 -ci -bn (four-space indentation, indented switch cases, binary operators may start a line).
Advanced details: placeholders, heredocs, brace groups, invalid shell
Snakemake placeholders
Snakemake {var} placeholders are masked before shfmt runs so it does not mis-parse them, then restored verbatim afterwards.
Escaped double-brace placeholders such as those required by awk are passed through unchanged:
rule example:
shell:
"""
awk '{{print $1}}' {input} > {output}
"""
Brace groups
Bash brace groups ({ cmd1; cmd2; }) appear as {{ cmd1; cmd2; }} in Snakemake shell strings
because Snakemake renders the block through str.format(), which requires {{ / }} to produce
literal { / }. snakefmt preserves these double-brace sequences verbatim — the body inside
a brace group is not internally reformatted by shfmt. This is an implementation trade-off:
safely unescaping, formatting, and re-escaping the contents without disrupting Snakemake's
variable interpolation introduces significant parser complexity, so opaque masking is used for
simplicity and safety.
If you need shfmt to format the body of a brace group, wrap it in # fmt: off / # fmt: on
and format that section manually.
Heredoc handling
snakefmt masks heredoc bodies before passing shell code to shfmt, and restores them afterwards. This means:
- Heredoc bodies are never reformatted —
shfmtdoes not reformat heredoc content, and neither doessnakefmt. - Snakemake-style escape prefixes on the terminator are supported. For example, a heredoc that ends with
\n!EOF!instead of a bare!EOF!at column 0 is detected and handled correctly — no# fmt: offrequired.
shell:
"""
python <<!EOF!
\nif True:
print("hello")
\n!EOF!
"""
Standard heredoc forms (<<EOF, <<-EOF, <<'EOF') are also supported and the terminator placement requirement (column 0 for <<EOF, leading tabs only for <<-EOF) is preserved after formatting.
Invalid shell
If shfmt cannot parse the shell body, snakefmt raises an InvalidShell error rather than silently leaving the block unformatted.
To work around genuinely invalid shell, either:
- Disable shell formatting for the whole run with
-F/--no-format-shell, or - Wrap the rule in
# fmt: off/# fmt: ondirectives (see below) to opt that block out.
Format Directives
snakefmt supports comment directives to control formatting behaviour for specific regions of code.
Directives should appear as standalone comment lines, an inline occurrence (e.g. input: # fmt: off) is treated as a plain comment and has no effect.
All directives are scope-local: only the region they select is affected, while code before and after follows normal snakefmt formatting and spacing rules (equivalent to replacing the directive with a plain comment line).
# fmt: off / # fmt: on
Disables all formatting for the region between the two directives.
Both directives must appear at the same indentation level; a # fmt: on at a deeper indent than the matching # fmt: off has no effect.
rule a:
input:
"a.txt",
# fmt: off
rule b:
input: "b.txt"
output:
"c.txt"
# fmt: on
rule c:
input:
"d.txt",
Note: inside
run:blocks and other Python contexts,# fmt: off/# fmt: onis passed through to Black, which handles it natively.
Additional directives: # fmt: off[sort], # fmt: off[next], # fmt: skip
# fmt: off[sort]
Disables directive sorting for the enclosed region while still applying all other formatting.
Directives between # fmt: off[sort] and # fmt: on[sort] are kept in their original order.
A plain # fmt: on also closes a # fmt: off[sort] region.
# fmt: off[sort]
rule keep_my_order:
output:
"result.txt",
input:
"source.txt",
shell:
"cp {input} {output}"
# fmt: on[sort]
# fmt: off[next]
Disables formatting for the single next Snakemake keyword block (e.g. rule, checkpoint, use rule).
Only that block is left unformatted; all subsequent blocks are formatted normally.
rule formatted:
input:
"a.txt",
output:
"b.txt",
# fmt: off[next]
rule unformatted:
input: "a.txt"
output: "b.txt"
rule also_formatted:
input:
"a.txt",
# fmt: skip
# fmt: skip preserves a single line exactly as written, without any formatting (see Black's documentation for details).
Note:
# fmt: skipis not yet supported within Snakemake rule blocks. It currently applies only to plain Python lines outside of rules, checkpoints, and similar Snakemake constructs.
Configuration
snakefmt is able to read project-specific default values for its command line options
from a pyproject.toml file. In addition, it will also load any black
configurations you have in the same file.
By default, snakefmt will search in the parent directories of the formatted file(s)
for a file called pyproject.toml and use any configuration there.
If your configuration file is located somewhere else or called something different,
specify it using --config.
Any options you pass on the command line will take precedence over default values in the configuration file.
Example
[tool.snakefmt]
line_length = 90
include = '\.smk$|^Snakefile|\.py$'
sort_directives = true # sort rule directives into a consistent order (default: true)
format_shell = true # format shell: blocks with shfmt (default: true)
# snakefmt passes these options on to black
[tool.black]
skip_string_normalization = true
In this example we increase the --line-length value and also include python (*.py)
files for formatting - this effectively runs black on them. snakefmt will also pass
on the [tool.black] settings, internally, to black.
Integration
Editor Integration
For instructions on how to integrate snakefmt into your editor of choice, refer to
docs/editor_integration.md
Version Control Integration
snakefmt supports pre-commit, a framework for managing git pre-commit hooks. Using this framework you can run snakefmt whenever you commit a Snakefile or *.smk file. Pre-commit automatically creates an isolated virtual environment with snakefmt and will stop the commit if snakefmt would modify the file. You then review, stage, and re-commit these changes. Pre-commit is especially useful if you don't have access to a CI/CD system like GitHub actions.
To do so, create the file .pre-commit-config.yaml in the root of your project directory with the following:
repos:
- repo: https://github.com/snakemake/snakefmt
rev: v1.1.0 # Replace by any tag/version ≥v0.6.0 : https://github.com/snakemake/snakefmt/releases
hooks:
- id: snakefmt
Then install pre-commit and initialize the pre-commit hooks by running pre-commit install (Note you need to run this step once per clone of your repository). Additional pre-commit hooks can be found here.
GitHub Actions
GitHub Actions in combination with super-linter allows you to automatically run snakefmt on all Snakefiles in your repository e.g. whenever you push a new commit.
Show GitHub Actions workflow configuration
Create .github/workflows/linter.yml in your repository:
---
name: Lint
on: # yamllint disable-line rule:truthy
push: null
pull_request: null
permissions: {}
jobs:
build:
name: Lint
runs-on: ubuntu-latest
permissions:
contents: read
packages: read
# To report GitHub Actions status checks
statuses: write
steps:
- name: Checkout code
uses: actions/checkout@v5
with:
# super-linter needs the full git history to get the
# list of files that changed across commits
fetch-depth: 0
persist-credentials: false
- name: Lint Code Base
uses: super-linter/super-linter@v8.2.1
env:
VALIDATE_ALL_CODEBASE: false
DEFAULT_BRANCH: main
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
VALIDATE_SNAKEMAKE_SNAKEFMT: true
Additional configuration parameters can be specified by creating .github/linters/.snakefmt.toml:
[tool.black]
skip_string_normalization = true
For more information check the super-linter readme.
Plug Us
If you can't get enough of badges, then feel free to show others you're using snakefmt
in your project.
Copy badge markup
Markdown
[](https://github.com/snakemake/snakefmt)
ReStructuredText
.. image:: https://img.shields.io/badge/code%20style-snakefmt-000000.svg
:target: https://github.com/snakemake/snakefmt
Changes
See CHANGELOG.md.
Contributing
See CONTRIBUTING.md.
Cite
BibTeX
@article{snakemake2021,
doi = {10.12688/f1000research.29032.2},
url = {https://doi.org/10.12688/f1000research.29032.2},
year = {2021},
month = apr,
publisher = {F1000 Research Ltd},
volume = {10},
pages = {33},
author = {Felix M\"{o}lder and Kim Philipp Jablonski and Brice Letcher and Michael B. Hall and Christopher H. Tomkins-Tinch and Vanessa Sochat and Jan Forster and Soohyun Lee and Sven O. Twardziok and Alexander Kanitz and Andreas Wilm and Manuel Holtgrewe and Sven Rahmann and Sven Nahnsen and Johannes K\"{o}ster},
title = {Sustainable data analysis with Snakemake},
journal = {F1000Research}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file snakefmt-2.0.0.tar.gz.
File metadata
- Download URL: snakefmt-2.0.0.tar.gz
- Upload date:
- Size: 164.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a47259b1fcd958b73e59052e2425708240652b7b2f9ff7d6b2b14d2894f10b33
|
|
| MD5 |
1b0e410fd4abee814af85422273cc56a
|
|
| BLAKE2b-256 |
8e0ace930eafdc3ea5999c6fd65cb473c33a3f310606907e6de0241ec5e5f149
|
File details
Details for the file snakefmt-2.0.0-py3-none-any.whl.
File metadata
- Download URL: snakefmt-2.0.0-py3-none-any.whl
- Upload date:
- Size: 43.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
300c983d653e70050ca7644f17c09ac3f88daf9d9abeb6dd8c2b34a1ce821b87
|
|
| MD5 |
c4b0b428bae3aa47f74d06ea5c6dd62d
|
|
| BLAKE2b-256 |
a4851bee3af4e9264d301769cf4475f58d987840334d274d3889f17682115105
|