frysk 0.2.0

frysk is a fork of the popular snapshot testing tool Cram. Even though Cram is pretty complete and mature for everyday use, frysk wants to continue pushing its development forward.

frysk tests look like snippets of interactive shell sessions. frysk runs each command and compares the command output in the test with the command’s actual output.

Here’s a snippet from frysk’s own test suite:

Set up frysk alias and example tests:

  $ . "$TESTDIR"/setup.sh

Usage:

  $ frysk -h
  [Uu]sage: frysk \[OPTIONS\] TESTS\.\.\. (re)

  [Oo]ptions: (re)
    -h, --help          show this help message and exit
    -V, --version       show version information and exit
    -q, --quiet         don't print diffs
    -v, --verbose       show filenames and test status
    -i, --interactive   interactively merge changed test output
    -d, --debug         write script output directly to the terminal
    -y, --yes           answer yes to all questions
    -n, --no            answer no to all questions
    -E, --preserve-env  don't reset common environment variables
    --keep-tmpdir       keep temporary directories
    --shell=PATH        shell to use for running tests (default: /bin/sh)
    --shell-opts=OPTS   arguments to invoke shell with
    --indent=NUM        number of spaces to use for indentation (default: 2)
    --xunit-file=PATH   path to write xUnit XML output
    --dos2unix          convert DOS/Windows line endings to UNIX line endings
    --color             mode which shall be used for coloring the output

The format in a nutshell:

• frysk tests use the .t file extension.

• Lines beginning with two spaces, a dollar sign ($), and a space are run in the shell.

• Lines beginning with two spaces, a greater than sign (>), and a space allow multi-line commands.

• All other lines beginning with two spaces are considered command output.

• Output lines ending with a space and the keyword (re) are matched as Perl-compatible regular expressions.

• Lines ending with a space and the keyword (glob) are matched with a glob-like syntax. The only special characters supported are * and ?. Both characters can be escaped using \, and the backslash can be escaped itself.

• Output lines ending with either of the above keywords are always first matched literally with actual command output.

• Lines ending with a space and the keyword (no-eol) will match actual output that doesn’t end in a newline.

• Actual output lines containing unprintable characters are escaped and suffixed with a space and the keyword (esc). Lines matching unprintable output must also contain the keyword.

• Anything else is a comment.

.s.!
--- examples/fail.t
+++ examples/fail.t.err
@@ -3,21 +3,22 @@
   $ echo 1
   1
   $ echo 1
-  2
+  1
   $ echo 1
   1

 Invalid regex:

   $ echo 1
-  +++ (re)
+  1

 Offset regular expression:

   $ printf 'foo\nbar\nbaz\n\n1\nA\n@\n'
   foo
+  bar
   baz

   \d (re)
   [A-Z] (re)
-  #
+  @
s.
# Ran 6 tests, 2 skipped, 1 failed.