Skip to main content

A snapshot library for python optimized for easy of use, human readable snapshots and enabling decoupling of chained integration tests.

Project description

Snappylapy

Welcome to Snappylapy, a powerful and intuitive snapshot testing tool for Python's pytest framework. Snappylapy simplifies the process of capturing and verifying snapshots of your data, ensuring your code behaves as expected across different runs. With Snappylapy, you can save snapshots in a human-readable format and deserialize them for robust integration testing, providing a clear separation layer to help isolate errors and maintain code integrity.

Installation

To get started with Snappylapy, install the package via pip:

pip install snappylapy

Key Features

Legend:

  • ✅ Implemented
  • ❌ Not implemented yet

The features are in development:

  • Human-Readable Snapshots✅: Save snapshots in a format that's easy to read and understand, making it simpler to review changes and debug issues.
  • Serialization and Deserialization✅: Snapshots can be serialized and deserialized, allowing for flexible and reusable test cases.
  • Integration Testing✅: Use snapshots for integration testing with a clear separation layer, preventing interdependencies between code components and making it easier to isolate and identify errors.
  • Easy to Use✅: Seamlessly integrates with pytest, allowing you to start capturing and verifying snapshots with minimal setup. For a good developer experience the package is fully typed, with docstrings to provide good editor code completion.
  • Customizable Output✅: Store snapshots in a location of your choice, enabling you to organize and manage your test data effectively.
  • Diff Report Generation❌: Generate a diff report in html format for easy comparison between test results and snapshots.
  • Provides a wide set of assertions❌: The package provides a wide set of assertions to make it easy to compare different types of data, for do fuzzy matching or ignore certain parts of the data that are variable.

Benefits of Snapshot Testing

Snapshot testing is a powerful technique for verifying the output of your code by comparing it to a stored snapshot. This approach offers several benefits, including:

  • Immutability Verification: Quickly detect unintended changes or regressions by comparing current output to stored snapshots.
  • Faster Test Creation: Simplify the process of writing and maintaining tests by capturing snapshots once and letting the framework handle comparisons.
  • Documentation: Use snapshots as a form of documentation, providing a clear record of expected output and behavior.
  • Version Control Integration: Include snapshots in your version control system to aid in code reviews and track changes over time.
  • Pull Request Reviews: Enhance PR reviews by showing exactly how changes affect the application's output, ensuring thorough and effective evaluations.

Why Snappylapy?

When working on a test suite for a project, it’s important to ensure tests are independent. This is to avoid situations where changes in one part of the code cause failures in tests for other unrelated areas, making it challenging to isolate and fix errors. Snappylapy addresses this by providing a mechanism to capture snapshots of your data and use them in your later tests, ensuring that each component can be tested independently. While also making sure that they are dependent enought to test the integration between them. It provides serialization and deserialization of the snapshots, making it easy to reuse them in different test cases. This is aimed at function working with large and complex data structures (dataframes or large nested dictionaries.)

Example

from snappylapy import Expect
from mypackage import my_function
   
def test_snapshot_dict(expect: Expect):
    """Test snapshot with dictionary data."""
    data: dict = my_function()
    expect(data).to_match_snapshot()
    # or expect.dict(data).to_match_snapshot()

In this example, snappylapy captures the output of my_function and compares it against a stored snapshot. If the output changes unexpectedly, pytest will flag the test, allowing you to review the differences and ensure your code behaves as expected.

Snappylapy can use the snapshots created for inputs in another test. You can think of it as automated/easier mock data generation and management.

import pytest
from snappylapy import Expect, LoadSnapshot

def test_snapshot_dict(expect: Expect):
    """Test snapshot with dictionary data."""
    expect({
        "name": "John Doe",
        "age": 31
    }).to_match_snapshot()

@pytest.mark.snappylapy(depends=[test_snapshot_dict])
def test_load_snapshot_from_file(load_snapshot: LoadSnapshot):
    """Test loading snapshot data created in test_snapshot_dict from a file using the deserializer."""
    data = load_snapshot.dict()
    # Normally you would use the data as an input for some other function
    # For demonstration, we will just assert the data matches the expected snapshot
    assert data == {"name": "John Doe", "age": 31}

This can be great for external dependencies, for example an AI service, that might change response over time. With this approach we can isolate the changes to the service and still make succeding tests pass.

The output structure

The results is split into two folders, for ease of comparison, and for handling stochastic/variable outputs (timestamps, generated ids, llm outputs, third party api responses etc).

  • test_results: Updated every time the tests is ran. Compare with snapshots when doing snapshot style assertions. Add this to your .gitignore file.
  • snapshots: Updated only when --snapshot-update flag is used when running the test suite. Commit this to your version control system.

Usage

Snapshots can be updated when running pytest:

pytest --snapshot-update

Alternatively, you can use the CLI command to update snapshots:

snappylapy update

Fixtures and roadmap

Registers fixtures:

  • expect ✅
  • load_snapshot ✅

Supported data types

  • .txt ✅
  • .json ✅
  • .csv ❌
  • .yaml ❌
  • .jsonl ❌

Planned data types:

Python Type Default Output file type Implementation Status
bytes .txt
pd.DataFrame .csv ✅ (missing csv support)
pd.Series .csv
np.ndarray .csv
dict .json
list .json
tuple .json
set .json
str .txt
int .txt
float .txt
bool .txt
datetime.datetime .txt
datetime.date .txt
datetime.time .txt
pathlib.Path .txt
decimal.Decimal .txt
uuid.UUID .txt
pydantic.BaseModel .json
python dataclasses .json

Snappylapy is your go-to tool for efficient and reliable snapshot testing in Python. By maintaining clear boundaries between different parts of your code, Snappylapy helps you isolate errors, streamline debugging, and ensure your code remains robust and maintainable.

Contributing

We welcome contributions to Snappylapy! If you have ideas for new features, improvements, or bug fixes, please open an issue or submit a pull request on our GitHub repository. We appreciate your feedback and support in making Snappylapy even better for the community.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

snappylapy-0.5.1.tar.gz (35.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

snappylapy-0.5.1-py3-none-any.whl (34.2 kB view details)

Uploaded Python 3

File details

Details for the file snappylapy-0.5.1.tar.gz.

File metadata

  • Download URL: snappylapy-0.5.1.tar.gz
  • Upload date:
  • Size: 35.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for snappylapy-0.5.1.tar.gz
Algorithm Hash digest
SHA256 fa981b0907ae9bf0f77560895c34a07e8cf9c7209435cde7dfcfe40e729884be
MD5 0fa49b56a24c69c695cc1f945b9f6ea1
BLAKE2b-256 4f72f6f48742947f7cad931c01ee1d35a392665409e65c79aea72a30bc4c20bf

See more details on using hashes here.

Provenance

The following attestation bundles were made for snappylapy-0.5.1.tar.gz:

Publisher: release.yaml on martinmoldrup/snappylapy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file snappylapy-0.5.1-py3-none-any.whl.

File metadata

  • Download URL: snappylapy-0.5.1-py3-none-any.whl
  • Upload date:
  • Size: 34.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for snappylapy-0.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 214638f0c4aceba325f747faa4ac8fd337108e5eae22cc30d04214105a430281
MD5 f2aef703e3a8621d1c1fa66b2152ef2b
BLAKE2b-256 b842463f309b3b2a14079e1e992ee055ff8b83c3e33203c122fac97a75e690e6

See more details on using hashes here.

Provenance

The following attestation bundles were made for snappylapy-0.5.1-py3-none-any.whl:

Publisher: release.yaml on martinmoldrup/snappylapy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page