Skip to main content

Easy-to-use, extensible random testing library.

Project description

pyquchk - random and serial testing

pyquchk (abbreviated from Python QuickCheck) is and easy-to-use, extensible random and serial testing framework. As you see from the name, it’s inspired by Haskell QuickCheck, but aims to provide much more capabilities.

Full documentation, including usage examples, is available at ReadTheDocs.

Features

Already implemented

pyquchk combines two approaches to the arguments values generation in a single framework:

  • QuickCheck-like (random)

    Random (fuzzy) testing runs a function for many randomly generated arguments values to make sure it’s generally correct. Some features (both from the original QuickCheck and unique to pyquchk)

  • SmallCheck-like (serial)

    Serial testing means that values are generated starting with some edge cases and small ones. This exhausts all possible values up to some “size” and is deterministic, in contrast to the random approach. Serial testing nicely complements the random one and so gives more confidence that the function tested is correct.

Other notable features include:

  • a lot of configurable built-in generators for different value types (in progress, see arbitraries for the list of currently implemented generators)
  • custom generators are supported, both for built-in types and user-created ones
  • easy-to-write and read syntax for simple property checking as well as for full tests to be run with a framework (nose for example)
  • pyquchk attempts to give you the smallest available counterexample, always performing shrinkg of the generated value (and if a value is found with serial testing, it’s probably already minimal)

Planned

pyquchk is in active development, and I have many features to implement here:

  • Option to check for exists, not forall

  • assume function (allows so-called conditional properties and much more)

  • Tests timing

  • Support generators arguments depending on other generators values

    Something like forAll in original QuickCheck, but everything is to be defined as the function default arguments. Example: integer from the range [0:len(list)].

  • Size support

    Generation function takes size parameter which increases (from 0 to 1?) from the first to the last test. Explore sized, resize and so on from QuickCheck - whether they will fit here.

  • Easy creation of Arbitraries combinations

    Examples: string from list; tuple with equally-sized strings.

  • Look for best way to express:

    • Modifiers like positive/negative/nonempty/…
    • Different numbers distributions like uniform/exponential/…
    • Structures like def f(a={int: [str_(...)]}, b=[float], c={'x': int, 'y': list})
  • Any use for Python 3 annotations?

  • Better testing pyquchk itself

    Look at https://github.com/npryce/python-factcheck/blob/master/test/test_factcheck.py

  • Smart shrink from QuickCheck, SmartCheck

  • Collect, classify, cover

    Not only boolean parameters (label/no label), but numerical as well. Example: difference between approximate function result and the exact one.

  • Verbosity settings

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pyquchk, version 0.1.3
Filename, size File type Python version Upload date Hashes
Filename, size pyquchk-0.1.3-py2.7.egg (18.4 kB) File type Egg Python version 2.7 Upload date Hashes View
Filename, size pyquchk-0.1.3-py3.3.egg (19.9 kB) File type Egg Python version 3.3 Upload date Hashes View
Filename, size pyquchk-0.1.3.tar.gz (6.2 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page