Skip to main content

CMA-ES Covariance Matrix Adaptation Evolution Strategy

The CMA-ES is a randomized derivative-free numerical optimization algorithm for difficult (non-convex, ill-conditioned, multi-modal, rugged, noisy) optimization problems in continuous or mixed-integer search spaces, implemented in Python.

The typical domain of application are objective functions with:

  • search space dimension between five and a few hundred,

  • dependent decision variables (non-separable)

  • gradients not being available or useful,

  • at least, say, 100 times dimension function evaluations possible and needed to get a satisfactory solution,

  • ill-conditioned or rugged or multi-modal landscapes.

The handling of

  • bound constraints via the 'bounds' = [lower, upper] option or the cma.BoundDomainTransform wrapper

  • linear and nonlinear constraints via the constraints argument to fmin2 or fmin_con2

  • noise via noise_handler=True as argument to fmin2

  • integer variables for mixed-integer problems via the 'integer_variables'=index_list option

is available too. The CMA-ES is quite reliable, however for small budgets (fewer function evaluations than 100 times dimension) or in very small dimensions faster methods are available.

The pycma module provides two independent implementations of the CMA-ES algorithm in the classes cma.CMAEvolutionStrategy and a basic implementation cma.purecma.CMAES.

Installation

In the terminal command line type

python -m pip install cma

The package will be downloaded and installed automatically. To upgrade an existing installation, ‘install’ must be replaced by ‘install -U’. For the documentation of pip, see here.

Alternatively, download and unpack the cma-...tar.gz file under the above Download files link. The folder cma from the tar archive can be used without any installation (for import to find it, it must be in the current folder or the Python search paths) or can be installed by pip install -e ..

Usage Example

In a Python shell:

>>> import cma
>>> help(cma)
    <output omitted>
>>> es = cma.CMAEvolutionStrategy(8 * [0], 0.5)
(5_w,10)-aCMA-ES (mu_w=3.2,w_1=45%) in dimension 8 (seed=468976, Tue May  6 19:14:06 2014)
>>> help(es)  # the same as help(cma.CMAEvolutionStrategy)
    <output omitted>
>>> es.optimize(cma.ff.rosen)
Iterat #Fevals   function value    axis ratio  sigma  minstd maxstd min:sec
    1      10 1.042661803766204e+02 1.0e+00 4.50e-01  4e-01  5e-01 0:0.0
    2      20 7.322331708590002e+01 1.2e+00 3.89e-01  4e-01  4e-01 0:0.0
    3      30 6.048150359372417e+01 1.2e+00 3.47e-01  3e-01  3e-01 0:0.0
  100    1000 3.165939452385367e+00 1.1e+01 7.08e-02  2e-02  7e-02 0:0.2
  200    2000 4.157333035296804e-01 1.9e+01 8.10e-02  9e-03  5e-02 0:0.4
  300    3000 2.413696640005903e-04 4.3e+01 9.57e-03  3e-04  7e-03 0:0.5
  400    4000 1.271582136805314e-11 7.6e+01 9.70e-06  8e-08  3e-06 0:0.7
  439    4390 1.062554035878040e-14 9.4e+01 5.31e-07  3e-09  8e-08 0:0.8
>>> es.result_pretty()  # pretty print result
termination on tolfun=1e-11
final/bestever f-value = 3.729752e-15 3.729752e-15
mean solution: [ 1.          1.          1.          1.          0.99999999  0.99999998
  0.99999995  0.99999991]
std deviation: [  2.84303359e-09   2.74700402e-09   3.28154576e-09   5.92961588e-09
   1.07700123e-08   2.12590385e-08   4.09374304e-08   8.16649754e-08]

optimizes the 8-dimensional Rosenbrock function with initial solution all zeros and initial sigma = 0.5.

Pretty much the same can be achieved with the “one-liner”

>>> import cma
>>> xopt, es = cma.fmin2(cma.ff.rosen, 8 * [0], 0.5)
    <output omitted>

where cma.fmin2 provides also options for restarts.

The same can be run via the ask-and-tell interface which gives the user direct control over the iteration loop of the algorithm:

>>> import cma
>>> es = cma.CMAEvolutionStrategy(12 * [0], 0.5)
>>> while not es.stop():
...     solutions = es.ask()
...     es.tell(solutions, [cma.ff.rosen(x) for x in solutions])
...     es.logger.add()  # write data to disc to be plotted
...     es.disp()
    <output omitted>
>>> es.result_pretty()
    <output omitted>
>>> cma.plot()  # shortcut for es.logger.plot()
CMA-ES on Rosenbrock function in dimension 8

A single run on the 12-dimensional Rosenbrock function.

The CMAOptions class manages the options for CMAEvolutionStrategy. The options class allows for substring search. For example, verbosity options can be found like

>>> import cma
>>> cma.s.pprint(cma.CMAOptions('erb'))
{'verb_log': '1  #v verbosity: write data to files every verb_log iteration, writing can be time critical on fast to evaluate functions'
 'verbose': '1  #v verbosity e.v. of initial/final message, -1 is very quiet, not yet implemented'
 'verb_plot': '0  #v in fmin(): plot() is called every verb_plot iteration'
 'verb_disp': '100  #v verbosity: display console output every verb_disp iteration'
 'verb_filenameprefix': 'outcmaes  # output filenames prefix'
 'verb_append': '0  # initial evaluation counter, if append, do not overwrite output files'
 'verb_time': 'True  #v output timings on console'}

Options are passed as another argument, after sigma, to cma.fmin2 or cma.CMAEvolutionStrategy like

>>> import cma
>>> es = cma.CMAEvolutionStrategy(8 * [0], 0.5,
                                  {'verb_disp': 1}) # display each iteration

Documentations

The full package API documentation:

See also

Dependencies

  • required (unless for cma.purecma): numpy – array processing for numbers, strings, records, and objects

  • optional (highly recommended): matplotlib – Python plotting package (includes pylab)

Use pip install numpy etc. for installation. The cma.purecma submodule can be used without any dependencies installed.

License: BSD-3-Clause

Metadata

Release files for cma 4.6.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for cma 4.6.0
File Size Uploaded Provenance Actions
cma-4.6.0.tar.gz 345.5 kB Without provenance Details for cma-4.6.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for cma 4.6.0
File Interpreter ABI Platform Actions
cma-4.6.0-py3-none-any.whl Python 3 none any Details for cma-4.6.0-py3-none-any.whl

Total release size: 702.5 kB

Release files / cma-4.6.0.tar.gz

Download URL cma-4.6.0.tar.gz
Size 345.5 kB
Tags Source
SHA-256 checksum
How to use checksums
0445d917d17d0a67f32564ac3f5abfe31bf52bd94cda5a54826a6f13efa83a18
BLAKE2b-256 checksum
How to use checksums
032137ceb4618fb381b38e584ec91ee14a62cf544f917e59e771e44684b19cb3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.2

Release files / cma-4.6.0-py3-none-any.whl

Download URL cma-4.6.0-py3-none-any.whl
Size 357.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
96c76678756d36b600ce6150caa30a62933fc652b4e22cc987746a2b1561db6a
BLAKE2b-256 checksum
How to use checksums
68d4a591dd5ab88bd701cc6eb99cff506a9bf4a59844aec2a715dfc41b320e47
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.2

Security for cma 4.6.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

4.6.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page