Skip to main content

cdxcore documentation

This module contains a number of lightweight tools, developed for managing data analytics and machine learning projects.

Install using:

pip install -U cdxcore

Documentation can be found here: https://quantitative-research.de/docs/cdxcore. cdxcore is best used with Python 3.12 and above, but is tested vs Python 3.10 onwards.

Highlights

  • Dynamic plotting: simple live/animated plots built on Matplotlib.
  • Config management: validated, discoverable configurations with automatic help.
  • Versioning & caching: code-versioned I/O and reproducible hashing for pipelines.
  • PrettyObject: dictionary-like objects that allow attribute access.
  • Utilities: formatting helpers, binary I/O, shared-memory arrays, and more.

Main Functionality

  • cdxcore.dynaplot is a framework for simple dynamic graphs with matplotlib. It has a simple methodology for animated updates for graphs (e.g. during training runs), and allows generation of plot layouts without knowing upfront the number of plots (e.g. for plotting a list of features).

    Animated 3D plot

  • cdxcore.config allows robust management of configurations. It automates help, validation checking, and detects misspelled configuration arguments.

    from cdxcore.config import Config, Int, Float
    
    class Network(object):
        def __init__( self, config ):
            self.depth      = config("depth", 1, Int>0, "Depth of the network")
            self.width      = config("width", 1, Int>0, "Width of the network")
            self.activation = config("activation", "selu", str, "Activation function")
            config.done() # see below
    
    config = Config()
    config.network.depth         = 10
    config.network.width         = 100
    config.network.activation    = 'relu'
    
    network = Network(config.network)
    config.done()
    
  • cdxcore.subdir wraps various file and directory functions into convenient objects. Useful if files have common extensions.

    from cdxcore.subdir import SubDir
    import numpy as np
    root   = SubDir("!")   # current temp directory
    subdir = root("test")  # sub-directory 'test'
    subdir.write("data", np.zeros((10,2)))
    data   = subdir.read("data")
    
  • Caching: SubDir supports code-versioned file i/o which is used by @cdxcore.subdir.SubDir.cache for an efficient code-versioned caching protocol for functions and objects:

from cdxcore.subdir import SubDir
cache   = SubDir("!/.cache;*.bin")

@cache.cache("0.1")
def f(x,y):
   return x*y

_ = f(1,2)    # function gets computed and the result cached
_ = f(1,2)    # restore result from cache
_ = f(2,2)    # different parameters: compute and store result
  • Code versioning is implemented in cdxcore.version:

    from cdxcore.version import version
    
    @version("0.0.1")
    def f(x):
        return x
    
    print( f.version.full )   # -> 0.0.1
    
  • Hashing (which is used for caching above) is implemented in cdxcore.uniquehash:

    class A(object):
        def __init__(self, x):
            self.x = x
            self._y = x*2  # protected member will not be hashed by default
    
    from cdxcore.uniquehash import UniqueHash
    uniqueHash = UniqueHash(length=12)
    a = A(2)
    print( uniqueHash(a) ) # --> "2d1dc3767730"
    
  • cdxcore.pretty provides a PrettyObject class whose objects operate like dictionaries. This is for users who prefer attribute . notation over item access when building structured output.

    from cdxcore.pretty import PrettyObject
    pdct = PrettyObject(z=1)
    
    pdct.num_samples = 1000
    pdct.num_batches = 100
    pdct.method = "signature"
    

General purpose utilities

  • cdxcore.verbose provides user-controllable context output for providing progress updates to users.

  • cdxcore.util offers a number of utility functions such as standard formatting for dates, big numbers, lists, dictionaries etc.

  • cdxcore.npio provides a low level binary i/o interface for numpy files.

  • cdxcore.npshm provides shared memory numpy arrays.

  • cdxcore.rolling provides robust rolling statistics: exponentially weighted location and scale estimators which flag outliers, for regular and irregular time steps.

Metadata

Release files for cdxcore 0.1.96

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for cdxcore 0.1.96
File Size Uploaded
cdxcore-0.1.96.tar.gz 280.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for cdxcore 0.1.96
File Interpreter ABI Platform
cdxcore-0.1.96-py3-none-any.whl Python 3 none any Details

Total release size: 500.3 kB

Release files / cdxcore-0.1.96.tar.gz

Download URL cdxcore-0.1.96.tar.gz
Size 280.4 kB
Tags Source
SHA-256 checksum
How to use checksums
54177acf4063a69c6c164c80715b7f1f13303ede2ca6faffd8d8c9fcc0b89297
BLAKE2b-256 checksum
How to use checksums
354aaa54024d697a42a8c0326b645ab9ca8333997130fd22a6f7790593ae5e5c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.5

Release files / cdxcore-0.1.96-py3-none-any.whl

Download URL cdxcore-0.1.96-py3-none-any.whl
Size 219.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7d44d7b8e2444badc9590b8e321c126a6965f6081bb9959e53087cd232db381e
BLAKE2b-256 checksum
How to use checksums
ef82b87772f6b1a8d35f164ed9cfd621a1d017327f14fbea0bf8a60b546fe1cc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.5

Release history Release notifications | RSS feed

This release

0.1.96 This release

2 release files

0.1.91

2 release files

0.1.90

2 release files

0.1.89

2 release files

0.1.88

2 release files

0.1.87

2 release files

0.1.85

2 release files

0.1.84

2 release files

0.1.83

2 release files

0.1.82

2 release files

0.1.79

2 release files

0.1.78

2 release files

0.1.76

2 release files

0.1.75

2 release files

0.1.69

2 release files

0.1.67

2 release files

0.1.66

2 release files

0.1.65

2 release files

0.1.64

2 release files

0.1.63

2 release files

0.1.62

2 release files

0.1.61

2 release files

0.1.57

2 release files

0.1.56

2 release files

0.1.55

2 release files

0.1.54

2 release files

0.1.53

2 release files

0.1.52

2 release files

0.1.51

2 release files

0.1.50

2 release files

0.1.49

2 release files

0.1.48

2 release files

0.1.47

2 release files

0.1.46

2 release files

0.1.45

2 release files

0.1.39

2 release files

0.1.38

2 release files

0.1.37

2 release files

0.1.36

2 release files

0.1.34

2 release files

0.1.33

2 release files

0.1.28

2 release files

0.1.27

2 release files

0.1.26

2 release files

0.1.24

2 release files

0.1.23

2 release files

0.1.22

2 release files

0.1.21

2 release files

0.1.20

2 release files

0.1.19

2 release files

0.1.18

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page