Skip to main content

cdxcore documentation

This module contains a number of lightweight tools, developed for managing data analytics and machine learning projects.

Install using:

pip install -U cdxcore

Documentation can be found here: https://quantitative-research.de/docs/cdxcore. cdxcore is best used with Python 3.12 and above, but is tested vs Python 3.10 onwards.

Highlights

  • Dynamic plotting: simple live/animated plots built on Matplotlib.
  • Config management: validated, discoverable configurations with automatic help.
  • Versioning & caching: code-versioned I/O and reproducible hashing for pipelines.
  • PrettyObject: dictionary-like objects that allow attribute access.
  • Utilities: formatting helpers, binary I/O, shared-memory arrays, and more.

Main Functionality

  • cdxcore.dynaplot is a framework for simple dynamic graphs with matplotlib. It has a simple methodology for animated updates for graphs (e.g. during training runs), and allows generation of plot layouts without knowing upfront the number of plots (e.g. for plotting a list of features).

    Animated 3D plot

  • cdxcore.config allows robust management of configurations. It automates help, validation checking, and detects misspelled configuration arguments.

    from cdxcore.config import Config, Int, Float
    
    class Network(object):
        def __init__( self, config ):
            self.depth      = config("depth", 1, Int>0, "Depth of the network")
            self.width      = config("width", 1, Int>0, "Width of the network")
            self.activation = config("activation", "selu", str, "Activation function")
            config.done() # see below
    
    config = Config()
    config.network.depth         = 10
    config.network.width         = 100
    config.network.activation    = 'relu'
    
    network = Network(config.network)
    config.done()
    
  • cdxcore.subdir wraps various file and directory functions into convenient objects. Useful if files have common extensions.

    from cdxcore.subdir import SubDir
    import numpy as np
    root   = SubDir("!")   # current temp directory
    subdir = root("test")  # sub-directory 'test'
    subdir.write("data", np.zeros((10,2)))
    data   = subdir.read("data")
    
  • Caching: SubDir supports code-versioned file i/o which is used by @cdxcore.subdir.SubDir.cache for an efficient code-versioned caching protocol for functions and objects:

from cdxcore.subdir import SubDir
cache   = SubDir("!/.cache;*.bin")

@cache.cache("0.1")
def f(x,y):
   return x*y

_ = f(1,2)    # function gets computed and the result cached
_ = f(1,2)    # restore result from cache
_ = f(2,2)    # different parameters: compute and store result
  • Code versioning is implemented in cdxcore.version:

    from cdxcore.version import version
    
    @version("0.0.1")
    def f(x):
        return x
    
    print( f.version.full )   # -> 0.0.1
    
  • Hashing (which is used for caching above) is implemented in cdxcore.uniquehash:

    class A(object):
        def __init__(self, x):
            self.x = x
            self._y = x*2  # protected member will not be hashed by default
    
    from cdxcore.uniquehash import UniqueHash
    uniqueHash = UniqueHash(length=12)
    a = A(2)
    print( uniqueHash(a) ) # --> "2d1dc3767730"
    
  • cdxcore.pretty provides a PrettyObject class whose objects operate like dictionaries. This is for users who prefer attribute . notation over item access when building structured output.

    from cdxcore.pretty import PrettyObject
    pdct = PrettyObject(z=1)
    
    pdct.num_samples = 1000
    pdct.num_batches = 100
    pdct.method = "signature"
    

General purpose utilities

  • cdxcore.verbose provides user-controllable context output for providing progress updates to users.

  • cdxcore.util offers a number of utility functions such as standard formatting for dates, big numbers, lists, dictionaries etc.

  • cdxcore.npio provides a low level binary i/o interface for numpy files.

  • cdxcore.npshm provides shared memory numpy arrays.

  • cdxcore.rolling provides robust rolling statistics: exponentially weighted location and scale estimators which flag outliers, for regular and irregular time steps.

Metadata

Release files for cdxcore 0.1.95

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for cdxcore 0.1.95
File Size Uploaded
cdxcore-0.1.95.tar.gz 277.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for cdxcore 0.1.95
File Interpreter ABI Platform
cdxcore-0.1.95-py3-none-any.whl Python 3 none any Details

Total release size: 496.7 kB

Release files / cdxcore-0.1.95.tar.gz

Download URL cdxcore-0.1.95.tar.gz
Size 277.7 kB
Tags Source
SHA-256 checksum
How to use checksums
5d9f98ca2071bc114f9218a9441811abb7bd783d8f16bcbf8b6721305773fdd4
BLAKE2b-256 checksum
How to use checksums
33ce82fe38ee1e4131f073baee3f9e7b6e57862c5d89cfa7d5731b9267152d9a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.5

Release files / cdxcore-0.1.95-py3-none-any.whl

Download URL cdxcore-0.1.95-py3-none-any.whl
Size 219.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7628844ecca4cb8343622f16b52b4aa8e5d34493651ae06a352b39d08f847cf7
BLAKE2b-256 checksum
How to use checksums
c23b5e317872e94187958188371e8bf1868e510178b47971645c1f1b8b1a6d08
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.5

Release history Release notifications | RSS feed

This release

0.1.95 This release

2 release files

0.1.91

2 release files

0.1.90

2 release files

0.1.89

2 release files

0.1.88

2 release files

0.1.87

2 release files

0.1.85

2 release files

0.1.84

2 release files

0.1.83

2 release files

0.1.82

2 release files

0.1.79

2 release files

0.1.78

2 release files

0.1.76

2 release files

0.1.75

2 release files

0.1.69

2 release files

0.1.67

2 release files

0.1.66

2 release files

0.1.65

2 release files

0.1.64

2 release files

0.1.63

2 release files

0.1.62

2 release files

0.1.61

2 release files

0.1.57

2 release files

0.1.56

2 release files

0.1.55

2 release files

0.1.54

2 release files

0.1.53

2 release files

0.1.52

2 release files

0.1.51

2 release files

0.1.50

2 release files

0.1.49

2 release files

0.1.48

2 release files

0.1.47

2 release files

0.1.46

2 release files

0.1.45

2 release files

0.1.39

2 release files

0.1.38

2 release files

0.1.37

2 release files

0.1.36

2 release files

0.1.34

2 release files

0.1.33

2 release files

0.1.28

2 release files

0.1.27

2 release files

0.1.26

2 release files

0.1.24

2 release files

0.1.23

2 release files

0.1.22

2 release files

0.1.21

2 release files

0.1.20

2 release files

0.1.19

2 release files

0.1.18

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page