Skip to main content

wrapper around pytables/hd5f to simplify using structured data

Project description

This module removes some of the boiler-plate code required to use the excellent pytables module to save and access structured data.

Example Usage:

>>> from simpletable import SimpleTable
>>> import tables

define a table as a subclass of simple table.

>>> RGB = tables.Enum(list('RGB'))
>>> class ATable(SimpleTable):
...     x = tables.Float32Col()
...     y = tables.Float32Col()
...     name = tables.StringCol(16)
...     color = tables.EnumCol(RGB, 'R', 'uint8')

instantiate with: args: filename, tablename

>>> tbl = ATable('test_docs.h5', 'atable1')

insert as with pytables:

>>> row = tbl.row
>>> for i in range(50):
...    row['x'], row['y'] = i, i * 10
...    row['name'] = "name_%i" % i
...    # NOTE how we have to manually translate the enum column.
...    row['color'] = RGB['G']
...    row.append()
>>> tbl.flush()

can have the enum cols automatically translated using insert

>>> data = {'x': 1000, 'y': 2000, 'color': 'G', 'name': 'flintstone'}
>>> tbl.insert(data, row)
>>> row.append()
>>> tbl.flush()

there is also insert_many() method with takes an iterable of dicts with keys matching the colunns (x, y, name) in this case.

query the data (query() alias of tables’ readWhere() note that pytables sends back the data with enum cols as they were and does nothing to translate them to their original values.

>>> tbl.query('(x > 4) & (y < 70)') #doctest: +NORMALIZE_WHITESPACE
array([(1, 'name_5', 5.0, 50.0), (1, 'name_6', 6.0, 60.0)],
       dtype=[('color', '|u1'), ('name', '|S16'), ('x', '<f4'), ('y', '<f4')])

get translated enumcols in an iterator with the .q method.

>>> r = tbl.q('x == 1000') # doctest: +NORMALIZE_WHITESPACE
>>> r # doctest: +ELLIPSIS
<generator ...>
>>> list(r)
[{'color': 'G', 'x': 1000.0, 'name': 'flintstone', 'y': 2000.0}]

or use the translate_enum method

>>> for row_with_enum in tbl.query('(x > 4) & (y < 70)'):
...     tbl.translate_enum(row_with_enum)
{'color': 'G', 'x': 5.0, 'name': 'name_5', 'y': 50.0}
{'color': 'G', 'x': 6.0, 'name': 'name_6', 'y': 60.0}

Note that using q or translate_enum will affect performance.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

simpletable-0.2.2.tar.gz (3.5 kB view details)

Uploaded Source

File details

Details for the file simpletable-0.2.2.tar.gz.

File metadata

File hashes

Hashes for simpletable-0.2.2.tar.gz
Algorithm Hash digest
SHA256 5cb028eaf37fef83821d9bfd0726c5cd4e4440dcc93e8e0ac253c11b04caa279
MD5 d88b7c1ce2b908a1ee5bf608966e074b
BLAKE2b-256 84ce6dbd6c6cfc8b672aa6f3c1e9134be6801985218610877ae8161430b50b69

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page