Structured data format (sdata)
Design goals
- open data format for open science projects
- self describing data
- flexible data structure layout
- hierarchical data structure (nesting groups, dictionaries)
- (posix path syntax support?)
- extendable data structure
- data format versions
- platform independent
- simple object model
- support of standard metadata formats (key/value, ...)
- support of standard dataset formats (hdf5, netcdf, csv, ...)
- support of standard dataset types (datacubes, tables, series, ...)
- support of physical units (conversion of units)
- transparent, optional data compression (zlib, blosc, ...)
- support of (de-)serialization of every dataset type (group, data, metadata)
- easy defineable (project) standards, e.g. for a uniaxial tension test (UT)
- (optional data encryption (gpg, ...))
- change management support?
- Enable use of data structures from existing tensor libraries transparently
- (single writer/ multiple reader (swmr) support)
- (nested data support)
df = pandas.DataFrame({"a":[1,2,3]})
import sdata
data = sdata.Data(name="my_data", table=df, comment="A remarkable comment")
data.metadata.add("my_key", 123, unit="m^3", description="a volume")
data.metadata.add("force", 1.234, unit="kN", description="x force")
data.to_xlsx(filepath="my_data.xlsx")
print(data.metadata.df)
name value dtype unit description
key
name name my_data str -
uuid uuid 08222ca66e5047808bdc3b35d8f17224 str -
my_key my_key 123 int m^3 a volume
force force 1.234 float kN x force
Howto
Demo App
Try to paste some Excel-Data in the forms ...
Metadata
Attributes
- name
- value
- dtype
- unit
- description
- label
- required
dtypes for attributes
- int
- float
- str
- bool
- timestamp (datetime.isoformat with timezone)
paper
-
- Ingolf Lepenies. (2020). Das sdata-Format (Version 0.8.4). http://doi.org/10.5281/zenodo.4311323
- slides, html, pdf temperaturmessung-001.json temperaturmessung-001.xlsx
-
- Ingolf Lepenies. (2020, December 8). sdata - a structured data format (Version 0.8.4). Zenodo. http://doi.org/10.5281/zenodo.4311397
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sdata-0.25.6.tar.gz
(165.1 kB
view details)
File details
Details for the file sdata-0.25.6.tar.gz.
File metadata
- Download URL: sdata-0.25.6.tar.gz
- Upload date:
- Size: 165.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dcded7e71390e7e52db68d5ce23ae084693fc1b37b5944e9d59fe086913b12b0
|
|
| MD5 |
2eec50c614d85a6ce4f5bd4bbab59724
|
|
| BLAKE2b-256 |
89a121409f671778db64139a3662b2fc3240ba6e922a8cd01caea7983d60d9ab
|
