binda 0.1.9

Read and write binary data using Pandas

binda

Read and write binary data using Pandas.

Map the data in the binary file to variables, single data structures or repeating data structures. Once mapped, the binary file can be viewed and edited using Pandas DataFrames.

Installation

binda can be installed using pip.

pip install binda

Docs

The documentation for binda is available on GitHub Docs here: https://jamiecash.github.io/binda/binda.html

Usage

Given the following binary data (represented as hex):

42:4c:4f:43:4b:44:41:54:41:64:4a:61:6d:69:65:20
43:61:73:68:20:20:20:20:20:01:65:42:6f:62:62:79
20:53:6d:69:74:68:20:20:20:20:00:66:4d:72:20:42
65:61:6e:20:20:20:20:20:20:20:20:01:4d:72:20:41
75:74:68:6f:72:20:20:20:20:20:20:0a:00:ff:ec:00
00:f7:42

Which contaains:

• A 9 bytes string containing 'BLOCKDATA'
• 3 repeating records of 17 bytes containing a 1 byte integer ID, a 15 bytes string NAME and a 1 byte interger ACTIVE flag
• 18 bytes containing a 15 bytes string AUTHOR, a 2 bytes integer ID and a 2 bytes bigendian signed integer POINTS.

First create the data handler with the data.

data = b'BLOCKDATAdJamie Cash     \x01eBobby Smith    \x00fMr Bean        '\
      +b'\x01Mr Author      \n\x00\xff\xec\x00\x00\xf7B'

handler = bd.DataHandler(data)

The name from the first record can be read by creating a variable, specifying a name for the variable, it's size, it's datatye and it's offset.

print("Name: " + handler.read_variable(bd.Variable('name', 15, str, 10)))

Name: Jamie Cash

The 18 bytes of author data starting at offset 60 can be read into a Pandas DataFrame by specifying the layout of the structure, including its variables. The DataHandler can then be used to read it.

author_struct = \
      bd.Structure(60, [bd.Variable('AUTHOR', 15, str), 
                        bd.Variable('ID', 2, int), 
                        bd.Variable('POINTS', 2, int, 
                                    byteorder=bd.ByteOrder.BIG, signed=True)])
handler.add_structure('author', author_struct)
df = handler.read_structure('author')
df

The three row repeating structure can be read in a similar way, but this time also specifying the number of rows.

people_struct = \
  bd.Structure(9, [bd.Variable('ID', 1, int),
                    bd.Variable('NAME', 15, str),
                    bd.Variable('ACTIVE', 1, bool)], rows=3)

handler.add_structure('people', people_struct)
df = handler.read_structure('people')
df

The dataframe can be edited, and saved back to edit the binary data.

# Change Bobby Smiths name to Bobby Smythe, his ID to 200 and is active 
# status to True
df.loc[df['ID'] == 101, 'ID'] = 200
df.loc[df['ID'] == 200, 'NAME'] = 'Bobby Smythe   '
df.loc[df['ID'] == 200, 'ACTIVE'] = True
handler.write_structure('people', df)

# Confirm that the change has been made to the data by re-reading it and 
# displaying
df = handler.read_structure('people')
df

We can also check the binary data to see the change.

print(handler.data[26:43])

b'\xc8Bobby Smythe   \x01'

Examples

2 Jupyter notebooks are provided in the examples folder, one containing the code from the Usage section above and one containing an example on reading and writimg Exif data to a .jpeg file.