Skip to main content

Utility for flashing, provisioning, and interacting with Espressif SOCs running ESP-IDF

Project description

idftool

A CLI tool built on top of esptool that is ESP-IDF partition aware.

Why idftool?

esptool is a generic tool for flashing Espressif modules that works with arbitrary flash addresses. It does not take into the ESP-IDF partition table or OTA mechanism, making it unduly difficult to perform simple tasks such as flashing a new firmware binary or pulling log data from a device - especially when dealing with multiple devices/partition tables.

idftool offers:

  • Partition-name addressing. Read, write, erase, or hex-dump a partition by name (nvs, ota_0, storage, …) — and grab slices of it with a name[start:stop] syntax.
  • OTA slot management. Inspect the active slot, switch slots, or roll back to factory without hand-computing otadata offsets. idftool list marks the running OTA partition right in the table.
  • Improved safety features. Writes are checked to ensure they do not overflow the target partition. Firmware binaries are checked to ensure compatibility with the chip being flashed.
  • Reproducible multi-binary flashing. create-bundle packs multiple partition binaries into a single ZIP; optionally flashing a partition table. write-bundle reflashes the lot in one command.

Installation

pipx (recommended)

pipx installs idftool into an isolated environment and puts it on your PATH automatically:

pipx install idftool

Install pipx first if you don't have it:

Platform Command
macOS brew install pipx
Windows winget install python.pipx
Linux / other pip install pipx

Binary

If you don't have Python, download the pre-built binary from the Releases page. Prefer the -dir archive over the single-file download — it starts instantly rather than extracting itself on each run.

At a glance

$ idftool devices
/dev/cu.usbmodem1101 || USB JTAG/serial debug unit || USB VID:PID=303A:1001 SER=...

$ idftool list
| Name     | Type | Subtype  | Offset   | Size | App description |
|----------|------|----------|----------|------|-----------------|
| nvs      | data | nvs      | 0x9000   | 16K  |                 |
| otadata  | data | ota (A)  | 0xd000   | 8K   |                 |
| phy_init | data | phy      | 0xf000   | 4K   |                 |
| ota_0    | app  | ota_0    | 0x10000  | 1M   | my-app v1.0.0   |
| ota_1    | app  | ota_1    | 0x110000 | 1M   | my-app v1.1.0 * |
| storage  | data | spiffs   | 0x210000 | 1M   |                 |

# The trailing `*` marks the currently-active OTA app

$ idftool ota build/my-app.bin
Writing 'my-app v1.2.0' to partition 'ota_0'...
Setting boot partition to 'ota_0'...

$ idftool write nvs my-nvs.bin
Writing file my-nvs.bin (size=0x4000) to partition nvs (offset=0x9000, size=0x4000)

$ idftool set-boot ota_1
Setting boot partition to 'ota_1'...

Command reference

Command Description
Discovery
devices List serial ports with hardware IDs
list Print the partition table
Partition I/O
read Read a partition (or slice) into a file
write Write one or more files to named partitions
erase Erase a partition (or slice)
view Pretty-print a partition's contents
Firmware
ota Push an app to the next OTA slot and switch to it
factory Flash an app to the factory partition
Boot selection
get-boot Show the currently-active OTA slot
set-boot Force the next boot to a specific OTA partition
clear-boot Erase otadata and let the bootloader fall back
Images
create-image Merge partition binaries into a single flash image
dump-image Dump the entire flash to an image file
write-image Write a full flash image to the device
Bundles
create-bundle Pack partition images into a ZIP bundle
dump-bundle Pack every partition from the device into a ZIP
write-bundle Flash every binary in a bundle ZIP
NVS
create-nvs Generate an NVS partition image from a CSV file
write-nvs Generate an NVS image from CSV and flash it
Misc
enter-bootloader Drop the chip into ROM bootloader mode

Discovery

devices

List the serial ports the host can see, with their descriptions and USB hardware IDs.

idftool devices

list

Print the device's partition table. With a connected ESP, idftool also reads the application descriptor of every app partition (project name, version) and marks the currently-active OTA slot with a trailing *. The selected otadata copy is shown next to the otadata partition's subtype (ota (A), ota (B), or ota (invalid) when otadata is erased).

idftool list
idftool --partition-table-file partitions.csv list   # offline

Partition I/O

read

Read a partition (or slice) into a file.

idftool read nvs nvs.bin
idftool read 'storage[-0x1000:]' tail.bin

write

Write one or more files to named partitions. Arguments come in PARTITION FILENAME pairs; you can repeat them to flash several partitions atomically.

idftool write ota_0 build/app.bin storage build/spiffs.bin

erase

Erase a partition (or slice of one).

idftool erase nvs

view

Pretty-print a partition's contents. Hex dump by default; pass -s for UTF-8 string mode and -w to tweak the dump width.

idftool view nvs
idftool view nvs -w 32
idftool view nvs -s

Firmware

ota

Push a new app image to the next OTA slot, then set it as the boot slot. idftool figures out which slot is next from otadata, writes the image, and bumps the OTA sequence counter — exactly what an OTA update from the firmware would do, just over USB.

idftool ota build/my-app.bin

factory

Write an app to the factory partition and erase otadata so the bootloader falls back to factory on next boot. If the device has no factory partition, the image is written to ota_0 instead.

idftool factory build/my-app.bin

Boot selection

get-boot

Print which OTA slot the bootloader will run on the next reset, along with the sequence number and OTA state.

idftool get-boot

set-boot

Force the next boot to a specific OTA partition by name (e.g. ota_0, ota_1).

idftool set-boot ota_1

clear-boot

Erase the otadata partition. The bootloader's fallback then kicks in: if a factory partition exists it boots factory, otherwise it boots ota_0. The OTA app images themselves are left untouched.

idftool clear-boot

Images

An image is a single contiguous flash image — everything from the primary bootloader through the partition table and partitions in one file. Useful for archiving a known-good snapshot, recovering a bricked device, or feeding production programmers that can't speak the esptool protocol.

create-image

Combine partition images into a single contiguous flash image, offline, from local files and a partition table.

idftool --partition-table-file partitions.csv create-image \
  -o merged.img --flash-partition-table \
  ota_0 build/app.bin storage build/spiffs.bin

dump-image

Read the entire flash to an image file. If no output filename is given, the file is named {chip}-{mac}-{timestamp}.img (e.g. esp32-s3-aabbccddeeff-20260522-143000.img). Works even when the on-device partition table is corrupted.

idftool dump-image                 # auto-named
idftool dump-image my-backup.img

write-image (alias: reflash)

Erase the entire flash and rewrite it from a flash image. The counterpart of dump-image.

idftool write-image build/full-flash.img

Bundles

A bundle is a plain ZIP file containing one *.bin per partition (named after the partition) and, optionally, a partition_table.csv. Bundles are useful for hand-off between build and flash steps and for archiving a reproducible "this is what shipped" snapshot.

create-bundle

Pack partition images into a bundle ZIP. Pass --flash-partition-table to embed the partition table CSV so write-bundle can also reflash it.

idftool --partition-table-file partitions.csv create-bundle \
  -o release.zip --flash-partition-table \
  ota_0 build/app.bin storage build/spiffs.bin

dump-bundle

Read every partition from the device and pack them into a bundle ZIP, always including partition_table.csv. If no output filename is given, the file is named {chip}-{mac}-{timestamp}.zip.

idftool dump-bundle                  # auto-named
idftool dump-bundle my-backup.zip

write-bundle

Flash every binary in a bundle ZIP. If the bundle contains partition_table.csv, idftool uses it (and rewrites the on-device table to match) instead of reading the table from flash.

idftool write-bundle release.zip

NVS

idftool can generate a binary NVS (Non-Volatile Storage) partition image from a CSV file, using the same format as ESP-IDF's nvs_partition_gen.py.

Example CSV:

key,type,encoding,value
storage,namespace,,
device_name,data,string,My Device
device_id,data,u32,12345
api_key,data,string,abc123def456

create-nvs

Generate an NVS partition image from a CSV file, offline. Requires either --size (explicit partition size) or --partition (look up the size from the partition table — needs --partition-table-file or a device).

idftool create-nvs nvs.csv -o nvs.bin --size 0x6000
idftool --partition-table-file partitions.csv create-nvs nvs.csv -o nvs.bin --partition nvs

write-nvs

Generate an NVS partition image from a CSV file and flash it to the named partition on the device.

idftool write-nvs nvs nvs.csv

Misc

enter-bootloader

Wait for a serial port to appear, then run the BOOT0+RESET dance to drop the chip into the ROM bootloader (a.k.a. firmware download mode) — and exit immediately, leaving the device parked for whatever tool you want to hand it off to. The port path is polled at 50 ms intervals, and transient errors (e.g. termios.error: Device not configured from a tty node that isn't fully settled) are retried silently.

idftool -p /dev/cu.usbmodem1101 enter-bootloader

Requires -p/--port.

--

Global options

These flags apply to every subcommand and go before the command name:

Flag Purpose
-p, --port PATH Serial port device. If omitted, idftool auto-picks one.
-b, --baud N Serial baud rate (defaults to esptool's ROM baud, 115200).
--no-reset Skip the hard reset that normally happens after a command.
--partition-table-file PATH Use a CSV or binary partition table from disk instead of reading it off the device.
--partition-table-offset OFFSET Where to expect the partition table in flash (default 0x8000).
--partition-table-size SIZE Size of the partition table region (default 0x1000).
--primary-bootloader-offset OFFSET Primary bootloader offset, or a chip name like esp32s3 to pick a default. Only needed when addressing the bootloader partition by name in offline mode (--partition-table-file with no device); auto-detected from a connected chip otherwise.
--recovery-bootloader-offset OFFSET Recovery bootloader offset; same scope as --primary-bootloader-offset.

The commands list, merge-bin, and create-bundle will work without a device when you supply --partition-table-file; everything else needs a connected ESP.

Partition addressing

Wherever a command takes a partition argument you can pass:

  • A name from the partition table (nvs, ota_0, storage, …).
  • A numeric address that matches an existing partition's start offset exactly — equivalent to looking the partition up by name, just keyed on its address.
  • An offset into a partition: name[offset]. Negative values count from the end. Sets the starting point for the operation. Accepted by write and merge-bin.
  • A slice of a partition: name[start:stop]. Negative values count from the end, and a +N stop is a length relative to start. Accepted by read, erase, and view. Examples:
    • nvs[0:0x100] — first 256 bytes of nvs
    • storage[-0x1000:] — last 4 KiB of storage
    • ota_0[0x1000:+0x800] — 2 KiB starting 4 KiB into ota_0

All numeric values in addresses, offsets, and sizes accept either decimal (4096) or hex (0x1000).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

idftool-0.2.0.tar.gz (28.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

idftool-0.2.0-py3-none-any.whl (21.1 kB view details)

Uploaded Python 3

File details

Details for the file idftool-0.2.0.tar.gz.

File metadata

  • Download URL: idftool-0.2.0.tar.gz
  • Upload date:
  • Size: 28.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for idftool-0.2.0.tar.gz
Algorithm Hash digest
SHA256 2b73bcc232bd07ac6c754ec68957f4f6e91050a8416c323dea11898fbd6abe71
MD5 cedc139c503ccfa12900f93dc64a727b
BLAKE2b-256 bae2d935a27c756ea900488873a293fc4c0ea1551520cc6f17cc65aedbe53f9a

See more details on using hashes here.

Provenance

The following attestation bundles were made for idftool-0.2.0.tar.gz:

Publisher: publish.yml on nebkat/idftool

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file idftool-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: idftool-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 21.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for idftool-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 92a9d1a238b3f98dff4b78da2b4de6e6da386a28e8b9355ef607f6eddc0c4591
MD5 49dda5d605209785710ca3a6b4e433f1
BLAKE2b-256 f2fc11b31a00d8c6490ae9405cff861ae8f83cbef62ce008aa53de1a2f32ac87

See more details on using hashes here.

Provenance

The following attestation bundles were made for idftool-0.2.0-py3-none-any.whl:

Publisher: publish.yml on nebkat/idftool

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page