Utility for flashing, provisioning, and interacting with Espressif SOCs running ESP-IDF
Project description
idftool
A CLI tool built on top of esptool
that is ESP-IDF partition aware.
Why idftool?
esptool is a generic tool for flashing Espressif modules that works with
arbitrary flash addresses. It does not take into the ESP-IDF partition
table or OTA mechanism, making it unduly difficult to perform simple tasks
such as flashing a new firmware binary or pulling log data from a device -
especially when dealing with multiple devices/partition tables.
idftool offers:
- Partition-name addressing. Read, write, erase, or hex-dump a
partition by name (
nvs,ota_0,storage, …) — and grab slices of it with aname[start:stop]syntax. - OTA slot management. Inspect the active slot, switch slots, or roll
back to factory without hand-computing otadata offsets.
idftool listmarks the running OTA partition right in the table. - Improved safety features. Writes are checked to ensure they do not overflow the target partition. Firmware binaries are checked to ensure compatibility with the chip being flashed.
- Reproducible multi-binary flashing.
create-bundlepacks multiple partition binaries into a single ZIP; optionally flashing a partition table.write-bundlereflashes the lot in one command.
Installation
pipx (recommended)
pipx installs idftool into an isolated environment and
puts it on your PATH automatically:
pipx install idftool
Install pipx first if you don't have it:
| Platform | Command |
|---|---|
| macOS | brew install pipx |
| Windows | winget install python.pipx |
| Linux / other | pip install pipx |
Binary
If you don't have Python, download the pre-built binary from the
Releases page. Prefer the -dir
archive over the single-file download — it starts instantly rather than extracting
itself on each run.
At a glance
$ idftool devices
/dev/cu.usbmodem1101 || USB JTAG/serial debug unit || USB VID:PID=303A:1001 SER=...
$ idftool list
| Name | Type | Subtype | Offset | Size | App description |
|----------|------|----------|----------|------|-----------------|
| nvs | data | nvs | 0x9000 | 16K | |
| otadata | data | ota (A) | 0xd000 | 8K | |
| phy_init | data | phy | 0xf000 | 4K | |
| ota_0 | app | ota_0 | 0x10000 | 1M | my-app v1.0.0 |
| ota_1 | app | ota_1 | 0x110000 | 1M | my-app v1.1.0 * |
| storage | data | spiffs | 0x210000 | 1M | |
# The trailing `*` marks the currently-active OTA app
$ idftool ota build/my-app.bin
Writing 'my-app v1.2.0' to partition 'ota_0'...
Setting boot partition to 'ota_0'...
$ idftool write nvs my-nvs.bin
Writing file my-nvs.bin (size=0x4000) to partition nvs (offset=0x9000, size=0x4000)
$ idftool set-boot ota_1
Setting boot partition to 'ota_1'...
Command reference
| Command | Description |
|---|---|
| Discovery | |
devices |
List serial ports with hardware IDs |
list |
Print the partition table (alias of print-table) |
| Partition I/O | |
read |
Read a partition (or slice) into a file |
write |
Write one or more files to named partitions |
erase |
Erase a partition (or slice) |
view |
Pretty-print a partition's contents |
| Firmware | |
ota |
Push an app to the next OTA slot and switch to it |
factory |
Flash an app to the factory partition |
| Boot selection | |
get-boot |
Show the currently-active OTA slot |
set-boot |
Force the next boot to a specific OTA partition |
clear-boot |
Erase otadata and let the bootloader fall back |
| Images | |
create-image |
Merge partition binaries into a single flash image |
dump-image |
Dump the entire flash to an image file |
write-image |
Write a full flash image to the device |
print-image |
Print partition table and app info from a flash image file |
| Bundles | |
create-bundle |
Pack partition images into a ZIP bundle |
dump-bundle |
Pack every partition from the device into a ZIP |
write-bundle |
Flash every binary in a bundle ZIP |
print-bundle |
Print partition table and app info from a bundle ZIP |
| Partition table | |
convert-table |
Convert a partition table file between CSV and binary |
print-table |
Print a partition table from a CSV or binary file, or the device |
dump-table |
Read the partition table from the device into a file |
write-table |
Flash a partition table from a CSV or binary file |
| NVS | |
create-nvs |
Generate an NVS partition image from a CSV file |
write-nvs |
Generate an NVS image from CSV and flash it |
| Misc | |
enter-bootloader |
Drop the chip into ROM bootloader mode |
Discovery
devices
List the serial ports the host can see, with their descriptions and USB hardware IDs.
idftool devices
Partition I/O
read
Read a partition (or slice) into a file.
idftool read nvs nvs.bin
idftool read 'storage[-0x1000:]' tail.bin
write
Write one or more files to named partitions. Arguments come in
PARTITION FILENAME pairs; you can repeat them to flash several
partitions atomically.
idftool write ota_0 build/app.bin storage build/spiffs.bin
erase
Erase a partition (or slice of one).
idftool erase nvs
view
Pretty-print a partition's contents. Hex dump by default; pass -s for
UTF-8 string mode and -w to tweak the dump width.
idftool view nvs
idftool view nvs -w 32
idftool view nvs -s
Firmware
ota
Push a new app image to the next OTA slot, then set it as the boot slot. idftool figures out which slot is next from otadata, writes the image, and bumps the OTA sequence counter — exactly what an OTA update from the firmware would do, just over USB.
idftool ota build/my-app.bin
factory
Write an app to the factory partition and erase otadata so the bootloader
falls back to factory on next boot. If the device has no factory
partition, the image is written to ota_0 instead.
idftool factory build/my-app.bin
Boot selection
get-boot
Print which OTA slot the bootloader will run on the next reset, along with the sequence number and OTA state.
idftool get-boot
set-boot
Force the next boot to a specific OTA partition by name (e.g. ota_0,
ota_1).
idftool set-boot ota_1
clear-boot
Erase the otadata partition. The bootloader's fallback then kicks in: if
a factory partition exists it boots factory, otherwise it boots ota_0.
The OTA app images themselves are left untouched.
idftool clear-boot
Images
An image is a single contiguous flash image — everything from the primary bootloader through the partition table and partitions in one file. Useful for archiving a known-good snapshot, recovering a bricked device, or feeding production programmers that can't speak the esptool protocol.
create-image
Combine partition images into a single contiguous flash image, offline, from local files and a partition table.
idftool --partition-table-file partitions.csv create-image \
-o merged.img --flash-partition-table \
ota_0 build/app.bin storage build/spiffs.bin
dump-image
Read the entire flash to an image file. If no output filename is given,
the file is named {chip}-{mac}-{timestamp}.img (e.g.
esp32-s3-aabbccddeeff-20260522-143000.img). Works even when the
on-device partition table is corrupted.
idftool dump-image # auto-named
idftool dump-image my-backup.img
write-image (alias: reflash)
Erase the entire flash and rewrite it from a flash image. The
counterpart of dump-image.
idftool write-image build/full-flash.img
print-image
Inspect a flash image file without touching a device: prints the partition table embedded in the image and, for each app partition that contains a valid app, the project name, version, IDF version, compile time, ELF SHA256, and target chip.
idftool print-image build/full-flash.img
Bundles
A bundle is a plain ZIP file containing one *.bin per partition (named
after the partition) and, optionally, a partition_table.csv. Bundles
are useful for hand-off between build and flash steps and for archiving a
reproducible "this is what shipped" snapshot.
create-bundle
Pack partition images into a bundle ZIP. Pass --flash-partition-table
to embed the partition table CSV so write-bundle can also reflash it.
idftool --partition-table-file partitions.csv create-bundle \
-o release.zip --flash-partition-table \
ota_0 build/app.bin storage build/spiffs.bin
dump-bundle
Read every partition from the device and pack them into a bundle ZIP,
always including partition_table.csv. If no output filename is given,
the file is named {chip}-{mac}-{timestamp}.zip.
idftool dump-bundle # auto-named
idftool dump-bundle my-backup.zip
write-bundle
Flash every binary in a bundle ZIP. If the bundle contains
partition_table.csv, idftool uses it (and rewrites the on-device table
to match) instead of reading the table from flash.
idftool write-bundle release.zip
print-bundle
Inspect a bundle ZIP without touching a device: prints the partition
table from the embedded partition_table.csv and, for each app
partition whose .bin is present in the bundle, the project name,
version, IDF version, compile time, ELF SHA256, and target chip.
idftool print-bundle release.zip
Partition table
These commands work directly on a partition table as a file — the table
is the subject, passed as a positional argument. This is distinct from the
global --partition-table-file option, which overrides the layout other
commands use to address partitions by name. Input format (CSV or binary)
is auto-detected; output format is inferred from the file extension
(.csv/.bin) or set with --format.
When the input is a CSV that includes a bootloader row, pass
--primary-bootloader-offset (an offset or a chip name, e.g. esp32s3)
so the offset can be resolved.
convert-table
Convert a partition table between CSV and binary, offline. Handles both
directions; the binary output includes the MD5 checksum and padding, so it
is ready to flash or embed in an image. Aliased as create-table.
idftool convert-table partitions.csv partitions.bin
idftool convert-table partitions.bin partitions.csv
idftool --primary-bootloader-offset esp32s3 convert-table partitions.csv partitions.bin
print-table
Pretty-print a partition table. Given a CSV or binary file it runs offline;
with no file it reads the table from the device (or from
--partition-table-file). With a connected ESP, idftool also reads the
application descriptor of every app partition (project name, version) and
marks the currently-active OTA slot with a trailing *; the selected otadata
copy is shown next to the otadata partition's subtype (ota (A), ota (B),
or ota (invalid) when otadata is erased).
Aliased as list.
idftool print-table partitions.bin # from a file, offline
idftool print-table # from the device
idftool list # same thing
idftool --partition-table-file partitions.csv print-table
dump-table
Read the partition table from the connected device and save it. Defaults to
CSV with an auto-generated filename; pass an output file or --format to
choose otherwise.
idftool dump-table # auto-named .csv
idftool dump-table backup.bin
idftool dump-table backup.csv --format csv
write-table
Flash a partition table from a CSV or binary file to the device. The file is
required, so this never reads the device's current table and writes it back
to itself — use dump-table to pull the current table. The table is verified
before flashing (override with --force).
Only the partition map (at the partition table offset) is replaced; existing partition data on flash is not moved, resized, or erased, so a table that no longer matches the flash contents can make the device unbootable.
idftool write-table partitions.csv
idftool write-table partitions.bin --force
NVS
idftool can generate a binary NVS (Non-Volatile Storage) partition image
from a CSV file, using the same format as ESP-IDF's
nvs_partition_gen.py.
Example CSV:
key,type,encoding,value
storage,namespace,,
device_name,data,string,My Device
device_id,data,u32,12345
api_key,data,string,abc123def456
create-nvs
Generate an NVS partition image from a CSV file, offline. Requires either
--size (explicit partition size) or --partition (look up the size from
the partition table — needs --partition-table-file or a device).
idftool create-nvs nvs.csv -o nvs.bin --size 0x6000
idftool --partition-table-file partitions.csv create-nvs nvs.csv -o nvs.bin --partition nvs
write-nvs
Generate an NVS partition image from a CSV file and flash it to the named partition on the device.
idftool write-nvs nvs nvs.csv
Misc
enter-bootloader
Wait for a serial port to appear, then run the BOOT0+RESET dance to drop
the chip into the ROM bootloader (a.k.a. firmware download mode) — and
exit immediately, leaving the device parked for whatever tool you want to
hand it off to. The port path is polled at 50 ms intervals, and transient
errors (e.g. termios.error: Device not configured from a tty node that
isn't fully settled) are retried silently.
idftool -p /dev/cu.usbmodem1101 enter-bootloader
Requires -p/--port.
--
Global options
These flags apply to every subcommand and go before the command name:
| Flag | Purpose |
|---|---|
-p, --port PATH |
Serial port device. If omitted, idftool auto-picks one. |
-b, --baud N |
Serial baud rate (defaults to esptool's ROM baud, 115200). |
--no-reset |
Skip the hard reset that normally happens after a command. |
--partition-table-file PATH |
Use a CSV or binary partition table from disk instead of reading it off the device. |
--partition-table-offset OFFSET |
Where to expect the partition table in flash (default 0x8000). |
--partition-table-size SIZE |
Size of the partition table region (default 0x1000). |
--primary-bootloader-offset OFFSET |
Primary bootloader offset, or a chip name like esp32s3 to pick a default. Only needed when addressing the bootloader partition by name in offline mode (--partition-table-file with no device); auto-detected from a connected chip otherwise. |
--recovery-bootloader-offset OFFSET |
Recovery bootloader offset; same scope as --primary-bootloader-offset. |
The commands list, create-image, create-bundle, and create-nvs will
work without a device when you supply --partition-table-file; everything
else needs a connected ESP.
Partition addressing
Wherever a command takes a partition argument you can pass:
- A name from the partition table (
nvs,ota_0,storage, …). - A numeric address that matches an existing partition's start offset exactly — equivalent to looking the partition up by name, just keyed on its address.
- An offset into a partition:
name[offset]. Negative values count from the end. Sets the starting point for the operation. Accepted bywriteandcreate-image. - A slice of a partition:
name[start:stop]. Negative values count from the end, and a+Nstop is a length relative tostart. Accepted byread,erase, andview. Examples:nvs[0:0x100]— first 256 bytes ofnvsstorage[-0x1000:]— last 4 KiB ofstorageota_0[0x1000:+0x800]— 2 KiB starting 4 KiB intoota_0
All numeric values in addresses, offsets, and sizes accept either
decimal (4096) or hex (0x1000).
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file idftool-0.5.1.tar.gz.
File metadata
- Download URL: idftool-0.5.1.tar.gz
- Upload date:
- Size: 335.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c887be2ab08cb7e50f339df402a41fa5d64e13bca62e13494163dd7139f29cc3
|
|
| MD5 |
d607afaa0d4a0728414fa9ae00e408ba
|
|
| BLAKE2b-256 |
d6915270185c175f8a74089e75cee9ceb3cfb02ebc3ae6f99f452e17f4e80732
|
Provenance
The following attestation bundles were made for idftool-0.5.1.tar.gz:
Publisher:
publish.yml on nebkat/idftool
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
idftool-0.5.1.tar.gz -
Subject digest:
c887be2ab08cb7e50f339df402a41fa5d64e13bca62e13494163dd7139f29cc3 - Sigstore transparency entry: 2192424949
- Sigstore integration time:
-
Permalink:
nebkat/idftool@4ee2b69b9c2a133e23be4727d2721e15b7e22c2f -
Branch / Tag:
refs/tags/v0.5.1 - Owner: https://github.com/nebkat
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@4ee2b69b9c2a133e23be4727d2721e15b7e22c2f -
Trigger Event:
push
-
Statement type:
File details
Details for the file idftool-0.5.1-py3-none-any.whl.
File metadata
- Download URL: idftool-0.5.1-py3-none-any.whl
- Upload date:
- Size: 27.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c4fe9437665c945cd7118f5e413905bcf82f9b446034a8ace157343772d38169
|
|
| MD5 |
0ea1976972c50caae584e7f283b6e75b
|
|
| BLAKE2b-256 |
e184fbfaa3f27dc7c5de2e6d76fbddc10529c6f71a3ac1aad55861fd362b2220
|
Provenance
The following attestation bundles were made for idftool-0.5.1-py3-none-any.whl:
Publisher:
publish.yml on nebkat/idftool
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
idftool-0.5.1-py3-none-any.whl -
Subject digest:
c4fe9437665c945cd7118f5e413905bcf82f9b446034a8ace157343772d38169 - Sigstore transparency entry: 2192424993
- Sigstore integration time:
-
Permalink:
nebkat/idftool@4ee2b69b9c2a133e23be4727d2721e15b7e22c2f -
Branch / Tag:
refs/tags/v0.5.1 - Owner: https://github.com/nebkat
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@4ee2b69b9c2a133e23be4727d2721e15b7e22c2f -
Trigger Event:
push
-
Statement type: