aws-analyzer
Understand your AWS data from a SageMaker notebook.
Install it in your notebook and get readable reports on your S3 buckets, DynamoDB tables, Bedrock knowledge bases, OpenSearch vector indexes, Lambda functions and the SageMaker notebook itself: what's there, what it costs, and what to do next. And windows you use by clicking: an explorer that shows how a knowledge base indexed each of its files, a chat window for asking it, with every setting in reach, and an explorer for your Lambda functions that reads their logs run by run.
Guides · Get started · S3 · DynamoDB · Bedrock Knowledge Bases · Knowledge base chat · SageMaker · OpenSearch · Lambda · Development · Changelog
ui.overview(): every bucket's size, estimated monthly cost and security settings, what's wrong with each, and what to run next.
Why aws-analyzer
|
🧭 The answer first Each report starts with the few numbers that matter, then explains the rest in plain English: bucket policies, lifecycle rules, knowledge base settings. The raw JSON is still there, folded away. |
💵 Findings you can act on Each warning says what's wrong, why it matters and what it costs ("costing $12.40/month"), then the next step. Reports end with the commands worth running next, arguments filled in. |
🧾 Honest about cost Estimates are labelled as estimates, with the prices used. Expensive scans stop early by default and say so, and show what they read or cost. |
📦 One install, boto3 only%pip install aws-analyzer in a notebook cell gives you every service. boto3 is the only requirement;
pandas, pyarrow and the rest are optional.
|
🔒 Read-only Nothing writes to a bucket, table or knowledge base. Where a change would help, the report shows the command (a restore, a sync, a lifecycle rule) instead of running it. |
💬 Notes, not tracebacks A missing permission, package or broken file becomes a short note that says how to fix it, and the rest of the report still renders. |
Services
| Service | What it shows you | File and guide |
|---|---|---|
| • Every bucket's size, monthly cost and risks • Folder trees, and search by name, size or date • Preview CSV, Parquet, JSON, Excel, PDF, Word and more • Cut storage costs and recover deleted files |
s3.pyGuide → |
|
| • Your buckets and folders, one click at a time • What's inside a file, as soon as you click it • Find files by name or type ( .csv), in subfolders too• Tick files and download them as one .zip |
s3_explorer.py (with s3.py)Guide → |
|
| • Every table's key, size, billing and cost • Scan, query and get items as plain tables • Which attributes the items hold, and their types • The read units each report used; scans stop early |
dynamodb.pyGuide → |
|
| • Settings in plain English, sync health and failed documents • Search with sources, pages and highlighted passages • Answers with each claim linked to its source • Compare search settings and measure retrieval hit rate |
bedrock_kb.pyGuide → |
|
| • Every file next to Bedrock's record of it: failed and why, changed, not synced, skipped • How a file was indexed: the parser, each chunk in order, its metadata • Whether a question finds a file, and where it ranks • Syncs as a timeline, search, and every setting, by clicking |
bedrock_kb.pyGuide → |
|
| • A chat window: pick the knowledge base and the model • Answers stream in, with citations, sources, request and response • Retrieve only: the search behind an answer, every passage ranked • Any RetrieveAndGenerate setting, and the setup as Python, JSON or an AWS CLI command • Test a list of questions, and see which did better after a change |
bedrock_chat.pyGuide → |
|
| • The notebook you're in: type, cost so far, idle shutdown • Its CPU, memory, disk and GPU use right now • What fills the disk, and what's safe to clear • Everything running and billing in the region, and what looks forgotten |
sagemaker_env.pyGuide → |
|
| • Every vector field in plain English: size, engine, similarity • Whether the vector graphs fit in the memory the nodes have • Documents without a vector, and zero or repeated vectors • The nearest neighbours of a question, a vector or a document |
opensearch.pyGuide → |
|
| • Every function's runtime, triggers, calls, errors and cost, in one region or all • Runtimes losing support, and functions anyone can call • Errors grouped by cause, from the function's own logs • Memory used and cold starts, and the code in its package |
lambda_functions.pyGuide → |
|
| • Every function and how it's doing, problems first: click one to open it • Its logs run by run, failed runs in red: search them, pick a time range, or watch them live • What calls it and where its results go, its errors by cause, its run times • The code in its package and every setting, by clicking |
lambda_functions.pyGuide → |
The guides walk through each service with screenshots: setting up in
SageMaker, every command, and ready-made IAM policies. Their source is in docs/.
Get started
1. Install it, in a notebook cell:
%pip install aws-analyzer # every service; only needs boto3, which SageMaker already has
%pip install "aws-analyzer[all]" # also every optional package: pandas, pyarrow, the PDF and Excel readers, progress bars
A notebook with no internet access (VPC-only mode) can install it from a bucket. On a computer that has internet, download the package and copy it to a bucket the notebook can read, once:
pip download aws-analyzer --no-deps -d wheels
aws s3 cp --recursive wheels/ s3://your-bucket/tools/wheels/
Then install it in the notebook from there:
!aws s3 cp --recursive s3://your-bucket/tools/wheels/ wheels/
%pip install --no-index --find-links wheels aws-analyzer
2. Import it and look around. It uses the notebook's IAM execution role, so there's nothing to configure:
from aws_analyzer import S3View # or DynamoDBView, BedrockKBView, SageMakerView, OpenSearchView, LambdaView,
# S3Explorer, KBExplorer, LambdaExplorer, chat
ui = S3View() # uses the notebook's IAM role
ui.help() # every command, grouped by task; ui.help("summary") shows one in full
ui.overview() # every bucket: size, monthly cost, security warnings
s3 = ui.core # the analyzer behind the view: returns data instead of a report
NOTE: Only boto3 is required, and SageMaker already has it. pandas, pyarrow and the other packages are optional: a command that needs one that isn't installed says which to install instead of failing.
Each service is a module of the package:
aws_analyzer.s3,aws_analyzer.dynamodb,aws_analyzer.bedrock_kb,aws_analyzer.bedrock_chat,aws_analyzer.sagemaker_env,aws_analyzer.opensearch,aws_analyzer.lambda_functionsandaws_analyzer.s3_explorer. The Analyzer and View classes,S3Explorer,KBExplorer,LambdaExplorerandchatalso come straight fromaws_analyzer.
Options: another profile or region, plain text, longer tables, progress bars
from aws_analyzer import S3Analyzer, S3View
ui = S3View(S3Analyzer(profile="dev", region="eu-west-1")) # another AWS profile or region
ui = S3View(mode="text") # plain text, e.g. in a terminal or a script
ui = S3View(max_rows=0) # show every row of long tables (default: 50)
ui = S3View(progress="plain") # a plain progress line instead of tqdm bars ("off" for none)
Every View takes the same options. Commands that take a while show a progress bar as they run: a
tqdm bar (a widget in Jupyter when ipywidgets is installed) with the rate and the
time left, when tqdm is installed, as it usually is on SageMaker. Without it you get a plain line with the same
numbers.
How it works
Every file has the same two layers:
| Layer | Class | What it does |
|---|---|---|
| Logic | S3Analyzer, DynamoDBAnalyzer, BedrockKBAnalyzer, BedrockChatAnalyzer, SageMakerAnalyzer, OpenSearchAnalyzer, LambdaAnalyzer |
Calls AWS, returns plain Python data (dataclasses, dicts, lists, DataFrames). Never prints. |
| UI | S3View, DynamoDBView, BedrockKBView, BedrockChatView, SageMakerView, OpenSearchView, LambdaView |
Wraps the analyzer and renders readable cards, bar tables and previews in the notebook (HTML in Jupyter, text in a terminal). |
Reading a report
Every report has the same shape, so the answer is always in the same place:
- Title and cards: the few numbers that matter. A card turns amber (or red) when a finding below is about it,
such as
Encryption: noneorPoint-in-time recovery: off. In text mode those cards end in(!). - Findings: what's wrong or worth knowing, warnings first. Each says why it matters, what it costs when that can be priced, and the next step. When every check passes, the report says so. In S3 reports each finding leads with a bold headline, then the why and the what-to-do as points.
- Tables of detail. Status cells such as
FAILEDorPUBLICare coloured. Long tables scroll under a fixed header, and secondary views (tags, the raw policy JSON) are folded: click to open them. In S3 reports, click a column's header to sort by it (again for the other way), pick a value in a column's filter to see only those rows (a storage class, a region), and untick the columns you don't need under Columns. Long keys keep the file name in view: the folder is shortened from the left, and the whole key shows when you hover over it. - Next: two or three commands worth running next, with the arguments filled in from this report, such as
get('orders', 'USER#0', 'ORDER#0000')after a scan orchunk(1)after a search.
ui.table_info("acme-app"): the point-in-time recovery card is amber because the finding below is about it, and the finding ends in the command that turns it on.
In the notebook, one click on a command anywhere in a report (documents(status='FAILED'),
aws dynamodb update-table ...) or on a code block (a restore call, a lifecycle rule, a sync command) selects all of
it, ready to copy. The HTML is plain HTML and CSS, with no JavaScript, so a report still works when the notebook is
reopened. ui.help() lists every command grouped by task, with a few to start with; ui.help("summary") shows one
command's full description.
Amazon S3
Buckets and the files in them. Every bucket's size, cost and risks, what's in a folder, a look inside the files,
and what you could save.
📄 src/aws_analyzer/s3.py · 📖 S3 guide
ui.preview() of a Parquet file: row, column and row-group counts, the first rows and the schema, reading only what it needs.
Quick start
Install the packages first, in a notebook cell (in a terminal, drop the %). On SageMaker, pandas and pyarrow are
already installed, so aws-analyzer alone is enough, and the optional packages only for the file types they read.
%pip install aws-analyzer pandas pyarrow # the commands below
# optional: Excel, PDF text and pages, .zst, snappy Avro, progress bars
%pip install openpyxl xlrd pypdf pypdfium2 pillow zstandard python-snappy tqdm
# or all of the above in one go
%pip install "aws-analyzer[all]"
What each package is for
| Package | Needed for |
|---|---|
boto3 |
Every command (required) |
pandas |
Tables in preview (CSV, JSON, Avro, Excel, NumPy), read_df, objects_to_df, to_df(). Installs numpy for .npy / .npz |
pyarrow |
.parquet, .orc, .feather, .arrow in preview, read_df and file_details, and parquet_info |
openpyxl / xlrd |
Excel .xlsx / .xlsm and old .xls |
pypdf |
PDF text in preview, document, read_pdf, and page counts in file_details |
pypdfium2 + pillow |
PDF pages drawn as pictures, the way they print (scanned pages too), in preview, document, render_pdf. pillow also shrinks big pictures in Word files before showing them |
zstandard |
.zst files before Python 3.14 |
python-snappy |
Avro files compressed with snappy |
tqdm |
Progress bars with the time left while long commands run (ipywidgets makes them notebook widgets). Without it, a plain progress line |
IPython, used for the HTML output, comes with Jupyter. If a package is missing, the command tells you which one to install instead of failing; install it and run the cell again.
from aws_analyzer import S3View
ui = S3View() # uses the notebook's execution role
ui.help() # every command, grouped by task
ui.help("summary") # one command in full
ui.overview() # every bucket: size, monthly cost, security warnings
ui.bucket_info("my-bucket")
ui.summary("s3://my-bucket/data/")
ui.preview("s3://my-bucket/data/part-0.parquet")
ui.what_if("s3://my-bucket/logs/", move_after=30, to="STANDARD_IA") # preview a lifecycle rule
TIP: Anywhere a location is expected you can pass
s3://bucket/prefixorbucket/prefix. Sizes accept1024,"10MB","1.5GB"; times accept adatetime,"2024-05-01", or relative"7d","12h".
Browse like a file explorer
s3_explorer.py turns a cell into a small file explorer for S3. Folders and files are
listed on the left. Click a folder to open it, or click a file to see what's inside it on the right, drawn by the
same preview as above: a table's first rows, a PDF's pages, a Word file with its pictures, an archive's contents.
📄 src/aws_analyzer/s3_explorer.py · 📖 Explorer guide
S3Explorer(): from your buckets to a Parquet file's first rows, a Word document, and every model file below a folder, one click at a time.
It builds on s3.py, which comes with it in the package. Clicking needs ipywidgets, which SageMaker notebooks
already have.
from aws_analyzer import S3Explorer
S3Explorer() # start from your buckets
S3Explorer("s3://my-bucket/data/") # or in a folder; S3 console links work too
S3Explorer("s3://my-bucket/data/report.pdf") # a file's folder, with the file shown
| To | Do this |
|---|---|
| Open a folder | Click it. ← → ↑ go back, forward and up, and each part of the path at the top opens that folder |
| See what's in a file | Click it. 🏷️ Details shows its metadata and tags, 📖 Read all a whole PDF, Word or PowerPoint file, 📄 Text a PDF's words laid out to read, ⬇ Download saves a copy in s3-downloads next to your notebook, and ↗ Open in new tab opens the file in your browser (PDFs, pictures, video and text show there). On a JSON file, ▾ Expand all opens every object and array at once (and stays on for the next ones). Clicking through files doesn't wait: each click shows its file as soon as it's read, and files you clicked past are skipped |
| Read a PDF | Click 📖 Read all: every page as it looks, 20 at a time, with buttons at the end for the next pages and each page's text folded underneath. Click a page to see it as big as the notebook; ‹ › step to the pages before and after, and ✕ goes back |
| Read a PDF's text | Click 📄 Text: its words, 50 pages at a time, laid out to read like a web page: headings, paragraphs joined back up from the PDF's lines, bullet and numbered lists, and a line where each page starts. The running headers, footers and page numbers are left out (a note says which), and a page with no text (a scan) says so; 📖 Read all shows it as a picture |
| Go to a path | Click ✎, paste an s3:// path or an S3 console link, and press Enter |
| Find files | Type part of a name, or a file type such as .csv (.csv .json for either; it also finds .csv.gz), in the search box over the list, or click a type's chip under it. Folders and Files show only one kind, and Include subfolders searches everything below the folder, not only its first level. Click Name, Size or Modified to sort; sizes and dates sort biggest and newest first |
| Add up a folder | Open it and click 📊 What's in here: every file below it, with sizes, types, cost and findings (the summary report) |
| Download a folder | Open it and click ⬇ Download .zip: everything below it in one .zip in s3-downloads next to your notebook (right-click it in the file browser to get it onto your computer), if it's within 100 MB and 10,000 files. ⚙ raises those limits and picks the folder downloads go to. It checks the disk space and read access first, and writes nothing if a check fails (the download_zip report) |
| Download some files | Tick them (a checkbox shows when you point at a row, and the one in the header ticks everything listed, such as every .csv the search found), then click ⬇ Download selected in the bar under the list. The right shows what goes in and suggests a name, such as churn-12-files.zip, which you can change; ⬇ Download makes it, after the same checks |
A big folder shows its first 1,000 entries at once and lists the rest in the background, up to 10,000, so the
search, the sort and the counts cover the whole folder; the list shows 100 rows a page, with « ‹ › »
under it. Past 10,000 entries, Load more from S3 lists the next 10,000, and Look up asks S3 for the names that
start with what you typed in the search box. Include subfolders lists 10,000 files below the folder at a time. Files in GLACIER or DEEP_ARCHIVE are marked ❄,
and opening one shows the command that restores it. Like s3.py, it only reads: browsing needs
s3:ListAllMyBuckets and s3:ListBucket, and opening files s3:GetObject.
Options, and using it from code
from aws_analyzer import S3Analyzer
from aws_analyzer import S3Explorer, S3Navigator
S3Explorer("s3://my-bucket/", profile="dev") # another AWS profile (or region=)
S3Explorer(core=S3Analyzer(region="eu-west-1")) # an S3Analyzer or S3View you already have
S3Explorer(height=720, page_size=200) # 720px panes (else they fill the window), 200 rows a page
S3Explorer(zip_max_size="2GB") # zip folders up to 2 GB (x.zip_max_files too)
S3Explorer(downloads="~/scratch/s3") # where ⬇ Download and the zips save (x.downloads)
x = S3Explorer("s3://my-bucket/")
x.open("s3://my-bucket/raw/"); x.back(); x.up(); x.refresh() # the toolbar, from code
x.filter(".parquet", subfolders=True) # the search box: every Parquet file below this folder
x.filter(kind="folders") # only the folders here; x.filter() shows everything again
x.ui.download_zip(x.picked) # what's ticked in the list, as one .zip
x.ui.summary(x.location) # any S3View report about where you are, in its own cell
nav = S3Navigator() # the same navigation as data, with no UI
folder = nav.open("s3://my-bucket/data/") # Folder: entries, more, error
nav.more(), nav.back(), nav.up(), nav.lookup("2024-")
nav.below() # everything below the folder, 10,000 files at a time
Outside Jupyter, without ipywidgets, or with mode="text", each folder prints as a table and open(...) moves
around. The pure functions work on their own: parse_location (s3:// paths, bucket/key, console links and object
URLs), breadcrumbs, parent_uri, sort_entries (folders first, part-2 before part-10), filter_entries and
parse_filter (what a search like "churn .csv .json" asks for), count_types and folder_stats.
Commands (S3View)
Grouped the way ui.help() lists them.
Buckets
| Command | Shows |
|---|---|
buckets() |
All buckets with region, creation date, age |
overview(match=None) |
Every bucket in one table: objects, size, estimated monthly cost, versioning, encryption, public access, lifecycle rules, and a list of warnings. match="sagemaker-*" checks only matching names |
bucket_info(bucket) |
Versioning, encryption, public access (bucket and account level), bucket policy and lifecycle rules in plain English, ownership, object lock, replication, logging, inventory, tags, plus CloudWatch object count, size and estimated monthly cost per storage type (instant, even for billion-object buckets), and flagged risks |
policy(bucket) |
The bucket policy in plain English (who can do what, on which files, under which conditions), its risks (public access, other accounts, no HTTPS requirement) and the raw JSON |
Explore a folder
| Command | Shows |
|---|---|
ls(uri, details=False) |
One level of folders and files, like aws s3 ls. details=True adds what's inside each file: a PDF's pages, a table's rows and columns, a picture's size |
tree(uri, depth=2, files=10) |
Folder tree with count, size and share at every level, and the files in each folder (the first files by name, then one "… N more files" row; files=0 for folders only) |
summary(uri) |
Dashboard: totals, estimated monthly cost, folder breakdown, file types, storage classes, size and age histograms, largest objects, and findings (small-file problem, archived objects, cold data in STANDARD and what moving it would save, files under 128 KB billed as 128 KB, empty files) |
find(uri, pattern=, regex=, extensions=, min_size=, max_size=, modified_after=, modified_before=, storage_classes=) |
Search by glob, regex, extension, size, date or storage class, e.g. find(uri, pattern="*.csv", min_size="10MB", modified_after="7d") |
file_details(uri, pattern=, extensions=, limit=200, max_read="1GB") |
What's inside each file, a table per kind (see what it reports): a PDF's pages, title, author and whether it has text, a Word file's words, a deck's slides, each Excel sheet's size, a table's rows and column names, a picture's size, a video's length, an archive's files. Findings: scanned PDFs that need OCR, password-protected files, files that aren't what their name says, table files in one folder with different columns. Reads only the parts each format needs |
largest(uri) / newest(uri) / oldest(uri) |
The top-N objects under a prefix: the biggest, the newest or the oldest |
compare(uri_a, uri_b) |
Diff two prefixes: identical / different / only in A / only in B (to verify a copy or sync) |
Cut cost
| Command | Shows |
|---|---|
duplicates(uri, method="hash", min_size=1, max_read="10GB") |
Identical files, the space and monthly cost of their copies, which copy to keep, and folders that hold nothing but copies (e.g. a backfill of files that exist elsewhere), plus the call that gets the list as a DataFrame. Files are matched by size and ETag, and where same-size files have different ETags (copies uploaded in parts of another size, or encrypted with SSE-KMS), by the SHA-256 of their content: the first 64 KB first, the whole file only where those match, reading at most max_read. method="etag" reads nothing; method="strict" hashes every file that shares its size |
what_if(uri, move_after=, to=, delete_after=) |
Preview a lifecycle rule before adding it: how many files it would move or delete today, cost before and after, one-time cost and payback time, plus the rule's JSON. move_after={30: "STANDARD_IA", 180: "GLACIER"} for several moves |
uploads(uri) |
Incomplete multipart uploads (billed but invisible in normal listings) and what they cost |
Versions and deleted files
| Command | Shows |
|---|---|
versions(uri) |
Current vs noncurrent versions, delete markers, what the old versions cost per month, keys holding the most old-version data |
history(uri) |
Version history of one object |
deleted(uri, deleted_after=None) |
Deleted files you can still bring back in a versioned bucket (most recent first), their size, the old versions kept, and the call that restores one. Read-only: it never restores anything itself |
Open a file
| Command | Shows |
|---|---|
head(uri) |
All object metadata, user metadata and tags |
preview(uri, n=20) |
Looks inside a file (see file types): tables as a DataFrame with their schema, the files in an archive, tensors, notebook cells, JSON as a tree you fold with a click (coloured like code), text, images, an audio / video player, a PDF's first pages as they look (scans too; click a page to see it full size), a Word file with its pictures in place, or a hex dump. Only downloads what it needs. |
document(uri, pages=None, pictures=None) |
A PDF, Word .docx or PowerPoint .pptx as it reads: a Word file with its headings, lists, tables and pictures in place, a PDF's text laid out to read (headings by font size, paragraphs joined back up from the PDF's lines, lists, a line where each page starts, no running headers, footers or page numbers), a deck slide by slide. PDF pages with no text (scans) are drawn as pictures; pictures=True draws every page (its text folded under it), pictures=False none, and a click on a drawn page shows it as big as the notebook. PDFs need pypdf, and pypdfium2 + pillow to draw pages |
link(uri) |
Clickable presigned download link |
Download
| Command | Shows |
|---|---|
download(uri, path=None) |
Downloads a file, or a whole folder with its sub-folders, with a progress bar, and says where it went: the downloads folder (s3-downloads, next to the notebook) unless you pass a path. Files already there with the same size and time are skipped, so running it again resumes. GLACIER files are listed as needing a restore, and it refuses when the disk hasn't room. For a table file it shows the pandas call that opens it |
download_zip(uri, path=None, max_size="100MB", max_files=10_000, dry_run=False) |
A file or folder (or a list of them from one bucket, laid out under the folder they share) as one .zip in the downloads folder, but first a check of whether this notebook can make it: the files fit the size limit (100 MB by default) and file count, the disk has room, memory, and the role can read them (one 1-byte read). If a check fails nothing is downloaded, and the report says what to change (e.g. the max_size= that would fit). dry_run=True only runs the checks. GLACIER files are left out and listed; parquet, gz and images are stored as they are, the rest compressed |
downloads() |
What you've downloaded: each file, folder and zip in the downloads folder with its size and when it was downloaded, how much disk they take, and findings: unfinished zips a stopped download_zip left, a disk running out of room, downloads over a month old, each with the clean_downloads(...) call that deletes them |
clean_downloads(names=None, older_than=None, dry_run=False) |
Deletes downloads to free the disk: all of them, the ones named (clean_downloads('churn.zip')), or those downloaded before older_than ('7d', '2024-05-01'). dry_run=True only shows what would go. It only empties a folder made for downloads, never the notebook's own folder or one that held other files first, and nothing in S3 changes |
Downloads go in s3-downloads, a folder next to the notebook, so they don't mix with your notebooks and code. It's
made with the first download, with a .gitignore that keeps it out of git and marks it as a folder clean_downloads()
may empty. To use another folder, pass downloads=; a path on one download saves that one elsewhere:
ui = S3View(downloads="~/scratch/s3") # or ui.core.downloads = "~/scratch/s3"
ui.download("s3://my-bucket/data/") # ~/scratch/s3/data/
ui.downloads() # what's there, how much disk it takes
ui.clean_downloads(older_than="7d") # delete what was downloaded before this week
Reference
Getting the data (S3Analyzer): the same answers as Python data, for pandas and your own code
ui.core is the S3Analyzer. Every UI command has a data method on it, and there are a few more:
s3 = ui.core # or S3Analyzer(region="us-east-1", profile="dev")
summary = s3.summarize("s3://my-bucket/data/") # PrefixSummary dataclass
summary.by_extension["parquet"].size # bytes
files = s3.find("s3://my-bucket/data/", extensions=["csv"], modified_after="7d")
df = objects_to_df(files) # key, size, last_modified, storage_class, ...
df = s3.read_df("s3://my-bucket/data/big.parquet", nrows=1000, columns=["id", "ts"])
df = s3.read_df("s3://my-bucket/reports/q1.xlsx", sheet_name="Summary")
df = s3.read_df("s3://my-bucket/spark/part-00000", fmt="parquet") # no extension: say what it is
s3.parquet_info("s3://my-bucket/data/big.parquet") # rows, row groups, schema (reads only the footer)
s3.list_archive("s3://my-bucket/job/output/model.tar.gz").entries # files inside, without extracting
details = s3.file_details("s3://my-bucket/docs/", extensions="pdf") # FileDetailsReport: .files, bytes_read
details.to_df() # one row per file: format, size, summary, pages, title, rows, ...
s3.describe_objects(s3.find("s3://my-bucket/", min_size="1GB")) # the same, for files you picked
s3.read_avro("s3://my-bucket/events.avro", n=100), s3.read_npy(uri, nrows=10), s3.safetensors_info(uri)
doc = s3.read_document("s3://my-bucket/docs/policy.pdf") # also .docx / .pptx: doc.text, doc.parts, doc.title
s3.read_pdf(uri, pages=[1, 2]), s3.read_docx(uri).headings, s3.read_pptx(uri).notes
pdf_flow(s3.read_pdf(uri, layout=True)) # [('h1', 'Refunds'), ('p', '...'), ('li', '...'), ...]: the text to read
pages = s3.render_pdf(uri, pages=[1, 2]) # [Picture]: each one shows itself in a notebook; .data is PNG / JPEG
s3.read_docx(uri, pictures=True).pictures # the pictures in a Word file, in reading order
s3.read_lines("s3://my-bucket/logs/app.log.gz", 50)
s3.read_json(...), s3.read_jsonl(..., n=100), s3.read_text(...), s3.read_bytes(uri, 0, 1023)
with s3.open("s3://my-bucket/data/x.csv.gz") as f: ... # streaming, decompressed
for obj in s3.iter_objects("s3://my-bucket/"): # stream a listing without holding it in memory
...
reports = s3.bucket_reports(match="sagemaker-*") # BucketConfig + CloudWatch size per bucket
explain_policy(s3.bucket_policy("my-bucket"), s3.account_id()) # [PolicyStatement], plain English
impact = s3.simulate_lifecycle("s3://my-bucket/logs/", move_after=30, to="STANDARD_IA")
impact.monthly_savings, impact.rule() # USD per month, the rule as a dict
s3.deleted_files("s3://my-bucket/data/", deleted_after="7d").files # [DeletedObject]
dupes = s3.find_duplicates("s3://my-bucket/data/") # DuplicateReport: groups, copies, reclaimable, monthly_cost
dupes.to_df() # one row per file: group, role ('keep' / 'copy'), key, sha256, ...
s3.download_folder("s3://my-bucket/data/", "data") # FolderDownload; s3.download(uri, path) for one file
plan = s3.plan_zip("s3://my-bucket/data/") # ZipPlan: files, size, disk / memory free, can_download
s3.download_zip("s3://my-bucket/data/", max_size="1GB").plan.path # ZipDownload; nothing written if a check fails
s3.list_downloads().entries # [LocalDownload]: what's in the downloads folder (s3.downloads_folder())
s3.clean_downloads(older_than="30d").freed # DownloadsCleanup; dry_run=True deletes nothing
The aggregation functions are pure (no AWS calls), so they also work on your own lists of ObjectInfo,
for example rows loaded from an S3 Inventory report: summarize_objects, build_folder_tree,
make_filter, find_duplicate_groups, compare_objects, simulate_lifecycle_objects, summary_findings,
bucket_findings, explain_policy, policy_findings, object_monthly_cost, cloudwatch_cost, the duplicate
finder's steps (files_to_hash says which files need reading, group_duplicates groups them given the hashes you
have, then duplicate_folders and duplicate_findings), zip_checks and zip_findings (on a ZipPlan), and the
file parsers parse_docx (pictures=True for its pictures), parse_pptx, parse_pdf (layout=True keeps where
each line sits, its size and weight), parse_avro, and render_pdf_pages, which draws a PDF's pages from a local file
or bytes. pdf_flow turns a PDF read with layout=True into headings, paragraphs and list items (the reading view
document and the explorer's 📄 Text show), and pdf_furniture lists the running headers and footers it leaves
out. describe_file("local.pdf") (or a binary file
object and its name) says what's inside a file the way file_details does, and file_details_findings works on a
FileDetailsReport.
File types: what preview and read_df can open
preview and read_df pick the reader from the file name, and from the first bytes when the name has
no extension or the wrong one (Spark's part-00000, a Firehose object, a .gz that isn't gzipped).
| Kind | Extensions | preview shows |
read_df |
|---|---|---|---|
| Delimited text | .csv .tsv .psv |
first rows | ✓ |
| JSON | .json .jsonl .ndjson |
table of records, or a tree you fold with a click, coloured like code; a string holding JSON is shown unpacked, and a file too big to read whole shows its start | ✓ |
| Columnar | .parquet .orc .feather .arrow |
first rows, schema, row count (reads only what it needs) | ✓ |
| Avro | .avro |
first rows, schema, codec (built-in reader; snappy needs python-snappy) |
✓ |
| Excel | .xlsx .xlsm .xls |
sheet names, first rows (needs openpyxl; .xls needs xlrd) |
✓ sheet_name= |
| NumPy | .npy .npz |
shape, dtype, first rows / the arrays inside | ✓ .npy up to 2-D |
| Archives | .zip .tar .tar.gz .tgz |
the files inside, e.g. a SageMaker model.tar.gz |
|
| Models | .safetensors .pt .pth .ckpt .pkl .joblib |
tensors, shapes, parameter count / files inside; pickles are never loaded | |
| Notebooks | .ipynb |
kernel and cells | |
| Images, audio, video | .png .jpg .gif .webp / .wav .mp3 .flac / .mp4 .webm .mov |
the image / a player | |
.pdf |
the first 3 pages as they look, scanned pages too (needs pypdfium2 + pillow), page count, title and first page's text (needs pypdf); without either, a link |
||
| Word | .docx .docm .dotx |
the first paragraphs laid out with their headings, lists, tables and pictures in place; word count (no package needed) | |
| PowerPoint | .pptx .pptm .ppsx |
every slide's title and text, speaker notes (no package needed) | |
| Old Office | .doc .ppt .msg |
recognised, with how to convert them (the old binary format can't be read) | |
| Text | .txt .log .md .yaml .xml .sql .py and more |
first lines |
Any of them can also be compressed: .gz, .bz2, .xz, or .zst (Python 3.14+, or pip install zstandard).
Packages in the table are optional; without them preview says what to install.
File details: what file_details and ls(details=True) report for each kind of file
Each file's format comes from its name and is checked against its first bytes, so a file with no extension is still
described and one with the wrong extension is flagged ("report.pdf is text, not a PDF"). Counts marked ≈ are
estimates from the start of the file, and + marks a lower bound.
| Kind | Extensions | Reports | Reads |
|---|---|---|---|
.pdf |
pages, whether the first 3 pages have text (none = probably scanned), page size (A4, Letter, …), title, author, the app that made it, creation date, PDF version, whether it needs a password | the page tree and first 3 pages (needs pypdf) |
|
| Word | .docx .docm .dotx |
words, pages (as Word last saved them), headings, tables, pictures, title, author, last saved | the document's text |
| PowerPoint | .pptx .pptm .ppsx |
slides, words, slides with speaker notes, tables, pictures, title, author | the slides' text |
| Excel | .xlsx .xlsm |
each sheet's name and rows × columns, title, author | the size saved at the top of each sheet |
| Parquet | .parquet |
rows, column names, row groups, compression, the program that wrote it | the footer (needs pyarrow) |
| ORC, Feather | .orc .feather .arrow |
rows, column names, compression, stripes / record batches | the metadata (needs pyarrow) |
| Avro | .avro |
rows, column names, codec | block headers, in files up to 64 MB |
| CSV, JSON lines | .csv .tsv .psv .jsonl .ndjson |
column names, rows: exact up to 256 KB, then ≈ estimated, or + when compressed |
the first 256 KB |
| JSON | .json |
records and their keys, or an object's keys | up to 16 MB |
| Pictures | .png .jpg .gif .bmp .webp, TIFF |
format, width × height | the first 64 KB |
| Audio, video | .wav .flac .mp4 .mov .m4a |
length; sample rate and channels; width × height | the header / the MP4 moov box |
| Archives | .zip .tar .tar.gz .tgz |
files inside, unpacked size | the zip index / tar headers |
| Models, arrays | .safetensors .npy .npz .pt .pth .pkl |
tensors, parameters, dtypes / shape / arrays / files inside; pickles are never loaded | headers only |
| Notebooks | .ipynb |
cells, code cells, outputs, kernel | up to 50 MB |
| Text | .txt .log .md and more |
lines | the first 256 KB |
Cost estimates: storage only, at us-east-1 list prices, or yours
Costs are storage only (no requests, retrievals or data transfer), at us-east-1 list prices for the first
50 TB (S3_PRICES). They follow S3's billing rules: STANDARD_IA, ONEZONE_IA and GLACIER_IR bill at least
128 KB per object, and GLACIER / DEEP_ARCHIVE add 40 KB of index data per object. Listings don't say which
Intelligent-Tiering tier an object is in, so it's priced at the frequent-access rate; CloudWatch does, so
bucket_info and overview price each tier. For another region, pass your prices:
ui = S3View(S3Analyzer(prices={"STANDARD": 0.025, "STANDARD_IA": 0.0138}))
Large buckets: how long each command takes on millions of objects, and what to run first
summary,tree,find,duplicatesandcomparelist every key under the prefix (1,000 per request), so expect about 1 to 3 minutes per million objects. A progress bar shows while they run. Passlimit=to sample.duplicatesalso downloads files that share a size but not an ETag: 64 KB of each, then whole files only where those match, 16 at a time, biggest possible saving first, and it stops atmax_read(10 GB by default). It says how much it read. That download is free inside the bucket's region; from outside AWS it's billed as data transfer.method="etag"reads nothing.download_zipcounts at mostmax_fileskeys (10,000 by default) before it decides, so it answers quickly even on a huge folder, and it only downloads once every check passes.what_iflists every key too;deletedandversionslist every version.bucket_inforeads the bucket's size from CloudWatch without listing anything. Use it first on huge buckets.overviewmakes about 15 read calls per bucket, 8 buckets at a time, and lists no keys.file_detailslooks inside the first 200 files (limit=), 8 at a time, in 256 KB ranged requests, reading only what each format needs (a PDF's page tree, a parquet footer, a picture's header), at most 128 MB of one file, and stops atmax_read(1 GB by default). It says how much it read.lsonly lists one level, so it's fast anywhere.ls(details=True)also reads a little of each file listed.
IAM permissions: read-only, and what each one is for
Read-only. Grant what you need:
| Permission | For |
|---|---|
s3:ListAllMyBuckets, s3:GetBucketLocation |
The list of buckets (also the explorer's first page), and each bucket's region |
s3:ListBucket, s3:ListBucketVersions |
Listing files (also in the explorer), their old versions and delete markers |
s3:ListBucketMultipartUploads, s3:ListMultipartUploadParts |
Incomplete multipart uploads |
s3:GetObject |
Reading files: preview, document, file_details, ls(details=True), duplicates, download / download_zip |
s3:GetObjectTagging |
Object tags |
The s3:GetBucket* / s3:GetLifecycleConfiguration / s3:GetReplicationConfiguration / s3:GetEncryptionConfiguration / s3:GetInventoryConfiguration family |
The settings in bucket_info, including s3:GetBucketPolicy for policy |
s3:GetAccountPublicAccessBlock |
The account-level public access setting |
cloudwatch:ListMetrics, cloudwatch:GetMetricData |
Bucket sizes |
Anything you can't read shows up as a note instead of an error. The S3 guide has a ready-made IAM policy that covers every command.
Amazon DynamoDB
Tables and the items in them. Every table's keys, size, billing and cost, the items as plain tables, and what
they hold.
📄 src/aws_analyzer/dynamodb.py · 📖 DynamoDB guide
ui.scan() with a where= filter: ten failed orders over 300, found by reading 1,619 items, the read units that took, and why a query would be cheaper.
Quick start
Install the packages first, in a notebook cell (in a terminal, drop the %). On SageMaker both are already
installed.
%pip install boto3 # every command (required)
%pip install pandas # optional: DataFrames (page.to_df(), profile.to_df(), items_to_df)
Every DynamoDBView command works with boto3 alone; IPython, used for the HTML output, comes with Jupyter.
from aws_analyzer import DynamoDBView
ui = DynamoDBView() # uses the notebook's execution role and region
ui.help() # every command, grouped by task
ui.help("scan") # one command in full
ui.tables() # every table in the region: key, items, size, est. cost, warnings
ui.table_info("orders") # indexes and how to query each, capacity, usage, backups, risks
ui.scan("orders") # the first 20 items as a table...
ui.more() # ...and the next 20
ui.schema("orders") # what the items look like
ui.get("orders", "USER#42", "ORDER#0017")
ui.query("orders", "USER#42", sort=("begins_with", "ORDER#"))
NOTE: Tables are regional:
DynamoDBView(DynamoDBAnalyzer(region="eu-west-1"))looks at another region. Items are shown and returned as plain Python, not DynamoDB JSON: numbers areint/float, sets are sets, binary isbytes. Nothing in the file writes to a table.
Commands (DynamoDBView)
Grouped the way ui.help() lists them.
Tables
| Command | Shows |
|---|---|
tables(match=None) |
Every table in the region in one table: key, item count, size, billing mode, indexes, estimated monthly cost (including on-demand requests at the last 24 hours' rate) and a list of warnings. match="prod-*" checks only matching names |
table_info(table) |
Keys and types, every index with its projection and the query(...) call that reads it, billing and capacity, CloudWatch usage over the last 24 hours (consumed units, busiest 5 minutes, throttling), TTL, stream, point-in-time recovery, deletion protection, encryption, tags, estimated monthly cost, and flagged risks, each with what to do about it: no point-in-time recovery (with its cost and the command that turns it on), throttling, capacity near its limit, or capacity far above what's used (with what less capacity or on-demand would cost) |
Look at items
| Command | Shows |
|---|---|
sample(table, n=20) |
About n items spread across the whole key space. scan shows the start of the table, which can all be one partition key; this reads a few items from many slices of it |
scan(table, n=20, where=, index=, attributes=) |
Items from the start of the table (or an index) as a table: key attributes first, then the others by how many items have them, nested maps as address.city columns. Shows how many items were read to find them and the read units used |
query(table, partition, sort=None, index=, where=, descending=) |
Items sharing one partition key, in sort-key order, on the table or an index |
get(table, *key) |
One item with every nested map and list expanded, the type of each attribute, its size and read / write cost. as_json=True adds a JSON copy |
sql(statement, *params) |
A PartiQL statement, e.g. sql('SELECT * FROM "orders" WHERE pk = ?', "USER#42") |
more() |
The next page of the last scan, query or sql |
Understand the data
| Command | Shows |
|---|---|
schema(table, n=1000) |
Every attribute and map field: type (or mix of types), share of items that have it, distinct values, examples, range. Key patterns such as USER#<number> and ORDER#<date>, which show the entity types of a single-table design. Item sizes, the largest items, and findings: mixed types, empty strings, items near the 400 KB limit, attribute names built from data |
value_counts(table, attribute) |
How often each value occurs, with the size of those items. On the partition key this is each item collection's size, so hot partitions stand out |
largest(table, n=10) |
The biggest items by DynamoDB's sizing rules, and what reading each costs |
count(table, where=None) |
Exact count (a full scan), next to DynamoDB's own estimate |
Filters
where= works on scan, query, sample, schema, value_counts, largest and count. It takes a dict, and
every condition must match:
where= |
Means |
|---|---|
{"status": "failed"} |
status = 'failed' |
{"total": (">", 100)} |
also "=", "!=", "<", "<=", ">=" |
{"total": ("between", 10, 100)} |
both ends included |
{"sk": ("begins_with", "ORDER#")} |
|
{"tags": ("contains", "promo")} |
a substring, or a member of a set or list |
{"status": ("in", ["paid", "shipped"])} |
|
{"deleted_at": ("not_exists",)} |
also ("exists",), and ("type", "N") to check the stored type |
{"address.city": "Pune"} |
dots reach into maps |
For OR and NOT, pass a boto3 condition instead: where=Attr("a").eq(1) | Attr("b").exists(). The sort= argument
of query takes a value or one of the same tuples (=, <, <=, >, >=, between, begins_with). Key values
are converted to the key's type, so "42" works for a number key.
Reference
Getting the data (DynamoDBAnalyzer): items as plain dicts and DataFrames, for pandas and your own code
ui.core is the DynamoDBAnalyzer. Every UI command has a data method on it:
ddb = ui.core # or DynamoDBAnalyzer(region="eu-west-1", profile="dev")
page = ddb.scan("orders", n=5000, where={"status": "failed"}) # ItemPage
page.items # list of plain dicts
df = page.to_df() # DataFrame: keys first, nested maps as 'address.city'
page.stats # items read, items returned, read units, seconds
more = ddb.scan("orders", n=5000, where={"status": "failed"}, start_key=page.last_key)
ddb.query("orders", "USER#42", sort=("between", "ORDER#2024-01", "ORDER#2024-12"), descending=True)
ddb.query("orders", "failed", index="by-status").to_df()
ddb.sample("orders", 500).items # spread over the key space
ddb.get("orders", "USER#42", "ORDER#0017") # dict, or None
ddb.sql('SELECT * FROM "orders" WHERE pk = ?', "USER#42").items
profile = ddb.profile("orders", 2000) # TableProfile (what schema() shows)
profile.attributes["total"].types # Counter({'N': 1990, 'S': 10})
profile.to_df() # one row per attribute
ddb.value_counts("orders", "status").counts # {'paid': Stat(count=..., size=...), ...}
ddb.count("orders", where={"status": "failed"}).matched
ddb.describe("orders") # TableInfo: keys, indexes, capacity, TTL, backups, tags
ddb.table_metrics("orders", hours=24) # consumed units, busiest period, throttle events
ddb.table_reports(match="prod-*") # [TableReport]: describe() + usage for every table
for item in ddb.iter_items("orders", limit=None): # stream a full scan without holding it in memory
...
The analysis functions are pure (no AWS calls), so they also work on items you already have, for example a
DynamoDB export to S3: from_dynamo_item, to_dynamo, items_to_df, flatten_item, profile_items,
count_values, item_size, key_pattern, build_filter, table_findings, profile_findings,
table_monthly_cost, capacity_cost, request_cost.
rows = S3Analyzer().read_jsonl("s3://my-bucket/AWSDynamoDB/01234-abcd/data/part.json.gz") # from s3.py
profile_items([from_dynamo_item(row["Item"]) for row in rows], keys=["pk", "sk"])
Large tables and cost: what scans read and bill, where they stop, and the prices used
- DynamoDB bills every item a scan reads, and a scan competes with your application for the table's
capacity. So the commands that scan stop early by default:
value_countsandlargestread the first 10,000 items (limit=Nonereads everything),schemaprofiles about 1,000, andui.scanwith a filter reads at most 100,000 items per page (scan_limit=). countalways reads the whole table:Select=COUNTreturns no items but still reads, and bills, every one. For an instant estimate,tables()andtable_info()show DynamoDB's own item count and size, which it refreshes about every 6 hours.- Every report shows the read units it used and, where it matters, what they cost on-demand.
- Costs are estimates at us-east-1 list prices for the standard table class, before the free tier
(
DYNAMODB_PRICES): storage, provisioned capacity and point-in-time recovery per month, and on-demand reads and writes per million. For another region, pass your prices:DynamoDBAnalyzer(prices={"storage": 0.285, "read_request": 0.1425}).
IAM permissions: read-only, and what each one is for
Read-only. Grant what you need:
| Permission | For |
|---|---|
dynamodb:ListTables |
The list of tables |
dynamodb:DescribeTable, dynamodb:DescribeTimeToLive, dynamodb:DescribeContinuousBackups, dynamodb:ListTagsOfResource |
A table's keys, indexes and settings |
dynamodb:Scan, dynamodb:Query, dynamodb:GetItem |
Reading items |
dynamodb:PartiQLSelect |
sql |
cloudwatch:GetMetricData |
Usage |
Reading an index needs the permission on its ARN too (arn:aws:dynamodb:<region>:<account>:table/orders/index/*),
and a table encrypted with a customer managed KMS key needs kms:Decrypt. Anything you can't read shows up as a
note instead of an error. The DynamoDB guide
has a ready-made IAM policy that covers every command.
Amazon Bedrock Knowledge Bases
Knowledge bases, what they retrieve, and the answers built on them. Settings and sync health, every file
and how it was indexed, search with highlighted passages, answers with citations, and retrieval measured on your own
questions. The explorer window shows it all by clicking.
📄 src/aws_analyzer/bedrock_kb.py · 📖 Knowledge Bases guide
ui.ask("How long do refunds take?"): the answer with its [1] [2] citations, 77% grounded because its last sentence cites nothing, and the passages behind it.
Quick start
Install the packages first, in a notebook cell (in a terminal, drop the %). On SageMaker both are already
installed.
%pip install boto3 # every command (required)
%pip install pandas # optional: DataFrames (r.to_df(), a.to_df(), report.to_df())
Every BedrockKBView command works with boto3 alone; IPython, used for the HTML output, comes with Jupyter.
Answers are generated through Bedrock itself (RetrieveAndGenerate or Converse), so no model SDK is needed and any
Bedrock model you have access to works.
from aws_analyzer import BedrockKBView
ui = BedrockKBView() # uses the notebook's execution role and region
ui.help() # every command, grouped by task
ui.help("ask") # one command in full
ui.kbs() # every knowledge base: status, store, last sync, warnings
ui.use("support-docs") # later commands use this one (a name, ID or ARN)
ui.kb_info() # settings in plain English, syncs, findings, idle cost
ui.search("how do refunds work?") # ranked passages, with the question's words highlighted
ui.chunk(2) # the full text and metadata of result #2
ui.link(2) # a link that opens result #2's file in a new browser tab
ui.ask("How long do refunds take?") # an answer with [1][2] citations and its sources
ui.follow_up("And for digital goods?") # same conversation
ui.ask("How long do refunds take?", data_source="faq") # answered from one data source only
ui.files() # every file next to Bedrock's record of it: failed, changed, not synced...
ui.file("refund-policy.pdf") # how one file was indexed: its parser, chunks in order, metadata, what to fix
ui.search_file("refund-policy.pdf", "How long do refunds take?") # does the question find it, and where it ranks
ui.explore() # all of it in a window, by clicking (below)
NOTE: Knowledge bases are regional:
BedrockKBView(BedrockKBAnalyzer(region="us-west-2"))looks at another region. Commands takekb=(a name in any case, the 10-character ID, or the ARN); without it they use the one set byuse()orBedrockKBView(kb=...), else the only knowledge base in the region, else they list the ones there and say how to pick. Nothing in the file changes a knowledge base: where a sync is needed, it shows theaws bedrock-agent start-ingestion-job ...command and the boto3 call instead of running them.
Explore by clicking
explore() opens a window on a knowledge base that you use by clicking, with nothing to type but a question. Every
file of its S3 data sources is listed next to Bedrock's record of it, so you see at once which ones failed and why,
which changed in S3 since they were indexed, which were added after the last sync, which the sync skipped, and which
are gone from S3 but still turn up in answers. Click a file to see how it was indexed, step by step: the parser that
read it, each chunk in document order with the text it shares with the one before, its metadata file next to what its
chunks carry, and what to fix.
explore("support-docs"): every file next to Bedrock's record of it, and for warranty.pdf, each step from S3 into the vector store.
from aws_analyzer.bedrock_kb import explore
explore() # the only knowledge base here, or the first active one
explore("support-docs") # a name, ID or ARN
explore("support-docs", file="faq/returns.md") # straight to one file's page
explore(region="us-west-2") # another region (or profile="dev")
explore("support-docs", height=800) # 800px pages (else the browser's height)
ui.explore() # from a BedrockKBView, on its knowledge base
The window needs ipywidgets, which SageMaker already has (elsewhere: %pip install ipywidgets, then reload the
browser tab). Without it, or outside Jupyter, it shows the same as reports: files(), file() and search_file().
| To | Do this |
|---|---|
| Pick a knowledge base | Click the field at the top left: the region's knowledge bases, with a search box that finds one by name, part of its ID or its description. Enter picks the first, and a whole ID or ARN works too. The cards beside it say how it's doing: its files, how many are searchable, failed or waiting for a sync, the last sync and the idle cost of its vector store |
| See what's wrong | Overview: its files by state in one bar, findings that say what's wrong and what to do, the commands that sync the data sources that need it (to copy: the window never syncs), how each data source becomes vectors (its location, parser, chunking, embedding model and vector store), and the recent syncs |
| Find a file | Files: type part of a name, a folder or Bedrock's reason in the search box, click a state's chip (Failed, Changed, Not synced, Skipped, Deleted, Ignored, Indexed) to see only those, pick a data source, or sort by name, folder, size, last change or last indexed. Problems come first, 40 to a page with « ‹ › » under the list |
| See how a file was indexed | Click it. Its page has its state and what to do about it, then each step from S3 into the vector store, the one that failed in red. Its chunks follow as a bar of their sizes (for a .txt or .md file, also where each sits in the file and what no chunk holds), then a line each with its page, size and first words that opens to the chunk's text, the part it repeats from the chunk before marked, and its metadata. Last, its .metadata.json next to what its chunks carry, and Bedrock's record of it |
| Check that a question finds a file | On its page, type a question in Ask a question… and press Enter: the file's own best passages for it, and where it ranks among the whole knowledge base's. When an answer, which sees the top 5, wouldn't see it, a finding says what to change |
| Search the knowledge base | Search: a question's passages with their scores and the question's words highlighted. Pick the number of passages, the search type (Semantic or Hybrid), a data source and a reranker. How refund-policy.pdf was indexed › under a passage opens its file's page |
| Read the sync history | Syncs: every sync, newest first, as a timeline: when it ran and how long it took, what it read, added, changed, deleted and couldn't index, and why a sync failed |
| Read the settings | Settings: every setting in plain English (the embedding model and its dimensions, the vector store and where it keeps each part of a chunk, each data source's location, chunking, parser and deletion policy, the tags), then GetKnowledgeBase and GetDataSource as AWS returns them, folded |
Everything is read in the background, so a click shows what's known at once and the rest as it arrives, and the
window keeps answering. Like the rest of the file it only reads: where a sync would help, it shows the command.
explore() returns the window: x.inventory, x.info and x.chunks hold the data behind what's shown, and x.ui
is a BedrockKBView for reports in other cells.
Commands (BedrockKBView)
Grouped the way ui.help() lists them.
Explore by clicking
| Command | Shows |
|---|---|
explore(kb=None, file=None, height=None) |
The explorer window: every file and how it was indexed, the syncs, a search box and every setting, by clicking. file= opens one file's page; view.explorer is the window |
Knowledge bases
| Command | Shows |
|---|---|
kbs() |
Every knowledge base in the region: status, type, vector store, embedding model, data sources, documents read by the last sync, last sync, estimated idle cost and warnings |
use(kb) |
Sets the knowledge base that later commands use when you don't pass kb=: a name in any case, the 10-character ID, or the ARN |
kb_info(kb=None) |
Cards (status, vector store, embedding model and dimensions, data sources, last sync, idle cost), findings, every setting in plain English (vector store, each data source's location, chunking, parsing and deletion policy, and the data_source= to ask each one when there are several), recent syncs, tags, and what to try next |
What's indexed
| Command | Shows |
|---|---|
syncs(kb=None, data_source=None, n=10) |
Sync history: when, how long, status, scanned / new / modified / deleted / failed counts, why syncs failed, and the command to sync again |
documents(kb=None, data_source=None, status=None, n=50) |
Documents by status (indexed, failed, pending ...), the ones that aren't indexed with Bedrock's reason, and the sync command. status="INDEXED" or "FAILED" lists only those |
unsynced(kb=None, data_source=None) |
S3 files added or changed since each data source's last successful sync, and the command to sync them |
files(kb=None, data_source=None, status=None, match=None, n=50) |
Every file next to Bedrock's record of it: indexed, failed (and why), changed in S3 since it was indexed, added after the last sync, skipped by the sync (and the likely reason: a type Bedrock doesn't read, over 50 MB, archived), gone from S3 but still searchable. Problems first, with the commands that sync them. status="failed" or match="refund" narrows the list |
file(path, kb=None) |
How one file was indexed, step by step (stored in S3, read by the parser, cut into chunks, embedded, stored as vectors, where it stands now), its chunks in document order with their size, page and the text each shares with the one before, its metadata file checked against what its chunks carry, and what to fix. path: its name, its path in the bucket or its s3:// path |
search_file(path, question, kb=None, n=10) |
Whether a question finds a file: its own best passages for it, and where it ranks among the whole knowledge base's (an answer sees the top 5), with what to change when it ranks too low |
Search and answer
| Command | Shows |
|---|---|
search(question, n=5, kb=, data_source=, where=, search_type=, rerank=) |
Ranked passages: a score bar relative to the top result, file and page (the file's name opens it in a new browser tab), the data source when they come from several, the best part of the text with the question's words highlighted, and the passage's metadata. Findings: nothing found, one file answering everything, duplicate passages, very short chunks, and codes in the question that no passage contains (try search_type="HYBRID"). Time and estimated cost |
chunk(rank) |
The full text, metadata and IDs of result #rank from the last search or ask, a link that opens its file in a new browser tab, and the S3View().preview("s3://...") call that previews it in the notebook |
link(source=1, expires=3600) |
A link that opens a file in a new browser tab: source #n of the last search or ask (a PDF opens at the passage's page), a file name from it, or any s3:// path. S3 files get a presigned link, signed in the notebook with no AWS call, that works for expires seconds; PDFs, pictures, text and HTML show in the tab, Word and Excel files download. Web, Confluence, SharePoint and Salesforce sources link to their page. Every file name in search, ask, follow_up, compare, documents and unsynced is already such a link |
ask(question, kb=, data_source=, n=5, where=, model=, engine="kb", prompt=, temperature=, max_tokens=) |
The answer with [1][2] citation markers, cards (grounded share, sources used, model, tokens, cost, time), the sources table (each file a link that opens it, with each source's data source when there are several) and findings (not grounded, mostly uncited, Bedrock's "unable to assist" reply, a guardrail, cut off at max_tokens) |
follow_up(question, data_source=None) |
The next question in the same RetrieveAndGenerate session (or Converse conversation), searching the same data source. data_source= moves this and later follow-ups to another one ("all" back to every one). If the session has expired, starts a new one and says so |
models(match=None) |
The text models you can use for ask() here: the ID to pass as model=, provider, on demand or through an inference profile, and $ per 1M tokens in and out |
Measure retrieval
| Command | Shows |
|---|---|
compare(question, kb=, n=(5, 10), search_types=("SEMANTIC", "HYBRID"), where=, data_source=) |
One row per passage and one column per setting with its rank there, how much each pair of settings overlaps, and what each found that the others missed |
evaluate(cases, kb=, n=5, search_type=, where=, data_source=) |
Retrieval hit rate @n and MRR on test questions, where each expected source ranked (or "missed") and what came up first instead, with the usual fixes |
Two ways to generate answers
engine="kb" (default) |
engine="converse" |
|
|---|---|---|
| How | Bedrock's managed RetrieveAndGenerate: Bedrock retrieves, prompts the model and returns the citations | Retrieves, then calls the model through Bedrock Converse with the passages numbered as sources. Any Bedrock model |
| Tokens and cost | Estimated from characters, and labelled as estimates: RetrieveAndGenerate doesn't report token counts | Exact counts and cost |
| Your own prompt | A custom prompt= must contain $search_results$ |
A prompt= template with {sources} and {question} (see bedrock_kb.DEFAULT_PROMPT) |
| Follow-ups | follow_up() keeps Bedrock's session |
follow_up() continues the conversation |
With engine="converse", the sources are sent as data, never as instructions, and the model is told to cite them as
[n] and to say when they don't hold the answer.
model= takes a model ID or ARN, an inference profile ID, or a short name: "opus", "sonnet", "haiku",
"claude-opus-5", "nova-pro". The default is Claude Haiku 4.5 (bedrock_kb.DEFAULT_MODEL), through the region's
inference profile when it needs one; BedrockKBAnalyzer(default_model="sonnet") changes it.
One data source (data_source=)
A knowledge base can have several data sources (an S3 bucket of policies, a crawled help site, a Confluence space).
data_source= points a question at one of them: search, ask, compare and evaluate take its name (in any case)
or its ID, or a list of them, and follow_up() keeps it for the rest of the conversation.
ui.search("refund window", data_source="faq") # passages from the faq data source only
ui.ask("How long do refunds take?", data_source="policies") # an answer from the policies only
ui.follow_up("And on the help site?", data_source="help-site") # the next question searches another one
ui.follow_up("Anything else?", data_source="all") # back to every data source
Bedrock tags every chunk with its data source's ID (x-amz-bedrock-kb-data-source-id), so this needs no metadata
files, and it combines with where= (both must match). kb_info() lists the data sources, with the data_source= for each.
When passages come from several data sources, the reports say which each came from and suggest asking the one most of
them came from. If a vector store returns passages from another data source anyway, a finding says so: tag the files
with your own metadata then, and filter with where=.
Filters (where=)
where= filters on the documents' own metadata, which comes from a <file>.metadata.json next to each file (for
example refund-policy.pdf.metadata.json holding {"metadataAttributes": {"team": "billing", "year": 2024}}). It
works on search, ask, compare and evaluate, uses the same vocabulary as the DynamoDB analyzer, and every
condition must match:
where= |
Means |
|---|---|
{"team": "billing"} |
team = 'billing' |
{"team": ["billing", "support"]} |
one of these values |
{"year": (">=", 2024)} |
also "=", "!=", ">", "<", "<=" |
{"year": ("between", 2020, 2024)} |
both ends included |
{"region": ("in", ["eu", "uk"])} |
also ("not_in", [...]) |
{"doc_id": ("begins_with", "POL-")} |
text starting with this |
{"title": ("contains", "refund")} |
text containing this, or a list with an element containing it |
{"tags": ("list_contains", "gdpr")} |
a list attribute holding exactly this element |
Values are typed: 2024 and "2024" differ. For OR, pass a Bedrock RetrievalFilter instead, e.g.
where={"orAll": [{"equals": {"key": "team", "value": "a"}}, {"equals": {"key": "team", "value": "b"}}]}; it is
sent unchanged.
Reference
Getting the data (BedrockKBAnalyzer): passages, answers and evaluations as Python objects
ui.core is the BedrockKBAnalyzer. Every UI command has a data method on it, and its methods take the knowledge
base first:
kb = ui.core # or BedrockKBAnalyzer(region="us-west-2", profile="dev")
info = kb.describe("support-docs") # KnowledgeBaseInfo: settings, data sources, last syncs, tags
info.data_sources[0].chunking # the chunkingConfiguration AWS returned
kb.list_knowledge_bases() # [KnowledgeBaseInfo], described in parallel
kb.ingestion_jobs("support-docs", n=20) # [IngestionJob], newest first, with failure reasons
docs, summary = kb.documents("support-docs", status="FAILED") # [KBDocument], DocumentSummary
kb.unsynced("support-docs") # [SyncFreshness]: changed S3 files per data source
inv = kb.file_inventory("support-docs") # FileInventory: every file, KBFile.state and why (KBFile.note)
inv.counts(), inv.to_df() # files per state; one row per file
f = "s3://support-docs-bucket/policies/refund-policy.pdf"
chunks = kb.document_chunks("support-docs", f) # DocumentChunks: its chunks in document order, .stats
kb.metadata_file(f) # MetadataFile: its .metadata.json's attributes and problems
kb.probe_file("support-docs", f, "refund window") # FileProbe: its passages, and .rank in the whole knowledge base
kb.document_status("support-docs", f, "docs-s3") # KBDocument: Bedrock's record of one file
r = kb.retrieve("support-docs", "refund window", n=10, where={"team": "billing"}) # Retrieval
r.passages[0].text, r.passages[0].source, r.passages[0].metadata
r = kb.retrieve("support-docs", "refund window", data_source="faq") # one data source: r.data_sources
kb.data_sources("support-docs") # [DataSourceInfo]: ID, name, status
df = r.to_df() # one row per passage
a = kb.ask("support-docs", "How long do refunds take?") # Answer (RetrieveAndGenerate)
a.text, a.citations, a.sources, a.grounded_share
a = kb.generate("refund window?", r.passages, model="opus", prompt=MY_TEMPLATE) # Converse on your passages
a = kb.generate("refund window?", ["my own chunk", "another chunk"]) # ...or on plain strings
a.input_tokens, a.output_tokens # exact, from Converse
kb.compare("support-docs", "refund window for EU orders").overlap # SearchComparison
report = kb.evaluate("support-docs", [("refund window?", "refund-policy.pdf")])
report.hit_rate, report.mrr, report.to_df() # EvalReport
kb.models("claude") # [ModelInfo]: what to pass as model=, and its price
The analysis functions are pure (no AWS calls), so they also work on responses and passages you already have:
parse_knowledge_base, parse_data_source, parse_ingestion_job, parse_retrieve, parse_rag, parse_converse,
describe_chunking, describe_parsing, describe_vector_store, build_filter, describe_filter,
data_source_filter, with_data_sources, describe_sources, build_prompt
(and DEFAULT_PROMPT), parse_citation_markers, question_terms, best_snippet, retrieval_metrics,
match_expected, compare_retrievals, summarize_documents, changed_since, generation_cost,
vector_store_monthly_cost, query_cost, the file functions: inventory_files, file_state, skip_reason,
sync_needed, parse_metadata_file, chunk_overlap, place_chunks, order_chunks, chunk_stats, file_steps,
find_files, sort_files, parse_file_state, and the findings: kb_findings, sync_findings, retrieval_findings,
answer_findings, eval_findings, inventory_findings, file_findings, probe_findings.
Cost and limits: the prices used, idle vector store cost, and where commands stop
- Costs are estimates at us-east-1 list prices, read from the Bedrock and OpenSearch pricing pages on 2026-09-25
and checked against the AWS Price List API on 2026-09-27, and every report says whether it used list prices or
yours.
BEDROCK_PRICESholds the OpenSearch Serverless OCU-hour, its idle minimum, reranking per 1,000 queries (Cohere Rerank 3.5, and Amazon Rerank at half that) and question embedding;MODEL_PRICESholds $ per 1M input and output tokens by model family, andGLOBAL_MODEL_PRICESthe lower prices ofglobal.profiles (a price you set inmodel_pricesapplies to every profile of that model). Pass your own:BedrockKBAnalyzer(prices={"opensearch_min_ocus": 1}, model_prices={"my-model": (1.0, 5.0)}). - The idle cost is only estimated for OpenSearch Serverless: a classic vector collection bills 2 OCUs (about $350/month) even with no traffic. Collections that share a KMS key share those OCUs, dev-test collections bill half, and NextGen collections scale to zero, so check your collection type. Other vector stores are billed by their own service and show "not estimated".
ask()with the default engine estimates tokens from characters, since RetrieveAndGenerate doesn't return them;engine="converse"shows exact counts. A model that isn't inMODEL_PRICESshows its cost as unknown.evaluate()andcompare()only retrieve, so they cost a question embedding per search (well under a cent), plus reranking when you ask for it.documents()reads at most 10,000 documents andunsynced()lists at most 100,000 objects by default; both say when they stopped early (.core.documents(..., limit=None)reads everything).files(),file()and the explorer read at most 10,000 of Bedrock's documents and 10,000 S3 files per data source, and say when they stopped (.core.file_inventory(..., limit=None)reads everything). A file the document list didn't reach is looked up on its own when you open it.- A file's chunks come from one Retrieve limited to the file (a filter on
x-amz-bedrock-kb-source-uri), which returns at most 100 passages: a file with more says so. Opening a file costs one search and asking it a question two (a question embedding each, well under a cent). A vector store that ignores the filter is caught: passages of other files are counted and left out.
IAM permissions: read-only, and which command needs which
Read-only, per command:
| Permission | Used by |
|---|---|
bedrock:ListKnowledgeBases, bedrock:GetKnowledgeBase |
kbs, kb_info, and finding a knowledge base by name |
bedrock:ListDataSources, bedrock:GetDataSource |
kb_info, syncs, documents, unsynced, files, file, explore; ListDataSources also for data_source= by name, and to name the data sources in search and ask |
bedrock:ListIngestionJobs, bedrock:GetIngestionJob |
kbs, kb_info, syncs, unsynced, files, file, explore |
bedrock:ListKnowledgeBaseDocuments |
documents, files, file, search_file, explore |
bedrock:GetKnowledgeBaseDocuments |
file and explore, for a file the document list stopped before |
bedrock:ListTagsForResource |
kb_info |
bedrock:Retrieve |
search, chunk, compare, evaluate, ask(engine="converse"), and a file's chunks and questions in file, search_file and explore |
bedrock:RetrieveAndGenerate plus bedrock:InvokeModel on the model or inference profile |
ask, follow_up |
bedrock:InvokeModel |
ask(engine="converse"), core.generate |
bedrock:ListFoundationModels, bedrock:ListInferenceProfiles |
models, and turning model="sonnet" into an ID |
s3:ListBucket on the data source's bucket |
unsynced, files, file, search_file, explore |
s3:GetObject on the data source's files |
file and explore read a file's <file>.metadata.json, and a .txt or .md file's text to place its chunks in it. Opening a file from its link (link, and the file names in reports) uses it too, in your browser |
A model also has to be enabled for the account under Model access in the Bedrock console. Anything you can't read shows up as a note instead of an error. The Knowledge Bases guide has a ready-made IAM policy that covers every command.
Bedrock knowledge base chat
A chat window on a knowledge base, with every setting in reach. Pick the knowledge base and the model, ask
questions, and change what's sent (passages, search type, filter, reranker, temperature, prompt, or any other field
of RetrieveAndGenerate) while you watch the request as JSON. Then ask a whole list of test questions with that setup,
see how each one did, try every combination of the settings you're unsure of at once and see which setup does best,
keep every run in a file that outlasts a restart, and copy the setup as a Python script, JSON or an AWS CLI command.
📄 src/aws_analyzer/bedrock_chat.py · 📖 Chat guide
chat("support-docs", model="sonnet"): a question and a follow-up answered in markdown, each with its citations and sources, and the settings every question sends.
Quick start
from aws_analyzer import chat
chat() # pick the knowledge base and the model in the window
chat("support-docs", model="sonnet") # or start on these: a name, ID or ARN; a model ID or short name
chat("support-docs", data_source="faq") # ask only one of its data sources (a name or ID)
chat("support-docs", files=["refund-policy.pdf", "faq/returns.md"]) # or only these files
chat("support-docs", retrieve_only=True) # questions only search: every passage found, no answer
chat("support-docs", height=800) # an 800px conversation (else the window fills the browser's height)
ui = chat("support-docs", n=8, temperature=0.2, search_type="hybrid", where={"team": "billing"})
ui.ask_all(["How long do refunds take? | refund-policy.pdf", "Can I return a gift?"]) # a test list, each answered
ui.sweep(n=[5, 10], search_type=["SEMANTIC", "HYBRID"]) # every combination on that list, the setups ranked
ui.use_run() # switch to the best setup
ui.save_runs() # keep every run (and every later one) in kb-test-runs.jsonl
ui.code() # this setup as a Python script, JSON and an AWS CLI command
The window needs ipywidgets, which SageMaker already has (elsewhere: %pip install ipywidgets, then reload the
browser tab). Without it, or outside Jupyter, every command below still works as a report.
- The pickers. The fields at the top: the knowledge base, the model (Claude Haiku 4.5 unless you pick another or
pass
model=) and, when the knowledge base has more than one, the data source questions search ("All data sources" by default), and the files. Click one to open its list, with a search box that finds a line by name, part of an ID (K7QJfindsK7QJ2M4XNA), description or provider; Enter picks the first, and a whole knowledge base ID or ARN works even when it isn't listed. Tick files and the next questions search only them (shown as chips; click one to drop it, or All files). Another data source, file or model keeps the conversation; another knowledge base starts a new one. - The conversation. Answers appear as they're written, their markdown laid out (lists, bold, tables, code). Each
one shades its cited spans and numbers them, lists its sources (click one to read the passage, with its location
and metadata), shows its time, grounded share and estimated cost, and folds away the exact request and response.
Findings under an answer say which setting to try (Bedrock's "unable to assist" reply, no citations, a guardrail,
cut off at
max_tokens). Follow-ups keep Bedrock's session; New chat starts over. - Answer / Retrieve only. The switch beside the question box. Retrieve only sends the same search without
the model (Retrieve instead of RetrieveAndGenerate): every passage the question finds, best first, with its score
and the start of its text, and no answer. Ask a question both ways to check the search and the answer apart: the
search marks the passages the answer to the same question cited (
cited [1]), and a finding says when the answer came back "unable to assist" although the search found passages (the answer step, not the search, is what to fix). Switching puts your last question back in the box; the settings for the answer (temperature, prompt...) are dimmed while they aren't sent. - Settings. Everything sent with every question, one line each, its value explained in a sentence (hover a
name for what it does and its path in the request). Change it in place, remove it with ✕, or open + Add a
setting to add the common ones with one click, search every field by
name, path or what it does (
rerank,latency,encrypts) and add it from the list, or browse them all by group: the list comes from the installed boto3's description of the API, so nothing is missing. A value that can't be sent turns red and says why, and warnings catch what Bedrock would refuse (temperaturewithtop_pon a newer Claude model, a guardrail ID without its version, a prompt that drops the citation instructions). - Request. The exact request the next question sends, as a folding tree with your settings highlighted, as JSON text, or as the boto3 call to paste into your code, both highlighted. Edit JSON takes a hand-edited request back into the settings, after checking it the way boto3 does before sending, and never undoes a setting changed while you were editing without saying so. Response shows what came back.
- Test. Paste a list of questions, one per line, and Run: each is asked with the window's knowledge base,
model, data source, files and settings, on its own (never as a follow-up), a few at a time, while the window stays
usable (Stop sends no more). Each question gets a line saying how it did (answered, "unable to assist", no
citations, partly grounded, failed) with its grounded share, sources and time, and opens to the full answer. Add
| refund-policy.pdfafter a question to check that the answer cites that file. Cards and findings sum up the run and say which setting to try; change it and Run again, and each line says whether that question did better or worse. Before you run, the estimated cost shows beside the button. On Retrieve only, the list is searched instead. - Try variations, in the Test tab, asks the list with every combination of the values you type, one setting
per line (
n = 5, 10,search_type = SEMANTIC, HYBRID,model = haiku, sonnet,reranker = none, cohere, ordata_source = all, faq), or add with one click. Run asks each question with every setup before the next one, so Stop leaves them all with the same questions, then ranks the setups: by the expected files cited, then the answers that say something, then the grounded share, the cheaper first when two are as good. Findings say which setup beats yours and by how much, what each setting changed ("search_type=HYBRID did best in each of the 2 groups of setups that differ only in search_type"; "temperature made no difference"), when the lead is small enough to be chance, and which questions no setup could answer. A table shows how each question did with each setup, and Use this setup switches to the one you pick. A sweep estimated over $2 asks for a second click. - Runs. Every test run, newest first, ranked against the other runs of the same questions: open one in the Test tab, switch to its setup, or compare it with the others side by side. Save writes them to a file (one JSON line per run, with each answer and its sources) and adds every later run as it finishes; Load reads a file back after a kernel restart, or a teammate's.
- Code. The setup as it is now, to run anywhere: a Python script that needs only boto3 and asks your test
questions, printing each answer and the files it cites; the config as JSON (the request without the question,
which
client.retrieve_and_generate(input={"text": question}, **config)or the AWS CLI's--cli-input-jsonsends); or the AWS CLI command for one question. It follows every change to the knowledge base, model, files and settings.
Commands (BedrockChatView)
chat() returns the view behind the window. Its commands share the window's settings and conversation, and an open
window follows them.
Chat
| Command | What it shows |
|---|---|
app() |
The chat window: knowledge base, data source and model pickers, the conversation, and the Settings, Test, Runs, Code, Request and Response tabs |
ask(question) |
An answer as a report: [1][2] citations, cards (grounded share, sources cited, model, estimated tokens and cost, time), findings and the sources table. Each question follows up on the ones before it |
retrieve(question) |
Only the search behind an answer (Retrieve, the same settings without the model): every passage found, best first, with its score, and no answer. After ask() with the same question, which passages the answer cited, and whether a poor answer comes from the search or the model |
new_chat() |
Forgets the conversation: the next question starts a new Bedrock session. The settings stay |
transcript() |
The conversation so far, as a report that stays in the notebook when it's saved (the window doesn't) |
last() |
The last answer (or search) in full: every passage, the exact request and response as JSON, and the same call in Python |
Test a list of questions
| Command | What it shows |
|---|---|
ask_all(questions=None, *, retrieve_only=None, workers=4, limit=50, label=None) |
Asks a list of test questions with these settings, each on its own (not as a follow-up), and shows how each did: answered or "unable to assist", grounded share, sources, the file it should cite ("question | file"), time and estimated cost, with findings across them all. ask_all() asks the last list again and says which questions did better or worse since the last run. questions is a list, text with one per line, or a DataFrame with question and expected columns; label= names the run |
sweep(questions=None, *, setups=None, retrieve_only=None, workers=4, limit=50, max_setups=16, max_cost=2.0, label=None, **values) |
Asks the test questions with every combination of the values listed: sweep(n=[5, 10], search_type=["SEMANTIC", "HYBRID"]), and model=, data_source= and files= lists too (None leaves a setting out), or whole setups=[{...}, {...}]. Ranks the setups best first, says which one beats yours, what each setting changed and which questions no setup handled, and shows how each question did with each setup. Each setup becomes a test run. Nothing is sent when it's more than max_setups setups or estimated over max_cost USD. retrieve_only=True sweeps the search alone, for the embedding's cost |
results(run=-1) |
A test run again, as a report that stays in the saved notebook: the last one, or results(1) for the first, as runs() numbers them. Nothing is asked again |
Keep and compare test runs
| Command | What it shows |
|---|---|
runs() |
Every test run so far, newest first: when, its setup, how it did and its estimated cost, ranked against the other runs of the same questions, with the best setup to switch to |
compare_runs(*runs) |
Runs of the same questions side by side, best first, and how each question did in each: compare_runs(2, 5), or compare_runs() for every run of the last run's questions |
use_run(run=None) |
Switches to a run's settings, model, data source and files: use_run() the best run of the last list, use_run(7) run 7 |
save_runs(path=None) |
Adds every test run to a file (JSON Lines, kb-test-runs.jsonl by default) and every later run as it finishes, so they outlast a kernel restart. Nothing in the file is changed |
load_runs(path=None) |
Reads saved runs back, after a restart or from a teammate, and lists them as runs() does |
Settings
| Command | What it shows |
|---|---|
settings() |
Every setting sent with every question, what its value means, where it goes in the request, warnings, and the chat(...) call that opens this setup again |
set(name=None, value=None, **values) |
Changes settings: set(temperature=0.2, n=8), or set("generationConfiguration.performanceConfig.latency", "optimized") for any field. None removes one |
unset(*names) |
Stops sending settings: unset("temperature", "top_p") |
fields(match=None) |
Every field RetrieveAndGenerate takes in this boto3: the name set() takes, its type and range, what it does and its path. fields("rerank") keeps those that mention it |
request(question=None, retrieve_only=None) |
The exact JSON the next question sends, highlighted, with what Bedrock would refuse in it, and the same call in Python. Nothing is sent. retrieve_only=True shows the Retrieve request retrieve() sends (default: the window's Answer / Retrieve only) |
code(questions=None, retrieve_only=None) |
This setup as code to copy and run anywhere: a Python script (boto3 only) that asks your test questions and prints each answer with the files it cites, the config as JSON (the request without the question), and the AWS CLI command for one question. Nothing is sent |
Knowledge base and model
| Command | What it shows |
|---|---|
use(kb=None, model=None, data_source=None, files=None) |
Switches the knowledge base (a new conversation), the model, or what questions search (the same one): use(data_source="faq"), use(files=["refund-policy.pdf", "faq/returns.md"]) (names, paths in the bucket or s3:// paths), or "all" |
files(match=None) |
The knowledge base's files to pick from: name, folder, data source, whether it's indexed, when it changed, and which ones questions search. files("refund") keeps those whose path contains it |
kbs(match=None) |
The knowledge bases in the region: name, ID, status, description and when each changed; match= finds them by name, ID or description |
models(match=None) |
The models you can chat with: the ID to pass as model=, on demand or through an inference profile, and $ per 1M tokens |
Settings with short names
chat() and set() take these as keywords. The API's own names (maxTokens, overrideSearchType) and paths work
too, and values are forgiving ("0.2", "hybrid", JSON text or a Python dict).
| Name | What it does |
|---|---|
n |
Passages to retrieve, 1 to 100 (Bedrock's default is 5) |
search_type |
"HYBRID" (meaning and exact words) or "SEMANTIC" |
filter (or where) |
Only documents whose metadata matches: {"team": "billing"}, {"year": (">=", 2024)} (in JSON, [">=", 2024]), or a Bedrock RetrievalFilter. The same vocabulary as bedrock_kb.py's where= |
reranker, rerank_n |
Re-order the passages with "cohere" (Cohere Rerank 3.5) or "amazon" (Amazon Rerank 1.0), or a model ID, and keep the best rerank_n |
temperature, top_p |
Randomness, 0 to 1. Newer Claude models take one of the two |
max_tokens, stop |
The longest answer in tokens; up to 4 stop sequences |
prompt |
Your own prompt template. It needs $search_results$; keep $output_format_instructions$ or answers lose their citations. Adding it in the window starts from bedrock_chat.DEFAULT_PROMPT |
model_fields |
The model's own settings, passed as they are: {"top_k": 50} for Claude |
guardrail_id, guardrail_version |
A Bedrock guardrail that screens the question and the answer |
latency |
"optimized" for latency-optimized inference, where the model offers it |
query_decomposition |
True: Bedrock splits a complicated question into simpler searches |
orchestration_prompt |
The prompt of the step that rewrites the question before searching |
kms_key |
A KMS key that encrypts the conversation Bedrock keeps |
Every other field goes by its path from knowledgeBaseConfiguration, e.g.
set("orchestrationConfiguration.inferenceConfig.textInferenceConfig.temperature", 0).
Reference
Getting the data (BedrockChatAnalyzer): requests and answers as Python objects
a = ui.answers[-1] # Answer: the conversation's answers (and searches), oldest first
a.text, a.citations, a.sources, a.grounded_share
a.retrieve_only # a search: no text, and a.sources is every passage found, with p.score
a.request, a.response # exactly what was sent and what came back
a.to_df() # one row per cited source
ui.values # the settings: {'n': 8, 'temperature': 0.2, ...}
core = ui.core # or BedrockChatAnalyzer(region="us-west-2", profile="dev")
params = core.request("support-docs", "refund window?", {"n": 8}) # the request, without sending it
a = core.ask("support-docs", "refund window?", {"n": 8, "temperature": 0.2}, model="sonnet")
a = core.ask("support-docs", "and for EU orders?", session_id=a.session_id) # a follow-up
a = core.ask("support-docs", "refund window?", data_source="faq") # one data source: a.data_sources
a = core.ask("support-docs", "refund window?", files=["refund-policy.pdf"]) # only these files: a.files
r = core.retrieve("support-docs", "refund window?", {"n": 8}) # only the search: r.sources, ranked, with scores
core.request("support-docs", "refund window?", retrieve_only=True) # the Retrieve request, not sent
core.data_sources("support-docs") # [DataSource]: ID, name, status
core.files("support-docs").documents # [KBDocument]: s3:// path, status, data source
core.ask("support-docs", "refund window?", stream=True, on_text=show) # show(text) gets the answer so far
core.schema().fields["temperature"] # Field: path, type, range, what it does
batch = core.ask_all("support-docs", ["refund window? | refund-policy.pdf", "gift returns?"], {"n": 8},
model="sonnet", workers=4) # Batch: each question asked on its own
batch.items[0].answer, batch.items[0].found, batch.items[0].cost # its Answer, where the file came up ([n]), USD
batch.failed, batch.cost, batch.to_df() # what Bedrock refused, the total, one row each
ui.batches # every test run of the view, oldest first; ui.questions: the Test tab's list
from aws_analyzer.bedrock_chat import sweep_setups
setups = sweep_setups({"n": [5, 10], "model": ["haiku", "sonnet"]}) # [{'n': 5, 'model': 'haiku'}, ...]
sweep = core.sweep("support-docs", ["refund window? | refund-policy.pdf"], setups, {"n": 5}) # Sweep: a Batch each
sweep.ranked # [(Batch, RunScore)], best first: answered, grounded, hits, MRR, failed, cost
sweep.best, sweep.to_df() # the best setup's run; one row per setup
ui.sweeps # every sweep of the view; ui.log: the file every run is added to
The analysis functions don't call AWS: request_schema, normalize_settings, coerce_setting, build_request,
build_retrieve_request, retrieve_settings, settings_from_request, validate_request, python_call,
parse_rag, parse_retrieve, collect_stream, as_filter,
describe_filter, data_source_filter, with_data_sources, split_data_sources, describe_sources,
files_filter, with_files, split_condition, match_files, file_labels, describe_files, describe_setting,
answer_cost, cited_ranks, and the findings: settings_findings, answer_findings and compare_findings (a
search and an answer to the same question). For test runs: parse_questions, format_questions, question_list,
match_expected, expected_at, item_verdict, batch_estimate, batch_findings and batch_changes (two runs of
the same questions). For sweeps and kept runs: sweep_setups, parse_variations, format_variations, apply_setup,
sweep_estimate, run_setup, varied_setups, setup_label, shared_questions, run_score, rank_runs,
ranking_findings, and run_record, run_from_record and read_runs (the file save_runs() writes). For the code:
config_of, config_json, python_script and cli_command.
Cost and limits: how answers are priced
- RetrieveAndGenerate doesn't report tokens, so they're estimated from characters (the question, the prompt and the passages retrieved; only the cited ones come back, so their average size stands in for the rest) and labelled as estimates. The estimate adds the question's embedding and, with a reranker, the reranking.
- A retrieve-only search costs the question's embedding and, with a reranker, the reranking: no model is called.
- Prices are the same us-east-1 list prices as
bedrock_kb.py(MODEL_PRICES,GLOBAL_MODEL_PRICES,BEDROCK_PRICES); pass your own withBedrockChatAnalyzer(model_prices={...}, prices={...}). A model that isn't in the table shows its cost as unknown. - Bedrock takes questions of up to 1,000 characters; the chat says so before sending a longer one.
- A test run (
ask_all(), the Test tab) costs what its questions would cost asked one by one, and the window shows an estimate before you run it (about 300 tokens per passage and per answer). It asks up to 50 questions (ask_all(limit=None)for all of them), four at a time; the client slows down and retries when Bedrock throttles, and a question that still fails is listed with the reason while the rest are asked. - A sweep costs its setups' runs added up: 4 setups × 20 questions is 80 answers. It's estimated before anything is
sent and refused over $2 (
max_cost=; the window asks for a second click), and up to 16 setups are asked at a time (max_setups=). Sweeping search settings withretrieve_only=Truecosts only the questions' embeddings (and reranking), so it's the cheap way to pick them before trying models. save_runs()writes a local file next to the notebook; it only ever adds lines to it, and nothing goes to AWS.
IAM permissions: read-only, and what needs which
| Permission | Used by |
|---|---|
bedrock:ListKnowledgeBases |
The knowledge base list, kbs, and finding a knowledge base by name (an ID works without it) |
bedrock:ListDataSources |
The data source list, and data_source= by name (an ID works without it) |
bedrock:ListKnowledgeBaseDocuments |
The Files list, files, and files= by name (an s3:// path works without it) |
bedrock:RetrieveAndGenerate and bedrock:Retrieve on the knowledge base, bedrock:InvokeModel on the model or inference profile |
Asking, in the window or with ask. Streamed answers (RetrieveAndGenerateStream) use the same permission; where streaming is refused anyway, answers arrive all at once and the window says why. Retrieve only and retrieve need only bedrock:Retrieve |
bedrock:ListFoundationModels, bedrock:ListInferenceProfiles |
The model list, models, and turning model="sonnet" into an ID |
A model also has to be enabled under Model access in the Bedrock console. A list the role can't read stays empty, with a note naming the missing permission, and its search box takes an ID instead. The chat guide has a ready-made IAM policy.
Amazon SageMaker
The notebook you're running in, and everything else SageMaker bills you for. What this notebook is and what it
costs, whether it stops when idle, how busy its CPU, memory, disk and GPU are, what fills its disk, and which
notebooks, apps and endpoints in the region look forgotten.
📄 src/aws_analyzer/sagemaker_env.py · 📖 SageMaker guide
ui.instance() in a Studio JupyterLab space: about $80 spent so far on a GPU that has sat idle, and nothing will stop the app tonight.
The file isn't called sagemaker.py, so it doesn't hide the SageMaker Python SDK, which is also imported as
sagemaker.
Quick start
Every command works with boto3 alone, so on SageMaker there's nothing to install.
from aws_analyzer import SageMakerView
ui = SageMakerView() # uses the notebook's execution role and region
ui.help() # every command, grouped by task
ui.instance() # this notebook: type, cost so far, idle shutdown, CPU / memory / disk / GPU now
ui.disk() # what fills the disk, and the caches and trash that are safe to clear
ui.running() # everything billing by the hour in the region, and what looks forgotten
ui.instance("old-experiment") # another notebook instance, or a Studio space by name
NOTE:
instance()anddisk()read the machine they run on, so run them in the notebook you want to know about: a notebook instance, or a Studio JupyterLab, Code Editor or Studio Classic app. Anywhere else,instance("name")andrunning()still work. Nothing in the file stops, deletes or changes anything; where that would help, the report shows the command.
Commands (SageMakerView)
Grouped the way ui.help() lists them.
This notebook
| Command | Shows |
|---|---|
instance(name=None) |
The notebook you're in: instance type with its vCPUs, memory and GPUs, price per hour, how long it has run and what that cost, what a month of it costs if it's never stopped, and whether anything stops it when idle (a notebook instance's auto-stop lifecycle configuration, or the Studio domain's idle shutdown), with the commands that turn it on. Then the machine right now: CPU load, memory, each disk and whether it survives a stop, GPU memory and use, the Jupyter kernels and the memory they hold, the biggest processes, and the Python and package versions. Settings: role, network, lifecycle configuration, image or platform, storage volume, space and domain. Findings: no idle shutdown, a disk or memory nearly full (and the other kernels holding memory), an idle GPU (and the CPU type with the same vCPUs and memory, with the saving), an instance far bigger than what's in use, Amazon Linux 1. name= shows another notebook instance or Studio space ("d-abc123/analysis" when two domains have one), without its machine |
disk(path=None, top=20, limit="200k") |
How full the disk is and what fills it: the biggest folders as a tree three levels deep, the biggest files and when they last changed, and the caches and trash that are safe to clear (Jupyter's trash, pip and conda caches, Hugging Face and PyTorch downloads, notebook checkpoints), each with the command that empties it. Findings: a nearly full disk (with the command that makes the volume bigger and what that costs a month), what can be cleared, big files untouched for 90 days (and what they'd cost in S3). The default folder is where your notebooks live: ~/SageMaker on a notebook instance, /home/sagemaker-user in Studio |
Your account
| Command | Shows |
|---|---|
running(metrics=True, days=7) |
Everything SageMaker bills by the hour in the region: notebook instances, Studio apps (JupyterLab, Code Editor, Studio Classic), endpoints, and training and processing jobs, with the instance, price per hour, how long each has run and whether it stops when idle, and each endpoint's requests over the last days days from CloudWatch. Stopped notebook instances are listed too, because their volumes are still billed. Findings, each with the command that stops it: notebooks and apps running for over 12 hours with nothing to stop them, endpoints with no requests, and the storage that stopped notebook instances keep |
Reference
Getting the data (SageMakerAnalyzer): the notebook, the machine and what's running, as Python objects
ui.core is the SageMakerAnalyzer. Every UI command has a data method on it:
sm = ui.core # or SageMakerAnalyzer(region="eu-west-1", profile="dev")
report = sm.instance() # InstanceReport: .env, .notebook, .machine, .identity
report.notebook.instance_type, report.notebook.idle # 'ml.g5.2xlarge', 'off'
report.machine.memory_share, report.machine.gpus # 0.37, [GPUInfo(name='NVIDIA A10G', busy=0.0, ...)]
sm.notebook("old-experiment") # NotebookInfo for any notebook instance or Studio space
sm.environment() # Environment: where this code runs, from SageMaker's metadata
sm.machine() # Machine: this machine right now (local reads only)
d = sm.disk("~/SageMaker", limit=None) # DiskReport: folders, largest files, caches you can clear
d.to_df() # one row per folder
r = sm.running(days=30) # RunningReport: .resources, .stopped, .errors
r.to_df() # one row per notebook, app, endpoint and job
The analysis functions are pure (no AWS calls), so they also work on responses you already have:
parse_metadata, parse_notebook_instance, parse_app, apply_studio_settings, studio_idle, lifecycle_idle,
parse_endpoint, parse_training_job, parse_processing_job, parse_meminfo, parse_loadavg, parse_gpus,
parse_process, hourly_price, describe_instance, notebook_costs, smaller_type, folder_tree,
idle_shutdown_commands, stop_command, and the findings: instance_findings, disk_findings, running_findings.
Cost and limits: the prices used, and what's measured and what's estimated
- Costs are estimates at us-east-1 on-demand list prices, read from the AWS Price List API on 2026-09-27.
INSTANCE_TYPESholds the price per hour of 134 instance types, with their vCPUs, memory and GPUs; a type costs the same per hour as a notebook instance, a Studio app, an endpoint or a job.SAGEMAKER_PRICESadds storage per GB-month: $0.14 for a notebook instance's volume, $0.112 for a Studio space's, and S3 Standard's $0.023 to compare with. For another region or a discount, pass your own:SageMakerAnalyzer(prices={"ml.g5.xlarge": 1.21, "notebook_storage": 0.15}). A type that isn't in the table shows its cost as unknown, and every report says whether it used list prices or yours. - "Cost since start" is the price per hour times how long it has run: since boot for the notebook instance you're in, since the app started for a Studio app, and since its last change (about when it last started) for any other notebook instance. Spot training jobs cost less than the on-demand price shown.
instance()reads CPU load (the 15-minute average) and memory as they are now, so the suggestion of a smaller instance says "if that's typical". Whether a notebook instance stops when idle is read from its lifecycle configuration script: AWS's auto-stop-idle sample and scripts like it.disk()stops after 200,000 files by default and says so (limit=Nonemeasures everything). It stays on one disk and doesn't follow links.
IAM permissions: read-only, and which command needs which
Read-only, per command:
| Permission | Used by |
|---|---|
sagemaker:DescribeNotebookInstance, sagemaker:DescribeNotebookInstanceLifecycleConfig |
instance on a notebook instance, running |
sagemaker:DescribeApp, sagemaker:DescribeSpace, sagemaker:DescribeDomain, sagemaker:DescribeUserProfile |
instance in Studio; running reads the domains |
sagemaker:ListDomains, sagemaker:ListSpaces, sagemaker:ListApps |
instance("space name") |
sagemaker:ListNotebookInstances, sagemaker:ListApps, sagemaker:ListEndpoints, sagemaker:DescribeEndpoint, sagemaker:DescribeEndpointConfig, sagemaker:ListTrainingJobs, sagemaker:DescribeTrainingJob, sagemaker:ListProcessingJobs, sagemaker:DescribeProcessingJob |
running |
cloudwatch:GetMetricData |
running: endpoint requests |
sts:GetCallerIdentity (who you're signed in as) needs no permission, and disk() only reads local files. Anything
you can't read shows up as a note instead of an error. The AmazonSageMakerFullAccess managed policy, which many
execution roles have, includes the sagemaker: permissions. The
SageMaker guide has a ready-made IAM
policy that covers every command.
Amazon OpenSearch
Vector (k-NN) indexes in OpenSearch Service domains and Serverless collections. Each vector field in plain
English, whether its graphs fit in the memory the nodes have, documents without a vector, vectors that repeat or are
all zeros, and the documents nearest a question.
📄 src/aws_analyzer/opensearch.py · 📖 OpenSearch guide
ui.index_info("vectors-prod/support-docs"): 27,000 documents vector search can't find, and graphs that need 15.7 GB of memory where the nodes have 12 GB.
Quick start
Every command works with boto3 alone, so on SageMaker there's nothing to install. No OpenSearch client library is needed either: requests to a domain or collection are signed with the notebook's role by botocore.
from aws_analyzer import OpenSearchView
ui = OpenSearchView() # uses the notebook's execution role and region
ui.help() # every command, grouped by task
ui.overview() # every domain and Serverless collection: size, cost, warnings
ui.indexes("vectors-prod") # its indexes: vector fields, documents without vectors, memory
ui.index_info("vectors-prod/support-docs") # one vector index in plain English, and the query to copy
ui.use("vectors-prod/support-docs") # later commands use this index...
ui.sample() # ...a few documents, and how healthy their vectors are
ui.search("how do I get my money back?") # the documents nearest a question (embedded with Bedrock)
ui.search(like="art-00156") # the documents nearest an existing one: no model needed
ui.search(vector=model.encode("refunds"), where={"lang": "en"}) # your own vector, filtered
NOTE: An index is named like a path,
"domain/index"or"collection/index"; a collection ID, an ARN or the endpoint URL your code already uses work too, and so does any OpenSearch you run yourself (indexes("https://host:9200"), withOpenSearchAnalyzer(auth=("user", "password"))for a user name and password). The notebook must be able to reach the endpoint: a domain inside a VPC answers only there. Nothing in the file writes: it sends GET requests, and POSTs only to_searchand_count, refusing anything else before it's sent.
Commands (OpenSearchView)
Grouped the way ui.help() lists them.
Domains and collections
| Command | Shows |
|---|---|
overview(match=None, metrics=True) |
Every domain and Serverless collection in the region, from the AWS APIs alone: each domain's engine and version, data nodes, storage, whether it's in a VPC, the memory its nodes have for vector graphs and estimated monthly cost; each collection's type, standby replicas, network access and key; and what Serverless bills even when idle (its OCU minimum) next to what it used in the last 24 hours and the most it can scale to. Warnings: a domain open to the internet, among others |
use(where) |
Sets the domain or collection ("vectors-prod"), or an index in it ("vectors-prod/support-docs"), that later commands use when you don't pass one |
Indexes
| Command | Shows |
|---|---|
indexes(target=None, hidden=False) |
Every index with its documents, size and shards, and each vector field's dimensions, engine and similarity, how many documents have a vector, and the memory its graphs need, against what the nodes have; cluster health and what the k-NN plugin has in memory now. Findings: the domain's own (version, instances, storage, encryption), graphs that don't fit, a tripped k-NN circuit breaker or graphs dropped from memory, documents without a vector, a deprecated engine |
index_info(index=None) |
One index in plain English: each vector field's engine, algorithm and settings (m, ef_construction, ef_search, compression), its similarity and what a score means, how many documents have a vector, the memory the graphs need and what on-disk mode or fp16 would need instead, the fields you can filter on (each with its where=), and the k-NN query as opensearch-py code. Findings: index.knn off, nmslib, documents without a vector, graphs that don't fit, no replicas, too many small shards or segments, many deleted documents, an index a Bedrock knowledge base writes |
Vectors
| Command | Shows |
|---|---|
sample(index=None, n=10, check=200, where=None) |
A few random documents with their text, source and fields (each vector as its dimensions and length), and a check of 200 documents' vectors: one size, unit length or not, all-zero vectors and exact repeats. where={"embedding": ("missing",)} shows documents with no vector |
search(query=None, index=None, vector=, like=, k=10, where=, field=, model=, embed=) |
The k nearest documents with their score and the similarity it stands for (cosine, inner product or distance), text, source and fields. The question is embedded with a Bedrock model (Titan Text Embeddings V2 for 256, 512 or 1,024 dimensions, or model=) or embed=your_function; vector= searches with your own vector and like="doc-id" with a document's own. Notes repeated texts and a query vector that doesn't look like the stored ones |
Filters (where=)
where= works on search (during the search, with faiss and lucene) and sample. It takes a dict, and every
condition must match:
where= |
Means |
|---|---|
{"lang": "en"} |
lang is en (a text field is matched through its .keyword sub-field when it has one) |
{"product": ["store", "app"]} |
one of these, also ("in", [...]) |
{"year": (">=", 2024)} |
also "=", "!=", ">", "<", "<=" |
{"updated": ("between", "2026-01-01", "2026-06-30")} |
both ends included |
{"metadata.source": ("prefix", "s3://acme/refunds")} |
starts with |
{"text": ("contains", "gift card")} |
the words, in a text field |
{"embedding": ("missing",)} |
the field isn't set, also ("exists",) |
Query DSL passes through unchanged (where={"bool": {...}}). A field the index doesn't have is reported with the
closest names, and index_info() lists the fields you can filter on.
Reference
Getting the data (OpenSearchAnalyzer): mappings, vectors and search results as Python objects
ui.core is the OpenSearchAnalyzer. Every UI command has a data method on it:
aos = ui.core # or OpenSearchAnalyzer(region="eu-west-1", profile="dev")
ov = aos.overview() # Overview: .domains, .collections, .ocus
report = aos.indexes("vectors-prod") # StoreReport: .indexes, .vector_indexes, .health, .knn
info = aos.index("vectors-prod", "support-docs") # IndexInfo: .vectors, .fields, .with_vector, .settings
info.vector().dimension, info.vector().space # 1024, 'cosinesimil'
s = aos.sample("vectors-prod", "support-docs", 500) # Sample: .docs, .checks["embedding"], .to_df()
r = aos.search("vectors-prod", "support-docs", vector=v, k=20, where={"lang": "en"})
r.to_df() # rank, id, score, similarity and the fields
aos.embed("refund policy", model="cohere") # Embedding: .vector, .tokens, .cost
aos.request("vectors-prod", "support-docs/_search", {"query": {"match": {"text": "refund"}}}) # any read
The analysis functions are pure (no AWS calls), so they also work on mappings and vectors you already have:
parse_mapping, read_settings, vector_memory, index_vector_memory, knn_memory_limit, check_vectors,
score_to_similarity, build_filter, knn_query, query_python, parse_location, domain_monthly_cost,
serverless_minimum, and the findings: domain_findings, collection_findings, index_findings, store_findings,
knn_findings, vector_findings, search_findings.
Cost, memory and limits: the prices used, and what's measured and what's estimated
- Costs are estimates at us-east-1 list prices, read from the AWS Price List API on 2026-10-05.
INSTANCE_TYPESholds the hourly price, vCPUs and memory of 189 OpenSearch Service instance types; a domain costs its data, master and UltraWarm nodes plus each data node's EBS storage (OPENSEARCH_PRICES: gp3 $0.122 per GB-month, gp2 $0.135). IOPS and throughput above gp3's baseline, UltraWarm storage and data transfer aren't included. For another region or a discount, pass your own:OpenSearchAnalyzer(prices={"r6g.large.search": 0.195, "gp3": 0.146}). - Serverless bills $0.24 per OCU-hour, indexing and search alike, and at least 2 OCUs (1 without standby replicas)
for each group of collections that share an encryption key, a type and the standby setting.
overview()uses the OCUs CloudWatch saw in the last 24 hours when it can read them, and never less than that minimum. Storage is $0.024 per GB-month on top. - Vector memory is OpenSearch's own sizing rule: HNSW needs 1.1 × (bytes per vector + 8 ×
m) per vector, for every copy. The memory a domain has for graphs is half of what the Java heap leaves on each data node (the heap gets half the RAM, up to 32 GiB): about 4 GB on anr6g.large.search. On a domain, the k-NN plugin's own numbers (graph memory in use, a tripped circuit breaker, graphs dropped) come from_plugins/_knn/stats. search()with a text embeds it with Bedrock: Titan Text Embeddings V2 is $0.02 per million tokens, so a question costs far less than a cent; the report shows the tokens and cost. The reports read only what they show:indexes()one count per vector field,sample()200 documents,search()one search.
IAM permissions: read-only, and what each one is for
Read-only. Grant what you need:
| Permission | For |
|---|---|
es:ListDomainNames, es:DescribeDomains, es:DescribeDomain |
The domains and their settings |
es:ESHttpGet, es:ESHttpPost on arn:aws:es:<region>:<account>:domain/<name>/* |
A domain's indexes. POST is only used for searches and counts |
aoss:ListCollections, aoss:BatchGetCollection, aoss:ListSecurityPolicies, aoss:GetSecurityPolicy, aoss:GetAccountSettings |
The Serverless collections, their network access and the account's capacity limits |
aoss:APIAccessAll, and a data access policy with aoss:DescribeIndex and aoss:ReadDocument on index/<collection>/* |
A collection's indexes |
cloudwatch:GetMetricData |
The OCUs Serverless used (overview) |
bedrock:InvokeModel |
search with a text, to embed it |
A domain's access policy must allow the role too, and with fine-grained access control the role must be mapped to an
OpenSearch role that can read, such as the built-in readall_and_monitor. sts:GetCallerIdentity (the account ID
for CloudWatch) needs no permission. Anything you can't read shows up as a note instead of an error. The
OpenSearch guide has a ready-made IAM policy
and data access policy.
AWS Lambda
Lambda functions, in one region or all of them. What each function runs and when its runtime loses support,
what triggers it and who else can call it, how often it ran, failed and was throttled, what it costs, and why it
fails, read from its own logs, with its memory, cold starts and code. The
explorer window shows it all by clicking, its logs run by run.
📄 src/aws_analyzer/lambda_functions.py · 📖 Lambda guide
ui.functions(regions="all"): two runtimes AWS no longer patches, $70 a month of provisioned concurrency for a function that never runs two at once, and 3% of calls failing in the last three days, against 0.6% over the month.
Quick start
Every command works with boto3 alone, so on SageMaker there's nothing to install. The file isn't called lambda.py
because lambda is a Python keyword.
from aws_analyzer import LambdaView
ui = LambdaView() # uses the notebook's execution role and region
ui.help() # every command, grouped by task
ui.functions() # every function: runtime, triggers, calls, errors, cost, warnings
ui.functions(regions="all") # ...in every region your account has turned on
ui.function_info("orders-etl") # one function in plain English, and its last 30 days
ui.errors("orders-etl") # its errors in the last 24 hours, grouped by cause
ui.logs("orders-etl", search="KeyError") # the newest lines it logged; request_id= shows one run
ui.performance("orders-etl") # run times, memory used, cold starts, and the memory it needs
ui.code("orders-etl") # the files in its package, and the handler's source
ui.explore() # all of it in a window, by clicking (below)
NOTE: A function is named by its name,
"name:alias", its ARN or a link to it in the Lambda console; passregion="eu-west-1"for one in another region. Nothing in the file invokes, changes or deletes a function: where a change would help, the report shows the AWS CLI command to run. Environment variable values never appear in a report, only their names.
Explore functions and logs by clicking
explore() opens a window on your functions that you use by clicking, with nothing to type but a search. Every
function in the region is listed with how it's doing, the ones that need attention first. Click one for what's wrong
with it, what calls it and where its results go, and, a click away, its logs run by run: each call on one line,
with its status, run time against the timeout, memory and cold start, the failed ones in red; click a run for every line
it logged. Its errors grouped by cause, its run times, the code in its package and every setting are tabs beside them.
explore("orders-etl", tab="logs"): the last 24 hours run by run, a failed run open with its traceback, and a run that hit the 60 s timeout.
from aws_analyzer.lambda_functions import explore
explore() # every function in the notebook's region
explore("orders-etl", tab="logs") # straight to one function's logs (a name, an ARN or a console link)
explore(region="all") # every region your account has turned on
ui.explore("orders-etl") # from a LambdaView
The window needs ipywidgets, which SageMaker already has (elsewhere: %pip install ipywidgets, then reload the
browser tab). Without it, or outside Jupyter, it shows the same as reports: functions(), or function_info() and the
other reports for one function.
| To | Do this |
|---|---|
| Find a function | Functions: every function with its runtime, triggers, calls, error rate, run time, monthly cost, when it was last called and its warnings, problems first. Search by name, description, runtime, region or trigger, click a chip (Needs attention, With errors, Old runtime, Public, Not called), or a column's header to sort. Or click the function field at the top, which searches as you type and takes an ARN too. The region field switches to another region, or every region |
| See what's wrong | Overview: the findings, each with what to do; how it's wired (what calls it, and where its results, failed events and logs go); its calls and run time a day for 30 days; and what it costs |
| Read its logs | Logs: a line per run, newest first, with its status, run time, memory, cold start and what failed; click one for every line it logged, its REPORT line summed up. Pick the time range (15 minutes to 30 days), type to find runs with some text, Enter to search CloudWatch for the whole range (each run found comes back whole), or click a chip for the failed runs, timeouts or cold starts. JSON logs show each line's message, its other fields a click away |
| Watch it while you test it | Live, on the Logs tab: new lines every 5 seconds, new runs at the top (it stops when you leave the tab, and after 15 minutes) |
| See why it fails | Errors: its errors grouped by cause with what to do, and the newest failed runs; click one to read it in the Logs tab. Performance: run times, memory and cold starts, and the slowest runs, each a click from its lines |
| Read its code and settings | Code: the files in its package, the handler's first; click one for its source, in colour (a secrets file's text is held back). Settings: every setting in plain English, then as Lambda returns it, environment values hidden |
Everything is read in the background, so a click shows what's known at once and the rest as it arrives. Like the rest
of the file it only reads. explore() returns the window: x.logs(search="KeyError", since="24h"), x.run(request_id)
and x.open("report-api") do what the clicks do, and x.ui is a LambdaView for reports in other cells.
Commands (LambdaView)
Grouped the way ui.help() lists them.
Explore by clicking
| Command | Shows |
|---|---|
explore(name=None, tab=None, region=None, height=None) |
The explorer window: every function, and for the one you click its health, logs run by run, errors, run times, code and settings. view.explorer is the window |
Functions
| Command | Shows |
|---|---|
functions(match=None, regions=None, days=30, metrics=True, details=True) |
Every function in the region, or in several (regions="all" for every region your account has turned on): its runtime and when that loses support, memory, timeout, what triggers it (queues and streams, services and accounts its resource policy allows, its function URL), calls, error rate, average run time and when it was last called (CloudWatch, 30 days), and the estimated monthly cost. Warnings: runtimes past or near end of support, functions anyone can call, idle provisioned concurrency, frequent or rising errors, throttles, runs close to the timeout |
function_info(name, region=None, days=30) |
One function in plain English: what it runs (handler, memory and the CPU it buys, timeout, layers), what triggers it and who may call it, what happens to failed asynchronous events, what it can reach (role, network, environment variable names), versions, aliases and provisioned concurrency, its last 30 days day by day, and the cost by part. Findings end in the command to fix each: the runtime to move to, the timeout to set, the log retention to add |
When something goes wrong
| Command | Shows |
|---|---|
errors(name, since="24h", region=None, limit=10000) |
The errors in its logs grouped by cause: timeouts, running out of memory, code that can't load, permissions its role lacks (with the action and resource), throttled or unreachable services, exceptions; how often and when each happened, and the run to look at, next to CloudWatch's count of failed and throttled calls |
logs(name, since=None, search=None, request_id=None, n=50, region=None) |
The newest lines it logged, with each run's REPORT line summed up; search= keeps lines with some text (or a CloudWatch Logs filter pattern), and request_id= shows one run from start to end |
performance(name, since="24h", region=None, limit=5000) |
Run times (median, 1 in 100, longest) against the timeout, memory used against what it has and the size that would do, cold starts and their start-up time, timeouts, and the slowest runs, from the REPORT line Lambda logs after each run |
Code
| Command | Shows |
|---|---|
code(name, file=None, region=None, max_size="50MB") |
What's in its deployment package: files and folders by size, and the source of the handler's file (or file=; a secrets file's text is held back). Findings: a handler no file matches, secrets files packed in it, size near Lambda's limit, boto3 bundled although the runtime has it |
Reference
Getting the data (LambdaAnalyzer): functions, metrics, errors and runs as Python objects
ui.core is the LambdaAnalyzer. Every UI command has a data method on it:
lam = ui.core # or LambdaAnalyzer(region="eu-west-1", profile="dev")
ov = lam.overview(regions="all") # Overview: .functions, .metrics, .triggers, .accounts
ov.to_df() # one row per function: settings, calls, errors, cost
detail = lam.describe("orders-etl") # FunctionDetail: .function, .triggers, .aliases, .metrics
lam.errors("orders-etl", since="7d").groups # ErrorGroup: kind, message, count, first, last, request_ids
lam.performance("orders-etl").to_df() # one row per run: duration, billed, memory used, cold start
lam.log_events("orders-etl", pattern='"KeyError"').to_df()
lam.log_runs("orders-etl", since="24h").runs # LogRun per call: .status, .duration, .cold, .events
lam.log_runs("orders-etl", search="ORD-1042").runs # the runs with a line that has it, each one whole
lam.code("orders-etl").files # CodeFile: path, size, compressed
The analysis functions are pure (no AWS calls), so they also work on configurations, policies and log lines you
already have: parse_function, parse_policy, parse_event_source_mapping, runtime_status,
function_monthly_cost, provisioned_monthly_cost, classify_error, group_errors, parse_report, split_runs
(log lines grouped into runs), line_level, percentile, suggest_memory, handler_file, read_package,
secret_like, and the findings: function_findings, account_findings, error_findings, performance_findings,
package_findings.
Cost and runtimes: the prices used, and where the support dates come from
- Costs are estimates at us-east-1 list prices, read from the AWS Price List API on 2026-10-05 (
LAMBDA_PRICES): $0.20 per million requests, $0.0000166667 per GB-second of compute on x86_64 ($0.0000133334 on arm64), provisioned concurrency $0.0000041667 per GB-second kept ready ($0.0000033334 on arm64),/tmpabove 512 MB, and CloudWatch Logs at $0.50 per GB logged and $0.03 per GB-month kept. Usage is what CloudWatch counted over the window (30 days by default) scaled to a month, before the free tier, at the first pricing tier, and with compute on provisioned concurrency at the on-demand rate (it's a little cheaper). API Gateway, SQS and data transfer aren't included. For another region or a discount:LambdaAnalyzer(prices={"gb_second": 0.0000183}). - Runtime support dates are AWS's published schedule (end of support, then blocked creates, then blocked updates),
as of 2026-09-29, in
RUNTIMES. A runtime gets a warning 90 days before its end of support. - The reports read only what they show.
functions()reads 7 CloudWatch metrics per function and one per region ($0.01 per 1,000) and says how many; reading logs and downloading code cost nothing.
IAM permissions: read-only, and what each one is for
Read-only. Grant what you need:
| Permission | For |
|---|---|
lambda:ListFunctions, lambda:GetFunction |
The functions and their settings, and the link code downloads from |
lambda:GetPolicy, lambda:ListEventSourceMappings, lambda:GetFunctionUrlConfig |
What triggers each function, and who may call it |
lambda:GetFunctionEventInvokeConfig, lambda:ListVersionsByFunction, lambda:ListAliases, lambda:ListProvisionedConcurrencyConfigs, lambda:GetRuntimeManagementConfig |
function_info: failed events, versions, aliases, provisioned concurrency, runtime updates |
lambda:GetAccountSettings |
Each region's concurrency and code storage limits |
cloudwatch:GetMetricData |
Calls, errors, throttles, run time and log volume |
logs:DescribeLogGroups, logs:DescribeLogStreams, logs:FilterLogEvents |
Log retention and size, and errors, logs, performance and the explorer's Logs tab |
ec2:DescribeRegions |
functions(regions="all"): the regions your account has turned on |
lambda:GetFunction also returns the environment variables' values, which the reports never show. Anything you can't
read shows up as a note instead of an error. The
Lambda guide has a ready-made IAM
policy.
Development
Issues and pull requests are welcome: CONTRIBUTING.md explains the set-up and the rules the code follows, and SECURITY.md how to report a vulnerability privately. What changed in each release is in CHANGELOG.md.
pip install -r requirements-dev.txt # pinned versions
python -m pytest # every test, no AWS account needed
ruff check . # lint
python -m build # the PyPI package, in dist/
pip install -r requirements-docs.txt # the guide site
mkdocs serve # preview it at http://127.0.0.1:8000
- Tests run against moto, so no AWS account is needed. moto covers little of
Bedrock and none of SageMaker Studio, so the Bedrock Knowledge Bases tests and the SageMaker Studio and
running()tests use botocore'sStubberon real clients instead, which also checks every request against the service model. The OpenSearch tests use moto for domains, fake Serverless, CloudWatch and Bedrock clients checked the same way, andtests/fake_opensearch.py, a small in-memory OpenSearch that answers the REST calls (k-NN searches included) and fails the test if anything but a read is sent. The Lambda tests use moto for functions, triggers, CloudWatch and logs, with the few Lambda reads moto lacks (account limits, provisioned concurrency) answered by functions checked against the service model. The SageMaker tests read a fake machine (metadata file,/proc, a home folder) from a temporary folder. The chat window's tests click its ipywidgets in Python, against fake Bedrock clients that check every request, response and stream event against the service model. - Guides in
docs/are Markdown, built with MkDocs and the Material theme (mkdocs.yml) and published to GitHub Pages by the Docs workflow whenever they change onmain; pull requests build them with--strict, so a broken link fails there.docs/index.mdis the home page with a card per service, and each service has its own guide (docs/s3.md,docs/dynamodb.md,docs/bedrock_kb.md,docs/bedrock_chat.md,docs/sagemaker_env.md,docs/opensearch.md,docs/lambda_functions.md), and so does the S3 explorer (docs/s3_explorer.md); a new analyzer gets a new guide, a card on the home page and an entry inmkdocs.yml'snav. - Screenshots are the tool's own output from demo buckets, tables and knowledge bases with synthetic data;
.claude/skills/demo/shots.pyremakes them (it needs Pillow and a headless Chrome), and.claude/skills/demo/demo.pyruns any command against the same kind of data. Bedrock's are served by a simulated Bedrock, since moto has none, and OpenSearch's by simulated clusters. The chat window's and the knowledge base explorer's are taken in a real JupyterLab by.claude/skills/demo/chat_shots.pyand.claude/skills/demo/kb_explorer_shots.py(they need jupyterlab and playwright too). - The PyPI package (
pyproject.toml) shipssrc/aws_analyzer/, where each analyzer is one module and_kit/holds the code they share (formatting, parsing, optional imports, AWS errors, how reports are drawn, and the base View and analyzer each service builds on);src/aws_analyzer/__init__.pyonly re-exports the classes and holds__version__. Optional packages are extras:data(pandas, pyarrow),files(Excel, PDF, .zst, snappy),notebook(IPython, ipywidgets, tqdm) andall. A release moves the## [Unreleased]entries inCHANGELOG.mdunder the new version, sets__version__to match (/releasein Claude Code does both, see CONTRIBUTING.md), and publishes a GitHub release taggedv<version>: the Release workflow builds it, checks it and uploads it to PyPI with trusted publishing (its comments have the one-time setup). - CI runs the same checks on Python 3.10 to 3.14 for every pull request and push to
main, and also imports each module with only boto3 installed, and builds the package and imports it the same way. The versions inrequirements-dev.txtandrequirements-docs.txtare pinned; Dependabot opens weekly pull requests to update them and the GitHub Actions the workflows use.
License
The service icons are from AWS's Architecture Icons, unchanged. AWS and the AWS service names are trademarks of Amazon.com, Inc. or its affiliates; this project isn't made or endorsed by AWS.
Metadata
Release files for aws-analyzer 0.14.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| aws_analyzer-0.14.0.tar.gz | 1.1 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| aws_analyzer-0.14.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 1.8 MB
Release files / aws_analyzer-0.14.0.tar.gz
| Download URL | aws_analyzer-0.14.0.tar.gz |
|---|---|
| Size | 1.1 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
375ffe78f4180581425b7b919b0515b71f417a08aaf8569b66c4a271d2903879
|
|
BLAKE2b-256 checksum How to use checksums |
a846ee31343a57d57fe568e4d551da8fb20f3ea4378c7b1fff5e240dc6ed09fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 12, 2026.
Transparency logRelease files / aws_analyzer-0.14.0-py3-none-any.whl
| Download URL | aws_analyzer-0.14.0-py3-none-any.whl |
|---|---|
| Size | 769.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b4c3d2aab2aeaeffc65cc751f130a0a9c2d660d9e24021cf5bf801199a24a390
|
|
BLAKE2b-256 checksum How to use checksums |
e1a50bc676fdd7eb2b530109b8fc8d3429e94df5970f770114d46008adeebb81
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Oct 12, 2026.
Transparency log