Skip to main content

MongoDB diagnostics toolkit with health checks and log analysis

Project description

x-ray

Makefile Release PyPI

This project aims to create tools for MongoDB analysis and diagnosis. So far 3 modules are being built:

  • Health check module.
  • Log analysis module.
  • getMongoData visualization module (Under construction).

1 Compatibility Matrix

1.1 Health Check

Replica Set Sharded Cluster Standalone
>=4.2 ✓ >=4.2 ✓

Older versions are not tested.

1.2 Log Analysis

Log analysis requires JSON format logs, which is supported since 4.4.

Replica Set Sharded Cluster Standalone
>=4.4 ✓ >=4.4 ✓ >=4.4 ✓

1.3 getMongoData Analysis

Analyze & visualize the getMongoData.js output.

Replica Set Sharded Cluster Standalone
>=4.4 ✓ >=4.4 ✓

2 How to Install

2.1 PyPi

2.1.1 Install with Pip

The easiest and recommended way to install x-ray is to use pip:

pip install mongo-x-ray

2.1.2 Build from Source

git clone https://github.com/zhangyaoxing/x-ray
cd x-ray
pip install .

2.2 PyInstaller

2.2.1 Prebuilt Binaries

Currently the prebuilt binaries are available on 3 platforms:

  • Ubuntu 22.04 (AMD64)
  • MacOS 14 (ARM64)
  • Windows 2022 (AMD64)

Download them from Releases.

2.2.2 Build from Source

x-ray is tested on Python 3.9.22. On MacOS or Linux distributions, you can use the make command to build the binary:

git clone https://github.com/zhangyaoxing/x-ray
cd x-ray
make deps # if it's the first time you build the project
make # equal to `make build`

There are other make targets. Use make help to find out.

For Windows users, if make command is not available. You can use Python commands to build the binary:

python.exe -m venv .venv
.venv\Scripts\python.exe -m pip install --upgrade pip
.venv\Scripts\python.exe -m pip install -e ".[dev]"
.venv\Scripts\python.exe -m PyInstaller --onefile `
  --name x-ray `
  --add-data="templates;templates" `
  --add-data="libs;libs" `
  --icon="misc/x-ray.ico" `
  --hidden-import=openai `
  x-ray

2.3 For Developers

For developers, use make deps to prepare venv and dependencies

make deps

Or

python3 -m venv .venv
python3 -m pip install --upgrade pip
python3 -m pip install -e ".[dev]"

3 Using the Tool

x-ray [-h] [-q] [-c CONFIG] {healthcheck,hc,log,gmd,ftdc}
Argument Description Default
-q, --quiet Quiet mode. false
-h, --help Show the help message and exit. n/a
-c, --config Path to configuration file. Built-in libs/config.json
command Command to run. Include:
- healthcheck or hc: Health check.
- log: Log analysis.
- version: Show version info.
None

Besides, you can use environment variables to control some behaviors:

  • ENV=development For developing. It will change the following behaviors:
    • Formatted the output JSON for for easier reading.
    • The output will not create a new folder for each run but overwrite the same files.
  • LOG_LEVEL: Can be DEBUG, ERROR or INFO (default).

3.1 Health Check Component

3.1.1 Examples

./x-ray healthcheck localhost:27017 # Scan the cluster with default settings.
./x-ray hc localhost:27017 --output ./output/ # Specify output folder.
./x-ray hc localhost:27017 --config ./config.json # Use your own configuration.

3.1.2 Full Arguments

x-ray healthcheck [-h] [-s CHECKSET] [-o OUTPUT] [-f {markdown,html}] [uri]
Argument Description Default
-s, --checkset Checkset to run. default
-o, --output Output folder path. output/
-f, --format Output format. Can be markdown or html. html
uri MongoDB database URI. None

For security reasons you may not want to include credentials in the command. There are 2 options:

  • If the URI is not provided, user will be asked to input one.
  • If URI is provided but not username/password, user will also be asked to input them.

3.1.3 More Info

Refer to the wiki for more details.

3.2 Log Analysis Component

3.2.1 Examples

# Full analysis
./x-ray log mongodb.log
# For large logs, analyze a random 10% logs
./x-ray log -r 0.1 mongodb.log

3.2.2 Full Arguments

x-ray log [-h] [-s CHECKSET] [-o OUTPUT] [-f {markdown,html}] [log_file]
Argument Description Default
-s, --checkset Checkset to run. default
-o, --output Output folder path. output/
-f, --format Output format. Can be markdown or html. html
-r, --rate Sample rate. Only analyze a subset of logs. 1
--top When analyzing the slow queries, only list top N. 10

3.3 getMongoData Analysis Component

3.3.1 Examples

# getMongoData output for a sharded cluster
x-ray gmd misc/getMongoData-sh.json
# getMongoData output for a replica set
x-ray gmd misc/getMongoData-rs.json

3.3.2 Full Arguments

x-ray gmd [-h] [-s CHECKSET] [-o OUTPUT] [-f {markdown,html}] gmd_file
Argument Description Default
-s, --checkset Checkset to run. default
-o, --output Output folder path. output/
-r, --rate controls FTDC sampling and accepts a value between 0 and 1. 1 / ingested files
-f, --format Output format (markdown/html). html

3.4 FTDC Analysis Component

The FTDC baseline analysis reports its capture timespan and effective sample rate, then groups metrics into Workload, Read/Write Operations and Latencies, and Performance sections. It includes operation rates and latencies, host memory and CPU utilization, WiredTiger cache utilization, queue depth for each block device, and free-space and utilization charts for every reported mount point. Each metric shows its peak, average, unit, and a chart saved under the report output's charts directory. Start and end are inclusive UTC ISO-8601 timestamps. When omitted, the first and last data points in the archive are used.

x-ray ftdc /var/lib/mongo/diagnostic.data
x-ray ftdc /var/lib/mongo/diagnostic.data 2026-06-17T08:00:00Z 2026-06-17T10:00:00Z
x-ray ftdc [-h] [-s CHECKSET] [-o OUTPUT] [-f {markdown,html}] [-r RATE] ftdc_path [start_time] [end_time]

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mongo_x_ray-1.4.0.post1.tar.gz (124.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mongo_x_ray-1.4.0.post1-py3-none-any.whl (219.9 kB view details)

Uploaded Python 3

File details

Details for the file mongo_x_ray-1.4.0.post1.tar.gz.

File metadata

  • Download URL: mongo_x_ray-1.4.0.post1.tar.gz
  • Upload date:
  • Size: 124.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for mongo_x_ray-1.4.0.post1.tar.gz
Algorithm Hash digest
SHA256 2ccc1be82531e9de6651d161d066380b54c9bb9e4c1e66652697bf46b9c3b488
MD5 7fe521e5c82ad94caed92dfdf5b6f757
BLAKE2b-256 38171a426aacb4212cc881db27b303966f82b6a4c77455bd4e7e70e02d0e1adf

See more details on using hashes here.

Provenance

The following attestation bundles were made for mongo_x_ray-1.4.0.post1.tar.gz:

Publisher: publish-pypi.yml on mongodb-ps/ce-mongo-x-ray

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file mongo_x_ray-1.4.0.post1-py3-none-any.whl.

File metadata

File hashes

Hashes for mongo_x_ray-1.4.0.post1-py3-none-any.whl
Algorithm Hash digest
SHA256 f73fe8bf502717b35996d33157d1e17f56e0eb9a0b34d21bc15251784b01c8cb
MD5 137c535fef576999085df4fe7d5b805c
BLAKE2b-256 53f2991120becc38f9e29f07d70a9792344e4cf657367979e83c4eb7ed4855a1

See more details on using hashes here.

Provenance

The following attestation bundles were made for mongo_x_ray-1.4.0.post1-py3-none-any.whl:

Publisher: publish-pypi.yml on mongodb-ps/ce-mongo-x-ray

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page