TensorFlow Model Analysis
TensorFlow Model Analysis (TFMA) is a library for evaluating TensorFlow models. It allows users to evaluate their models on large amounts of data in a distributed manner, using the same metrics defined in their trainer. These metrics can be computed over different slices of data and visualized in Jupyter notebooks.
Caution: TFMA may introduce backwards incompatible changes before version 1.0.
Installation
The recommended way to install TFMA is using the PyPI package:
pip install tensorflow-model-analysis
Currently, TFMA requires that TensorFlow is installed but does not have an explicit dependency on the TensorFlow PyPI package. See the TensorFlow install guides for instructions.
To enable TFMA visualization in Jupyter Notebook:
jupyter nbextension enable --py widgetsnbextensionjupyter nbextension install --py --symlink tensorflow_model_analysisjupyter nbextension enable --py tensorflow_model_analysis
Note: If Jupyter notebook is already installed in your home directory, add
--user to these commands. If Jupyter is installed as root, or using a virtual
environment, the parameter --sys-prefix might be required.
Dependencies
Apache Beam is required to run distributed analysis. By default, Apache Beam runs in local mode but can also run in distributed mode using Google Cloud Dataflow. TFMA is designed to be extensible for other Apache Beam runners.
Getting Started
For instructions on using TFMA, see the get started guide and try out the extensive end-to-end example.
Compatible Versions
The following table is the TFMA package versions that are compatible with each other. This is determined by our testing framework, but other untested combinations may also work.
| tensorflow-model-analysis | tensorflow | apache-beam[gcp] |
|---|---|---|
| GitHub master | nightly (1.x) | 2.11.0 |
| 0.13.2 | 1.13 | 2.11.0 |
| 0.13.1 | 1.13 | 2.11.0 |
| 0.13.0 | 1.13 | 2.11.0 |
| 0.12.1 | 1.12 | 2.10.0 |
| 0.12.0 | 1.12 | 2.10.0 |
| 0.11.0 | 1.11 | 2.8.0 |
| 0.9.2 | 1.9 | 2.6.0 |
| 0.9.1 | 1.10 | 2.6.0 |
| 0.9.0 | 1.9 | 2.5.0 |
| 0.6.0 | 1.6 | 2.4.0 |
Questions
Please direct any questions about working with TFMA to Stack Overflow using the tensorflow-model-analysis tag.
2 maintainers
Release files for tensorflow-model-analysis 0.13.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| tensorflow_model_analysis-0.13.2-py3-none-any.whl | Python 3 | none | any | Details |
| tensorflow_model_analysis-0.13.2-py2-none-any.whl | Python 2 | none | any | Details |
Total release size: 1.9 MB
Release files / tensorflow_model_analysis-0.13.2-py3-none-any.whl
| Download URL | tensorflow_model_analysis-0.13.2-py3-none-any.whl |
|---|---|
| Size | 976.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e2a21129b13be4a6a3c55e6bbb2aa0472279fe8577416c545e9b69c48a2064af
|
|
BLAKE2b-256 checksum How to use checksums |
d1aa9da9ebb67ce799f8fe8b455c45e8721c879b4f16230e9bccf0b29bd7952a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.5
|
Release files / tensorflow_model_analysis-0.13.2-py2-none-any.whl
| Download URL | tensorflow_model_analysis-0.13.2-py2-none-any.whl |
|---|---|
| Size | 973.4 kB |
| Tags | Python 2 |
|
SHA-256 checksum How to use checksums |
1cb31ae6f33619f37c7a72bda42d1ded5841e6c961fb64f8d1f3b8ff76962811
|
|
BLAKE2b-256 checksum How to use checksums |
666462af31245f2afacd21526985da025325e7774de6668d3aeec5bc8665fa1b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/41.0.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.5
|
