Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
[10:25:24] Transferring environment variable script to build VM
[10:25:25] Transferring kokoro_log_reader.py to build VM
[10:25:26] Transferring source code to build VM
[10:25:28] Executing build script on build VM



[ID: 6889416] Executing command via SSH:
export KOKORO_BUILD_NUMBER="5803"
export KOKORO_JOB_NAME="keras/github/ubuntu/cpu/presubmit"
source /tmpfs/kokoro-env_vars.sh; cd /tmpfs/src/ ; chmod 755 github/keras/keras/kokoro/github/ubuntu/cpu/build.sh ; PYTHON_3_VERSION="$(pyenv which python3 2> /dev/null || which python3)" ; PYTHON_2_VERSION="$(pyenv which python2 2> /dev/null || which python2)" ; if "$PYTHON_3_VERSION" -c "import psutil" ; then KOKORO_PYTHON_COMMAND="$PYTHON_3_VERSION" ; else KOKORO_PYTHON_COMMAND="$PYTHON_2_VERSION" ; fi > /dev/null 2>&1 ; echo "export KOKORO_PYTHON_COMMAND="$KOKORO_PYTHON_COMMAND"" > "$HOME/.kokoro_python_vars" ; nohup bash -c "( rm -f /tmpfs/kokoro_build_exit_code ; github/keras/keras/kokoro/github/ubuntu/cpu/build.sh ; echo \${PIPESTATUS[0]} > /tmpfs/kokoro_build_exit_code ) > /tmpfs/kokoro_build.log 2>&1" > /dev/null 2>&1 & echo $! > /tmpfs/kokoro_build.pid ; source "$HOME/.kokoro_python_vars" ; "$KOKORO_PYTHON_COMMAND" /tmpfs/kokoro_log_reader.py /tmpfs/kokoro_build.log /tmpfs/kokoro_build_exit_code /tmpfs/kokoro_build.pid /tmpfs/kokoro_log_reader.pid --start_byte 0

+ cd /tmpfs/
+ sudo update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.9 1
update-alternatives: using /usr/bin/python3.9 to provide /usr/bin/python3 (python3) in auto mode
+ PYTHON_BINARY=/usr/bin/python3.9
+ /usr/bin/python3.9 -m venv venv
+ source venv/bin/activate
++ deactivate nondestructive
++ '[' -n '' ']'
++ '[' -n '' ']'
++ '[' -n /bin/bash -o -n '' ']'
++ hash -r
++ '[' -n '' ']'
++ unset VIRTUAL_ENV
++ '[' '!' nondestructive = nondestructive ']'
++ VIRTUAL_ENV=/tmpfs/venv
++ export VIRTUAL_ENV
++ _OLD_VIRTUAL_PATH=/usr/local/cuda/bin:/opt/android-sdk/current/cmdline-tools/tools/bin:/opt/android-sdk/current/bin:/usr/local/go/bin:/usr/local/go/packages/bin:/opt/kubernetes/client/bin:/usr/local/cuda/bin:/opt/android-sdk/current/cmdline-tools/tools/bin:/opt/android-sdk/current/bin:/usr/local/go/bin:/usr/local/go/packages/bin:/opt/kubernetes/client/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ PATH=/tmpfs/venv/bin:/usr/local/cuda/bin:/opt/android-sdk/current/cmdline-tools/tools/bin:/opt/android-sdk/current/bin:/usr/local/go/bin:/usr/local/go/packages/bin:/opt/kubernetes/client/bin:/usr/local/cuda/bin:/opt/android-sdk/current/cmdline-tools/tools/bin:/opt/android-sdk/current/bin:/usr/local/go/bin:/usr/local/go/packages/bin:/opt/kubernetes/client/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
++ export PATH
++ '[' -n '' ']'
++ '[' -z '' ']'
++ _OLD_VIRTUAL_PS1=
++ PS1='(venv) '
++ export PS1
++ '[' -n /bin/bash -o -n '' ']'
++ hash -r
+ python --version
Python 3.9.16
+ python3 --version
Python 3.9.16
+ cd src/github/keras
+ pip install -U pip==20.1.1 setuptools
Collecting pip==20.1.1
Downloading pip-20.1.1-py2.py3-none-any.whl (1.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 27.9 MB/s eta 0:00:00
Requirement already satisfied: setuptools in /tmpfs/venv/lib/python3.9/site-packages (58.1.0)
Collecting setuptools
Downloading setuptools-67.1.0-py3-none-any.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 88.3 MB/s eta 0:00:00
Installing collected packages: setuptools, pip
Attempting uninstall: setuptools
Found existing installation: setuptools 58.1.0
Uninstalling setuptools-58.1.0:
Successfully uninstalled setuptools-58.1.0
Attempting uninstall: pip
Found existing installation: pip 22.0.4
Uninstalling pip-22.0.4:
Successfully uninstalled pip-22.0.4
Successfully installed pip-20.1.1 setuptools-67.1.0
+ pip install -r requirements.txt
Ignoring numpy: markers 'python_version >= "3.11"' don't match your environment
Collecting pandas
Downloading pandas-1.5.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.2 MB)
Collecting pydot
Downloading pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting scipy~=1.7.2
Downloading scipy-1.7.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (39.8 MB)
Collecting protobuf==3.20.3
Downloading protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting tf-nightly
Downloading tf_nightly-2.12.0.dev20230201-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (586.5 MB)
Collecting portpicker
Downloading portpicker-1.5.2-py3-none-any.whl (14 kB)
Collecting pyyaml
Downloading PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)
Collecting Pillow
Downloading Pillow-9.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
Collecting numpy~=1.22.0
Downloading numpy-1.22.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
Collecting black==22.3.0
Downloading black-22.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
Collecting isort==5.10.1
Downloading isort-5.10.1-py3-none-any.whl (103 kB)
Collecting flake8==4.0.1
Downloading flake8-4.0.1-py2.py3-none-any.whl (64 kB)
Collecting pytz>=2020.1
Downloading pytz-2022.7.1-py2.py3-none-any.whl (499 kB)
Collecting python-dateutil>=2.8.1
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pyparsing>=2.1.4
Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting six>=1.12.0
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Requirement already satisfied: setuptools in /tmpfs/venv/lib/python3.9/site-packages (from tf-nightly->-r requirements.txt (line 12)) (67.1.0)
Collecting tensorflow-io-gcs-filesystem>=0.23.1; platform_machine != "arm64" or platform_system != "Darwin"
Downloading tensorflow_io_gcs_filesystem-0.30.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting h5py>=2.9.0
Downloading h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting flatbuffers>=2.0
Downloading flatbuffers-23.1.21-py2.py3-none-any.whl (26 kB)
Collecting keras-nightly~=2.12.0.dev
Downloading keras_nightly-2.12.0.dev2023020108-py2.py3-none-any.whl (1.7 MB)
Collecting wrapt>=1.11.0
Downloading wrapt-1.14.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting packaging
Downloading packaging-23.0-py3-none-any.whl (42 kB)
Collecting google-pasta>=0.1.1
Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting opt-einsum>=2.3.2
Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting libclang>=13.0.0
Downloading libclang-15.0.6.1-py2.py3-none-manylinux2010_x86_64.whl (21.5 MB)
Collecting tf-estimator-nightly~=2.12.0.dev
Downloading tf_estimator_nightly-2.12.0.dev2023020109-py2.py3-none-any.whl (440 kB)
Collecting typing-extensions>=3.6.6
Downloading typing_extensions-4.4.0-py3-none-any.whl (26 kB)
Collecting jax>=0.3.15
Downloading jax-0.4.2.tar.gz (1.2 MB)
Collecting grpcio<2.0,>=1.24.3
Downloading grpcio-1.51.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB)
Collecting termcolor>=1.1.0
Downloading termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting absl-py>=1.0.0
Downloading absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting astunparse>=1.6.0
Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting gast<=0.4.0,>=0.2.1
Downloading gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting tb-nightly~=2.12.0.a
Downloading tb_nightly-2.12.0a20230201-py3-none-any.whl (5.6 MB)
Collecting psutil
Downloading psutil-5.9.4-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (280 kB)
Collecting click>=8.0.0
Downloading click-8.1.3-py3-none-any.whl (96 kB)
Collecting pathspec>=0.9.0
Downloading pathspec-0.11.0-py3-none-any.whl (29 kB)
Collecting platformdirs>=2
Downloading platformdirs-2.6.2-py3-none-any.whl (14 kB)
Collecting tomli>=1.1.0; python_version < "3.11"
Downloading tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting mypy-extensions>=0.4.3
Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)
Collecting pycodestyle<2.9.0,>=2.8.0
Downloading pycodestyle-2.8.0-py2.py3-none-any.whl (42 kB)
Collecting pyflakes<2.5.0,>=2.4.0
Downloading pyflakes-2.4.0-py2.py3-none-any.whl (69 kB)
Collecting mccabe<0.7.0,>=0.6.0
Downloading mccabe-0.6.1-py2.py3-none-any.whl (8.6 kB)
Collecting wheel<1.0,>=0.23.0
Downloading wheel-0.38.4-py3-none-any.whl (36 kB)
Collecting google-auth<3,>=1.6.3
Downloading google_auth-2.16.0-py2.py3-none-any.whl (177 kB)
Collecting markdown>=2.6.8
Downloading Markdown-3.4.1-py3-none-any.whl (93 kB)
Collecting requests<3,>=2.21.0
Downloading requests-2.28.2-py3-none-any.whl (62 kB)
Collecting werkzeug>=1.0.1
Downloading Werkzeug-2.2.2-py3-none-any.whl (232 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
Downloading google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.8.0,>=0.7.0
Downloading tensorboard_data_server-0.7.0-py3-none-manylinux2014_x86_64.whl (6.6 MB)
Collecting tensorboard-plugin-wit>=1.6.0
Downloading tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting pyasn1-modules>=0.2.1
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4; python_version >= "3.6"
Downloading rsa-4.9-py3-none-any.whl (34 kB)
Collecting cachetools<6.0,>=2.0.0
Downloading cachetools-5.3.0-py3-none-any.whl (9.3 kB)
Collecting importlib-metadata>=4.4; python_version < "3.10"
Downloading importlib_metadata-6.0.0-py3-none-any.whl (21 kB)
Collecting charset-normalizer<4,>=2
Downloading charset_normalizer-3.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting idna<4,>=2.5
Downloading idna-3.4-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Downloading certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Downloading urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting MarkupSafe>=2.1.1
Downloading MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting requests-oauthlib>=0.7.0
Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting pyasn1<0.5.0,>=0.4.6
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting zipp>=0.5
Downloading zipp-3.12.0-py3-none-any.whl (6.6 kB)
Collecting oauthlib>=3.0.0
Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB)
Using legacy setup.py install for jax, since package 'wheel' is not installed.
Installing collected packages: numpy, pytz, six, python-dateutil, pandas, pyparsing, pydot, scipy, protobuf, tensorflow-io-gcs-filesystem, h5py, flatbuffers, keras-nightly, wrapt, packaging, google-pasta, opt-einsum, libclang, tf-estimator-nightly, typing-extensions, jax, grpcio, termcolor, absl-py, wheel, astunparse, gast, pyasn1, pyasn1-modules, rsa, cachetools, google-auth, zipp, importlib-metadata, markdown, charset-normalizer, idna, certifi, urllib3, requests, MarkupSafe, werkzeug, oauthlib, requests-oauthlib, google-auth-oauthlib, tensorboard-data-server, tensorboard-plugin-wit, tb-nightly, tf-nightly, psutil, portpicker, pyyaml, Pillow, click, pathspec, platformdirs, tomli, mypy-extensions, black, isort, pycodestyle, pyflakes, mccabe, flake8
Running setup.py install for jax: started
Running setup.py install for jax: finished with status 'done'
Successfully installed MarkupSafe-2.1.2 Pillow-9.4.0 absl-py-1.4.0 astunparse-1.6.3 black-22.3.0 cachetools-5.3.0 certifi-2022.12.7 charset-normalizer-3.0.1 click-8.1.3 flake8-4.0.1 flatbuffers-23.1.21 gast-0.4.0 google-auth-2.16.0 google-auth-oauthlib-0.4.6 google-pasta-0.2.0 grpcio-1.51.1 h5py-3.8.0 idna-3.4 importlib-metadata-6.0.0 isort-5.10.1 jax-0.4.2 keras-nightly-2.12.0.dev2023020108 libclang-15.0.6.1 markdown-3.4.1 mccabe-0.6.1 mypy-extensions-0.4.3 numpy-1.22.4 oauthlib-3.2.2 opt-einsum-3.3.0 packaging-23.0 pandas-1.5.3 pathspec-0.11.0 platformdirs-2.6.2 portpicker-1.5.2 protobuf-3.20.3 psutil-5.9.4 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycodestyle-2.8.0 pydot-1.4.2 pyflakes-2.4.0 pyparsing-3.0.9 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 requests-2.28.2 requests-oauthlib-1.3.1 rsa-4.9 scipy-1.7.3 six-1.16.0 tb-nightly-2.12.0a20230201 tensorboard-data-server-0.7.0 tensorboard-plugin-wit-1.8.1 tensorflow-io-gcs-filesystem-0.30.0 termcolor-2.2.0 tf-estimator-nightly-2.12.0.dev2023020109 tf-nightly-2.12.0.dev20230201 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 werkzeug-2.2.2 wheel-0.38.4 wrapt-1.14.1 zipp-3.12.0
WARNING: You are using pip version 20.1.1; however, version 23.0 is available.
You should consider upgrading via the '/tmpfs/venv/bin/python3.9 -m pip install --upgrade pip' command.
+ pip uninstall -y keras-nightly
Found existing installation: keras-nightly 2.12.0.dev2023020108
Uninstalling keras-nightly-2.12.0.dev2023020108:
Successfully uninstalled keras-nightly-2.12.0.dev2023020108
+ bazel test --test_timeout 300,450,1200,3600 --test_output=errors --keep_going --define=use_fast_cpp_protos=false --build_tests_only --build_tag_filters=-no_oss --test_tag_filters=-no_oss -- //keras/...
2023/02/01 18:26:42 Downloading https://releases.bazel.build/5.4.0/release/bazel-5.4.0-linux-x86_64...
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [v2]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'test' from /tmpfs/src/github/keras/.bazelrc:
Inherited 'build' options: --apple_platform_type=macos --define open_source_build=true --define=use_fast_cpp_protos=false --define=tensorflow_enable_mlir_generated_gpu_kernels=0 --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --config=short_logs --config=v2
INFO: Reading rc options for 'test' from /tmpfs/src/github/keras/.bazelrc:
'test' options: --define open_source_build=true --define=use_fast_cpp_protos=false --config=v2
INFO: Found applicable config definition build:short_logs in file /tmpfs/src/github/keras/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tmpfs/src/github/keras/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:v2 in file /tmpfs/src/github/keras/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 51 packages loaded
currently loading: keras/protobuf
Analyzing: 388 targets (52 packages loaded, 0 targets configured)
Analyzing: 388 targets (88 packages loaded, 135 targets configured)
Analyzing: 388 targets (99 packages loaded, 2317 targets configured)
Analyzing: 388 targets (104 packages loaded, 2374 targets configured)
Analyzing: 388 targets (104 packages loaded, 2374 targets configured)
Analyzing: 388 targets (105 packages loaded, 2658 targets configured)
INFO: Analyzed 388 targets (105 packages loaded, 2895 targets configured).
INFO: Found 388 test targets...
[0 / 255] [Prepa] Expanding template keras/benchmarks/keras_examples_benchmarks/antirectifier_benchmark_test_gpu ... (10 actions, 0 running)
[50 / 256] Compiling src/google/protobuf/compiler/cpp/padding_optimizer.cc; 1s local ... (32 actions, 31 running)
[71 / 256] Compiling src/google/protobuf/compiler/cpp/message.cc; 3s local ... (32 actions, 31 running)
[94 / 256] Compiling src/google/protobuf/compiler/cpp/message.cc; 6s local ... (32 actions, 31 running)
[128 / 256] Compiling src/google/protobuf/compiler/cpp/message.cc; 8s local ... (32 actions, 31 running)
[152 / 256] Compiling src/google/protobuf/descriptor.cc; 11s local ... (32 actions, 31 running)
[202 / 287] Compiling src/google/protobuf/descriptor.cc; 15s local ... (29 actions running)
[918 / 983] Compiling src/google/protobuf/descriptor.cc; 19s local ... (31 actions, 30 running)
[1,291 / 1,332] Testing //keras/distribute:custom_training_loop_optimizer_test; 7s local ... (32 actions running)
[1,331 / 1,365] 12 / 388 tests; Testing //keras/dtensor:optimizers_test; 12s local ... (32 actions running)
[1,355 / 1,396] 16 / 388 tests; Testing //keras/distribute:keras_metrics_test_gpu (shard 6 of 8); 11s local ... (32 actions running)
[1,368 / 1,402] 26 / 388 tests; Testing //keras/dtensor:mnist_model_test; 12s local ... (32 actions running)
[1,379 / 1,413] 34 / 388 tests; Testing //keras/dtensor:mnist_model_test; 20s local ... (32 actions running)
[1,394 / 1,428] 45 / 388 tests; Testing //keras/dtensor:mnist_model_test; 29s local ... (32 actions running)
[1,412 / 1,448] 54 / 388 tests; Testing //keras/dtensor:mnist_model_test; 40s local ... (32 actions running)
[1,424 / 1,478] 58 / 388 tests; Testing //keras/dtensor:mnist_model_test; 53s local ... (32 actions, 31 running)
[1,442 / 1,478] 64 / 388 tests; Testing //keras/integration_test:saved_model_test_gpu; 66s local ... (32 actions, 31 running)
[1,470 / 1,504] 71 / 388 tests; Testing //keras/integration_test:saved_model_test_gpu; 83s local ... (32 actions running)
[1,510 / 1,548] 101 / 388 tests; Testing //keras/integration_test:saved_model_test_gpu; 103s local ... (32 actions running)
[1,544 / 1,581] 109 / 388 tests; Testing //keras/integration_test:saving_v3_test (shard 8 of 12); 123s local ... (32 actions, 31 running)
[1,584 / 1,627] 122 / 388 tests; Testing //keras/integration_test:fit_test (shard 4 of 28); 100s local ... (32 actions, 31 running)
[1,614 / 1,649] 131 / 388 tests; Testing //keras/integration_test:fit_test (shard 4 of 28); 131s local ... (32 actions running)
[1,660 / 1,696] 141 / 388 tests; Testing //keras/integration_test:fit_test (shard 4 of 28); 167s local ... (32 actions, 31 running)
[1,719 / 1,755] 156 / 388 tests; Testing //keras/layers/rnn:base_rnn_test (shard 2 of 12); 66s local ... (32 actions running)
[1,780 / 1,827] 170 / 388 tests; Testing //keras/optimizers/legacy:optimizer_v2_test_gpu [38s (8 actions)] ... (32 actions, 31 running)
[1,838 / 1,872] 178 / 388 tests; Testing //keras/layers/locally_connected:locally_connected_test [83s (4 actions)] ... (32 actions, 31 running)
[1,910 / 1,947] 197 / 388 tests; Testing //keras/saving/legacy/saved_model:saved_model_test [98s (4 actions)] ... (32 actions running)
[1,974 / 2,021] 214 / 388 tests; Testing //keras/saving:save_test [102s (2 actions)] ... (32 actions running)
[1,992 / 2,026] 216 / 388 tests; Testing //keras/applications:applications_test [19s (27 actions)] ... (32 actions running)
FAIL: //keras/layers/preprocessing:normalization_test (shard 1 of 4) (see /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_1_of_4/test.log)
INFO: From Testing //keras/layers/preprocessing:normalization_test (shard 1 of 4):
==================== Test output for //keras/layers/preprocessing:normalization_test (shard 1 of 4):
2023-02-01 18:37:41.173551: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay
2023-02-01 18:37:41.200010: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-02-01 18:37:47.016599: E tensorflow/compiler/xla/stream_executor/cuda/cuda_driver.cc:266] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
Running tests under Python 3.9.16: /tmpfs/venv/bin/python3
[ RUN ] NormalizationAdaptTest.test_0d_unbatched_adapt_v2_eager
2023-02-01 18:37:47.140808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [4]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:47.693431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [4]
[[{{node Placeholder/_0}}]]
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_0d_unbatched_adapt_v2_eager): 0.7s
I0201 18:37:47.722183 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_0d_unbatched_adapt_v2_eager): 0.7s
[ OK ] NormalizationAdaptTest.test_0d_unbatched_adapt_v2_eager
[ RUN ] NormalizationAdaptTest.test_axis_permutations0_v2_eager (axis=(1, 2))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations0_v2_eager (axis=(1, 2))): 0.45s
I0201 18:37:48.168872 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations0_v2_eager (axis=(1, 2))): 0.45s
[ OK ] NormalizationAdaptTest.test_axis_permutations0_v2_eager (axis=(1, 2))
[ RUN ] NormalizationAdaptTest.test_axis_permutations2_v2_eager (axis=(1, -1))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations2_v2_eager (axis=(1, -1))): 0.45s
I0201 18:37:48.621979 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations2_v2_eager (axis=(1, -1))): 0.45s
[ OK ] NormalizationAdaptTest.test_axis_permutations2_v2_eager (axis=(1, -1))
[ RUN ] NormalizationAdaptTest.test_layer_api_compatibility_v2_eager
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 122ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 73ms/step
WARNING:tensorflow:5 out of the last 8 calls to .adapt_step at 0x7fc76cf67820> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:49.975098 140502750168896 polymorphic_function.py:156] 5 out of the last 8 calls to .adapt_step at 0x7fc76cf67820> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 71ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 69ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_api_compatibility_v2_eager): 1.79s
I0201 18:37:50.410870 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_api_compatibility_v2_eager): 1.79s
[ OK ] NormalizationAdaptTest.test_layer_api_compatibility_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_eager
2023-02-01 18:37:50.445152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype int32 and shape [5,1]
[[{{node Placeholder/_0}}]]
WARNING:tensorflow:6 out of the last 9 calls to .adapt_step at 0x7fc76f712940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:51.073646 140502750168896 polymorphic_function.py:156] 6 out of the last 9 calls to .adapt_step at 0x7fc76f712940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
2023-02-01 18:37:51.163887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype int32 and shape [3,1]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 3ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_eager): 0.83s
I0201 18:37:51.243744 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_eager): 0.83s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_eager
2023-02-01 18:37:51.276083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [1,5]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:51.684880: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [3,1]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 3ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_eager): 0.53s
I0201 18:37:51.771358 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_eager): 0.53s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_eager
2023-02-01 18:37:51.800499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [5,1]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:52.156560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [3,1]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 3ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_eager): 0.51s
I0201 18:37:52.281864 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_eager): 0.51s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_eager
2023-02-01 18:37:52.328863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [5,1]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:52.767972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [3,1]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 3ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_eager): 0.58s
I0201 18:37:52.868244 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_eager): 0.58s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_eager
2023-02-01 18:37:52.927912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:53.449524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
1/2 [==============>...............] - ETA: 0s2/2 [==============================] - 0s 4ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_eager): 0.65s
I0201 18:37:53.519452 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_eager): 0.65s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_eager
2023-02-01 18:37:53.553543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:53.946256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
1/2 [==============>...............] - ETA: 0s2/2 [==============================] - 0s 3ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_eager): 0.5s
I0201 18:37:54.018778 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_eager): 0.5s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_eager
2023-02-01 18:37:54.046784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype double and shape [3,4]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:54.398366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype double and shape [3,4]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 3ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_eager): 0.48s
I0201 18:37:54.504151 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_eager): 0.48s
[ OK ] NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_eager
[ RUN ] NormalizationAdaptTest.test_multiple_adapts_v2_eager
WARNING:tensorflow:5 out of the last 5 calls to .predict_function at 0x7fc864390e50> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:55.174038 140502750168896 polymorphic_function.py:156] 5 out of the last 5 calls to .predict_function at 0x7fc864390e50> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 109ms/step
WARNING:tensorflow:6 out of the last 6 calls to .predict_function at 0x7fc8644ac940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:55.525875 140502750168896 polymorphic_function.py:156] 6 out of the last 6 calls to .predict_function at 0x7fc8644ac940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 122ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_multiple_adapts_v2_eager): 1.03s
I0201 18:37:55.537660 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_multiple_adapts_v2_eager): 1.03s
[ OK ] NormalizationAdaptTest.test_multiple_adapts_v2_eager
[ RUN ] NormalizationAdaptTest.test_saved_model_keras1_v2_eager (save_format='tf', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 119ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:55.815807 140502750168896 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/9b7333aab629274d10159357f4b1bf9cbwowm3jc/tmp4uiszcaj/tf_keras_saved_model/assets
I0201 18:37:56.618522 140502750168896 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/9b7333aab629274d10159357f4b1bf9cbwowm3jc/tmp4uiszcaj/tf_keras_saved_model/assets
WARNING:tensorflow:No training configuration found in save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:57.479836 140502750168896 load.py:177] No training configuration found in save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 137ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras1_v2_eager (save_format='tf', adapt=False)): 2.17s
I0201 18:37:57.706120 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras1_v2_eager (save_format='tf', adapt=False)): 2.17s
[ OK ] NormalizationAdaptTest.test_saved_model_keras1_v2_eager (save_format='tf', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras3_v2_eager (save_format='h5', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 192ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:58.030538 140502750168896 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
WARNING:tensorflow:No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:58.062658 140502750168896 hdf5_format.py:205] No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 119ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras3_v2_eager (save_format='h5', adapt=False)): 0.56s
I0201 18:37:58.266387 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras3_v2_eager (save_format='h5', adapt=False)): 0.56s
[ OK ] NormalizationAdaptTest.test_saved_model_keras3_v2_eager (save_format='h5', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert1_v2_eager (save_format='tf', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 142ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert1_v2_eager (save_format='tf', adapt=False)): 0.28s
I0201 18:37:58.546761 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert1_v2_eager (save_format='tf', adapt=False)): 0.28s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert1_v2_eager (save_format='tf', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert3_v2_eager (save_format='h5', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 116ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert3_v2_eager (save_format='h5', adapt=False)): 0.26s
I0201 18:37:58.807450 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert3_v2_eager (save_format='h5', adapt=False)): 0.26s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert3_v2_eager (save_format='h5', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_tf1_v2_eager (adapted=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 135ms/step
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/9b7333aab629274d10159357f4b1bf9cbwowm3jc/tmpf_z77s6v/tf_saved_model/assets
I0201 18:37:59.674606 140502750168896 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/9b7333aab629274d10159357f4b1bf9cbwowm3jc/tmpf_z77s6v/tf_saved_model/assets
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_tf1_v2_eager (adapted=False)): 1.34s
I0201 18:38:00.152398 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_tf1_v2_eager (adapted=False)): 1.34s
[ OK ] NormalizationAdaptTest.test_saved_model_tf1_v2_eager (adapted=False)
[ RUN ] NormalizationAdaptTest.test_saved_weights_keras1_v2_eager (adapted=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 104ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 121ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_weights_keras1_v2_eager (adapted=False)): 0.5s
I0201 18:38:00.650446 140502750168896 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_weights_keras1_v2_eager (adapted=False)): 0.5s
[ OK ] NormalizationAdaptTest.test_saved_weights_keras1_v2_eager (adapted=False)
[ RUN ] NormalizationTest.test_0d_data_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_0d_data_v2_function): 0.02s
I0201 18:38:00.674762 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_0d_data_v2_function): 0.02s
[ OK ] NormalizationTest.test_0d_data_v2_function
[ RUN ] NormalizationTest.test_bad_axis_fail_build0_v2_function (axis=3)
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build0_v2_function (axis=3)): 0.0s
I0201 18:38:00.680441 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build0_v2_function (axis=3)): 0.0s
[ OK ] NormalizationTest.test_bad_axis_fail_build0_v2_function (axis=3)
[ RUN ] NormalizationTest.test_bad_axis_fail_build2_v2_function (axis=(1, 3))
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build2_v2_function (axis=(1, 3))): 0.0s
I0201 18:38:00.685287 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build2_v2_function (axis=(1, 3))): 0.0s
[ OK ] NormalizationTest.test_bad_axis_fail_build2_v2_function (axis=(1, 3))
[ RUN ] NormalizationTest.test_broadcasting_during_direct_setting_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_v2_function): 0.02s
I0201 18:38:00.706050 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_v2_function): 0.02s
[ OK ] NormalizationTest.test_broadcasting_during_direct_setting_v2_function
[ RUN ] NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_function): 0.01s
I0201 18:38:00.718417 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_function): 0.01s
[ OK ] NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_function
[ RUN ] NormalizationTest.test_invert_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_invert_v2_function): 0.03s
I0201 18:38:00.746223 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_invert_v2_function): 0.03s
[ OK ] NormalizationTest.test_invert_v2_function
[ RUN ] NormalizationTest.test_list_input_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_list_input_v2_function): 0.01s
I0201 18:38:00.753892 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_list_input_v2_function): 0.01s
[ OK ] NormalizationTest.test_list_input_v2_function
[ RUN ] NormalizationTest.test_scalar_input_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_scalar_input_v2_function): 0.01s
I0201 18:38:00.765118 140502750168896 test_util.py:2467] time(__main__.NormalizationTest.test_scalar_input_v2_function): 0.01s
[ OK ] NormalizationTest.test_scalar_input_v2_function
======================================================================
FAIL: test_saved_model_keras_invert1_v2_eager (save_format='tf', adapt=False) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert1_v2_eager (save_format='tf', adapt=False)
test_saved_model_keras_invert1_v2_eager('v2_eager')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 412, in decorated
_v2_eager_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 433, in _v2_eager_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

======================================================================
FAIL: test_saved_model_keras_invert3_v2_eager (save_format='h5', adapt=False) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert3_v2_eager (save_format='h5', adapt=False)
test_saved_model_keras_invert3_v2_eager('v2_eager')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 412, in decorated
_v2_eager_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 433, in _v2_eager_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

----------------------------------------------------------------------
Ran 26 tests in 13.741s

FAILED (failures=2)
================================================================================
FAIL: //keras/layers/preprocessing:normalization_test (shard 2 of 4) (see /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_2_of_4/test.log)
INFO: From Testing //keras/layers/preprocessing:normalization_test (shard 2 of 4):
==================== Test output for //keras/layers/preprocessing:normalization_test (shard 2 of 4):
2023-02-01 18:37:43.003370: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay
2023-02-01 18:37:43.070981: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-02-01 18:37:48.038234: E tensorflow/compiler/xla/stream_executor/cuda/cuda_driver.cc:266] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
Running tests under Python 3.9.16: /tmpfs/venv/bin/python3
[ RUN ] NormalizationAdaptTest.test_0d_unbatched_adapt_v2_function
2023-02-01 18:37:48.142563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [4]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:48.583072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [4]
[[{{node Placeholder/_0}}]]
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_0d_unbatched_adapt_v2_function): 0.58s
I0201 18:37:48.632119 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_0d_unbatched_adapt_v2_function): 0.58s
[ OK ] NormalizationAdaptTest.test_0d_unbatched_adapt_v2_function
[ RUN ] NormalizationAdaptTest.test_axis_permutations0_v2_function (axis=(1, 2))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations0_v2_function (axis=(1, 2))): 0.5s
I0201 18:37:49.131847 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations0_v2_function (axis=(1, 2))): 0.5s
[ OK ] NormalizationAdaptTest.test_axis_permutations0_v2_function (axis=(1, 2))
[ RUN ] NormalizationAdaptTest.test_axis_permutations2_v2_function (axis=(1, -1))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations2_v2_function (axis=(1, -1))): 0.48s
I0201 18:37:49.613679 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations2_v2_function (axis=(1, -1))): 0.48s
[ OK ] NormalizationAdaptTest.test_axis_permutations2_v2_function (axis=(1, -1))
[ RUN ] NormalizationAdaptTest.test_layer_api_compatibility_v2_function
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 146ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 95ms/step
WARNING:tensorflow:5 out of the last 8 calls to .adapt_step at 0x7f692f6a2ca0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:51.039979 140090020382528 polymorphic_function.py:156] 5 out of the last 8 calls to .adapt_step at 0x7f692f6a2ca0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 72ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 78ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_api_compatibility_v2_function): 1.79s
I0201 18:37:51.406469 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_api_compatibility_v2_function): 1.79s
[ OK ] NormalizationAdaptTest.test_layer_api_compatibility_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_function
2023-02-01 18:37:51.438112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype int32 and shape [5,1]
[[{{node Placeholder/_0}}]]
WARNING:tensorflow:6 out of the last 9 calls to .adapt_step at 0x7f692f8b80d0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:52.174430 140090020382528 polymorphic_function.py:156] 6 out of the last 9 calls to .adapt_step at 0x7f692f8b80d0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
2023-02-01 18:37:52.288962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype int32 and shape [3,1]
[[{{node Placeholder/_0}}]]
WARNING:tensorflow:5 out of the last 5 calls to .predict_function at 0x7f68afb88310> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:52.390268 140090020382528 polymorphic_function.py:156] 5 out of the last 5 calls to .predict_function at 0x7f68afb88310> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 2ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_function): 1.01s
I0201 18:37:52.421077 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_function): 1.01s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_int_data_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_function
2023-02-01 18:37:52.450089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [1,5]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:52.941231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [3,1]
[[{{node Placeholder/_0}}]]
WARNING:tensorflow:6 out of the last 8 calls to .predict_function at 0x7f68afb304c0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:53.018371 140090020382528 polymorphic_function.py:156] 6 out of the last 8 calls to .predict_function at 0x7f68afb304c0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 2ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_function): 0.62s
I0201 18:37:53.045240 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_function): 0.62s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_function
2023-02-01 18:37:53.073881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [5,1]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:53.533403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [3,1]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 2ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_function): 0.57s
I0201 18:37:53.618008 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_function): 0.57s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_function
2023-02-01 18:37:53.650295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [5,1]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:54.008361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [3,1]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 7ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_function): 0.49s
I0201 18:37:54.110684 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_function): 0.49s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_function
2023-02-01 18:37:54.137103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:54.502242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
1/2 [==============>...............] - ETA: 0s2/2 [==============================] - 0s 2ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_function): 0.54s
I0201 18:37:54.655346 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_function): 0.54s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_function
2023-02-01 18:37:54.682864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:55.052158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,2,3]
[[{{node Placeholder/_0}}]]
1/2 [==============>...............] - ETA: 0s2/2 [==============================] - 0s 2ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_function): 0.49s
I0201 18:37:55.142119 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_function): 0.49s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_function
2023-02-01 18:37:55.169297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype double and shape [3,4]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:55.524136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype double and shape [3,4]
[[{{node Placeholder/_0}}]]
1/3 [=========>....................] - ETA: 0s3/3 [==============================] - 0s 2ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_function): 0.49s
I0201 18:37:55.632208 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_function): 0.49s
[ OK ] NormalizationAdaptTest.test_layer_computation_zero_variance_with_dataset_v2_function
[ RUN ] NormalizationAdaptTest.test_multiple_adapts_v2_function
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 127ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 94ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_multiple_adapts_v2_function): 1.16s
I0201 18:37:56.792581 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_multiple_adapts_v2_function): 1.16s
[ OK ] NormalizationAdaptTest.test_multiple_adapts_v2_function
[ RUN ] NormalizationAdaptTest.test_saved_model_keras1_v2_function (save_format='tf', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 134ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:57.083120 140090020382528 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/5cab3a47ab3e36c0a75b2a4fcd51a245vddn3hy_/tmpm0ix29fp/tf_keras_saved_model/assets
I0201 18:37:57.799928 140090020382528 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/5cab3a47ab3e36c0a75b2a4fcd51a245vddn3hy_/tmpm0ix29fp/tf_keras_saved_model/assets
WARNING:tensorflow:No training configuration found in save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:58.694908 140090020382528 load.py:177] No training configuration found in save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 107ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras1_v2_function (save_format='tf', adapt=False)): 2.09s
I0201 18:37:58.885472 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras1_v2_function (save_format='tf', adapt=False)): 2.09s
[ OK ] NormalizationAdaptTest.test_saved_model_keras1_v2_function (save_format='tf', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras3_v2_function (save_format='h5', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 119ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:59.146540 140090020382528 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
WARNING:tensorflow:No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:59.181800 140090020382528 hdf5_format.py:205] No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 119ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras3_v2_function (save_format='h5', adapt=False)): 0.51s
I0201 18:37:59.392150 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras3_v2_function (save_format='h5', adapt=False)): 0.51s
[ OK ] NormalizationAdaptTest.test_saved_model_keras3_v2_function (save_format='h5', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert1_v2_function (save_format='tf', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 152ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert1_v2_function (save_format='tf', adapt=False)): 0.3s
I0201 18:37:59.690373 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert1_v2_function (save_format='tf', adapt=False)): 0.3s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert1_v2_function (save_format='tf', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert3_v2_function (save_format='h5', adapt=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 182ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert3_v2_function (save_format='h5', adapt=False)): 0.33s
I0201 18:38:00.025094 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert3_v2_function (save_format='h5', adapt=False)): 0.33s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert3_v2_function (save_format='h5', adapt=False)
[ RUN ] NormalizationAdaptTest.test_saved_model_tf1_v2_function (adapted=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 118ms/step
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/5cab3a47ab3e36c0a75b2a4fcd51a245vddn3hy_/tmp2baa_l10/tf_saved_model/assets
I0201 18:38:00.896532 140090020382528 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/5cab3a47ab3e36c0a75b2a4fcd51a245vddn3hy_/tmp2baa_l10/tf_saved_model/assets
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_tf1_v2_function (adapted=False)): 1.36s
I0201 18:38:01.386953 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_tf1_v2_function (adapted=False)): 1.36s
[ OK ] NormalizationAdaptTest.test_saved_model_tf1_v2_function (adapted=False)
[ RUN ] NormalizationAdaptTest.test_saved_weights_keras1_v2_function (adapted=False)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 113ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 113ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_weights_keras1_v2_function (adapted=False)): 0.51s
I0201 18:38:01.900119 140090020382528 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_weights_keras1_v2_function (adapted=False)): 0.51s
[ OK ] NormalizationAdaptTest.test_saved_weights_keras1_v2_function (adapted=False)
[ RUN ] NormalizationTest.test_1d_data_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_1d_data_v2_eager): 0.02s
I0201 18:38:01.922663 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_1d_data_v2_eager): 0.02s
[ OK ] NormalizationTest.test_1d_data_v2_eager
[ RUN ] NormalizationTest.test_bad_axis_fail_build1_v2_eager (axis=-4)
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build1_v2_eager (axis=-4)): 0.0s
I0201 18:38:01.927805 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build1_v2_eager (axis=-4)): 0.0s
[ OK ] NormalizationTest.test_bad_axis_fail_build1_v2_eager (axis=-4)
[ RUN ] NormalizationTest.test_bad_axis_fail_build3_v2_eager (axis=(1, -4))
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build3_v2_eager (axis=(1, -4))): 0.0s
I0201 18:38:01.933159 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build3_v2_eager (axis=(1, -4))): 0.0s
[ OK ] NormalizationTest.test_bad_axis_fail_build3_v2_eager (axis=(1, -4))
[ RUN ] NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_eager): 0.02s
I0201 18:38:01.958756 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_eager): 0.02s
[ OK ] NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_eager
[ RUN ] NormalizationTest.test_invert_adapt_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_invert_adapt_v2_eager): 1.45s
I0201 18:38:03.404979 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_invert_adapt_v2_eager): 1.45s
[ OK ] NormalizationTest.test_invert_adapt_v2_eager
[ RUN ] NormalizationTest.test_keeping_an_unknown_axis_fails_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_keeping_an_unknown_axis_fails_v2_eager): 0.01s
I0201 18:38:03.411914 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_keeping_an_unknown_axis_fails_v2_eager): 0.01s
[ OK ] NormalizationTest.test_keeping_an_unknown_axis_fails_v2_eager
[ RUN ] NormalizationTest.test_output_dtype_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_output_dtype_v2_eager): 0.04s
I0201 18:38:03.454775 140090020382528 test_util.py:2467] time(__main__.NormalizationTest.test_output_dtype_v2_eager): 0.04s
[ OK ] NormalizationTest.test_output_dtype_v2_eager
[ RUN ] NormalizationTest.test_session
[ SKIPPED ] NormalizationTest.test_session
======================================================================
FAIL: test_saved_model_keras_invert1_v2_function (save_format='tf', adapt=False) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert1_v2_function (save_format='tf', adapt=False)
test_saved_model_keras_invert1_v2_function('v2_function')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 414, in decorated
_v2_function_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 439, in _v2_function_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

======================================================================
FAIL: test_saved_model_keras_invert3_v2_function (save_format='h5', adapt=False) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert3_v2_function (save_format='h5', adapt=False)
test_saved_model_keras_invert3_v2_function('v2_function')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 414, in decorated
_v2_function_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 439, in _v2_function_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

----------------------------------------------------------------------
Ran 26 tests in 15.402s

FAILED (failures=2, skipped=1)
================================================================================
FAIL: //keras/layers/preprocessing:normalization_test (shard 4 of 4) (see /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_4_of_4/test.log)
INFO: From Testing //keras/layers/preprocessing:normalization_test (shard 4 of 4):
==================== Test output for //keras/layers/preprocessing:normalization_test (shard 4 of 4):
2023-02-01 18:37:44.243534: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay
2023-02-01 18:37:44.269594: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-02-01 18:37:48.996160: E tensorflow/compiler/xla/stream_executor/cuda/cuda_driver.cc:266] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
Running tests under Python 3.9.16: /tmpfs/venv/bin/python3
[ RUN ] NormalizationAdaptTest.test_1d_unbatched_adapt_v2_function
2023-02-01 18:37:49.087416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,4]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:49.493805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,4]
[[{{node Placeholder/_0}}]]
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_1d_unbatched_adapt_v2_function): 0.52s
I0201 18:37:49.521125 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_1d_unbatched_adapt_v2_function): 0.52s
[ OK ] NormalizationAdaptTest.test_1d_unbatched_adapt_v2_function
[ RUN ] NormalizationAdaptTest.test_axis_permutations1_v2_function (axis=(2, 1))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations1_v2_function (axis=(2, 1))): 0.57s
I0201 18:37:50.089431 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations1_v2_function (axis=(2, 1))): 0.57s
[ OK ] NormalizationAdaptTest.test_axis_permutations1_v2_function (axis=(2, 1))
[ RUN ] NormalizationAdaptTest.test_axis_permutations3_v2_function (axis=(-1, 1))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations3_v2_function (axis=(-1, 1))): 0.48s
I0201 18:37:50.569942 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations3_v2_function (axis=(-1, 1))): 0.48s
[ OK ] NormalizationAdaptTest.test_axis_permutations3_v2_function (axis=(-1, 1))
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_function
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 118ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_function): 0.66s
I0201 18:37:51.235055 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_function): 0.66s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_function
WARNING:tensorflow:5 out of the last 6 calls to .adapt_step at 0x7efbf76d1700> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:51.682911 139620928960320 polymorphic_function.py:156] 5 out of the last 6 calls to .adapt_step at 0x7efbf76d1700> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 86ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_function): 0.67s
I0201 18:37:51.907770 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_function): 0.67s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_function
WARNING:tensorflow:6 out of the last 7 calls to .adapt_step at 0x7efbf76d1940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:52.487845 139620928960320 polymorphic_function.py:156] 6 out of the last 7 calls to .adapt_step at 0x7efbf76d1940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 90ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_function): 0.89s
I0201 18:37:52.799392 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_function): 0.89s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_function
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 78ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_function): 1.09s
I0201 18:37:53.894802 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_function): 1.09s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_function
WARNING:tensorflow:5 out of the last 5 calls to .predict_function at 0x7efbf759e940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:54.587885 139620928960320 polymorphic_function.py:156] 5 out of the last 5 calls to .predict_function at 0x7efbf759e940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 90ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_function): 0.7s
I0201 18:37:54.597439 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_function): 0.7s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_function
WARNING:tensorflow:6 out of the last 6 calls to .predict_function at 0x7efbf76d1c10> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:55.235075 139620928960320 polymorphic_function.py:156] 6 out of the last 6 calls to .predict_function at 0x7efbf76d1c10> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 71ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_function): 0.64s
I0201 18:37:55.244045 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_function): 0.64s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_function
[ RUN ] NormalizationAdaptTest.test_layer_computation_zero_variance_v2_function
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 74ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_v2_function): 0.6s
I0201 18:37:55.844446 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_v2_function): 0.6s
[ OK ] NormalizationAdaptTest.test_layer_computation_zero_variance_v2_function
[ RUN ] NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_function
Model: "sequential"
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
normalization (Normalizatio (None, None, 3) 7
n)

dense (Dense) (None, None, 64) 256

dense_1 (Dense) (None, None, 1) 65

=================================================================
Total params: 328
Trainable params: 321
Non-trainable params: 7
_________________________________________________________________
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_function): 0.71s
I0201 18:37:56.555040 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_function): 0.71s
[ OK ] NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_function
[ RUN ] NormalizationAdaptTest.test_saved_model_keras0_v2_function (save_format='tf', adapt=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 115ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:57.306776 139620928960320 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/52f73188acf349ce7c76b2cc63745919ahg60uvm/tmptxxubm3y/tf_keras_saved_model/assets
I0201 18:37:58.363540 139620928960320 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/52f73188acf349ce7c76b2cc63745919ahg60uvm/tmptxxubm3y/tf_keras_saved_model/assets
WARNING:tensorflow:No training configuration found in save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:59.425254 139620928960320 load.py:177] No training configuration found in save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 143ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras0_v2_function (save_format='tf', adapt=True)): 3.1s
I0201 18:37:59.659443 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras0_v2_function (save_format='tf', adapt=True)): 3.1s
[ OK ] NormalizationAdaptTest.test_saved_model_keras0_v2_function (save_format='tf', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras2_v2_function (save_format='h5', adapt=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 100ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:38:00.358775 139620928960320 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
WARNING:tensorflow:No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
W0201 18:38:00.416470 139620928960320 hdf5_format.py:205] No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 133ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras2_v2_function (save_format='h5', adapt=True)): 0.98s
I0201 18:38:00.636296 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras2_v2_function (save_format='h5', adapt=True)): 0.98s
[ OK ] NormalizationAdaptTest.test_saved_model_keras2_v2_function (save_format='h5', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert0_v2_function (save_format='tf', adapt=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 100ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert0_v2_function (save_format='tf', adapt=True)): 0.92s
I0201 18:38:01.561480 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert0_v2_function (save_format='tf', adapt=True)): 0.92s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert0_v2_function (save_format='tf', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert2_v2_function (save_format='h5', adapt=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 118ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert2_v2_function (save_format='h5', adapt=True)): 0.75s
I0201 18:38:02.317826 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert2_v2_function (save_format='h5', adapt=True)): 0.75s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert2_v2_function (save_format='h5', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_tf0_v2_function (adapted=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 109ms/step
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/52f73188acf349ce7c76b2cc63745919ahg60uvm/tmpk2tr7pui/tf_saved_model/assets
I0201 18:38:04.273183 139620928960320 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/52f73188acf349ce7c76b2cc63745919ahg60uvm/tmpk2tr7pui/tf_saved_model/assets
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_tf0_v2_function (adapted=True)): 2.63s
I0201 18:38:04.954867 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_tf0_v2_function (adapted=True)): 2.63s
[ OK ] NormalizationAdaptTest.test_saved_model_tf0_v2_function (adapted=True)
[ RUN ] NormalizationAdaptTest.test_saved_weights_keras0_v2_function (adapted=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 127ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 139ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_weights_keras0_v2_function (adapted=True)): 1.1s
I0201 18:38:06.052784 139620928960320 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_weights_keras0_v2_function (adapted=True)): 1.1s
[ OK ] NormalizationAdaptTest.test_saved_weights_keras0_v2_function (adapted=True)
[ RUN ] NormalizationTest.test_0d_data_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_0d_data_v2_eager): 0.02s
I0201 18:38:06.078937 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_0d_data_v2_eager): 0.02s
[ OK ] NormalizationTest.test_0d_data_v2_eager
[ RUN ] NormalizationTest.test_bad_axis_fail_build0_v2_eager (axis=3)
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build0_v2_eager (axis=3)): 0.01s
I0201 18:38:06.084890 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build0_v2_eager (axis=3)): 0.01s
[ OK ] NormalizationTest.test_bad_axis_fail_build0_v2_eager (axis=3)
[ RUN ] NormalizationTest.test_bad_axis_fail_build2_v2_eager (axis=(1, 3))
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build2_v2_eager (axis=(1, 3))): 0.0s
I0201 18:38:06.089844 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build2_v2_eager (axis=(1, 3))): 0.0s
[ OK ] NormalizationTest.test_bad_axis_fail_build2_v2_eager (axis=(1, 3))
[ RUN ] NormalizationTest.test_broadcasting_during_direct_setting_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_v2_eager): 0.02s
I0201 18:38:06.113623 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_v2_eager): 0.02s
[ OK ] NormalizationTest.test_broadcasting_during_direct_setting_v2_eager
[ RUN ] NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_eager): 0.01s
I0201 18:38:06.125617 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_eager): 0.01s
[ OK ] NormalizationTest.test_broadcasting_during_direct_setting_with_variables_fails_v2_eager
[ RUN ] NormalizationTest.test_invert_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_invert_v2_eager): 0.03s
I0201 18:38:06.156038 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_invert_v2_eager): 0.03s
[ OK ] NormalizationTest.test_invert_v2_eager
[ RUN ] NormalizationTest.test_list_input_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_list_input_v2_eager): 0.01s
I0201 18:38:06.164590 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_list_input_v2_eager): 0.01s
[ OK ] NormalizationTest.test_list_input_v2_eager
[ RUN ] NormalizationTest.test_scalar_input_v2_eager
INFO:tensorflow:time(__main__.NormalizationTest.test_scalar_input_v2_eager): 0.01s
I0201 18:38:06.171186 139620928960320 test_util.py:2467] time(__main__.NormalizationTest.test_scalar_input_v2_eager): 0.01s
[ OK ] NormalizationTest.test_scalar_input_v2_eager
======================================================================
FAIL: test_saved_model_keras_invert0_v2_function (save_format='tf', adapt=True) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert0_v2_function (save_format='tf', adapt=True)
test_saved_model_keras_invert0_v2_function('v2_function')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 414, in decorated
_v2_function_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 439, in _v2_function_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

======================================================================
FAIL: test_saved_model_keras_invert2_v2_function (save_format='h5', adapt=True) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert2_v2_function (save_format='h5', adapt=True)
test_saved_model_keras_invert2_v2_function('v2_function')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 414, in decorated
_v2_function_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 439, in _v2_function_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

----------------------------------------------------------------------
Ran 25 tests in 17.167s

FAILED (failures=2)
================================================================================
FAIL: //keras/layers/preprocessing:normalization_test (shard 3 of 4) (see /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_3_of_4/test.log)

FAILED: //keras/layers/preprocessing:normalization_test (Summary)
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_1_of_4/test.log
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_2_of_4/test.log
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_4_of_4/test.log
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_3_of_4/test.log
INFO: From Testing //keras/layers/preprocessing:normalization_test (shard 3 of 4):
==================== Test output for //keras/layers/preprocessing:normalization_test (shard 3 of 4):
2023-02-01 18:37:43.894779: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay
2023-02-01 18:37:43.921123: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-02-01 18:37:48.623128: E tensorflow/compiler/xla/stream_executor/cuda/cuda_driver.cc:266] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
Running tests under Python 3.9.16: /tmpfs/venv/bin/python3
[ RUN ] NormalizationAdaptTest.test_1d_unbatched_adapt_v2_eager
2023-02-01 18:37:48.713659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,4]
[[{{node Placeholder/_0}}]]
2023-02-01 18:37:49.137486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder/_0' with dtype float and shape [2,4]
[[{{node Placeholder/_0}}]]
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_1d_unbatched_adapt_v2_eager): 0.57s
I0201 18:37:49.198191 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_1d_unbatched_adapt_v2_eager): 0.57s
[ OK ] NormalizationAdaptTest.test_1d_unbatched_adapt_v2_eager
[ RUN ] NormalizationAdaptTest.test_axis_permutations1_v2_eager (axis=(2, 1))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations1_v2_eager (axis=(2, 1))): 0.47s
I0201 18:37:49.672846 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations1_v2_eager (axis=(2, 1))): 0.47s
[ OK ] NormalizationAdaptTest.test_axis_permutations1_v2_eager (axis=(2, 1))
[ RUN ] NormalizationAdaptTest.test_axis_permutations3_v2_eager (axis=(-1, 1))
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_axis_permutations3_v2_eager (axis=(-1, 1))): 0.58s
I0201 18:37:50.249384 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_axis_permutations3_v2_eager (axis=(-1, 1))): 0.58s
[ OK ] NormalizationAdaptTest.test_axis_permutations3_v2_eager (axis=(-1, 1))
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_eager
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 41ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_eager): 0.66s
I0201 18:37:50.911092 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_eager): 0.66s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_int_data_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_eager
WARNING:tensorflow:5 out of the last 6 calls to .adapt_step at 0x7f6e0f4a0940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:51.343513 140110912087872 polymorphic_function.py:156] 5 out of the last 6 calls to .adapt_step at 0x7f6e0f4a0940> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 52ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_eager): 0.64s
I0201 18:37:51.552093 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_eager): 0.64s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_flat_data_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_eager
WARNING:tensorflow:6 out of the last 7 calls to .adapt_step at 0x7f6e0f303700> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:37:52.026775 140110912087872 polymorphic_function.py:156] 6 out of the last 7 calls to .adapt_step at 0x7f6e0f303700> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 80ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_eager): 0.71s
I0201 18:37:52.266054 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_eager): 0.71s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_none_axis_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_eager
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 48ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_eager): 0.69s
I0201 18:37:52.962298 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_eager): 0.69s
[ OK ] NormalizationAdaptTest.test_layer_computation_2d_single_element_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_eager
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 44ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_eager): 1.06s
I0201 18:37:54.026031 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_eager): 1.06s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_internal_axis_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_eager
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 42ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_eager): 0.63s
I0201 18:37:54.655737 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_eager): 0.63s
[ OK ] NormalizationAdaptTest.test_layer_computation_3d_multiple_axis_v2_eager
[ RUN ] NormalizationAdaptTest.test_layer_computation_zero_variance_v2_eager
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 44ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_v2_eager): 0.58s
I0201 18:37:55.239231 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_layer_computation_zero_variance_v2_eager): 0.58s
[ OK ] NormalizationAdaptTest.test_layer_computation_zero_variance_v2_eager
[ RUN ] NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_eager
Model: "sequential"
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
normalization (Normalizatio (None, None, 3) 7
n)

dense (Dense) (None, None, 64) 256

dense_1 (Dense) (None, None, 1) 65

=================================================================
Total params: 328
Trainable params: 321
Non-trainable params: 7
_________________________________________________________________
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_eager): 0.64s
I0201 18:37:55.879570 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_eager): 0.64s
[ OK ] NormalizationAdaptTest.test_model_summary_after_layer_adapt_v2_eager
[ RUN ] NormalizationAdaptTest.test_saved_model_keras0_v2_eager (save_format='tf', adapt=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 169ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:56.661712 140110912087872 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/579882ef1b1a68bb58cda63178968a6e4qt1vyie/tmpj2o348pv/tf_keras_saved_model/assets
I0201 18:37:57.610558 140110912087872 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/579882ef1b1a68bb58cda63178968a6e4qt1vyie/tmpj2o348pv/tf_keras_saved_model/assets
WARNING:tensorflow:No training configuration found in save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:58.811010 140110912087872 load.py:177] No training configuration found in save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 154ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras0_v2_eager (save_format='tf', adapt=True)): 3.18s
I0201 18:37:59.063283 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras0_v2_eager (save_format='tf', adapt=True)): 3.18s
[ OK ] NormalizationAdaptTest.test_saved_model_keras0_v2_eager (save_format='tf', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras2_v2_eager (save_format='h5', adapt=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 129ms/step
WARNING:tensorflow:Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
W0201 18:37:59.847496 140110912087872 saving_utils.py:359] Compiled the loaded model, but the compiled metrics have yet to be built. `model.compile_metrics` will be empty until you train or evaluate the model.
WARNING:tensorflow:No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
W0201 18:37:59.919553 140110912087872 hdf5_format.py:205] No training configuration found in the save file, so the model was *not* compiled. Compile it manually.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 114ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras2_v2_eager (save_format='h5', adapt=True)): 1.11s
I0201 18:38:00.173465 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras2_v2_eager (save_format='h5', adapt=True)): 1.11s
[ OK ] NormalizationAdaptTest.test_saved_model_keras2_v2_eager (save_format='h5', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert0_v2_eager (save_format='tf', adapt=True)
WARNING:tensorflow:5 out of the last 5 calls to .predict_function at 0x7f6e0f4c6790> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:38:00.954858 140110912087872 polymorphic_function.py:156] 5 out of the last 5 calls to .predict_function at 0x7f6e0f4c6790> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 208ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert0_v2_eager (save_format='tf', adapt=True)): 0.8s
I0201 18:38:00.973820 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert0_v2_eager (save_format='tf', adapt=True)): 0.8s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert0_v2_eager (save_format='tf', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_keras_invert2_v2_eager (save_format='h5', adapt=True)
WARNING:tensorflow:6 out of the last 6 calls to .predict_function at 0x7f6d28677040> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
W0201 18:38:01.735281 140110912087872 polymorphic_function.py:156] 6 out of the last 6 calls to .predict_function at 0x7f6d28677040> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 112ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert2_v2_eager (save_format='h5', adapt=True)): 0.77s
I0201 18:38:01.748082 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_keras_invert2_v2_eager (save_format='h5', adapt=True)): 0.77s
[ FAILED ] NormalizationAdaptTest.test_saved_model_keras_invert2_v2_eager (save_format='h5', adapt=True)
[ RUN ] NormalizationAdaptTest.test_saved_model_tf0_v2_eager (adapted=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 193ms/step
INFO:tensorflow:Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/579882ef1b1a68bb58cda63178968a6e4qt1vyie/tmp1f8c9ppd/tf_saved_model/assets
I0201 18:38:03.703713 140110912087872 builder_impl.py:797] Assets written to: /home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/_tmp/579882ef1b1a68bb58cda63178968a6e4qt1vyie/tmp1f8c9ppd/tf_saved_model/assets
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_model_tf0_v2_eager (adapted=True)): 2.61s
I0201 18:38:04.363503 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_model_tf0_v2_eager (adapted=True)): 2.61s
[ OK ] NormalizationAdaptTest.test_saved_model_tf0_v2_eager (adapted=True)
[ RUN ] NormalizationAdaptTest.test_saved_weights_keras0_v2_eager (adapted=True)
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 138ms/step
1/1 [==============================] - ETA: 0s1/1 [==============================] - 0s 111ms/step
INFO:tensorflow:time(__main__.NormalizationAdaptTest.test_saved_weights_keras0_v2_eager (adapted=True)): 1.12s
I0201 18:38:05.480636 140110912087872 test_util.py:2467] time(__main__.NormalizationAdaptTest.test_saved_weights_keras0_v2_eager (adapted=True)): 1.12s
[ OK ] NormalizationAdaptTest.test_saved_weights_keras0_v2_eager (adapted=True)
[ RUN ] NormalizationAdaptTest.test_session
[ SKIPPED ] NormalizationAdaptTest.test_session
[ RUN ] NormalizationTest.test_1d_data_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_1d_data_v2_function): 0.03s
I0201 18:38:05.509022 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_1d_data_v2_function): 0.03s
[ OK ] NormalizationTest.test_1d_data_v2_function
[ RUN ] NormalizationTest.test_bad_axis_fail_build1_v2_function (axis=-4)
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build1_v2_function (axis=-4)): 0.01s
I0201 18:38:05.516398 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build1_v2_function (axis=-4)): 0.01s
[ OK ] NormalizationTest.test_bad_axis_fail_build1_v2_function (axis=-4)
[ RUN ] NormalizationTest.test_bad_axis_fail_build3_v2_function (axis=(1, -4))
INFO:tensorflow:time(__main__.NormalizationTest.test_bad_axis_fail_build3_v2_function (axis=(1, -4))): 0.0s
I0201 18:38:05.521222 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_bad_axis_fail_build3_v2_function (axis=(1, -4))): 0.0s
[ OK ] NormalizationTest.test_bad_axis_fail_build3_v2_function (axis=(1, -4))
[ RUN ] NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_function): 0.03s
I0201 18:38:05.549435 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_function): 0.03s
[ OK ] NormalizationTest.test_broadcasting_during_direct_setting_with_tensors_v2_function
[ RUN ] NormalizationTest.test_invert_adapt_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_invert_adapt_v2_function): 1.07s
I0201 18:38:06.616787 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_invert_adapt_v2_function): 1.07s
[ OK ] NormalizationTest.test_invert_adapt_v2_function
[ RUN ] NormalizationTest.test_keeping_an_unknown_axis_fails_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_keeping_an_unknown_axis_fails_v2_function): 0.01s
I0201 18:38:06.624217 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_keeping_an_unknown_axis_fails_v2_function): 0.01s
[ OK ] NormalizationTest.test_keeping_an_unknown_axis_fails_v2_function
[ RUN ] NormalizationTest.test_output_dtype_v2_function
INFO:tensorflow:time(__main__.NormalizationTest.test_output_dtype_v2_function): 0.06s
I0201 18:38:06.680930 140110912087872 test_util.py:2467] time(__main__.NormalizationTest.test_output_dtype_v2_function): 0.06s
[ OK ] NormalizationTest.test_output_dtype_v2_function
======================================================================
FAIL: test_saved_model_keras_invert0_v2_eager (save_format='tf', adapt=True) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert0_v2_eager (save_format='tf', adapt=True)
test_saved_model_keras_invert0_v2_eager('v2_eager')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 412, in decorated
_v2_eager_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 433, in _v2_eager_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

======================================================================
FAIL: test_saved_model_keras_invert2_v2_eager (save_format='h5', adapt=True) (__main__.NormalizationAdaptTest)
NormalizationAdaptTest.test_saved_model_keras_invert2_v2_eager (save_format='h5', adapt=True)
test_saved_model_keras_invert2_v2_eager('v2_eager')
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 320, in bound_param_test
return test_method(self, *testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 412, in decorated
_v2_eager_test(f, self, *args, **kwargs)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/testing_infra/test_combinations.py", line 433, in _v2_eager_test
f(test_or_class, *args, **kwargs)
File "/tmpfs/venv/lib/python3.9/site-packages/absl/testing/parameterized.py", line 318, in bound_param_test
return test_method(self, **testcase_params)
File "/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/bin/keras/layers/preprocessing/normalization_test.runfiles/org_keras/keras/layers/preprocessing/normalization_test.py", line 479, in test_saved_model_keras_invert
self.assertAllClose(output_data, expected_output)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 1542, in decorated
return f(*args, **kwds)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3144, in assertAllClose
self._assertAllCloseRecursive(a, b, rtol=rtol, atol=atol, msg=msg)
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3100, in _assertAllCloseRecursive
self._assertArrayLikeAllClose(
File "/tmpfs/venv/lib/python3.9/site-packages/tensorflow/python/framework/test_util.py", line 3037, in _assertArrayLikeAllClose
np.testing.assert_allclose(
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 1530, in assert_allclose
assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
File "/tmpfs/venv/lib/python3.9/site-packages/numpy/testing/_private/utils.py", line 844, in assert_array_compare
raise AssertionError(msg)
AssertionError:
Not equal to tolerance rtol=1e-06, atol=1e-06
Mismatched value: a is different from b.
not close where = (array([0, 1, 2, 3]), array([0, 0, 0, 0]))
not close lhs = [-2. 0. -2. 0.]
not close rhs = [0. 2. 0. 2.]
not close dif = [2. 2. 2. 2.]
not close tol = [1.e-06 3.e-06 1.e-06 3.e-06]
dtype = float32, shape = (4, 1)
Mismatched elements: 4 / 4 (100%)
Max absolute difference: 2.
Max relative difference: 1.
x: array([[-2.],
[ 0.],
[-2.],
[ 0.]], dtype=float32)
y: array([[0.],
[2.],
[0.],
[2.]])

----------------------------------------------------------------------
Ran 25 tests in 18.050s

FAILED (failures=2, skipped=1)
================================================================================
[2,087 / 2,123] 240 / 388 tests, 1 failed; Testing //keras/applications:applications_test [110s (3 actions)] ... (32 actions running)
[2,285 / 2,319] 287 / 388 tests, 1 failed; Testing //keras/engine:training_eager_test; 48s local ... (32 actions running)
[2,441 / 2,483] 331 / 388 tests, 1 failed; Testing //keras/distribute:saved_model_save_load_test_gpu [43s (6 actions)] ... (32 actions running)
[2,758 / 2,781] 380 / 388 tests, 1 failed; Testing //keras/utils:sidecar_evaluator_test; 154s local ... (23 actions running)
INFO: Elapsed time: 1166.682s, Critical Path: 243.93s
INFO: 2781 processes: 1178 internal, 1603 local.
INFO: Build completed, 1 test FAILED, 2781 total actions
//keras:activations_test PASSED in 9.5s
//keras:backend_config_test PASSED in 7.7s
//keras:callbacks_v1_test PASSED in 55.1s
//keras:constraints_test PASSED in 10.5s
//keras:regularizers_test PASSED in 57.0s
//keras/benchmarks:benchmark_util_test PASSED in 11.5s
//keras/benchmarks:eager_microbenchmarks_test PASSED in 11.4s
//keras/benchmarks:eager_microbenchmarks_test_gpu PASSED in 9.7s
//keras/benchmarks:keras_cpu_benchmark_test PASSED in 12.0s
//keras/benchmarks:metrics_memory_benchmark_test PASSED in 10.5s
//keras/benchmarks:model_components_benchmarks_test PASSED in 10.2s
//keras/benchmarks:model_components_benchmarks_test_gpu PASSED in 10.8s
//keras/benchmarks:optimizer_benchmarks_test PASSED in 8.1s
//keras/benchmarks/keras_examples_benchmarks:antirectifier_benchmark_test PASSED in 11.2s
//keras/benchmarks/keras_examples_benchmarks:antirectifier_benchmark_test_gpu PASSED in 12.0s
//keras/benchmarks/keras_examples_benchmarks:bidirectional_lstm_benchmark_test PASSED in 11.3s
//keras/benchmarks/keras_examples_benchmarks:bidirectional_lstm_benchmark_test_gpu PASSED in 11.0s
//keras/benchmarks/keras_examples_benchmarks:cifar10_cnn_benchmark_test PASSED in 11.2s
//keras/benchmarks/keras_examples_benchmarks:cifar10_cnn_benchmark_test_gpu PASSED in 8.8s
//keras/benchmarks/keras_examples_benchmarks:mnist_conv_benchmark_test PASSED in 10.9s
//keras/benchmarks/keras_examples_benchmarks:mnist_conv_benchmark_test_gpu PASSED in 10.3s
//keras/benchmarks/keras_examples_benchmarks:mnist_conv_custom_training_benchmark_test PASSED in 11.3s
//keras/benchmarks/keras_examples_benchmarks:mnist_conv_custom_training_benchmark_test_gpu PASSED in 12.6s
//keras/benchmarks/keras_examples_benchmarks:mnist_hierarchical_rnn_benchmark_test PASSED in 11.3s
//keras/benchmarks/keras_examples_benchmarks:mnist_hierarchical_rnn_benchmark_test_gpu PASSED in 12.2s
//keras/benchmarks/keras_examples_benchmarks:mnist_irnn_benchmark_test PASSED in 10.7s
//keras/benchmarks/keras_examples_benchmarks:mnist_irnn_benchmark_test_gpu PASSED in 12.5s
//keras/benchmarks/keras_examples_benchmarks:reuters_mlp_benchmark_test PASSED in 11.5s
//keras/benchmarks/keras_examples_benchmarks:reuters_mlp_benchmark_test_gpu PASSED in 10.3s
//keras/benchmarks/keras_examples_benchmarks:text_classification_transformer_benchmark_test PASSED in 12.2s
//keras/benchmarks/keras_examples_benchmarks:text_classification_transformer_benchmark_test_gpu PASSED in 11.5s
//keras/benchmarks/layer_benchmarks:layer_benchmarks_test PASSED in 11.6s
//keras/benchmarks/saved_model_benchmarks:densenet_benchmark_test PASSED in 9.6s
//keras/benchmarks/saved_model_benchmarks:densenet_benchmark_test_gpu PASSED in 8.6s
//keras/benchmarks/saved_model_benchmarks:efficientnet_benchmark_test PASSED in 10.7s
//keras/benchmarks/saved_model_benchmarks:efficientnet_benchmark_test_gpu PASSED in 11.8s
//keras/benchmarks/saved_model_benchmarks:inception_resnet_v2_benchmark_test PASSED in 10.8s
//keras/benchmarks/saved_model_benchmarks:inception_resnet_v2_benchmark_test_gpu PASSED in 10.7s
//keras/benchmarks/saved_model_benchmarks:mobilenet_benchmark_test PASSED in 9.8s
//keras/benchmarks/saved_model_benchmarks:mobilenet_benchmark_test_gpu PASSED in 11.9s
//keras/benchmarks/saved_model_benchmarks:nasnet_large_benchmark_test PASSED in 8.6s
//keras/benchmarks/saved_model_benchmarks:nasnet_large_benchmark_test_gpu PASSED in 10.2s
//keras/benchmarks/saved_model_benchmarks:resnet152_v2_benchmark_test PASSED in 9.1s
//keras/benchmarks/saved_model_benchmarks:resnet152_v2_benchmark_test_gpu PASSED in 13.2s
//keras/benchmarks/saved_model_benchmarks:vgg_benchmark_test PASSED in 9.5s
//keras/benchmarks/saved_model_benchmarks:vgg_benchmark_test_gpu PASSED in 9.6s
//keras/benchmarks/saved_model_benchmarks:xception_benchmark_test PASSED in 8.8s
//keras/benchmarks/saved_model_benchmarks:xception_benchmark_test_gpu PASSED in 6.9s
//keras/distribute:checkpointing_test PASSED in 6.3s
//keras/distribute:checkpointing_test_gpu PASSED in 6.7s
//keras/distribute:collective_all_reduce_strategy_test PASSED in 7.8s
//keras/distribute:collective_all_reduce_strategy_test_gpu PASSED in 7.4s
//keras/distribute:custom_training_loop_metrics_test PASSED in 10.1s
//keras/distribute:custom_training_loop_metrics_test_gpu PASSED in 10.1s
//keras/distribute:custom_training_loop_models_test PASSED in 32.4s
//keras/distribute:custom_training_loop_models_test_gpu PASSED in 32.8s
//keras/distribute:custom_training_loop_optimizer_test PASSED in 7.1s
//keras/distribute:custom_training_loop_optimizer_test_gpu PASSED in 5.9s
//keras/distribute:distributed_file_utils_test PASSED in 4.7s
//keras/distribute:distributed_training_utils_test PASSED in 7.7s
//keras/distribute:distributed_training_utils_test_gpu PASSED in 8.0s
//keras/distribute:minimize_loss_test PASSED in 91.5s
//keras/distribute:minimize_loss_test_gpu PASSED in 91.3s
//keras/distribute:mirrored_strategy_test PASSED in 8.9s
//keras/distribute:mirrored_strategy_test_gpu PASSED in 8.4s
//keras/distribute:mirrored_variable_test PASSED in 9.6s
//keras/distribute:mirrored_variable_test_gpu PASSED in 8.3s
//keras/dtensor:mnist_model_test PASSED in 55.3s
//keras/dtensor:optimizers_test PASSED in 12.8s
//keras/dtensor:save_load_test PASSED in 10.3s
//keras/dtensor:utils_test PASSED in 9.8s
//keras/engine:base_layer_utils_test PASSED in 10.5s
//keras/engine:base_preprocessing_layer_test PASSED in 17.0s
//keras/engine:compile_utils_test PASSED in 12.0s
//keras/engine:deferred_sequential_test PASSED in 21.5s
//keras/engine:feature_columns_integration_test PASSED in 29.0s
//keras/engine:functional_utils_test PASSED in 21.3s
//keras/engine:input_spec_test PASSED in 8.0s
//keras/engine:keras_tensor_test PASSED in 8.9s
//keras/engine:ragged_keras_tensor_test PASSED in 17.7s
//keras/engine:training_arrays_test PASSED in 41.4s
//keras/engine:training_eager_test PASSED in 89.5s
//keras/engine:training_gpu_test PASSED in 7.6s
//keras/engine:training_gpu_test_gpu PASSED in 8.7s
//keras/export:export_lib_test PASSED in 77.8s
//keras/feature_column:dense_features_test PASSED in 15.0s
//keras/feature_column:dense_features_v2_test PASSED in 12.0s
//keras/feature_column:sequence_feature_column_integration_test PASSED in 8.6s
//keras/feature_column:sequence_feature_column_test PASSED in 21.2s
//keras/initializers:initializers_test PASSED in 13.8s
//keras/integration_test:central_storage_strategy_test PASSED in 9.9s
//keras/integration_test:central_storage_strategy_test_gpu PASSED in 9.6s
//keras/integration_test:custom_object_saving_test PASSED in 16.3s
//keras/integration_test:forwardprop_test PASSED in 42.0s
//keras/integration_test:function_test PASSED in 13.1s
//keras/integration_test:gradients_test PASSED in 30.6s
//keras/integration_test:legacy_rnn_test PASSED in 46.9s
//keras/integration_test:module_test PASSED in 10.4s
//keras/integration_test:mwms_multi_process_runner_test PASSED in 11.1s
//keras/integration_test:mwms_multi_process_runner_test_gpu PASSED in 20.6s
//keras/integration_test:parameter_server_training_metric_test PASSED in 18.3s
//keras/integration_test:saved_model_test PASSED in 91.9s
//keras/integration_test:saved_model_test_gpu PASSED in 103.3s
//keras/integration_test:vectorized_map_test PASSED in 10.7s
//keras/layers:kernelized_test PASSED in 18.9s
//keras/layers:layers_test PASSED in 7.7s
//keras/layers:serialization_test PASSED in 8.8s
//keras/layers/activation:elu_test PASSED in 11.6s
//keras/layers/activation:leaky_relu_test PASSED in 10.9s
//keras/layers/activation:prelu_test PASSED in 13.6s
//keras/layers/activation:relu_test PASSED in 14.3s
//keras/layers/activation:softmax_test PASSED in 9.7s
//keras/layers/activation:thresholded_relu_test PASSED in 10.3s
//keras/layers/attention:additive_attention_test PASSED in 9.6s
//keras/layers/attention:attention_test PASSED in 9.9s
//keras/layers/attention:base_dense_attention_test PASSED in 9.5s
//keras/layers/attention:multi_head_attention_test PASSED in 46.5s
//keras/layers/convolutional:conv_transpose_test PASSED in 64.6s
//keras/layers/convolutional:conv_transpose_test_gpu PASSED in 71.0s
//keras/layers/convolutional:separable_conv_test PASSED in 52.1s
//keras/layers/convolutional:separable_conv_test_gpu PASSED in 55.0s
//keras/layers/core:einsum_dense_test PASSED in 11.7s
//keras/layers/core:embedding_test PASSED in 20.1s
//keras/layers/core:embedding_test_gpu PASSED in 24.4s
//keras/layers/normalization:unit_normalization_test PASSED in 11.1s
//keras/layers/normalization:unit_normalization_test_gpu PASSED in 10.5s
//keras/layers/preprocessing:category_encoding_test PASSED in 25.6s
//keras/layers/preprocessing:integer_lookup_test PASSED in 31.0s
//keras/layers/preprocessing:preprocessing_stage_test PASSED in 8.2s
//keras/layers/preprocessing:preprocessing_utils_test PASSED in 9.0s
//keras/layers/preprocessing:string_lookup_test PASSED in 24.5s
//keras/layers/preprocessing/benchmarks:bucketized_column_dense_benchmark PASSED in 9.2s
//keras/layers/preprocessing/benchmarks:category_encoding_benchmark PASSED in 8.8s
//keras/layers/preprocessing/benchmarks:category_hash_dense_benchmark PASSED in 10.3s
//keras/layers/preprocessing/benchmarks:category_hash_varlen_benchmark PASSED in 10.9s
//keras/layers/preprocessing/benchmarks:category_vocab_file_dense_benchmark PASSED in 9.9s
//keras/layers/preprocessing/benchmarks:category_vocab_file_varlen_benchmark PASSED in 9.7s
//keras/layers/preprocessing/benchmarks:category_vocab_list_dense_benchmark PASSED in 11.6s
//keras/layers/preprocessing/benchmarks:category_vocab_list_indicator_dense_benchmark PASSED in 11.4s
//keras/layers/preprocessing/benchmarks:category_vocab_list_indicator_varlen_benchmark PASSED in 10.3s
//keras/layers/preprocessing/benchmarks:category_vocab_list_varlen_benchmark PASSED in 9.3s
//keras/layers/preprocessing/benchmarks:discretization_adapt_benchmark PASSED in 11.1s
//keras/layers/preprocessing/benchmarks:embedding_dense_benchmark PASSED in 11.2s
//keras/layers/preprocessing/benchmarks:embedding_varlen_benchmark PASSED in 11.2s
//keras/layers/preprocessing/benchmarks:hashed_crossing_benchmark PASSED in 10.0s
//keras/layers/preprocessing/benchmarks:hashing_benchmark PASSED in 9.6s
//keras/layers/preprocessing/benchmarks:image_preproc_benchmark PASSED in 10.7s
//keras/layers/preprocessing/benchmarks:image_preproc_benchmark_gpu PASSED in 8.4s
//keras/layers/preprocessing/benchmarks:index_lookup_adapt_benchmark PASSED in 12.0s
//keras/layers/preprocessing/benchmarks:index_lookup_forward_benchmark PASSED in 10.6s
//keras/layers/preprocessing/benchmarks:normalization_adapt_benchmark PASSED in 9.6s
//keras/layers/preprocessing/benchmarks:weighted_embedding_varlen_benchmark PASSED in 12.5s
//keras/layers/regularization:alpha_dropout_test PASSED in 10.3s
//keras/layers/regularization:gaussian_dropout_test PASSED in 11.3s
//keras/layers/regularization:gaussian_noise_test PASSED in 10.6s
//keras/legacy_tf_layers:base_test PASSED in 14.1s
//keras/legacy_tf_layers:convolutional_test PASSED in 13.4s
//keras/legacy_tf_layers:core_test PASSED in 11.0s
//keras/legacy_tf_layers:migration_utils_test PASSED in 7.6s
//keras/legacy_tf_layers:pooling_test PASSED in 7.2s
//keras/legacy_tf_layers:variable_scope_shim_test PASSED in 32.9s
//keras/metrics:metrics_functional_test PASSED in 8.6s
//keras/mixed_precision:autocast_variable_test PASSED in 25.5s
//keras/mixed_precision:device_compatibility_check_test PASSED in 8.7s
//keras/mixed_precision:device_compatibility_check_test_gpu PASSED in 8.1s
//keras/mixed_precision:layer_test PASSED in 12.5s
//keras/mixed_precision:layer_test_gpu PASSED in 13.0s
//keras/mixed_precision:mixed_precision_graph_rewrite_test PASSED in 8.2s
//keras/mixed_precision:mixed_precision_graph_rewrite_test_gpu PASSED in 8.0s
//keras/mixed_precision:policy_test PASSED in 7.5s
//keras/optimizers:legacy_learning_rate_decay_test PASSED in 16.2s
//keras/optimizers:legacy_learning_rate_decay_test_gpu PASSED in 14.7s
//keras/preprocessing:sequence_test PASSED in 8.0s
//keras/preprocessing:text_test PASSED in 8.4s
//keras/saving:object_registration_test PASSED in 7.4s
//keras/saving:saving_lib_test PASSED in 24.8s
//keras/saving:saving_utils_test PASSED in 51.9s
//keras/saving:serialization_lib_test PASSED in 8.2s
//keras/saving/legacy/saved_model:json_utils_test PASSED in 8.1s
//keras/testing_infra:keras_doctest_lib_test PASSED in 5.3s
//keras/testing_infra:test_combinations_test PASSED in 9.3s
//keras/tests:graph_util_test PASSED in 11.5s
//keras/tests:keras_doctest PASSED in 4.8s
//keras/tests:saver_test PASSED in 11.0s
//keras/tests:saver_test_gpu PASSED in 12.9s
//keras/tests:serialization_util_test PASSED in 9.4s
//keras/tests:tracking_test PASSED in 22.4s
//keras/tests:tracking_util_test PASSED in 41.6s
//keras/tests:tracking_util_with_v1_optimizers_test PASSED in 37.4s
//keras/utils:audio_dataset_test PASSED in 11.0s
//keras/utils:conv_utils_test PASSED in 8.0s
//keras/utils:dataset_creator_test PASSED in 17.8s
//keras/utils:dataset_utils_test PASSED in 17.7s
//keras/utils:feature_space_test PASSED in 38.3s
//keras/utils:generic_utils_test PASSED in 13.1s
//keras/utils:image_dataset_test PASSED in 10.3s
//keras/utils:io_utils_test PASSED in 8.2s
//keras/utils:kernelized_utils_test PASSED in 6.8s
//keras/utils:layer_utils_test PASSED in 13.0s
//keras/utils:losses_utils_test PASSED in 8.1s
//keras/utils:metrics_utils_test PASSED in 10.1s
//keras/utils:np_utils_test PASSED in 8.1s
//keras/utils:sidecar_evaluator_test PASSED in 221.7s
//keras/utils:text_dataset_test PASSED in 9.0s
//keras/utils:tf_utils_test PASSED in 9.0s
//keras/utils:timeseries_dataset_test PASSED in 10.7s
//keras/utils:traceback_utils_test PASSED in 8.5s
//keras/utils:version_utils_test PASSED in 8.7s
//keras/wrappers:scikit_learn_test PASSED in 26.4s
//keras/applications:imagenet_utils_test PASSED in 10.2s
Stats over 2 runs: max = 10.2s, min = 9.1s, avg = 9.6s, dev = 0.6s
//keras/distribute:sharded_variable_test PASSED in 39.2s
Stats over 2 runs: max = 39.2s, min = 34.3s, avg = 36.7s, dev = 2.5s
//keras/distribute:sharded_variable_test_gpu PASSED in 38.4s
Stats over 2 runs: max = 38.4s, min = 34.0s, avg = 36.2s, dev = 2.2s
//keras/engine:correctness_test PASSED in 16.0s
Stats over 2 runs: max = 16.0s, min = 14.7s, avg = 15.4s, dev = 0.7s
//keras/layers/rnn:gru_lstm_test PASSED in 28.8s
Stats over 2 runs: max = 28.8s, min = 28.4s, avg = 28.6s, dev = 0.2s
//keras/layers/rnn:gru_lstm_test_gpu PASSED in 28.9s
Stats over 2 runs: max = 28.9s, min = 27.1s, avg = 28.0s, dev = 0.9s
//keras/optimizers/legacy:rmsprop_test PASSED in 27.2s
Stats over 2 runs: max = 27.2s, min = 26.1s, avg = 26.6s, dev = 0.6s
//keras/optimizers/legacy:rmsprop_test_gpu PASSED in 25.8s
Stats over 2 runs: max = 25.8s, min = 24.5s, avg = 25.2s, dev = 0.6s
//keras/premade_models:linear_test PASSED in 16.5s
Stats over 2 runs: max = 16.5s, min = 16.2s, avg = 16.3s, dev = 0.1s
//keras/premade_models:wide_deep_test PASSED in 25.8s
Stats over 2 runs: max = 25.8s, min = 18.4s, avg = 22.1s, dev = 3.7s
//keras/engine:input_layer_test PASSED in 9.5s
Stats over 3 runs: max = 9.5s, min = 8.1s, avg = 9.0s, dev = 0.6s
//keras/engine:node_test PASSED in 7.8s
Stats over 3 runs: max = 7.8s, min = 6.8s, avg = 7.4s, dev = 0.4s
//keras/layers:subclassed_layers_test PASSED in 8.7s
Stats over 3 runs: max = 8.7s, min = 7.5s, avg = 8.0s, dev = 0.5s
//keras/layers:tensorflow_op_layer_test PASSED in 38.3s
Stats over 3 runs: max = 38.3s, min = 27.9s, avg = 34.0s, dev = 4.5s
//keras/layers/core:core_test PASSED in 26.1s
Stats over 3 runs: max = 26.1s, min = 17.6s, avg = 23.2s, dev = 4.0s
//keras/layers/regularization:activity_regularization_test PASSED in 7.7s
Stats over 3 runs: max = 7.7s, min = 6.4s, avg = 6.9s, dev = 0.5s
//keras/layers/regularization:dropout_test PASSED in 11.3s
Stats over 3 runs: max = 11.3s, min = 9.2s, avg = 10.2s, dev = 0.9s
//keras/layers/regularization:spatial_dropout_test PASSED in 10.6s
Stats over 3 runs: max = 10.6s, min = 9.2s, avg = 9.8s, dev = 0.6s
//keras/layers/reshaping:flatten_test PASSED in 10.9s
Stats over 3 runs: max = 10.9s, min = 9.0s, avg = 9.9s, dev = 0.8s
//keras/layers/reshaping:permute_test PASSED in 7.7s
Stats over 3 runs: max = 7.7s, min = 7.6s, avg = 7.6s, dev = 0.0s
//keras/layers/reshaping:repeat_vector_test PASSED in 8.7s
Stats over 3 runs: max = 8.7s, min = 7.4s, avg = 8.0s, dev = 0.5s
//keras/layers/reshaping:reshape_test PASSED in 11.1s
Stats over 3 runs: max = 11.1s, min = 7.5s, avg = 9.5s, dev = 1.5s
//keras:backend_test PASSED in 21.1s
Stats over 4 runs: max = 21.1s, min = 11.9s, avg = 14.6s, dev = 3.8s
//keras:losses_test PASSED in 17.2s
Stats over 4 runs: max = 17.2s, min = 14.3s, avg = 15.8s, dev = 1.1s
//keras/distribute:keras_optimizer_v2_test PASSED in 8.0s
Stats over 4 runs: max = 8.0s, min = 7.0s, avg = 7.3s, dev = 0.4s
//keras/distribute:keras_optimizer_v2_test_gpu PASSED in 7.6s
Stats over 4 runs: max = 7.6s, min = 7.5s, avg = 7.6s, dev = 0.0s
//keras/distribute:keras_stateful_lstm_model_correctness_test PASSED in 8.6s
Stats over 4 runs: max = 8.6s, min = 7.6s, avg = 8.0s, dev = 0.4s
//keras/distribute:keras_stateful_lstm_model_correctness_test_gpu PASSED in 8.3s
Stats over 4 runs: max = 8.3s, min = 7.5s, avg = 7.8s, dev = 0.3s
//keras/distribute:keras_utils_test PASSED in 32.3s
Stats over 4 runs: max = 32.3s, min = 28.6s, avg = 29.7s, dev = 1.5s
//keras/distribute:keras_utils_test_gpu PASSED in 36.6s
Stats over 4 runs: max = 36.6s, min = 28.9s, avg = 32.0s, dev = 3.1s
//keras/distribute:worker_training_state_test PASSED in 18.0s
Stats over 4 runs: max = 18.0s, min = 7.6s, avg = 10.6s, dev = 4.3s
//keras/distribute:worker_training_state_test_gpu PASSED in 17.4s
Stats over 4 runs: max = 17.4s, min = 7.7s, avg = 10.4s, dev = 4.0s
//keras/dtensor:initializers_test PASSED in 10.7s
Stats over 4 runs: max = 10.7s, min = 10.3s, avg = 10.6s, dev = 0.2s
//keras/dtensor:metrics_test PASSED in 12.6s
Stats over 4 runs: max = 12.6s, min = 12.2s, avg = 12.4s, dev = 0.1s
//keras/engine:data_adapter_test PASSED in 50.5s
Stats over 4 runs: max = 50.5s, min = 31.9s, avg = 38.4s, dev = 7.5s
//keras/engine:sequential_test PASSED in 62.1s
Stats over 4 runs: max = 62.1s, min = 18.2s, avg = 31.5s, dev = 18.0s
//keras/engine:training_dataset_test PASSED in 28.6s
Stats over 4 runs: max = 28.6s, min = 26.9s, avg = 27.5s, dev = 0.7s
//keras/layers/locally_connected:locally_connected_test PASSED in 134.6s
Stats over 4 runs: max = 134.6s, min = 97.8s, avg = 116.6s, dev = 13.4s
//keras/layers/merging:merging_test PASSED in 16.7s
Stats over 4 runs: max = 16.7s, min = 15.5s, avg = 15.9s, dev = 0.5s
//keras/layers/normalization:batch_normalization_test PASSED in 34.2s
Stats over 4 runs: max = 34.2s, min = 15.9s, avg = 23.2s, dev = 7.0s
//keras/layers/normalization:batch_normalization_test_gpu PASSED in 35.9s
Stats over 4 runs: max = 35.9s, min = 16.9s, avg = 25.1s, dev = 7.0s
//keras/layers/normalization:group_normalization_test PASSED in 7.3s
Stats over 4 runs: max = 7.3s, min = 6.6s, avg = 6.8s, dev = 0.3s
//keras/layers/normalization:group_normalization_test_gpu PASSED in 7.7s
Stats over 4 runs: max = 7.7s, min = 7.0s, avg = 7.4s, dev = 0.3s
//keras/layers/normalization:layer_normalization_test PASSED in 35.3s
Stats over 4 runs: max = 35.3s, min = 16.0s, avg = 25.4s, dev = 7.8s
//keras/layers/normalization:layer_normalization_test_gpu PASSED in 44.8s
Stats over 4 runs: max = 44.8s, min = 21.1s, avg = 32.6s, dev = 9.2s
//keras/layers/preprocessing:discretization_test PASSED in 14.3s
Stats over 4 runs: max = 14.3s, min = 12.9s, avg = 13.8s, dev = 0.6s
//keras/layers/preprocessing:hashed_crossing_test PASSED in 9.0s
Stats over 4 runs: max = 9.0s, min = 6.9s, avg = 8.0s, dev = 1.0s
//keras/layers/preprocessing:hashing_distribution_test PASSED in 12.7s
Stats over 4 runs: max = 12.7s, min = 6.9s, avg = 10.0s, dev = 2.5s
//keras/layers/preprocessing:hashing_distribution_test_gpu PASSED in 13.7s
Stats over 4 runs: max = 13.7s, min = 7.7s, avg = 10.8s, dev = 2.8s
//keras/layers/preprocessing:hashing_test PASSED in 10.0s
Stats over 4 runs: max = 10.0s, min = 8.3s, avg = 8.9s, dev = 0.7s
//keras/layers/preprocessing:hashing_test_gpu PASSED in 9.6s
Stats over 4 runs: max = 9.6s, min = 7.3s, avg = 8.5s, dev = 1.0s
//keras/layers/preprocessing:image_preprocessing_distribution_test PASSED in 9.6s
Stats over 4 runs: max = 9.6s, min = 6.7s, avg = 8.3s, dev = 1.2s
//keras/layers/preprocessing:image_preprocessing_distribution_test_gpu PASSED in 9.6s
Stats over 4 runs: max = 9.6s, min = 6.2s, avg = 8.0s, dev = 1.4s
//keras/layers/preprocessing:image_preprocessing_test PASSED in 42.9s
Stats over 4 runs: max = 42.9s, min = 34.8s, avg = 39.5s, dev = 2.9s
//keras/layers/preprocessing:image_preprocessing_test_gpu PASSED in 42.9s
Stats over 4 runs: max = 42.9s, min = 34.5s, avg = 39.6s, dev = 3.1s
//keras/layers/preprocessing:index_lookup_distribution_test PASSED in 13.8s
Stats over 4 runs: max = 13.8s, min = 9.2s, avg = 11.6s, dev = 2.1s
//keras/layers/preprocessing:index_lookup_distribution_test_gpu PASSED in 13.8s
Stats over 4 runs: max = 13.8s, min = 9.0s, avg = 11.5s, dev = 2.0s
//keras/layers/preprocessing:index_lookup_test PASSED in 53.6s
Stats over 4 runs: max = 53.6s, min = 48.4s, avg = 51.2s, dev = 1.9s
//keras/layers/preprocessing:text_vectorization_distribution_test PASSED in 13.3s
Stats over 4 runs: max = 13.3s, min = 7.8s, avg = 10.4s, dev = 2.6s
//keras/layers/preprocessing:text_vectorization_distribution_test_gpu PASSED in 13.7s
Stats over 4 runs: max = 13.7s, min = 8.6s, avg = 11.2s, dev = 2.4s
//keras/layers/preprocessing:text_vectorization_test PASSED in 50.8s
Stats over 4 runs: max = 50.8s, min = 46.3s, avg = 48.5s, dev = 2.0s
//keras/layers/rnn:base_wrapper_test PASSED in 7.7s
Stats over 4 runs: max = 7.7s, min = 6.7s, avg = 7.0s, dev = 0.4s
//keras/layers/rnn:cell_wrappers_test PASSED in 8.4s
Stats over 4 runs: max = 8.4s, min = 7.8s, avg = 8.1s, dev = 0.2s
//keras/layers/rnn:cudnn_test PASSED in 7.8s
Stats over 4 runs: max = 7.8s, min = 6.7s, avg = 7.1s, dev = 0.4s
//keras/layers/rnn:cudnn_test_gpu PASSED in 8.9s
Stats over 4 runs: max = 8.9s, min = 7.5s, avg = 8.1s, dev = 0.5s
//keras/layers/rnn:gru_v1_test PASSED in 39.4s
Stats over 4 runs: max = 39.4s, min = 14.0s, avg = 26.5s, dev = 12.5s
//keras/layers/rnn:legacy_cell_wrappers_test PASSED in 8.0s
Stats over 4 runs: max = 8.0s, min = 7.2s, avg = 7.5s, dev = 0.3s
//keras/layers/rnn:lstm_v1_test PASSED in 56.4s
Stats over 4 runs: max = 56.4s, min = 30.3s, avg = 42.9s, dev = 12.6s
//keras/layers/rnn:simple_rnn_test PASSED in 27.4s
Stats over 4 runs: max = 27.4s, min = 16.0s, avg = 21.5s, dev = 4.1s
//keras/metrics:accuracy_metrics_test PASSED in 9.5s
Stats over 4 runs: max = 9.5s, min = 7.9s, avg = 8.7s, dev = 0.6s
//keras/metrics:base_metric_test PASSED in 19.0s
Stats over 4 runs: max = 19.0s, min = 8.3s, avg = 14.1s, dev = 4.8s
//keras/metrics:confusion_metrics_test PASSED in 40.2s
Stats over 4 runs: max = 40.2s, min = 32.6s, avg = 36.2s, dev = 3.5s
//keras/metrics:hinge_metrics_test PASSED in 7.9s
Stats over 4 runs: max = 7.9s, min = 7.4s, avg = 7.6s, dev = 0.2s
//keras/metrics:iou_metrics_test PASSED in 10.1s
Stats over 4 runs: max = 10.1s, min = 9.0s, avg = 9.4s, dev = 0.5s
//keras/metrics:metrics_correctness_test PASSED in 64.9s
Stats over 4 runs: max = 64.9s, min = 35.7s, avg = 51.5s, dev = 10.9s
//keras/metrics:probabilistic_metrics_test PASSED in 8.4s
Stats over 4 runs: max = 8.4s, min = 7.5s, avg = 7.8s, dev = 0.4s
//keras/mixed_precision:loss_scale_optimizer_test PASSED in 23.9s
Stats over 4 runs: max = 23.9s, min = 14.7s, avg = 19.5s, dev = 3.5s
//keras/mixed_precision:loss_scale_optimizer_test_gpu PASSED in 24.0s
Stats over 4 runs: max = 24.0s, min = 15.0s, avg = 19.5s, dev = 3.4s
//keras/optimizers/legacy:adadelta_test PASSED in 42.2s
Stats over 4 runs: max = 42.2s, min = 7.4s, avg = 16.7s, dev = 14.7s
//keras/optimizers/legacy:adadelta_test_gpu PASSED in 41.0s
Stats over 4 runs: max = 41.0s, min = 5.9s, avg = 15.8s, dev = 14.6s
//keras/optimizers/legacy:adagrad_test PASSED in 10.5s
Stats over 4 runs: max = 10.5s, min = 9.5s, avg = 10.2s, dev = 0.4s
//keras/optimizers/legacy:adagrad_test_gpu PASSED in 9.8s
Stats over 4 runs: max = 9.8s, min = 8.9s, avg = 9.4s, dev = 0.3s
//keras/optimizers/legacy:adam_test PASSED in 17.8s
Stats over 4 runs: max = 17.8s, min = 15.9s, avg = 16.7s, dev = 0.8s
//keras/optimizers/legacy:adam_test_gpu PASSED in 17.0s
Stats over 4 runs: max = 17.0s, min = 14.3s, avg = 15.4s, dev = 1.0s
//keras/optimizers/legacy:adamax_test PASSED in 9.7s
Stats over 4 runs: max = 9.7s, min = 7.5s, avg = 8.5s, dev = 0.8s
//keras/optimizers/legacy:adamax_test_gpu PASSED in 13.4s
Stats over 4 runs: max = 13.4s, min = 10.4s, avg = 11.4s, dev = 1.2s
//keras/optimizers/legacy:ftrl_test PASSED in 8.6s
Stats over 4 runs: max = 8.6s, min = 7.4s, avg = 8.0s, dev = 0.5s
//keras/optimizers/legacy:ftrl_test_gpu PASSED in 7.6s
Stats over 4 runs: max = 7.6s, min = 6.1s, avg = 7.0s, dev = 0.6s
//keras/optimizers/legacy:gradient_descent_test PASSED in 10.3s
Stats over 4 runs: max = 10.3s, min = 8.6s, avg = 9.5s, dev = 0.6s
//keras/optimizers/legacy:gradient_descent_test_gpu PASSED in 13.1s
Stats over 4 runs: max = 13.1s, min = 11.9s, avg = 12.2s, dev = 0.5s
//keras/optimizers/legacy:nadam_test PASSED in 6.9s
Stats over 4 runs: max = 6.9s, min = 5.0s, avg = 5.9s, dev = 0.9s
//keras/optimizers/legacy:nadam_test_gpu PASSED in 6.5s
Stats over 4 runs: max = 6.5s, min = 5.2s, avg = 5.6s, dev = 0.5s
//keras/optimizers/schedules:learning_rate_schedule_test PASSED in 12.1s
Stats over 4 runs: max = 12.1s, min = 9.9s, avg = 10.8s, dev = 0.9s
//keras/optimizers/schedules:learning_rate_schedule_test_gpu PASSED in 12.9s
Stats over 4 runs: max = 12.9s, min = 10.3s, avg = 11.4s, dev = 0.9s
//keras/saving:losses_serialization_test PASSED in 41.5s
Stats over 4 runs: max = 41.5s, min = 29.1s, avg = 35.4s, dev = 6.0s
//keras/saving:pickle_utils_test PASSED in 21.2s
Stats over 4 runs: max = 21.2s, min = 19.9s, avg = 20.6s, dev = 0.5s
//keras/saving:save_test PASSED in 130.9s
Stats over 4 runs: max = 130.9s, min = 91.5s, avg = 111.2s, dev = 16.9s
//keras/saving:save_weights_test PASSED in 21.9s
Stats over 4 runs: max = 21.9s, min = 17.8s, avg = 19.7s, dev = 1.5s
//keras/saving/legacy/saved_model:saved_model_test PASSED in 163.9s
Stats over 4 runs: max = 163.9s, min = 148.5s, avg = 156.0s, dev = 6.7s
//keras/tests:add_loss_correctness_test PASSED in 17.8s
Stats over 4 runs: max = 17.8s, min = 13.9s, avg = 15.5s, dev = 1.5s
//keras/tests:convert_to_constants_test PASSED in 15.3s
Stats over 4 runs: max = 15.3s, min = 10.4s, avg = 12.9s, dev = 1.8s
//keras/tests:custom_training_loop_test PASSED in 16.4s
Stats over 4 runs: max = 16.4s, min = 13.5s, avg = 14.5s, dev = 1.2s
//keras/tests:get_config_test PASSED in 12.9s
Stats over 4 runs: max = 12.9s, min = 9.9s, avg = 11.5s, dev = 1.2s
//keras/tests:model_subclassing_compiled_test PASSED in 28.8s
Stats over 4 runs: max = 28.8s, min = 19.3s, avg = 23.1s, dev = 3.6s
//keras/tests:model_subclassing_test PASSED in 14.4s
Stats over 4 runs: max = 14.4s, min = 12.6s, avg = 13.3s, dev = 0.7s
//keras/utils:image_utils_test PASSED in 8.2s
Stats over 4 runs: max = 8.2s, min = 7.0s, avg = 7.5s, dev = 0.4s
//keras/utils:vis_utils_test PASSED in 29.4s
Stats over 4 runs: max = 29.4s, min = 27.1s, avg = 28.1s, dev = 0.9s
//keras/layers/preprocessing:normalization_test FAILED in 4 out of 4 in 25.5s
Stats over 4 runs: max = 25.5s, min = 22.0s, avg = 23.7s, dev = 1.4s
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_1_of_4/test.log
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_2_of_4/test.log
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_4_of_4/test.log
/home/kbuilder/.cache/bazel/_bazel_kbuilder/31d6f47147b75c35404d734345be7323/execroot/org_keras/bazel-out/k8-opt/testlogs/keras/layers/preprocessing/normalization_test/shard_3_of_4/test.log
//keras/distribute:multi_worker_callback_tf2_test PASSED in 15.3s
Stats over 5 runs: max = 15.3s, min = 13.9s, avg = 14.5s, dev = 0.5s
//keras/mixed_precision:model_test PASSED in 67.1s
Stats over 5 runs: max = 67.1s, min = 49.4s, avg = 56.7s, dev = 6.9s
//keras/mixed_precision:model_test_gpu PASSED in 59.2s
Stats over 5 runs: max = 59.2s, min = 42.9s, avg = 49.8s, dev = 6.2s
//keras:callbacks_test PASSED in 75.6s
Stats over 6 runs: max = 75.6s, min = 46.7s, avg = 63.8s, dev = 8.8s
//keras/engine:training_generator_test PASSED in 28.8s
Stats over 6 runs: max = 28.8s, min = 25.4s, avg = 27.8s, dev = 1.1s
//keras/integration_test:multi_worker_tutorial_test PASSED in 51.0s
Stats over 6 runs: max = 51.0s, min = 8.3s, avg = 18.7s, dev = 15.1s
//keras/utils:data_utils_test PASSED in 8.5s
Stats over 6 runs: max = 8.5s, min = 7.4s, avg = 8.0s, dev = 0.3s
//keras/distribute:keras_save_load_test PASSED in 49.4s
Stats over 7 runs: max = 49.4s, min = 36.4s, avg = 44.6s, dev = 4.4s
//keras/distribute:keras_save_load_test_gpu PASSED in 47.9s
Stats over 7 runs: max = 47.9s, min = 36.3s, avg = 43.7s, dev = 4.0s
//keras/distribute:saved_model_mixed_api_test PASSED in 45.4s
Stats over 7 runs: max = 45.4s, min = 34.5s, avg = 41.5s, dev = 3.8s
//keras/distribute:saved_model_mixed_api_test_gpu PASSED in 45.1s
Stats over 7 runs: max = 45.1s, min = 36.1s, avg = 41.7s, dev = 3.1s
//keras/distribute:saved_model_save_load_test PASSED in 58.2s
Stats over 7 runs: max = 58.2s, min = 44.4s, avg = 52.3s, dev = 4.3s
//keras/distribute:saved_model_save_load_test_gpu PASSED in 58.6s
Stats over 7 runs: max = 58.6s, min = 43.5s, avg = 52.1s, dev = 4.8s
//keras/distribute:keras_embedding_model_correctness_test PASSED in 43.6s
Stats over 8 runs: max = 43.6s, min = 22.9s, avg = 32.7s, dev = 6.3s
//keras/distribute:keras_embedding_model_correctness_test_gpu PASSED in 48.9s
Stats over 8 runs: max = 48.9s, min = 25.8s, avg = 34.1s, dev = 7.7s
//keras/distribute:keras_metrics_test PASSED in 13.3s
Stats over 8 runs: max = 13.3s, min = 6.9s, avg = 8.9s, dev = 2.0s
//keras/distribute:keras_metrics_test_gpu PASSED in 13.4s
Stats over 8 runs: max = 13.4s, min = 7.4s, avg = 9.0s, dev = 1.9s
//keras/distribute:keras_premade_models_test PASSED in 32.6s
Stats over 8 runs: max = 32.6s, min = 17.6s, avg = 22.8s, dev = 5.3s
//keras/distribute:keras_premade_models_test_gpu PASSED in 31.6s
Stats over 8 runs: max = 31.6s, min = 16.7s, avg = 23.3s, dev = 6.0s
//keras/engine:base_layer_test PASSED in 11.1s
Stats over 8 runs: max = 11.1s, min = 9.8s, avg = 10.6s, dev = 0.5s
//keras/engine:control_flow_test PASSED in 10.8s
Stats over 8 runs: max = 10.8s, min = 8.0s, avg = 8.7s, dev = 0.9s
//keras/engine:functional_test PASSED in 20.8s
Stats over 8 runs: max = 20.8s, min = 11.5s, avg = 15.4s, dev = 3.2s
//keras/layers/convolutional:conv_test PASSED in 30.7s
Stats over 8 runs: max = 30.7s, min = 18.0s, avg = 24.5s, dev = 4.4s
//keras/layers/convolutional:conv_test_gpu PASSED in 36.7s
Stats over 8 runs: max = 36.7s, min = 23.6s, avg = 30.6s, dev = 4.6s
//keras/layers/convolutional:depthwise_conv_test PASSED in 13.3s
Stats over 8 runs: max = 13.3s, min = 10.2s, avg = 12.2s, dev = 1.0s
//keras/layers/convolutional:depthwise_conv_test_gpu PASSED in 13.4s
Stats over 8 runs: max = 13.4s, min = 10.6s, avg = 12.4s, dev = 0.9s
//keras/layers/pooling:average_pooling_test PASSED in 12.0s
Stats over 8 runs: max = 12.0s, min = 7.0s, avg = 8.6s, dev = 1.5s
//keras/layers/pooling:global_average_pooling_test PASSED in 11.4s
Stats over 8 runs: max = 11.4s, min = 7.6s, avg = 9.4s, dev = 1.2s
//keras/layers/pooling:global_max_pooling_test PASSED in 10.9s
Stats over 8 runs: max = 10.9s, min = 8.4s, avg = 9.6s, dev = 1.0s
//keras/layers/pooling:max_pooling_test PASSED in 13.2s
Stats over 8 runs: max = 13.2s, min = 7.3s, avg = 8.9s, dev = 1.8s
//keras/layers/reshaping:cropping_test PASSED in 12.3s
Stats over 8 runs: max = 12.3s, min = 6.9s, avg = 9.3s, dev = 1.7s
//keras/layers/reshaping:cropping_test_gpu PASSED in 11.8s
Stats over 8 runs: max = 11.8s, min = 6.5s, avg = 8.4s, dev = 1.6s
//keras/layers/reshaping:up_sampling_test PASSED in 10.4s
Stats over 8 runs: max = 10.4s, min = 8.0s, avg = 8.6s, dev = 0.7s
//keras/layers/reshaping:up_sampling_test_gpu PASSED in 10.0s
Stats over 8 runs: max = 10.0s, min = 7.7s, avg = 8.8s, dev = 0.8s
//keras/layers/reshaping:zero_padding_test PASSED in 10.7s
Stats over 8 runs: max = 10.7s, min = 8.2s, avg = 9.1s, dev = 0.8s
//keras/layers/reshaping:zero_padding_test_gpu PASSED in 10.3s
Stats over 8 runs: max = 10.3s, min = 8.1s, avg = 9.2s, dev = 0.7s
//keras/layers/rnn:conv_lstm_test PASSED in 29.1s
Stats over 8 runs: max = 29.1s, min = 22.8s, avg = 26.7s, dev = 2.2s
//keras/models:cloning_test PASSED in 29.9s
Stats over 8 runs: max = 29.9s, min = 10.9s, avg = 20.3s, dev = 6.6s
//keras/models:sharpness_aware_minimization_test PASSED in 21.4s
Stats over 8 runs: max = 21.4s, min = 7.7s, avg = 10.8s, dev = 4.5s
//keras/models:sharpness_aware_minimization_test_gpu PASSED in 17.9s
Stats over 8 runs: max = 17.9s, min = 6.3s, avg = 8.8s, dev = 3.8s
//keras/optimizers:optimizer_v1_test PASSED in 7.8s
Stats over 8 runs: max = 7.8s, min = 6.5s, avg = 7.0s, dev = 0.4s
//keras/optimizers/legacy:optimizer_v2_test PASSED in 78.6s
Stats over 8 runs: max = 78.6s, min = 52.7s, avg = 67.3s, dev = 9.4s
//keras/optimizers/legacy:optimizer_v2_test_gpu PASSED in 80.6s
Stats over 8 runs: max = 80.6s, min = 55.2s, avg = 68.9s, dev = 9.5s
//keras/saving:metrics_serialization_test PASSED in 51.3s
Stats over 8 runs: max = 51.3s, min = 27.9s, avg = 39.6s, dev = 9.4s
//keras/saving/legacy/saved_model:revive_test PASSED in 133.8s
Stats over 8 runs: max = 133.8s, min = 8.1s, avg = 59.1s, dev = 56.9s
//keras/utils:composite_tensor_support_test PASSED in 37.9s
Stats over 8 runs: max = 37.9s, min = 16.4s, avg = 25.4s, dev = 8.9s
//keras/distribute:ctl_correctness_test PASSED in 24.1s
Stats over 10 runs: max = 24.1s, min = 19.8s, avg = 21.6s, dev = 1.5s
//keras/distribute:ctl_correctness_test_gpu PASSED in 22.5s
Stats over 10 runs: max = 22.5s, min = 17.3s, avg = 19.6s, dev = 1.7s
//keras/legacy_tf_layers:normalization_test PASSED in 7.6s
Stats over 10 runs: max = 7.6s, min = 7.0s, avg = 7.3s, dev = 0.2s
//keras/legacy_tf_layers:normalization_test_gpu PASSED in 7.3s
Stats over 10 runs: max = 7.3s, min = 6.7s, avg = 7.0s, dev = 0.2s
//keras/mixed_precision:layer_correctness_test PASSED in 58.8s
Stats over 10 runs: max = 58.8s, min = 25.3s, avg = 42.7s, dev = 11.4s
//keras/mixed_precision:layer_correctness_test_gpu PASSED in 64.8s
Stats over 10 runs: max = 64.8s, min = 26.1s, avg = 46.5s, dev = 13.3s
//keras/integration_test:saving_v3_test PASSED in 137.5s
Stats over 12 runs: max = 137.5s, min = 9.6s, avg = 35.2s, dev = 33.7s
//keras/layers/rnn:base_rnn_test PASSED in 66.7s
Stats over 12 runs: max = 66.7s, min = 23.4s, avg = 44.4s, dev = 10.6s
//keras/layers/rnn:bidirectional_test PASSED in 46.0s
Stats over 12 runs: max = 46.0s, min = 19.4s, avg = 30.8s, dev = 8.8s
//keras/layers/rnn:gru_test PASSED in 75.5s
Stats over 12 runs: max = 75.5s, min = 23.0s, avg = 45.1s, dev = 14.7s
//keras/layers/rnn:gru_test_gpu PASSED in 72.4s
Stats over 12 runs: max = 72.4s, min = 22.1s, avg = 43.4s, dev = 13.8s
//keras/layers/rnn:time_distributed_test PASSED in 14.3s
Stats over 12 runs: max = 14.3s, min = 6.9s, avg = 9.8s, dev = 2.2s
//keras/distribute:keras_image_model_correctness_test PASSED in 8.2s
Stats over 16 runs: max = 8.2s, min = 7.0s, avg = 7.5s, dev = 0.3s
//keras/distribute:keras_image_model_correctness_test_gpu PASSED in 7.6s
Stats over 16 runs: max = 7.6s, min = 6.4s, avg = 6.8s, dev = 0.3s
//keras/optimizers:optimizer_test PASSED in 13.1s
Stats over 16 runs: max = 13.1s, min = 6.7s, avg = 8.2s, dev = 1.9s
//keras/optimizers:optimizer_test_gpu PASSED in 14.1s
Stats over 16 runs: max = 14.1s, min = 7.5s, avg = 8.9s, dev = 1.9s
//keras/tests:integration_test PASSED in 49.8s
Stats over 16 runs: max = 49.8s, min = 13.3s, avg = 28.0s, dev = 12.2s
//keras/tests:model_architectures_test PASSED in 129.4s
Stats over 16 runs: max = 129.4s, min = 19.4s, avg = 56.0s, dev = 39.1s
//keras/engine:training_test PASSED in 131.7s
Stats over 20 runs: max = 131.7s, min = 19.0s, avg = 34.1s, dev = 24.5s
//keras/tests:temporal_sample_weights_correctness_test PASSED in 56.2s
Stats over 20 runs: max = 56.2s, min = 12.9s, avg = 33.5s, dev = 13.7s
//keras/integration_test:fit_test PASSED in 193.3s
Stats over 28 runs: max = 193.3s, min = 7.3s, avg = 27.3s, dev = 35.9s
//keras/engine:training_integration_test PASSED in 35.0s
Stats over 30 runs: max = 35.0s, min = 11.4s, avg = 20.5s, dev = 7.9s
//keras/distribute:keras_rnn_model_correctness_test PASSED in 29.8s
Stats over 31 runs: max = 29.8s, min = 6.5s, avg = 14.5s, dev = 9.7s
//keras/distribute:keras_rnn_model_correctness_test_gpu PASSED in 29.4s
Stats over 31 runs: max = 29.4s, min = 6.2s, avg = 15.0s, dev = 10.2s
//keras/applications:applications_test PASSED in 189.0s
Stats over 40 runs: max = 189.0s, min = 75.4s, avg = 113.4s, dev = 27.4s

Executed 388 out of 388 tests: 387 tests pass and 1 fails locally.
There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
INFO: Build completed, 1 test FAILED, 2781 total actions


[ID: 6889416] Command finished after 1241 secs, exit value: 3


Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
[10:46:09] Collecting build artifacts from build VM
Build script failed with exit code: 3