Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
[11:24:45] Transferring environment variable script to build VM
[11:24:45] Transferring kokoro_log_reader.py to build VM
[11:24:46] Transferring source code to build VM
[11:24:50] Executing build script on build VM



[ID: 8655033] Executing command via SSH:
export KOKORO_BUILD_NUMBER="98"
export KOKORO_JOB_NAME="grpc/core/v1.56.x/branch/linux/grpc_xds_url_map_python"
source /tmpfs/kokoro-env_vars.sh; cd /tmpfs/src/ ; chmod 755 github/grpc/tools/internal_ci/linux/grpc_xds_url_map_python.sh ; PYTHON_3_VERSION="$(pyenv which python3 2> /dev/null || which python3)" ; PYTHON_2_VERSION="$(pyenv which python2 2> /dev/null || which python2)" ; if "$PYTHON_3_VERSION" -c "import psutil" ; then KOKORO_PYTHON_COMMAND="$PYTHON_3_VERSION" ; else KOKORO_PYTHON_COMMAND="$PYTHON_2_VERSION" ; fi > /dev/null 2>&1 ; echo "export KOKORO_PYTHON_COMMAND="$KOKORO_PYTHON_COMMAND"" > "$HOME/.kokoro_python_vars" ; nohup bash -c "( rm -f /tmpfs/kokoro_build_exit_code ; github/grpc/tools/internal_ci/linux/grpc_xds_url_map_python.sh ; echo \${PIPESTATUS[0]} > /tmpfs/kokoro_build_exit_code ) > /tmpfs/kokoro_build.log 2>&1" > /dev/null 2>&1 & echo $! > /tmpfs/kokoro_build.pid ; source "$HOME/.kokoro_python_vars" ; "$KOKORO_PYTHON_COMMAND" /tmpfs/kokoro_log_reader.py /tmpfs/kokoro_build.log /tmpfs/kokoro_build_exit_code /tmpfs/kokoro_build.pid /tmpfs/kokoro_log_reader.pid --start_byte 0

Sourcing test driver install script from: https://raw.githubusercontent.com/XuanWang-Amos/grpc/print_error_message_before_treadown/tools/internal_ci/linux/grpc_xds_k8s_install_test_driver.sh
Activated GKE cluster: GKE_CLUSTER_NAME=interop-test-psm-basic GKE_CLUSTER_ZONE=us-central1-c
+ [[ -n /tmpfs/src ]]
+ kokoro_setup_test_driver grpc
+ set +x
Kokoro Ubuntu version:
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 22.04.2 LTS
Release: 22.04
Codename: jammy
Python 3.10.6
pip 22.0.2 from /usr/lib/python3/dist-packages/pip (python 3.10)
Sponge properties:
TESTS_FORMAT_VERSION,2
TESTGRID_EXCLUDE,1
GIT_ORIGIN_URL,https://github.com/grpc/grpc.git
GIT_COMMIT_SHORT,f0f5ed4dd3
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 128497 files and directories currently installed.)
Removing needrestart (3.5-5ubuntu2.1) ...
Processing triggers for man-db (2.10.2-1) ...
W: https://packages.cloud.google.com/apt/dists/cloud-sdk/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 128442 files and directories currently installed.)
Removing libintl-xs-perl (1.26-3build2) ...
Removing libintl-perl (1.26-3build2) ...
Removing libmodule-find-perl (0.15-1) ...
Removing libmodule-scandeps-perl (1.31-1) ...
Removing libproc-processtable-perl:amd64 (0.634-1build1) ...
Removing libsort-naturally-perl (1.03-2) ...
Removing libterm-readkey-perl (2.38-1build4) ...
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 128042 files and directories currently installed.)
Preparing to unpack .../00-python3.10-dev_3.10.12-1~22.04.2_amd64.deb ...
Unpacking python3.10-dev (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Preparing to unpack .../01-libpython3.10-dev_3.10.12-1~22.04.2_amd64.deb ...
Unpacking libpython3.10-dev:amd64 (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Preparing to unpack .../02-libpython3.10_3.10.12-1~22.04.2_amd64.deb ...
Unpacking libpython3.10:amd64 (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Preparing to unpack .../03-python3.10_3.10.12-1~22.04.2_amd64.deb ...
Unpacking python3.10 (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Preparing to unpack .../04-libpython3.10-stdlib_3.10.12-1~22.04.2_amd64.deb ...
Unpacking libpython3.10-stdlib:amd64 (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Preparing to unpack .../05-python3.10-minimal_3.10.12-1~22.04.2_amd64.deb ...
Unpacking python3.10-minimal (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Preparing to unpack .../06-libpython3.10-minimal_3.10.12-1~22.04.2_amd64.deb ...
Unpacking libpython3.10-minimal:amd64 (3.10.12-1~22.04.2) over (3.10.6-1~22.04.2ubuntu1) ...
Selecting previously unselected package google-cloud-sdk-gke-gcloud-auth-plugin.
Preparing to unpack .../07-google-cloud-sdk-gke-gcloud-auth-plugin_442.0.0-0_amd64.deb ...
Unpacking google-cloud-sdk-gke-gcloud-auth-plugin (442.0.0-0) ...
Selecting previously unselected package kubectl.
Preparing to unpack .../08-kubectl_1.27.4-00_amd64.deb ...
Unpacking kubectl (1.27.4-00) ...
Selecting previously unselected package python3-pip-whl.
Preparing to unpack .../09-python3-pip-whl_22.0.2+dfsg-1ubuntu0.3_all.deb ...
Unpacking python3-pip-whl (22.0.2+dfsg-1ubuntu0.3) ...
Selecting previously unselected package python3-setuptools-whl.
Preparing to unpack .../10-python3-setuptools-whl_59.6.0-1.2ubuntu0.22.04.1_all.deb ...
Unpacking python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ...
Selecting previously unselected package python3.10-venv.
Preparing to unpack .../11-python3.10-venv_3.10.12-1~22.04.2_amd64.deb ...
Unpacking python3.10-venv (3.10.12-1~22.04.2) ...
Setting up python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ...
Setting up python3-pip-whl (22.0.2+dfsg-1ubuntu0.3) ...
Setting up google-cloud-sdk-gke-gcloud-auth-plugin (442.0.0-0) ...
Setting up kubectl (1.27.4-00) ...
Setting up libpython3.10-minimal:amd64 (3.10.12-1~22.04.2) ...
Setting up python3.10-minimal (3.10.12-1~22.04.2) ...
Setting up libpython3.10-stdlib:amd64 (3.10.12-1~22.04.2) ...
Setting up libpython3.10:amd64 (3.10.12-1~22.04.2) ...
Setting up python3.10 (3.10.12-1~22.04.2) ...
Setting up libpython3.10-dev:amd64 (3.10.12-1~22.04.2) ...
Setting up python3.10-dev (3.10.12-1~22.04.2) ...
Setting up python3.10-venv (3.10.12-1~22.04.2) ...
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.1) ...
Fetching cluster endpoint and auth data.
kubeconfig entry generated for interop-test-psm-basic.
Cloning driver to https://github.com/XuanWang-Amos/grpc.git branch print_error_message_before_treadown to /tmp/tmp.qFY6iMjIkq/grpc
Cloning into '/tmp/tmp.qFY6iMjIkq/grpc'...
Install python dependencies
Creating python virtual environment: /tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv
Collecting Mako==1.2.4 (from -r requirements.lock (line 1))
Downloading Mako-1.2.4-py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.7/78.7 kB 2.2 MB/s eta 0:00:00
Collecting PyYAML==6.0 (from -r requirements.lock (line 2))
Downloading PyYAML-6.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (682 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 682.2/682.2 kB 8.0 MB/s eta 0:00:00
Collecting absl-py==0.15.0 (from -r requirements.lock (line 3))
Downloading absl_py-0.15.0-py3-none-any.whl (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.0/132.0 kB 7.7 MB/s eta 0:00:00
Collecting google-api-python-client==1.12.11 (from -r requirements.lock (line 4))
Downloading google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.1/62.1 kB 8.9 MB/s eta 0:00:00
Collecting google-cloud-secret-manager==2.15.1 (from -r requirements.lock (line 5))
Downloading google_cloud_secret_manager-2.15.1-py2.py3-none-any.whl (100 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100.4/100.4 kB 11.4 MB/s eta 0:00:00
Collecting grpcio==1.51.1 (from -r requirements.lock (line 6))
Downloading grpcio-1.51.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.8/4.8 MB 12.5 MB/s eta 0:00:00
Collecting grpcio-health-checking==1.48.2 (from -r requirements.lock (line 7))
Downloading grpcio_health_checking-1.48.2-py3-none-any.whl (18 kB)
Collecting grpcio-tools==1.48.2 (from -r requirements.lock (line 8))
Downloading grpcio_tools-1.48.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 31.7 MB/s eta 0:00:00
Collecting grpcio-channelz==1.48.2 (from -r requirements.lock (line 9))
Downloading grpcio_channelz-1.48.2-py3-none-any.whl (21 kB)
Collecting kubernetes==25.3.0 (from -r requirements.lock (line 10))
Downloading kubernetes-25.3.0-py2.py3-none-any.whl (1.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 35.9 MB/s eta 0:00:00
Collecting six==1.16.0 (from -r requirements.lock (line 11))
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting tenacity==6.3.1 (from -r requirements.lock (line 12))
Downloading tenacity-6.3.1-py2.py3-none-any.whl (36 kB)
Collecting packaging==21.3 (from -r requirements.lock (line 13))
Downloading packaging-21.3-py3-none-any.whl (40 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.8/40.8 kB 6.2 MB/s eta 0:00:00
Collecting Pygments==2.14.0 (from -r requirements.lock (line 14))
Downloading Pygments-2.14.0-py3-none-any.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 35.1 MB/s eta 0:00:00
Collecting python-dateutil==2.8.2 (from -r requirements.lock (line 15))
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 27.8 MB/s eta 0:00:00
Collecting protobuf==3.20.3 (from -r requirements.lock (line 16))
Downloading protobuf-3.20.3-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 41.3 MB/s eta 0:00:00
Collecting xds-protos==0.0.11 (from -r requirements.lock (line 17))
Downloading xds_protos-0.0.11-py3-none-any.whl (1.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 44.0 MB/s eta 0:00:00
Collecting cachetools==5.3.0 (from -r requirements.lock (line 19))
Downloading cachetools-5.3.0-py3-none-any.whl (9.3 kB)
Collecting certifi==2022.12.7 (from -r requirements.lock (line 20))
Downloading certifi-2022.12.7-py3-none-any.whl (155 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 23.0 MB/s eta 0:00:00
Collecting charset-normalizer==3.0.1 (from -r requirements.lock (line 21))
Downloading charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 198.8/198.8 kB 29.9 MB/s eta 0:00:00
Collecting google-api-core==2.11.0 (from -r requirements.lock (line 22))
Downloading google_api_core-2.11.0-py3-none-any.whl (120 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.3/120.3 kB 17.4 MB/s eta 0:00:00
Collecting google-auth==2.16.0 (from -r requirements.lock (line 23))
Downloading google_auth-2.16.0-py2.py3-none-any.whl (177 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 177.8/177.8 kB 20.1 MB/s eta 0:00:00
Collecting google-auth-httplib2==0.1.0 (from -r requirements.lock (line 24))
Downloading google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting googleapis-common-protos==1.58.0 (from -r requirements.lock (line 25))
Downloading googleapis_common_protos-1.58.0-py2.py3-none-any.whl (223 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 223.0/223.0 kB 29.6 MB/s eta 0:00:00
Collecting grpc-google-iam-v1==0.12.6 (from -r requirements.lock (line 26))
Downloading grpc_google_iam_v1-0.12.6-py2.py3-none-any.whl (26 kB)
Collecting grpcio-status==1.48.2 (from -r requirements.lock (line 27))
Downloading grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting httplib2==0.21.0 (from -r requirements.lock (line 28))
Downloading httplib2-0.21.0-py3-none-any.whl (96 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96.8/96.8 kB 15.0 MB/s eta 0:00:00
Collecting idna==3.4 (from -r requirements.lock (line 29))
Downloading idna-3.4-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 9.2 MB/s eta 0:00:00
Collecting MarkupSafe==2.1.2 (from -r requirements.lock (line 30))
Downloading MarkupSafe-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting oauthlib==3.2.2 (from -r requirements.lock (line 31))
Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 20.1 MB/s eta 0:00:00
Collecting proto-plus==1.22.2 (from -r requirements.lock (line 32))
Downloading proto_plus-1.22.2-py3-none-any.whl (47 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.9/47.9 kB 6.7 MB/s eta 0:00:00
Collecting pyasn1==0.4.8 (from -r requirements.lock (line 33))
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 kB 11.8 MB/s eta 0:00:00
Collecting pyasn1-modules==0.2.8 (from -r requirements.lock (line 34))
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 19.7 MB/s eta 0:00:00
Collecting pyparsing==3.0.9 (from -r requirements.lock (line 35))
Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.3/98.3 kB 15.1 MB/s eta 0:00:00
Collecting requests==2.28.2 (from -r requirements.lock (line 36))
Downloading requests-2.28.2-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 8.8 MB/s eta 0:00:00
Collecting requests-oauthlib==1.3.1 (from -r requirements.lock (line 37))
Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting rsa==4.9 (from -r requirements.lock (line 38))
Downloading rsa-4.9-py3-none-any.whl (34 kB)
Collecting uritemplate==3.0.1 (from -r requirements.lock (line 39))
Downloading uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Collecting urllib3==1.26.14 (from -r requirements.lock (line 40))
Downloading urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.6/140.6 kB 14.3 MB/s eta 0:00:00
Collecting websocket-client==1.5.1 (from -r requirements.lock (line 41))
Downloading websocket_client-1.5.1-py3-none-any.whl (55 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.9/55.9 kB 6.1 MB/s eta 0:00:00
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.10.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3.0.0dev,>=1.34.0 (from google-cloud-secret-manager==2.15.1->-r requirements.lock (line 5))
Obtaining dependency information for google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.10.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3.0.0dev,>=1.34.0 from https://files.pythonhosted.org/packages/6e/c4/c3cd048b6cbeba8d9ae50dd7643ac065b85237338aa7501b0efae91eb4d9/google_api_core-2.11.1-py3-none-any.whl.metadata
Downloading google_api_core-2.11.1-py3-none-any.whl.metadata (2.7 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.10/site-packages (from grpcio-tools==1.48.2->-r requirements.lock (line 8)) (68.0.0)
Collecting googleapis-common-protos[grpc]<2.0.0dev,>=1.56.0 (from grpc-google-iam-v1==0.12.6->-r requirements.lock (line 26))
Obtaining dependency information for googleapis-common-protos[grpc]<2.0.0dev,>=1.56.0 from https://files.pythonhosted.org/packages/a7/bc/416a1ffeba4dcd072bc10523dac9ed97f2e7fc4b760580e2bdbdc1e2afdd/googleapis_common_protos-1.60.0-py2.py3-none-any.whl.metadata
Downloading googleapis_common_protos-1.60.0-py2.py3-none-any.whl.metadata (1.5 kB)
INFO: pip is looking at multiple versions of google-api-core[grpc] to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of googleapis-common-protos[grpc] to determine which version is compatible with other requirements. This could take a while.
Obtaining dependency information for googleapis-common-protos[grpc]<2.0.0dev,>=1.56.0 from https://files.pythonhosted.org/packages/b3/b7/bbaa556e9ff0580f408c64ccf4db0c1414eec79e7151d33a10bc209ffb6d/googleapis_common_protos-1.59.1-py2.py3-none-any.whl.metadata
Downloading googleapis_common_protos-1.59.1-py2.py3-none-any.whl.metadata (1.5 kB)
Downloading googleapis_common_protos-1.59.0-py2.py3-none-any.whl (223 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 223.6/223.6 kB 32.4 MB/s eta 0:00:00
Installing collected packages: pyasn1, charset-normalizer, websocket-client, urllib3, uritemplate, six, rsa, PyYAML, pyparsing, Pygments, pyasn1-modules, protobuf, oauthlib, MarkupSafe, idna, grpcio, certifi, cachetools, xds-protos, tenacity, requests, python-dateutil, proto-plus, packaging, Mako, httplib2, grpcio-tools, grpcio-health-checking, grpcio-channelz, googleapis-common-protos, google-auth, absl-py, requests-oauthlib, grpcio-status, google-auth-httplib2, google-api-core, kubernetes, grpc-google-iam-v1, google-api-python-client, google-cloud-secret-manager
Successfully installed Mako-1.2.4 MarkupSafe-2.1.2 PyYAML-6.0 Pygments-2.14.0 absl-py-0.15.0 cachetools-5.3.0 certifi-2022.12.7 charset-normalizer-3.0.1 google-api-core-2.11.0 google-api-python-client-1.12.11 google-auth-2.16.0 google-auth-httplib2-0.1.0 google-cloud-secret-manager-2.15.1 googleapis-common-protos-1.58.0 grpc-google-iam-v1-0.12.6 grpcio-1.51.1 grpcio-channelz-1.48.2 grpcio-health-checking-1.48.2 grpcio-status-1.48.2 grpcio-tools-1.48.2 httplib2-0.21.0 idna-3.4 kubernetes-25.3.0 oauthlib-3.2.2 packaging-21.3 proto-plus-1.22.2 protobuf-3.20.3 pyasn1-0.4.8 pyasn1-modules-0.2.8 pyparsing-3.0.9 python-dateutil-2.8.2 requests-2.28.2 requests-oauthlib-1.3.1 rsa-4.9 six-1.16.0 tenacity-6.3.1 uritemplate-3.0.1 urllib3-1.26.14 websocket-client-1.5.1 xds-protos-0.0.11
Installed Python packages:
Package Version
--------------------------- ---------
absl-py 0.15.0
cachetools 5.3.0
certifi 2022.12.7
charset-normalizer 3.0.1
google-api-core 2.11.0
google-api-python-client 1.12.11
google-auth 2.16.0
google-auth-httplib2 0.1.0
google-cloud-secret-manager 2.15.1
googleapis-common-protos 1.58.0
grpc-google-iam-v1 0.12.6
grpcio 1.51.1
grpcio-channelz 1.48.2
grpcio-health-checking 1.48.2
grpcio-status 1.48.2
grpcio-tools 1.48.2
httplib2 0.21.0
idna 3.4
kubernetes 25.3.0
Mako 1.2.4
MarkupSafe 2.1.2
oauthlib 3.2.2
packaging 21.3
pip 23.2.1
proto-plus 1.22.2
protobuf 3.20.3
pyasn1 0.4.8
pyasn1-modules 0.2.8
Pygments 2.14.0
pyparsing 3.0.9
python-dateutil 2.8.2
PyYAML 6.0
requests 2.28.2
requests-oauthlib 1.3.1
rsa 4.9
setuptools 68.0.0
six 1.16.0
tenacity 6.3.1
uritemplate 3.0.1
urllib3 1.26.14
websocket-client 1.5.1
xds-protos 0.0.11
Generate python code from grpc.testing protos: src/proto/grpc/testing/test.proto src/proto/grpc/testing/messages.proto src/proto/grpc/testing/empty.proto
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/grpc_tools/protoc.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
Generated files /tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/src/proto/grpc/testing:
total 84
-rw-rw-r-- 1 kbuilder kbuilder 1163 Aug 10 18:26 empty_pb2.py
-rw-rw-r-- 1 kbuilder kbuilder 159 Aug 10 18:26 empty_pb2_grpc.py
-rw-rw-r-- 1 kbuilder kbuilder 29462 Aug 10 18:26 messages_pb2.py
-rw-rw-r-- 1 kbuilder kbuilder 159 Aug 10 18:26 messages_pb2_grpc.py
-rw-rw-r-- 1 kbuilder kbuilder 3934 Aug 10 18:26 test_pb2.py
-rw-rw-r-- 1 kbuilder kbuilder 34950 Aug 10 18:26 test_pb2_grpc.py
Client image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
┌──────────────────────────────────────────────────┬──────────────┬─────────────────────┐
│ TAGS │ DIGEST │ TIMESTAMP │
├──────────────────────────────────────────────────┼──────────────┼─────────────────────┤
│ f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7,v1.56.x │ 3c42b2b44a35 │ 2023-07-26T03:13:41 │
└──────────────────────────────────────────────────┴──────────────┴─────────────────────┘
Skipping Python test app build
mkdir: created directory '/tmpfs/src/artifacts/grpc/core/v1.56.x/branch/linux/grpc_xds_url_map_python/url_map'
+ python3 -m tests.url_map --flagfile=config/grpc-testing.cfg --flagfile=config/url-map.cfg --kube_context=gke_grpc-testing_us-central1-c_interop-test-psm-basic --client_image=gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7 --testing_version=dev-v1.56.x --collect_app_logs --log_dir=/tmpfs/src/artifacts/grpc/core/v1.56.x/branch/linux/grpc_xds_url_map_python/url_map --xml_output_file=/tmpfs/src/artifacts/grpc/core/v1.56.x/branch/linux/grpc_xds_url_map_python/url_map/sponge_log.xml
+ tee /tmpfs/src/artifacts/grpc/core/v1.56.x/branch/linux/grpc_xds_url_map_python/url_map/sponge_log.log
Running tests under Python 3.10.12: /tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/bin/python3
I0810 18:26:12.360403 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestHeaderBasedAffinity -----
I0810 18:26:12.360616 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:26:12.360959 139712423387136 skips.py:121] Skipping TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
[ SKIPPED ] setUpClass (affinity_test.TestHeaderBasedAffinity)
I0810 18:26:12.361352 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestHeaderBasedAffinityMultipleHeaders -----
I0810 18:26:12.361413 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:26:12.361487 139712423387136 skips.py:121] Skipping TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
[ SKIPPED ] setUpClass (affinity_test.TestHeaderBasedAffinityMultipleHeaders)
I0810 18:26:12.361626 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestBasicCsds -----
I0810 18:26:12.361690 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:26:12.361794 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:26:12.362153 139712423387136 xds_url_map_test_resources.py:158] GcpResourceManager: resource prefix=interop-psm-url-map, suffix=
I0810 18:26:13.575726 139712423387136 k8s.py:129] Using kubernetes context "gke_grpc-testing_us-central1-c_interop-test-psm-basic", active host: https://130.211.205.238
I0810 18:26:13.986609 139712423387136 logs.py:31] Log root dir: /tmpfs/src/artifacts/grpc/core/v1.56.x/branch/linux/grpc_xds_url_map_python/url_map
I0810 18:26:13.987428 139712423387136 xds_url_map_test_resources.py:221] Strategy of GCP resources management: reuse
I0810 18:26:13.987573 139712423387136 xds_url_map_test_resources.py:261] GcpResourceManager: skipping setup for strategy [reuse]
I0810 18:26:13.987821 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1826-lkj0t
I0810 18:26:13.988134 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1826-lkj0t: server_target=xds:///csds.test-basic-csds:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:26:13.988432 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1826-lkj0t%22;timeRange=2023-08-10T18:26:13.988245Z%2F2023-08-10T18:56:13.988245Z?project=grpc-testing
I0810 18:26:13.994140 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1826-lkj0t
labels:
name: interop-psm-url-map-client-20230810-1826-lkj0t
owner: xds-k8s-interop-test
...

I0810 18:26:14.060554 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1826-lkj0t created
I0810 18:26:14.070064 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1826-lkj0t
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-q7ip5fqg
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-q7ip5fqg
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-q7ip5fqg
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///csds.test-basic-csds:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:26:14.133579 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:26:14.133908 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:26:15.196185 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-586bf494c8-bzp24']
I0810 18:26:15.196517 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-586bf494c8-bzp24 to start
I0810 18:26:17.265269 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-586bf494c8-bzp24 ready, IP: 10.60.3.25
I0810 18:26:17.265617 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-586bf494c8-bzp24 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1826-lkj0t_psm-grpc-client-586bf494c8-bzp24.log
I0810 18:26:17.266136 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-586bf494c8-bzp24
I0810 18:26:17.266417 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:26:24.375085 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
[ RUN ] csds_test.TestBasicCsds.test_client_config
I0810 18:26:24.392033 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:26:39.415575 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:26:54.438970 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:27:09.462016 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:27:24.484662 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:27:39.507575 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:27:54.530728 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:28:09.553852 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:28:24.576250 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:28:39.599989 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:28:54.622392 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:29:09.644955 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:29:24.667307 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:29:39.689723 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:29:54.712807 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:30:09.735792 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:30:24.757147 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:30:39.780596 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:30:54.803669 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:31:09.826572 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:31:24.849323 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:31:39.873852 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:31:54.899837 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:32:09.922875 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:32:24.945217 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:32:39.968126 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:32:54.991569 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:33:10.014544 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:33:25.037662 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:33:40.060834 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:33:55.083726 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:34:10.108094 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:34:25.130273 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:34:40.154933 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:34:55.178819 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:35:10.202316 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:35:25.224917 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:35:40.248023 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:35:55.270041 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:36:10.293020 139712423387136 retryers.py:206] Retrying framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config in 15.0 seconds as it raised AssertionError: 2 != 3.
I0810 18:36:25.330804 139712423387136 xds_url_map_testcase.py:494] latest xDS config:
---
genericXdsConfigs:
- clientStatus: ACKED
lastUpdated: '2023-08-10T18:26:22.938590581Z'
name: cloud-internal-istio:cloud_mp_830293263384_3527413874041835445
typeUrl: type.googleapis.com/envoy.config.cluster.v3.Cluster
versionInfo: '1691691963278507316'
xdsConfig: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.config.cluster.v3.Cluster
- - name
- cloud-internal-istio:cloud_mp_830293263384_3527413874041835445
- - type
- EDS
- - edsClusterConfig
- edsConfig:
ads: {}
initialFetchTimeout: 15s
resourceApiVersion: V3
- - connectTimeout
- 30s
- - circuitBreakers
- thresholds:
- maxConnections: 2147483647
maxPendingRequests: 2147483647
maxRequests: 2147483647
maxRetries: 2147483647
- - http2ProtocolOptions
- maxConcurrentStreams: 100
- - metadata
- filterMetadata:
com.google.trafficdirector:
backend_service_name: interop-psm-url-map-backend-service
backend_service_project_number: 830293263384.0
- - commonLbConfig
- healthyPanicThreshold:
value: 1.0
localityWeightedLbConfig: {}
- - altStatName
- /projects/830293263384/global/backendServices/interop-psm-url-map-backend-service
- - lrsServer
- self: {}
- clientStatus: ACKED
lastUpdated: '2023-08-10T18:26:22.954590629Z'
name: cloud-internal-istio:cloud_mp_830293263384_3527413874041835445
typeUrl: type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment
versionInfo: '1'
xdsConfig: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment
- - clusterName
- cloud-internal-istio:cloud_mp_830293263384_3527413874041835445
- - endpoints
- - lbEndpoints:
- endpoint:
address:
socketAddress:
address: 10.60.2.2
portValue: 8080
healthStatus: HEALTHY
loadBalancingWeight: 1000000
locality:
subZone: ia:us-central1-c_2616348914244931337_neg
- clientStatus: ACKED
lastUpdated: '2023-08-10T18:26:22.909590631Z'
name: csds.test-basic-csds:8848
typeUrl: type.googleapis.com/envoy.config.listener.v3.Listener
versionInfo: '1691691963278507316'
xdsConfig: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.config.listener.v3.Listener
- - name
- csds.test-basic-csds:8848
- - apiListener
- apiListener: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.extensions.filters.network.http_connection_manager.v3.HttpConnectionManager
- - statPrefix
- trafficdirector
- - rds
- configSource:
ads: {}
resourceApiVersion: V3
routeConfigName: URL_MAP/830293263384_interop-psm-url-map-url-map_2_csds.test-basic-csds:8848
- - httpFilters
- - name: envoy.filters.http.fault
typedConfig: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.extensions.filters.http.fault.v3.HTTPFault
- name: envoy.filters.http.router
typedConfig: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.extensions.filters.http.router.v3.Router
- - suppressEnvoyHeaders
- true
- - normalizePath
- true
- - mergeSlashes
- true
- clientStatus: ACKED
lastUpdated: '2023-08-10T18:26:22.921590630Z'
name: URL_MAP/830293263384_interop-psm-url-map-url-map_2_csds.test-basic-csds:8848
typeUrl: type.googleapis.com/envoy.config.route.v3.RouteConfiguration
versionInfo: '1691691963278507316'
xdsConfig: !!python/object/apply:collections.OrderedDict
- - - '@type'
- type.googleapis.com/envoy.config.route.v3.RouteConfiguration
- - name
- URL_MAP/830293263384_interop-psm-url-map-url-map_2_csds.test-basic-csds:8848
- - virtualHosts
- - domains:
- csds.test-basic-csds:8848
routes:
- match:
prefix: ''
name: URL_MAP/830293263384_interop-psm-url-map-url-map_2_csds.test-basic-csds:8848-route-0
route:
cluster: cloud-internal-istio:cloud_mp_830293263384_3527413874041835445
retryPolicy:
numRetries: 1
perTryTimeout: 30s
retryOn: gateway-error
timeout: 30s
node:
clientFeatures:
- envoy.lb.does_not_support_overprovisioning
cluster: cluster
id: projects/830293263384/networks/default-vpc/nodes/2a1b5055-e855-4a61-9d3b-b9ea03140e6d
locality:
zone: us-central1-c
metadata:
INSTANCE_IP: 10.60.3.25
TRAFFICDIRECTOR_GCP_PROJECT_NUMBER: '830293263384'
TRAFFICDIRECTOR_NETWORK_NAME: default-vpc
userAgentName: gRPC C-core linux
userAgentVersion: C-core 33.0.0
...

[ FAILED ] csds_test.TestBasicCsds.test_client_config
I0810 18:36:25.332329 139712423387136 base_testcase.py:34] ----- TestCase csds_test.TestBasicCsds.test_client_config FAILED -----
E0810 18:36:25.332529 139712423387136 base_testcase.py:53] ERROR Traceback in: csds_test.TestBasicCsds.test_client_config:
E0810 18:36:25.332598 139712423387136 base_testcase.py:54] Traceback (most recent call last):
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/framework/xds_url_map_testcase.py", line 492, in test_client_config
retryer(self._fetch_and_check_xds_config)
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 423, in __call__
do = self.iter(retry_state=retry_state)
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 369, in iter
return self.retry_error_callback(retry_state=retry_state)
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/framework/helpers/retryers.py", line 141, in error_handler
raise RetryError(
framework.helpers.retryers.RetryError: Retry error calling framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config: timeout 0:10:00 (h:mm:ss) exceeded. Last exception: AssertionError: 2 != 3

I0810 18:36:25.332715 139712423387136 xds_url_map_testcase.py:478] Aborting TestBasicCsds
I0810 18:36:25.332844 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestBasicCsds teardown -----
I0810 18:36:25.387166 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 18:37:05.533678 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1826-lkj0t
I0810 18:37:35.618270 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:37:35.618710 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-q7ip5fqg:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1826-lkj0t%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-q7ip5fqg%22;timeRange=2023-08-10T18:26:13.988238Z%2F2023-08-10T18:37:35.618019Z?project=grpc-testing
I0810 18:37:35.618911 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestAbortHalf -----
I0810 18:37:35.618993 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:37:35.619123 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:37:35.619285 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1837-sgb13
I0810 18:37:35.619692 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1837-sgb13: server_target=xds:///fault-injection.test-abort-half:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:37:35.619905 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1837-sgb13%22;timeRange=2023-08-10T18:37:35.619805Z%2F2023-08-10T19:07:35.619805Z?project=grpc-testing
I0810 18:37:35.621973 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1837-sgb13
labels:
name: interop-psm-url-map-client-20230810-1837-sgb13
owner: xds-k8s-interop-test
...

I0810 18:37:35.652247 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1837-sgb13 created
I0810 18:37:35.660562 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1837-sgb13
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-2bj6762x
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-2bj6762x
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-2bj6762x
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///fault-injection.test-abort-half:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:37:35.702254 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:37:35.702538 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:37:36.750658 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-5598758bfb-l668l']
I0810 18:37:36.750972 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-5598758bfb-l668l to start
I0810 18:37:39.826983 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-5598758bfb-l668l ready, IP: 10.60.12.217
I0810 18:37:39.827342 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-5598758bfb-l668l to url_map/test_app_logs/interop-psm-url-map-client-20230810-1837-sgb13_psm-grpc-client-5598758bfb-l668l.log
I0810 18:37:39.827790 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-5598758bfb-l668l
I0810 18:37:39.828130 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:37:45.923864 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:37:45.924397 139712423387136 xds_url_map_testcase.py:478] Aborting TestAbortHalf
I0810 18:37:45.924552 139712423387136 xds_url_map_testcase.py:478] Aborting TestAbortHalf
I0810 18:37:45.924652 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestAbortHalf teardown -----
I0810 18:37:45.938899 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:38:26.098270 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1837-sgb13
I0810 18:38:56.196551 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:38:56.196969 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-2bj6762x:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1837-sgb13%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-2bj6762x%22;timeRange=2023-08-10T18:37:35.619800Z%2F2023-08-10T18:38:56.196343Z?project=grpc-testing
I0810 18:38:56.197129 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestAlwaysAbort -----
I0810 18:38:56.197210 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:38:56.197340 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:38:56.197498 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1838-utzle
I0810 18:38:56.197904 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1838-utzle: server_target=xds:///fault-injection.test-always-abort:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:38:56.198147 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1838-utzle%22;timeRange=2023-08-10T18:38:56.198013Z%2F2023-08-10T19:08:56.198013Z?project=grpc-testing
I0810 18:38:56.200218 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1838-utzle
labels:
name: interop-psm-url-map-client-20230810-1838-utzle
owner: xds-k8s-interop-test
...

I0810 18:38:56.230911 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1838-utzle created
I0810 18:38:56.239457 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1838-utzle
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-avmaam8p
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-avmaam8p
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-avmaam8p
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///fault-injection.test-always-abort:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:38:56.281244 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:38:56.281556 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:38:57.325201 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-5c888bc8c4-fsqtf']
I0810 18:38:57.325565 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-5c888bc8c4-fsqtf to start
I0810 18:39:00.420379 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-5c888bc8c4-fsqtf ready, IP: 10.60.3.28
I0810 18:39:00.420715 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-5c888bc8c4-fsqtf to url_map/test_app_logs/interop-psm-url-map-client-20230810-1838-utzle_psm-grpc-client-5c888bc8c4-fsqtf.log
I0810 18:39:00.421121 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-5c888bc8c4-fsqtf
I0810 18:39:00.421276 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:39:03.487084 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:39:03.487652 139712423387136 xds_url_map_testcase.py:478] Aborting TestAlwaysAbort
I0810 18:39:03.487835 139712423387136 xds_url_map_testcase.py:478] Aborting TestAlwaysAbort
I0810 18:39:03.487945 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestAlwaysAbort teardown -----
I0810 18:39:03.504325 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:39:43.624786 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1838-utzle
I0810 18:40:13.716003 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:40:13.716673 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-avmaam8p:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1838-utzle%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-avmaam8p%22;timeRange=2023-08-10T18:38:56.198007Z%2F2023-08-10T18:40:13.715794Z?project=grpc-testing
I0810 18:40:13.717036 139712423387136 xds_url_map_testcase.py:478] Aborting TestAlwaysDelay
I0810 18:40:13.717281 139712423387136 xds_url_map_testcase.py:478] Aborting TestAlwaysDelay
I0810 18:40:13.717445 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestDelayHalf -----
I0810 18:40:13.717521 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:40:13.717687 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:40:13.717868 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1840-pddsb
I0810 18:40:13.718331 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1840-pddsb: server_target=xds:///fault-injection.test-delay-half:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:40:13.718595 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1840-pddsb%22;timeRange=2023-08-10T18:40:13.718457Z%2F2023-08-10T19:10:13.718457Z?project=grpc-testing
I0810 18:40:13.720912 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1840-pddsb
labels:
name: interop-psm-url-map-client-20230810-1840-pddsb
owner: xds-k8s-interop-test
...

I0810 18:40:13.735287 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1840-pddsb created
I0810 18:40:13.743355 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1840-pddsb
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-kj9v40ze
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-kj9v40ze
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-kj9v40ze
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///fault-injection.test-delay-half:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:40:13.787419 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:40:13.787734 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:40:13.825546 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-857cfcb467-hgn74']
I0810 18:40:13.825909 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-857cfcb467-hgn74 to start
I0810 18:40:16.909135 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-857cfcb467-hgn74 ready, IP: 10.60.3.30
I0810 18:40:16.909462 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-857cfcb467-hgn74 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1840-pddsb_psm-grpc-client-857cfcb467-hgn74.log
I0810 18:40:16.909883 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-857cfcb467-hgn74
I0810 18:40:16.910084 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:40:20.993443 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:40:20.994012 139712423387136 xds_url_map_testcase.py:478] Aborting TestDelayHalf
I0810 18:40:20.994202 139712423387136 xds_url_map_testcase.py:478] Aborting TestDelayHalf
I0810 18:40:20.994307 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestDelayHalf teardown -----
I0810 18:40:21.012251 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:41:01.171712 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1840-pddsb
I0810 18:41:31.257473 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:41:31.257915 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-kj9v40ze:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1840-pddsb%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-kj9v40ze%22;timeRange=2023-08-10T18:40:13.718450Z%2F2023-08-10T18:41:31.257253Z?project=grpc-testing
I0810 18:41:31.258073 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestNonMatchingFaultInjection -----
I0810 18:41:31.258181 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:41:31.258327 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:41:31.258501 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1841-ungmi
I0810 18:41:31.258934 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1841-ungmi: server_target=xds:///fault-injection.test-non-matching-fault-injection:8848 rpc=EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:41:31.259159 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1841-ungmi%22;timeRange=2023-08-10T18:41:31.259053Z%2F2023-08-10T19:11:31.259053Z?project=grpc-testing
I0810 18:41:31.261234 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1841-ungmi
labels:
name: interop-psm-url-map-client-20230810-1841-ungmi
owner: xds-k8s-interop-test
...

I0810 18:41:31.286508 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1841-ungmi created
I0810 18:41:31.295317 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1841-ungmi
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-jqgc5yzp
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-jqgc5yzp
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-jqgc5yzp
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///fault-injection.test-non-matching-fault-injection:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:41:31.338309 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:41:31.338616 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:41:32.385208 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7ffc4d99f-rht92']
I0810 18:41:32.385555 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-7ffc4d99f-rht92 to start
I0810 18:41:34.457996 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-7ffc4d99f-rht92 ready, IP: 10.60.1.209
I0810 18:41:34.458297 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-7ffc4d99f-rht92 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1841-ungmi_psm-grpc-client-7ffc4d99f-rht92.log
I0810 18:41:34.458737 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-7ffc4d99f-rht92
I0810 18:41:34.458952 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:41:41.567604 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:41:41.568121 139712423387136 xds_url_map_testcase.py:478] Aborting TestNonMatchingFaultInjection
I0810 18:41:41.568275 139712423387136 xds_url_map_testcase.py:478] Aborting TestNonMatchingFaultInjection
I0810 18:41:41.568373 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestNonMatchingFaultInjection teardown -----
I0810 18:41:41.584363 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:42:21.710591 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1841-ungmi
I0810 18:42:51.828777 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:42:51.829160 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-jqgc5yzp:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1841-ungmi%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-jqgc5yzp%22;timeRange=2023-08-10T18:41:31.259046Z%2F2023-08-10T18:42:51.828560Z?project=grpc-testing
I0810 18:42:51.829324 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestZeroPercentFaultInjection -----
I0810 18:42:51.829405 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:42:51.829529 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:42:51.829726 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1842-ii9j4
I0810 18:42:51.830123 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1842-ii9j4: server_target=xds:///fault-injection.test-zero-percent-fault-injection:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:42:51.830337 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1842-ii9j4%22;timeRange=2023-08-10T18:42:51.830239Z%2F2023-08-10T19:12:51.830239Z?project=grpc-testing
I0810 18:42:51.832354 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1842-ii9j4
labels:
name: interop-psm-url-map-client-20230810-1842-ii9j4
owner: xds-k8s-interop-test
...

I0810 18:42:51.861081 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1842-ii9j4 created
I0810 18:42:51.869724 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1842-ii9j4
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-9uyjjc4q
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-9uyjjc4q
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-9uyjjc4q
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///fault-injection.test-zero-percent-fault-injection:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:42:51.913367 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:42:51.913673 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:42:52.961112 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7569658945-vx6rm']
I0810 18:42:52.961451 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-7569658945-vx6rm to start
I0810 18:42:56.037154 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-7569658945-vx6rm ready, IP: 10.60.1.210
I0810 18:42:56.037493 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-7569658945-vx6rm to url_map/test_app_logs/interop-psm-url-map-client-20230810-1842-ii9j4_psm-grpc-client-7569658945-vx6rm.log
I0810 18:42:56.037934 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-7569658945-vx6rm
I0810 18:42:56.038136 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:42:59.107959 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:42:59.108538 139712423387136 xds_url_map_testcase.py:478] Aborting TestZeroPercentFaultInjection
I0810 18:42:59.108706 139712423387136 xds_url_map_testcase.py:478] Aborting TestZeroPercentFaultInjection
I0810 18:42:59.108819 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestZeroPercentFaultInjection teardown -----
I0810 18:42:59.130463 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:43:39.263613 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1842-ii9j4
I0810 18:44:09.356291 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:44:09.356696 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-9uyjjc4q:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1842-ii9j4%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-9uyjjc4q%22;timeRange=2023-08-10T18:42:51.830233Z%2F2023-08-10T18:44:09.356071Z?project=grpc-testing
I0810 18:44:09.356928 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestExactMatch -----
I0810 18:44:09.357016 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:44:09.357181 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:44:09.357350 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1844-jngwa
I0810 18:44:09.357784 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1844-jngwa: server_target=xds:///header-matching.test-exact-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:44:09.358016 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1844-jngwa%22;timeRange=2023-08-10T18:44:09.357893Z%2F2023-08-10T19:14:09.357893Z?project=grpc-testing
I0810 18:44:09.360287 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1844-jngwa
labels:
name: interop-psm-url-map-client-20230810-1844-jngwa
owner: xds-k8s-interop-test
...

I0810 18:44:09.370884 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1844-jngwa created
I0810 18:44:09.379736 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1844-jngwa
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-2gwtdk57
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-2gwtdk57
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-2gwtdk57
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///header-matching.test-exact-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:44:09.424270 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:44:09.424577 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:44:10.545076 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-5db574f85b-2m9jr']
I0810 18:44:10.545456 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-5db574f85b-2m9jr to start
I0810 18:44:13.627153 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-5db574f85b-2m9jr ready, IP: 10.60.3.34
I0810 18:44:13.627471 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-5db574f85b-2m9jr to url_map/test_app_logs/interop-psm-url-map-client-20230810-1844-jngwa_psm-grpc-client-5db574f85b-2m9jr.log
I0810 18:44:13.627889 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-5db574f85b-2m9jr
I0810 18:44:13.628085 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:44:16.692490 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:44:16.693045 139712423387136 xds_url_map_testcase.py:478] Aborting TestExactMatch
I0810 18:44:16.693234 139712423387136 xds_url_map_testcase.py:478] Aborting TestExactMatch
I0810 18:44:16.693335 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestExactMatch teardown -----
I0810 18:44:16.708457 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:44:56.874341 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1844-jngwa
I0810 18:45:26.959883 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:45:26.960220 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-2gwtdk57:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1844-jngwa%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-2gwtdk57%22;timeRange=2023-08-10T18:44:09.357888Z%2F2023-08-10T18:45:26.959663Z?project=grpc-testing
I0810 18:45:26.960353 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestInvertMatch -----
I0810 18:45:26.960413 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:45:26.960525 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:45:26.960677 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1845-ca1u5
I0810 18:45:26.961053 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1845-ca1u5: server_target=xds:///header-matching.test-invert-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:45:26.961253 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1845-ca1u5%22;timeRange=2023-08-10T18:45:26.961139Z%2F2023-08-10T19:15:26.961139Z?project=grpc-testing
I0810 18:45:26.963565 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1845-ca1u5
labels:
name: interop-psm-url-map-client-20230810-1845-ca1u5
owner: xds-k8s-interop-test
...

I0810 18:45:26.991224 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1845-ca1u5 created
I0810 18:45:26.999701 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1845-ca1u5
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-weo2p0y5
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-weo2p0y5
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-weo2p0y5
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///header-matching.test-invert-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:45:27.043982 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:45:27.044295 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:45:28.095758 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-b6cfb7579-vd5xm']
I0810 18:45:28.096080 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-b6cfb7579-vd5xm to start
I0810 18:45:31.175154 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-b6cfb7579-vd5xm ready, IP: 10.60.1.213
I0810 18:45:31.175493 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-b6cfb7579-vd5xm to url_map/test_app_logs/interop-psm-url-map-client-20230810-1845-ca1u5_psm-grpc-client-b6cfb7579-vd5xm.log
I0810 18:45:31.175955 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-b6cfb7579-vd5xm
I0810 18:45:31.176148 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:45:34.249544 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:45:34.250219 139712423387136 xds_url_map_testcase.py:478] Aborting TestInvertMatch
I0810 18:45:34.250422 139712423387136 xds_url_map_testcase.py:478] Aborting TestInvertMatch
I0810 18:45:34.250556 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestInvertMatch teardown -----
I0810 18:45:34.265910 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:46:14.388985 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1845-ca1u5
I0810 18:46:44.482570 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:46:44.482975 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-weo2p0y5:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1845-ca1u5%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-weo2p0y5%22;timeRange=2023-08-10T18:45:26.961134Z%2F2023-08-10T18:46:44.482361Z?project=grpc-testing
I0810 18:46:44.483132 139712423387136 xds_url_map_testcase.py:478] Aborting TestPrefixMatch
I0810 18:46:44.483228 139712423387136 xds_url_map_testcase.py:478] Aborting TestPrefixMatch
I0810 18:46:44.483318 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestPresentMatch -----
I0810 18:46:44.483402 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:46:44.483530 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:46:44.483699 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1846-ymjuj
I0810 18:46:44.484078 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1846-ymjuj: server_target=xds:///header-matching.test-present-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:46:44.484262 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1846-ymjuj%22;timeRange=2023-08-10T18:46:44.484165Z%2F2023-08-10T19:16:44.484165Z?project=grpc-testing
I0810 18:46:44.486292 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1846-ymjuj
labels:
name: interop-psm-url-map-client-20230810-1846-ymjuj
owner: xds-k8s-interop-test
...

I0810 18:46:44.496727 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1846-ymjuj created
I0810 18:46:44.504717 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1846-ymjuj
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-8ucy1fqn
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-8ucy1fqn
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-8ucy1fqn
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///header-matching.test-present-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:46:44.547410 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:46:44.547693 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:46:45.598437 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-b974654cd-d7hdz']
I0810 18:46:45.598798 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-b974654cd-d7hdz to start
I0810 18:46:48.681791 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-b974654cd-d7hdz ready, IP: 10.60.3.37
I0810 18:46:48.682183 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-b974654cd-d7hdz to url_map/test_app_logs/interop-psm-url-map-client-20230810-1846-ymjuj_psm-grpc-client-b974654cd-d7hdz.log
I0810 18:46:48.682692 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-b974654cd-d7hdz
I0810 18:46:48.682978 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:46:51.752312 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:46:51.752929 139712423387136 xds_url_map_testcase.py:478] Aborting TestPresentMatch
I0810 18:46:51.753103 139712423387136 xds_url_map_testcase.py:478] Aborting TestPresentMatch
I0810 18:46:51.753204 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestPresentMatch teardown -----
I0810 18:46:51.768498 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:47:31.925830 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1846-ymjuj
I0810 18:48:02.013411 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:48:02.013846 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-8ucy1fqn:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1846-ymjuj%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-8ucy1fqn%22;timeRange=2023-08-10T18:46:44.484159Z%2F2023-08-10T18:48:02.013200Z?project=grpc-testing
I0810 18:48:02.014017 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestRangeMatch -----
I0810 18:48:02.014120 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:48:02.014258 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:48:02.014423 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1848-jyo7x
I0810 18:48:02.014823 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1848-jyo7x: server_target=xds:///header-matching.test-range-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:48:02.015025 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1848-jyo7x%22;timeRange=2023-08-10T18:48:02.014920Z%2F2023-08-10T19:18:02.014920Z?project=grpc-testing
I0810 18:48:02.017056 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1848-jyo7x
labels:
name: interop-psm-url-map-client-20230810-1848-jyo7x
owner: xds-k8s-interop-test
...

I0810 18:48:02.052211 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1848-jyo7x created
I0810 18:48:02.060951 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1848-jyo7x
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-op168nrv
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-op168nrv
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-op168nrv
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///header-matching.test-range-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:48:02.105715 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:48:02.106013 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:48:03.150967 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-568fd5f9c7-w2d22']
I0810 18:48:03.151324 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-568fd5f9c7-w2d22 to start
I0810 18:48:05.215941 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-568fd5f9c7-w2d22 ready, IP: 10.60.6.215
I0810 18:48:05.216282 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-568fd5f9c7-w2d22 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1848-jyo7x_psm-grpc-client-568fd5f9c7-w2d22.log
I0810 18:48:05.216725 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-568fd5f9c7-w2d22
I0810 18:48:05.216918 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:48:15.359599 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:48:15.360145 139712423387136 xds_url_map_testcase.py:478] Aborting TestRangeMatch
I0810 18:48:15.360300 139712423387136 xds_url_map_testcase.py:478] Aborting TestRangeMatch
I0810 18:48:15.360398 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestRangeMatch teardown -----
I0810 18:48:15.375617 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:48:55.501469 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1848-jyo7x
I0810 18:49:25.621053 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:49:25.621461 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-op168nrv:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1848-jyo7x%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-op168nrv%22;timeRange=2023-08-10T18:48:02.014915Z%2F2023-08-10T18:49:25.620840Z?project=grpc-testing
I0810 18:49:25.621622 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestRegexMatch -----
I0810 18:49:25.621701 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:49:25.621847 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:49:25.622035 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1849-w8vx7
I0810 18:49:25.622488 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1849-w8vx7: server_target=xds:///header-matching.test-regex-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:49:25.622709 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1849-w8vx7%22;timeRange=2023-08-10T18:49:25.622598Z%2F2023-08-10T19:19:25.622598Z?project=grpc-testing
I0810 18:49:25.624758 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1849-w8vx7
labels:
name: interop-psm-url-map-client-20230810-1849-w8vx7
owner: xds-k8s-interop-test
...

I0810 18:49:25.665615 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1849-w8vx7 created
I0810 18:49:25.673783 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1849-w8vx7
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-qqqb7c56
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-qqqb7c56
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-qqqb7c56
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///header-matching.test-regex-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:49:25.719024 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:49:25.719325 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:49:26.769506 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-79b4674bcc-nrs59']
I0810 18:49:26.769855 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-79b4674bcc-nrs59 to start
I0810 18:49:29.844886 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-79b4674bcc-nrs59 ready, IP: 10.60.12.230
I0810 18:49:29.845206 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-79b4674bcc-nrs59 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1849-w8vx7_psm-grpc-client-79b4674bcc-nrs59.log
I0810 18:49:29.845604 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-79b4674bcc-nrs59
I0810 18:49:29.845805 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:49:32.914686 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:49:32.915229 139712423387136 xds_url_map_testcase.py:478] Aborting TestRegexMatch
I0810 18:49:32.915376 139712423387136 xds_url_map_testcase.py:478] Aborting TestRegexMatch
I0810 18:49:32.915476 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestRegexMatch teardown -----
I0810 18:49:32.930385 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:50:13.052753 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1849-w8vx7
I0810 18:50:43.141494 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:50:43.141840 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-qqqb7c56:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1849-w8vx7%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-qqqb7c56%22;timeRange=2023-08-10T18:49:25.622592Z%2F2023-08-10T18:50:43.141283Z?project=grpc-testing
I0810 18:50:43.141968 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestSuffixMatch -----
I0810 18:50:43.142028 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:50:43.142173 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:50:43.142320 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1850-c9lf9
I0810 18:50:43.142692 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1850-c9lf9: server_target=xds:///header-matching.test-suffix-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:50:43.142857 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1850-c9lf9%22;timeRange=2023-08-10T18:50:43.142759Z%2F2023-08-10T19:20:43.142759Z?project=grpc-testing
I0810 18:50:43.144853 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1850-c9lf9
labels:
name: interop-psm-url-map-client-20230810-1850-c9lf9
owner: xds-k8s-interop-test
...

I0810 18:50:43.155068 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1850-c9lf9 created
I0810 18:50:43.163116 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1850-c9lf9
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-412zr45w
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-412zr45w
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-412zr45w
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///header-matching.test-suffix-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:50:43.204324 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:50:43.204631 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:50:44.249405 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-84f56cffd8-7gfvd']
I0810 18:50:44.249760 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-84f56cffd8-7gfvd to start
I0810 18:50:47.322744 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-84f56cffd8-7gfvd ready, IP: 10.60.0.30
I0810 18:50:47.323061 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-84f56cffd8-7gfvd to url_map/test_app_logs/interop-psm-url-map-client-20230810-1850-c9lf9_psm-grpc-client-84f56cffd8-7gfvd.log
I0810 18:50:47.323446 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-84f56cffd8-7gfvd
I0810 18:50:47.323635 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:50:50.391489 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:50:50.392083 139712423387136 xds_url_map_testcase.py:478] Aborting TestSuffixMatch
I0810 18:50:50.392236 139712423387136 xds_url_map_testcase.py:478] Aborting TestSuffixMatch
I0810 18:50:50.392361 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestSuffixMatch teardown -----
I0810 18:50:50.407425 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:51:30.570447 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1850-c9lf9
I0810 18:52:00.654693 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:52:00.655116 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-412zr45w:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1850-c9lf9%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-412zr45w%22;timeRange=2023-08-10T18:50:43.142754Z%2F2023-08-10T18:52:00.654439Z?project=grpc-testing
I0810 18:52:00.655291 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestMetadataFilterMatchAll -----
I0810 18:52:00.655397 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:52:00.655527 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:52:00.655708 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1852-92jyf
I0810 18:52:00.656096 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1852-92jyf: server_target=xds:///metadata-filter.test-metadata-filter-match-all:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:52:00.656325 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1852-92jyf%22;timeRange=2023-08-10T18:52:00.656221Z%2F2023-08-10T19:22:00.656221Z?project=grpc-testing
I0810 18:52:00.658395 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1852-92jyf
labels:
name: interop-psm-url-map-client-20230810-1852-92jyf
owner: xds-k8s-interop-test
...

I0810 18:52:00.680700 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1852-92jyf created
I0810 18:52:00.689136 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1852-92jyf
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-mtmzxixg
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-mtmzxixg
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-mtmzxixg
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///metadata-filter.test-metadata-filter-match-all:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:52:00.732356 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:52:00.732650 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:52:01.780425 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-69887996b5-k77fd']
I0810 18:52:01.780771 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-69887996b5-k77fd to start
I0810 18:52:04.859628 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-69887996b5-k77fd ready, IP: 10.60.3.43
I0810 18:52:04.859943 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-69887996b5-k77fd to url_map/test_app_logs/interop-psm-url-map-client-20230810-1852-92jyf_psm-grpc-client-69887996b5-k77fd.log
I0810 18:52:04.860315 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-69887996b5-k77fd
I0810 18:52:04.860455 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:52:07.925440 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:52:07.925986 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchAll
I0810 18:52:07.926153 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchAll
I0810 18:52:07.926259 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestMetadataFilterMatchAll teardown -----
I0810 18:52:07.941192 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:52:48.065037 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1852-92jyf
I0810 18:53:18.161242 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:53:18.161669 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-mtmzxixg:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1852-92jyf%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-mtmzxixg%22;timeRange=2023-08-10T18:52:00.656215Z%2F2023-08-10T18:53:18.161018Z?project=grpc-testing
I0810 18:53:18.161855 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestMetadataFilterMatchAny -----
I0810 18:53:18.161939 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:53:18.162070 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:53:18.162291 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1853-mt1uq
I0810 18:53:18.162705 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1853-mt1uq: server_target=xds:///metadata-filter.test-metadata-filter-match-any:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:53:18.162938 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1853-mt1uq%22;timeRange=2023-08-10T18:53:18.162828Z%2F2023-08-10T19:23:18.162828Z?project=grpc-testing
I0810 18:53:18.164958 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1853-mt1uq
labels:
name: interop-psm-url-map-client-20230810-1853-mt1uq
owner: xds-k8s-interop-test
...

I0810 18:53:18.177294 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1853-mt1uq created
I0810 18:53:18.185816 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1853-mt1uq
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-naw99202
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-naw99202
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-naw99202
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///metadata-filter.test-metadata-filter-match-any:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:53:18.229085 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:53:18.229454 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:53:19.275920 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-5cf9b8d88-b8lzl']
I0810 18:53:19.276252 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-5cf9b8d88-b8lzl to start
I0810 18:53:21.339741 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-5cf9b8d88-b8lzl ready, IP: 10.60.1.222
I0810 18:53:21.340062 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-5cf9b8d88-b8lzl to url_map/test_app_logs/interop-psm-url-map-client-20230810-1853-mt1uq_psm-grpc-client-5cf9b8d88-b8lzl.log
I0810 18:53:21.340452 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-5cf9b8d88-b8lzl
I0810 18:53:21.340659 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:53:25.416960 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:53:25.417473 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchAny
I0810 18:53:25.417633 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchAny
I0810 18:53:25.417742 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestMetadataFilterMatchAny teardown -----
I0810 18:53:25.432170 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:54:05.595066 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1853-mt1uq
I0810 18:54:35.687266 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:54:35.687685 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-naw99202:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1853-mt1uq%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-naw99202%22;timeRange=2023-08-10T18:53:18.162822Z%2F2023-08-10T18:54:35.687051Z?project=grpc-testing
I0810 18:54:35.687880 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestMetadataFilterMatchAnyAndAll -----
I0810 18:54:35.687964 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:54:35.688106 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:54:35.688284 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1854-pce1t
I0810 18:54:35.688700 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1854-pce1t: server_target=xds:///metadata-filter.test-metadata-filter-match-any-and-all:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:54:35.688915 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1854-pce1t%22;timeRange=2023-08-10T18:54:35.688803Z%2F2023-08-10T19:24:35.688803Z?project=grpc-testing
I0810 18:54:35.690979 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1854-pce1t
labels:
name: interop-psm-url-map-client-20230810-1854-pce1t
owner: xds-k8s-interop-test
...

I0810 18:54:35.715399 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1854-pce1t created
I0810 18:54:35.723380 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1854-pce1t
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-mnzhdkr6
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-mnzhdkr6
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-mnzhdkr6
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///metadata-filter.test-metadata-filter-match-any-and-all:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:54:35.769623 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:54:35.769932 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:54:36.817962 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-f9c956946-n5n94']
I0810 18:54:36.818288 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-f9c956946-n5n94 to start
I0810 18:54:39.898670 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-f9c956946-n5n94 ready, IP: 10.60.1.223
I0810 18:54:39.898994 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-f9c956946-n5n94 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1854-pce1t_psm-grpc-client-f9c956946-n5n94.log
I0810 18:54:39.899388 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-f9c956946-n5n94
I0810 18:54:39.899696 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:54:42.967006 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:54:42.967533 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchAnyAndAll
I0810 18:54:42.967696 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchAnyAndAll
I0810 18:54:42.967798 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestMetadataFilterMatchAnyAndAll teardown -----
I0810 18:54:42.982669 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:55:23.111054 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1854-pce1t
I0810 18:55:53.249013 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:55:53.249429 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-mnzhdkr6:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1854-pce1t%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-mnzhdkr6%22;timeRange=2023-08-10T18:54:35.688797Z%2F2023-08-10T18:55:53.248810Z?project=grpc-testing
I0810 18:55:53.249611 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestMetadataFilterMatchMultipleRules -----
I0810 18:55:53.249695 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:55:53.249826 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:55:53.249990 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1855-mqiiz
I0810 18:55:53.250422 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1855-mqiiz: server_target=xds:///metadata-filter.test-metadata-filter-match-multiple-rules:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:55:53.250637 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1855-mqiiz%22;timeRange=2023-08-10T18:55:53.250530Z%2F2023-08-10T19:25:53.250530Z?project=grpc-testing
I0810 18:55:53.252740 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1855-mqiiz
labels:
name: interop-psm-url-map-client-20230810-1855-mqiiz
owner: xds-k8s-interop-test
...

I0810 18:55:53.289400 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1855-mqiiz created
I0810 18:55:53.297580 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1855-mqiiz
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-e6rmjqc2
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-e6rmjqc2
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-e6rmjqc2
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///metadata-filter.test-metadata-filter-match-multiple-rules:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:55:53.340280 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:55:53.340566 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:55:54.390859 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-85879fd446-j5v5n']
I0810 18:55:54.391191 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-85879fd446-j5v5n to start
I0810 18:55:56.455216 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-85879fd446-j5v5n ready, IP: 10.60.12.236
I0810 18:55:56.455556 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-85879fd446-j5v5n to url_map/test_app_logs/interop-psm-url-map-client-20230810-1855-mqiiz_psm-grpc-client-85879fd446-j5v5n.log
I0810 18:55:56.455945 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-85879fd446-j5v5n
I0810 18:55:56.456092 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:56:00.534924 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:56:00.535492 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchMultipleRules
I0810 18:56:00.535667 139712423387136 xds_url_map_testcase.py:478] Aborting TestMetadataFilterMatchMultipleRules
I0810 18:56:00.535784 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestMetadataFilterMatchMultipleRules teardown -----
I0810 18:56:00.551257 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:56:40.679172 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1855-mqiiz
I0810 18:57:10.770872 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:57:10.771304 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-e6rmjqc2:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1855-mqiiz%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-e6rmjqc2%22;timeRange=2023-08-10T18:55:53.250525Z%2F2023-08-10T18:57:10.770655Z?project=grpc-testing
I0810 18:57:10.771480 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestCaseInsensitiveMatch -----
I0810 18:57:10.771596 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:57:10.771744 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:57:10.771909 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1857-zcmg0
I0810 18:57:10.772292 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1857-zcmg0: server_target=xds:///path-matching.test-case-insensitive-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:57:10.772490 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1857-zcmg0%22;timeRange=2023-08-10T18:57:10.772390Z%2F2023-08-10T19:27:10.772390Z?project=grpc-testing
I0810 18:57:10.774563 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1857-zcmg0
labels:
name: interop-psm-url-map-client-20230810-1857-zcmg0
owner: xds-k8s-interop-test
...

I0810 18:57:10.786338 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1857-zcmg0 created
I0810 18:57:10.795016 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1857-zcmg0
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-w3fufjkk
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-w3fufjkk
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-w3fufjkk
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///path-matching.test-case-insensitive-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:57:10.836498 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:57:10.836802 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:57:11.892387 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-5665dd9795-zkgwd']
I0810 18:57:11.892757 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-5665dd9795-zkgwd to start
I0810 18:57:13.959258 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-5665dd9795-zkgwd ready, IP: 10.60.1.225
I0810 18:57:13.959610 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-5665dd9795-zkgwd to url_map/test_app_logs/interop-psm-url-map-client-20230810-1857-zcmg0_psm-grpc-client-5665dd9795-zkgwd.log
I0810 18:57:13.960035 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-5665dd9795-zkgwd
I0810 18:57:13.960218 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:57:15.018013 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:57:15.018596 139712423387136 xds_url_map_testcase.py:478] Aborting TestCaseInsensitiveMatch
I0810 18:57:15.018759 139712423387136 xds_url_map_testcase.py:478] Aborting TestCaseInsensitiveMatch
I0810 18:57:15.018859 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestCaseInsensitiveMatch teardown -----
I0810 18:57:15.036813 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:57:55.192088 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1857-zcmg0
I0810 18:58:25.256850 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:58:25.257505 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-w3fufjkk:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1857-zcmg0%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-w3fufjkk%22;timeRange=2023-08-10T18:57:10.772384Z%2F2023-08-10T18:58:25.256622Z?project=grpc-testing
I0810 18:58:25.257729 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestFullPathMatchEmptyCall -----
I0810 18:58:25.257826 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:58:25.257972 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:58:25.258170 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1858-k1swa
I0810 18:58:25.258583 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1858-k1swa: server_target=xds:///path-matching.test-full-path-match-empty-call:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:58:25.258801 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1858-k1swa%22;timeRange=2023-08-10T18:58:25.258698Z%2F2023-08-10T19:28:25.258698Z?project=grpc-testing
I0810 18:58:25.260820 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1858-k1swa
labels:
name: interop-psm-url-map-client-20230810-1858-k1swa
owner: xds-k8s-interop-test
...

I0810 18:58:25.286506 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1858-k1swa created
I0810 18:58:25.295538 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1858-k1swa
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-7h9jof2h
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-7h9jof2h
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-7h9jof2h
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///path-matching.test-full-path-match-empty-call:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:58:25.340101 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:58:25.340394 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:58:26.383821 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-79bfc6c45f-4qwtn']
I0810 18:58:26.384149 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-79bfc6c45f-4qwtn to start
I0810 18:58:29.463426 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-79bfc6c45f-4qwtn ready, IP: 10.60.3.51
I0810 18:58:29.463767 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-79bfc6c45f-4qwtn to url_map/test_app_logs/interop-psm-url-map-client-20230810-1858-k1swa_psm-grpc-client-79bfc6c45f-4qwtn.log
I0810 18:58:29.464156 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-79bfc6c45f-4qwtn
I0810 18:58:29.464339 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:58:35.561852 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:58:35.562431 139712423387136 xds_url_map_testcase.py:478] Aborting TestFullPathMatchEmptyCall
I0810 18:58:35.562582 139712423387136 xds_url_map_testcase.py:478] Aborting TestFullPathMatchEmptyCall
I0810 18:58:35.562682 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestFullPathMatchEmptyCall teardown -----
I0810 18:58:35.577937 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 18:59:15.707027 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1858-k1swa
I0810 18:59:45.799419 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 18:59:45.799804 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-7h9jof2h:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1858-k1swa%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-7h9jof2h%22;timeRange=2023-08-10T18:58:25.258692Z%2F2023-08-10T18:59:45.799213Z?project=grpc-testing
I0810 18:59:45.799954 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestFullPathMatchUnaryCall -----
I0810 18:59:45.800034 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 18:59:45.800186 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 18:59:45.800355 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1859-20e6x
I0810 18:59:45.800746 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1859-20e6x: server_target=xds:///path-matching.test-full-path-match-unary-call:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 18:59:45.800939 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1859-20e6x%22;timeRange=2023-08-10T18:59:45.800836Z%2F2023-08-10T19:29:45.800836Z?project=grpc-testing
I0810 18:59:45.803009 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1859-20e6x
labels:
name: interop-psm-url-map-client-20230810-1859-20e6x
owner: xds-k8s-interop-test
...

I0810 18:59:45.813592 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1859-20e6x created
I0810 18:59:45.821749 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1859-20e6x
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-tw08hcxz
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-tw08hcxz
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-tw08hcxz
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///path-matching.test-full-path-match-unary-call:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 18:59:45.863621 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 18:59:45.863921 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 18:59:46.910902 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-8ccd78f5d-8n6j9']
I0810 18:59:46.911239 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-8ccd78f5d-8n6j9 to start
I0810 18:59:48.977185 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-8ccd78f5d-8n6j9 ready, IP: 10.60.3.52
I0810 18:59:48.977512 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-8ccd78f5d-8n6j9 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1859-20e6x_psm-grpc-client-8ccd78f5d-8n6j9.log
I0810 18:59:48.977948 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-8ccd78f5d-8n6j9
I0810 18:59:48.978159 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 18:59:53.054613 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 18:59:53.055163 139712423387136 xds_url_map_testcase.py:478] Aborting TestFullPathMatchUnaryCall
I0810 18:59:53.055320 139712423387136 xds_url_map_testcase.py:478] Aborting TestFullPathMatchUnaryCall
I0810 18:59:53.055422 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestFullPathMatchUnaryCall teardown -----
I0810 18:59:53.073073 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 19:00:33.236778 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1859-20e6x
I0810 19:01:03.327252 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 19:01:03.327665 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-tw08hcxz:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1859-20e6x%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-tw08hcxz%22;timeRange=2023-08-10T18:59:45.800831Z%2F2023-08-10T19:01:03.327046Z?project=grpc-testing
I0810 19:01:03.327836 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestRegexMatch -----
I0810 19:01:03.327920 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:01:03.328051 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 19:01:03.328208 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1901-uel6g
I0810 19:01:03.328592 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1901-uel6g: server_target=xds:///path-matching.test-regex-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 19:01:03.328806 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1901-uel6g%22;timeRange=2023-08-10T19:01:03.328700Z%2F2023-08-10T19:31:03.328700Z?project=grpc-testing
I0810 19:01:03.330919 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1901-uel6g
labels:
name: interop-psm-url-map-client-20230810-1901-uel6g
owner: xds-k8s-interop-test
...

I0810 19:01:03.359889 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1901-uel6g created
I0810 19:01:03.368092 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1901-uel6g
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-dvw1l8jg
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-dvw1l8jg
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-dvw1l8jg
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///path-matching.test-regex-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 19:01:03.414563 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 19:01:03.414868 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 19:01:04.468199 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7df8cb69c4-c45gp']
I0810 19:01:04.468560 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-7df8cb69c4-c45gp to start
I0810 19:01:06.536616 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-7df8cb69c4-c45gp ready, IP: 10.60.1.229
I0810 19:01:06.536954 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-7df8cb69c4-c45gp to url_map/test_app_logs/interop-psm-url-map-client-20230810-1901-uel6g_psm-grpc-client-7df8cb69c4-c45gp.log
I0810 19:01:06.537360 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-7df8cb69c4-c45gp
I0810 19:01:06.537679 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 19:01:10.619536 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 19:01:10.620107 139712423387136 xds_url_map_testcase.py:478] Aborting TestRegexMatch
I0810 19:01:10.620274 139712423387136 xds_url_map_testcase.py:478] Aborting TestRegexMatch
I0810 19:01:10.620383 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestRegexMatch teardown -----
I0810 19:01:10.637310 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 19:01:50.758912 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1901-uel6g
I0810 19:02:20.884359 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 19:02:20.884807 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-dvw1l8jg:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1901-uel6g%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-dvw1l8jg%22;timeRange=2023-08-10T19:01:03.328695Z%2F2023-08-10T19:02:20.884154Z?project=grpc-testing
I0810 19:02:20.884972 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestTwoRoutesAndPrefixMatch -----
I0810 19:02:20.885058 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:02:20.885209 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 19:02:20.885374 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1902-rbt7w
I0810 19:02:20.885804 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1902-rbt7w: server_target=xds:///path-matching.test-two-routes-and-prefix-match:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 19:02:20.886026 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1902-rbt7w%22;timeRange=2023-08-10T19:02:20.885917Z%2F2023-08-10T19:32:20.885917Z?project=grpc-testing
I0810 19:02:20.888173 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1902-rbt7w
labels:
name: interop-psm-url-map-client-20230810-1902-rbt7w
owner: xds-k8s-interop-test
...

I0810 19:02:20.916809 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1902-rbt7w created
I0810 19:02:20.925650 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1902-rbt7w
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-obt8pd09
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-obt8pd09
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-obt8pd09
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///path-matching.test-two-routes-and-prefix-match:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 19:02:20.970923 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 19:02:20.971240 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 19:02:22.024416 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-77b44bbd64-5t9j6']
I0810 19:02:22.024792 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-77b44bbd64-5t9j6 to start
I0810 19:02:25.107839 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-77b44bbd64-5t9j6 ready, IP: 10.60.1.230
I0810 19:02:25.108159 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-77b44bbd64-5t9j6 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1902-rbt7w_psm-grpc-client-77b44bbd64-5t9j6.log
I0810 19:02:25.108527 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-77b44bbd64-5t9j6
I0810 19:02:25.108757 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 19:02:31.223229 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 19:02:31.223786 139712423387136 xds_url_map_testcase.py:478] Aborting TestTwoRoutesAndPrefixMatch
I0810 19:02:31.223936 139712423387136 xds_url_map_testcase.py:478] Aborting TestTwoRoutesAndPrefixMatch
I0810 19:02:31.224045 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestTwoRoutesAndPrefixMatch teardown -----
I0810 19:02:31.239951 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
I0810 19:03:11.368020 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1902-rbt7w
I0810 19:03:41.453241 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 19:03:41.453648 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-obt8pd09:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1902-rbt7w%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-obt8pd09%22;timeRange=2023-08-10T19:02:20.885911Z%2F2023-08-10T19:03:41.453038Z?project=grpc-testing
I0810 19:03:41.453844 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestRetryUpTo3AttemptsAndFail -----
I0810 19:03:41.453936 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:03:41.454233 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 19:03:41.454421 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1903-wli1b
I0810 19:03:41.454826 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1903-wli1b: server_target=xds:///retry.test-retry-up-to3-attempts-and-fail:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 19:03:41.455049 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1903-wli1b%22;timeRange=2023-08-10T19:03:41.454945Z%2F2023-08-10T19:33:41.454945Z?project=grpc-testing
I0810 19:03:41.457035 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1903-wli1b
labels:
name: interop-psm-url-map-client-20230810-1903-wli1b
owner: xds-k8s-interop-test
...

I0810 19:03:41.478452 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1903-wli1b created
I0810 19:03:41.487307 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1903-wli1b
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-hqnlqvbc
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-hqnlqvbc
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-hqnlqvbc
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///retry.test-retry-up-to3-attempts-and-fail:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 19:03:41.541185 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 19:03:41.541481 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 19:03:42.595834 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7f4858d5d7-ktt4n']
I0810 19:03:42.596173 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-7f4858d5d7-ktt4n to start
I0810 19:03:44.662526 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-7f4858d5d7-ktt4n ready, IP: 10.60.12.242
I0810 19:03:44.662840 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-7f4858d5d7-ktt4n to url_map/test_app_logs/interop-psm-url-map-client-20230810-1903-wli1b_psm-grpc-client-7f4858d5d7-ktt4n.log
I0810 19:03:44.663219 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-7f4858d5d7-ktt4n
I0810 19:03:44.663368 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 19:03:48.739850 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 19:03:48.740434 139712423387136 xds_url_map_testcase.py:478] Aborting TestRetryUpTo3AttemptsAndFail
I0810 19:03:48.740591 139712423387136 xds_url_map_testcase.py:478] Aborting TestRetryUpTo3AttemptsAndFail
I0810 19:03:48.740693 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestRetryUpTo3AttemptsAndFail teardown -----
I0810 19:03:48.755996 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:04:28.931893 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1903-wli1b
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:04:59.076335 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 19:04:59.076689 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-hqnlqvbc:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1903-wli1b%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-hqnlqvbc%22;timeRange=2023-08-10T19:03:41.454939Z%2F2023-08-10T19:04:59.076126Z?project=grpc-testing
I0810 19:04:59.076845 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestRetryUpTo4AttemptsAndSucceed -----
I0810 19:04:59.076925 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:04:59.077142 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 19:04:59.077334 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1904-99739
I0810 19:04:59.077966 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1904-99739: server_target=xds:///retry.test-retry-up-to4-attempts-and-succeed:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 19:04:59.078301 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1904-99739%22;timeRange=2023-08-10T19:04:59.078178Z%2F2023-08-10T19:34:59.078178Z?project=grpc-testing
I0810 19:04:59.080400 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1904-99739
labels:
name: interop-psm-url-map-client-20230810-1904-99739
owner: xds-k8s-interop-test
...

I0810 19:04:59.118927 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1904-99739 created
I0810 19:04:59.127034 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1904-99739
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-397iysr8
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-397iysr8
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-397iysr8
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///retry.test-retry-up-to4-attempts-and-succeed:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 19:04:59.190314 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 19:04:59.190601 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 19:05:00.264267 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-6f8b4c8477-c9qj8']
I0810 19:05:00.264607 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-6f8b4c8477-c9qj8 to start
I0810 19:05:02.356597 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-6f8b4c8477-c9qj8 ready, IP: 10.60.3.57
I0810 19:05:02.356946 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-6f8b4c8477-c9qj8 to url_map/test_app_logs/interop-psm-url-map-client-20230810-1904-99739_psm-grpc-client-6f8b4c8477-c9qj8.log
I0810 19:05:02.357356 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-6f8b4c8477-c9qj8
I0810 19:05:02.357547 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 19:05:06.476177 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 19:05:06.476739 139712423387136 xds_url_map_testcase.py:478] Aborting TestRetryUpTo4AttemptsAndSucceed
I0810 19:05:06.476888 139712423387136 xds_url_map_testcase.py:478] Aborting TestRetryUpTo4AttemptsAndSucceed
I0810 19:05:06.476994 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestRetryUpTo4AttemptsAndSucceed teardown -----
I0810 19:05:06.500205 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:05:46.659034 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1904-99739
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:06:16.766158 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 19:06:16.766503 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-397iysr8:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1904-99739%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-397iysr8%22;timeRange=2023-08-10T19:04:59.078169Z%2F2023-08-10T19:06:16.765931Z?project=grpc-testing
I0810 19:06:16.766674 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestTimeoutInRouteRule -----
I0810 19:06:16.766813 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:06:16.766946 139712423387136 skips.py:121] Skipping TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
[ SKIPPED ] setUpClass (timeout_test.TestTimeoutInRouteRule)
I0810 19:06:16.767185 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestTimeoutInApplication -----
I0810 19:06:16.767256 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:06:16.767332 139712423387136 skips.py:121] Skipping TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
[ SKIPPED ] setUpClass (timeout_test.TestTimeoutInApplication)
I0810 19:06:16.767473 139712423387136 xds_url_map_testcase.py:373] ----- Testing TestTimeoutNotExceeded -----
I0810 19:06:16.767538 139712423387136 xds_url_map_testcase.py:374] Logs timezone: UTC
I0810 19:06:16.767611 139712423387136 skips.py:124] Detected language and version: TestConfig(client_lang='python', server_lang='java', version='dev-v1.56.x')
I0810 19:06:16.767760 139712423387136 xds_url_map_test_resources.py:230] GcpResourceManager: client_namespace_suffix=20230810-1906-tfjlg
I0810 19:06:16.768144 139712423387136 k8s_xds_client_runner.py:107] Deploying xDS test client "psm-grpc-client" to k8s namespace interop-psm-url-map-client-20230810-1906-tfjlg: server_target=xds:///timeout.test-timeout-not-exceeded:8848 rpc=UnaryCall,EmptyCall qps=25 metadata='' secure_mode=False print_response=True
I0810 19:06:16.768362 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1906-tfjlg%22;timeRange=2023-08-10T19:06:16.768250Z%2F2023-08-10T19:36:16.768250Z?project=grpc-testing
I0810 19:06:16.770386 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: interop-psm-url-map-client-20230810-1906-tfjlg
labels:
name: interop-psm-url-map-client-20230810-1906-tfjlg
owner: xds-k8s-interop-test
...

I0810 19:06:16.787976 139712423387136 k8s_base_runner.py:280] Namespace interop-psm-url-map-client-20230810-1906-tfjlg created
I0810 19:06:16.796520 139712423387136 k8s_base_runner.py:258] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: interop-psm-url-map-client-20230810-1906-tfjlg
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-4sp9x2d7
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-4sp9x2d7
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-4sp9x2d7
owner: xds-k8s-interop-test
spec:
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/python-client:f0f5ed4dd33ae6e7cf04f79fa81b6f0e10e3a5e7
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///timeout.test-timeout-not-exceeded:8848"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall,EmptyCall"
- "--metadata="
- "--print_response=True"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:d6baaf7b0e0c63054ac4d9bedc09021ff261d599
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I0810 19:06:16.844702 139712423387136 k8s_base_runner.py:280] Deployment psm-grpc-client created
I0810 19:06:16.845011 139712423387136 k8s_base_runner.py:531] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I0810 19:06:16.904737 139712423387136 k8s_base_runner.py:541] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-788d949c6b-pxkhg']
I0810 19:06:16.905097 139712423387136 k8s_base_runner.py:551] Waiting for pod psm-grpc-client-788d949c6b-pxkhg to start
I0810 19:06:20.052934 139712423387136 k8s_base_runner.py:554] Pod psm-grpc-client-788d949c6b-pxkhg ready, IP: 10.60.6.224
I0810 19:06:20.053414 139712423387136 k8s_base_runner.py:577] Enabling log collection from pod psm-grpc-client-788d949c6b-pxkhg to url_map/test_app_logs/interop-psm-url-map-client-20230810-1906-tfjlg_psm-grpc-client-788d949c6b-pxkhg.log
I0810 19:06:20.054001 139712333600320 k8s_log_collector.py:70] Starting log collection thread 139712333600320 for psm-grpc-client-788d949c6b-pxkhg
I0810 19:06:20.054337 139712423387136 k8s_base_runner.py:513] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I0810 19:06:27.228590 139712423387136 k8s_base_runner.py:522] Deployment psm-grpc-client has 1 replicas available
I0810 19:06:27.229145 139712423387136 xds_url_map_testcase.py:478] Aborting TestTimeoutNotExceeded
I0810 19:06:27.229294 139712423387136 xds_url_map_testcase.py:478] Aborting TestTimeoutNotExceeded
I0810 19:06:27.229393 139712423387136 xds_url_map_testcase.py:408] ----- TestCase TestTimeoutNotExceeded teardown -----
I0810 19:06:27.251667 139712423387136 k8s_base_runner.py:462] Deleting deployment psm-grpc-client
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:07:07.460351 139712423387136 k8s_base_runner.py:499] Deleting namespace interop-psm-url-map-client-20230810-1906-tfjlg
W0810 19:11:17.540927 139712423387136 connectionpool.py:812] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ProtocolError('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))': /api/v1/namespaces/interop-psm-url-map-client-20230810-1906-tfjlg
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:11:24.151369 139712423387136 k8s.py:164] Reloading k8s api client to refresh the auth.
I0810 19:11:25.270017 139712423387136 k8s.py:129] Using kubernetes context "gke_grpc-testing_us-central1-c_interop-test-psm-basic", active host: https://130.211.205.238
/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/kubernetes/client/rest.py:44: DeprecationWarning: HTTPResponse.getheaders() is deprecated and will be removed in urllib3 v2.1.0. Instead access HTTPResponse.headers directly.
return self.urllib3_response.getheaders()
I0810 19:11:57.472015 139712423387136 xds_url_map_testcase.py:437] ----- Test client logs -----
I0810 19:11:57.472447 139712423387136 k8s_base_runner.py:672] GCP Logs Explorer link to psm-grpc-client-4sp9x2d7:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22interop-psm-url-map-client-20230810-1906-tfjlg%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-4sp9x2d7%22;timeRange=2023-08-10T19:06:16.768244Z%2F2023-08-10T19:11:57.471811Z?project=grpc-testing
======================================================================
ERROR: test_client_config (csds_test.TestBasicCsds)
csds_test.TestBasicCsds.test_client_config
----------------------------------------------------------------------
Traceback (most recent call last):
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/framework/xds_url_map_testcase.py", line 492, in test_client_config
retryer(self._fetch_and_check_xds_config)
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 423, in __call__
do = self.iter(retry_state=retry_state)
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/venv/lib/python3.10/site-packages/tenacity/__init__.py", line 369, in iter
return self.retry_error_callback(retry_state=retry_state)
File "/tmp/tmp.qFY6iMjIkq/grpc/tools/run_tests/xds_k8s_test_driver/framework/helpers/retryers.py", line 141, in error_handler
raise RetryError(
framework.helpers.retryers.RetryError: Retry error calling framework.xds_url_map_testcase.XdsUrlMapTestCase._fetch_and_check_xds_config: timeout 0:10:00 (h:mm:ss) exceeded. Last exception: AssertionError: 2 != 3

----------------------------------------------------------------------
Ran 1 test in 2745.112s

FAILED (errors=1, skipped=4)
+ echo 'Failed url_map test'
Failed url_map test


[ID: 8655033] Command finished after 2827 secs, exit value: 0


Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
[12:11:58] Collecting build artifacts from build VM
[12:11:59] Kokoro builder finished