Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
[16:23:08 PST] Transferring environment variable script to build VM
[16:23:09 PST] Transferring kokoro_log_reader.py to build VM
[16:23:09 PST] Transferring source code to build VM
[16:23:11 PST] Executing build script on build VM



[ID: 9686610] Executing command via SSH:
export KOKORO_BUILD_NUMBER="76"
export KOKORO_JOB_NAME="grpc/java/v1.59.x/branch/psm-security"
source /tmpfs/kokoro-env_vars.sh; cd /tmpfs/src/ ; chmod 755 github/grpc-java/buildscripts/kokoro/psm-security.sh ; PYTHON_3_VERSION="$(pyenv which python3 2> /dev/null || which python3)" ; PYTHON_2_VERSION="$(pyenv which python2 2> /dev/null || which python2)" ; if "$PYTHON_3_VERSION" -c "import psutil" ; then KOKORO_PYTHON_COMMAND="$PYTHON_3_VERSION" ; else KOKORO_PYTHON_COMMAND="$PYTHON_2_VERSION" ; fi > /dev/null 2>&1 ; echo "export KOKORO_PYTHON_COMMAND="$KOKORO_PYTHON_COMMAND"" > "$HOME/.kokoro_python_vars" ; nohup bash -c "( rm -f /tmpfs/kokoro_build_exit_code ; github/grpc-java/buildscripts/kokoro/psm-security.sh ; echo \${PIPESTATUS[0]} > /tmpfs/kokoro_build_exit_code ) > /tmpfs/kokoro_build.log 2>&1" > /dev/null 2>&1 & echo $! > /tmpfs/kokoro_build.pid ; source "$HOME/.kokoro_python_vars" ; "$KOKORO_PYTHON_COMMAND" /tmpfs/kokoro_log_reader.py /tmpfs/kokoro_build.log /tmpfs/kokoro_build_exit_code /tmpfs/kokoro_build.pid /tmpfs/kokoro_log_reader.pid --start_byte 0

Sourcing test driver install script from: https://raw.githubusercontent.com/XuanWang-Amos/grpc/switch_interop_repo/tools/internal_ci/linux/grpc_xds_k8s_install_test_driver.sh
Activated GKE cluster: GKE_CLUSTER_NAME=psm-interop-security GKE_CLUSTER_ZONE=us-central1-a
+ [[ -n /tmpfs/src ]]
+ kokoro_setup_test_driver grpc-java
+ set +x
Kokoro Ubuntu version:
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 22.04.3 LTS
Release: 22.04
Codename: jammy
Python 3.10.12
pip 22.0.2 from /usr/lib/python3/dist-packages/pip (python 3.10)
Sponge properties:
TESTS_FORMAT_VERSION,2
TESTGRID_EXCLUDE,1
GIT_ORIGIN_URL,https://github.com/grpc/grpc-java.git
GIT_COMMIT_SHORT,c4fe1175e
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 129773 files and directories currently installed.)
Removing needrestart (3.5-5ubuntu2.1) ...
Processing triggers for man-db (2.10.2-1) ...
W: https://packages.cloud.google.com/apt/dists/cloud-sdk/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 129718 files and directories currently installed.)
Removing libintl-xs-perl (1.26-3build2) ...
Removing libintl-perl (1.26-3build2) ...
Removing libmodule-find-perl (0.15-1) ...
Removing libmodule-scandeps-perl (1.31-1) ...
Removing libproc-processtable-perl:amd64 (0.634-1build1) ...
Removing libsort-naturally-perl (1.03-2) ...
Removing libterm-readkey-perl (2.38-1build4) ...
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 129318 files and directories currently installed.)
Preparing to unpack .../00-python3.10-dev_3.10.12-1~22.04.3_amd64.deb ...
Unpacking python3.10-dev (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Preparing to unpack .../01-libpython3.10-dev_3.10.12-1~22.04.3_amd64.deb ...
Unpacking libpython3.10-dev:amd64 (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Preparing to unpack .../02-libpython3.10_3.10.12-1~22.04.3_amd64.deb ...
Unpacking libpython3.10:amd64 (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Preparing to unpack .../03-python3.10_3.10.12-1~22.04.3_amd64.deb ...
Unpacking python3.10 (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Preparing to unpack .../04-libpython3.10-stdlib_3.10.12-1~22.04.3_amd64.deb ...
Unpacking libpython3.10-stdlib:amd64 (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Preparing to unpack .../05-python3.10-minimal_3.10.12-1~22.04.3_amd64.deb ...
Unpacking python3.10-minimal (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Preparing to unpack .../06-libpython3.10-minimal_3.10.12-1~22.04.3_amd64.deb ...
Unpacking libpython3.10-minimal:amd64 (3.10.12-1~22.04.3) over (3.10.12-1~22.04.2) ...
Selecting previously unselected package google-cloud-sdk-gke-gcloud-auth-plugin.
Preparing to unpack .../07-google-cloud-sdk-gke-gcloud-auth-plugin_457.0.0-0_amd64.deb ...
Unpacking google-cloud-sdk-gke-gcloud-auth-plugin (457.0.0-0) ...
Selecting previously unselected package kubectl.
Preparing to unpack .../08-kubectl_1.28.2-00_amd64.deb ...
Unpacking kubectl (1.28.2-00) ...
Selecting previously unselected package python3-pip-whl.
Preparing to unpack .../09-python3-pip-whl_22.0.2+dfsg-1ubuntu0.4_all.deb ...
Unpacking python3-pip-whl (22.0.2+dfsg-1ubuntu0.4) ...
Selecting previously unselected package python3-setuptools-whl.
Preparing to unpack .../10-python3-setuptools-whl_59.6.0-1.2ubuntu0.22.04.1_all.deb ...
Unpacking python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ...
Selecting previously unselected package python3.10-venv.
Preparing to unpack .../11-python3.10-venv_3.10.12-1~22.04.3_amd64.deb ...
Unpacking python3.10-venv (3.10.12-1~22.04.3) ...
Setting up python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ...
Setting up python3-pip-whl (22.0.2+dfsg-1ubuntu0.4) ...
Setting up google-cloud-sdk-gke-gcloud-auth-plugin (457.0.0-0) ...
Setting up kubectl (1.28.2-00) ...
Setting up libpython3.10-minimal:amd64 (3.10.12-1~22.04.3) ...
Setting up python3.10-minimal (3.10.12-1~22.04.3) ...
Setting up libpython3.10-stdlib:amd64 (3.10.12-1~22.04.3) ...
Setting up libpython3.10:amd64 (3.10.12-1~22.04.3) ...
Setting up python3.10 (3.10.12-1~22.04.3) ...
Setting up libpython3.10-dev:amd64 (3.10.12-1~22.04.3) ...
Setting up python3.10-dev (3.10.12-1~22.04.3) ...
Setting up python3.10-venv (3.10.12-1~22.04.3) ...
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.4) ...
Fetching cluster endpoint and auth data.
kubeconfig entry generated for psm-interop-security.
Cloning driver to https://github.com/XuanWang-Amos/psm-interop.git branch switch_interop_repo to /tmp/tmp.C9b0mU2t71/psm-interop
Cloning into '/tmp/tmp.C9b0mU2t71/psm-interop'...
Install python dependencies
Creating python virtual environment: /tmp/tmp.C9b0mU2t71/psm-interop/venv
Collecting Mako==1.2.4 (from -r requirements.lock (line 1))
Downloading Mako-1.2.4-py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.7/78.7 kB 2.4 MB/s eta 0:00:00
Collecting PyYAML==6.0 (from -r requirements.lock (line 2))
Downloading PyYAML-6.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (682 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 682.2/682.2 kB 16.8 MB/s eta 0:00:00
Collecting absl-py==0.15.0 (from -r requirements.lock (line 3))
Downloading absl_py-0.15.0-py3-none-any.whl (132 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.0/132.0 kB 11.3 MB/s eta 0:00:00
Collecting google-api-python-client==1.12.11 (from -r requirements.lock (line 4))
Downloading google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.1/62.1 kB 5.7 MB/s eta 0:00:00
Collecting google-cloud-secret-manager==2.15.1 (from -r requirements.lock (line 5))
Downloading google_cloud_secret_manager-2.15.1-py2.py3-none-any.whl (100 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100.4/100.4 kB 9.5 MB/s eta 0:00:00
Collecting grpcio==1.57.0 (from -r requirements.lock (line 6))
Downloading grpcio-1.57.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB)
Collecting grpcio-health-checking==1.57.0 (from -r requirements.lock (line 7))
Downloading grpcio_health_checking-1.57.0-py3-none-any.whl.metadata (1.2 kB)
Collecting grpcio-tools==1.57.0 (from -r requirements.lock (line 8))
Downloading grpcio_tools-1.57.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.2 kB)
Collecting grpcio-channelz==1.57.0 (from -r requirements.lock (line 9))
Downloading grpcio_channelz-1.57.0-py3-none-any.whl.metadata (1.2 kB)
Collecting kubernetes==27.2.0 (from -r requirements.lock (line 10))
Downloading kubernetes-27.2.0-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting six==1.16.0 (from -r requirements.lock (line 11))
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting tenacity==6.3.1 (from -r requirements.lock (line 12))
Downloading tenacity-6.3.1-py2.py3-none-any.whl (36 kB)
Collecting packaging==23.1 (from -r requirements.lock (line 13))
Downloading packaging-23.1-py3-none-any.whl (48 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 3.6 MB/s eta 0:00:00
Collecting Pygments==2.14.0 (from -r requirements.lock (line 14))
Downloading Pygments-2.14.0-py3-none-any.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 46.8 MB/s eta 0:00:00
Collecting python-dateutil==2.8.2 (from -r requirements.lock (line 15))
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 19.6 MB/s eta 0:00:00
Collecting protobuf==4.24.1 (from -r requirements.lock (line 16))
Downloading protobuf-4.24.1-cp37-abi3-manylinux2014_x86_64.whl.metadata (540 bytes)
Collecting xds-protos==1.58.0rc1 (from -r requirements.lock (line 17))
Downloading xds_protos-1.58.0rc1-py3-none-any.whl.metadata (1.3 kB)
Collecting cachetools==5.3.1 (from -r requirements.lock (line 19))
Downloading cachetools-5.3.1-py3-none-any.whl.metadata (5.2 kB)
Collecting certifi==2023.7.22 (from -r requirements.lock (line 20))
Downloading certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting charset-normalizer==3.2.0 (from -r requirements.lock (line 21))
Downloading charset_normalizer-3.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (31 kB)
Collecting google-api-core==2.11.1 (from -r requirements.lock (line 22))
Downloading google_api_core-2.11.1-py3-none-any.whl.metadata (2.7 kB)
Collecting google-auth==2.22.0 (from -r requirements.lock (line 23))
Downloading google_auth-2.22.0-py2.py3-none-any.whl.metadata (4.2 kB)
Collecting google-auth-httplib2==0.1.0 (from -r requirements.lock (line 24))
Downloading google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting googleapis-common-protos==1.60.0 (from -r requirements.lock (line 25))
Downloading googleapis_common_protos-1.60.0-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting grpc-google-iam-v1==0.12.6 (from -r requirements.lock (line 26))
Downloading grpc_google_iam_v1-0.12.6-py2.py3-none-any.whl (26 kB)
Collecting grpcio-status==1.57.0 (from -r requirements.lock (line 27))
Downloading grpcio_status-1.57.0-py3-none-any.whl.metadata (1.2 kB)
Collecting httplib2==0.22.0 (from -r requirements.lock (line 28))
Downloading httplib2-0.22.0-py3-none-any.whl (96 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96.9/96.9 kB 7.5 MB/s eta 0:00:00
Collecting idna==3.4 (from -r requirements.lock (line 29))
Downloading idna-3.4-py3-none-any.whl (61 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 5.8 MB/s eta 0:00:00
Collecting MarkupSafe==2.1.3 (from -r requirements.lock (line 30))
Downloading MarkupSafe-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Collecting oauthlib==3.2.2 (from -r requirements.lock (line 31))
Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 15.4 MB/s eta 0:00:00
Collecting proto-plus==1.22.3 (from -r requirements.lock (line 32))
Downloading proto_plus-1.22.3-py3-none-any.whl.metadata (2.2 kB)
Collecting pyasn1==0.5.0 (from -r requirements.lock (line 33))
Downloading pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.9/83.9 kB 7.3 MB/s eta 0:00:00
Collecting pyasn1-modules==0.3.0 (from -r requirements.lock (line 34))
Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 17.1 MB/s eta 0:00:00
Collecting pyparsing==3.1.1 (from -r requirements.lock (line 35))
Downloading pyparsing-3.1.1-py3-none-any.whl.metadata (5.1 kB)
Collecting requests==2.31.0 (from -r requirements.lock (line 36))
Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting requests-oauthlib==1.3.1 (from -r requirements.lock (line 37))
Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting rsa==4.9 (from -r requirements.lock (line 38))
Downloading rsa-4.9-py3-none-any.whl (34 kB)
Collecting uritemplate==3.0.1 (from -r requirements.lock (line 39))
Downloading uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Collecting urllib3==1.26.16 (from -r requirements.lock (line 40))
Downloading urllib3-1.26.16-py2.py3-none-any.whl.metadata (48 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.4/48.4 kB 4.1 MB/s eta 0:00:00
Collecting websocket-client==1.6.2 (from -r requirements.lock (line 41))
Downloading websocket_client-1.6.2-py3-none-any.whl.metadata (7.5 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.10/site-packages (from grpcio-tools==1.57.0->-r requirements.lock (line 8)) (69.0.2)
Downloading grpcio-1.57.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.3/5.3 MB 86.9 MB/s eta 0:00:00
Downloading grpcio_health_checking-1.57.0-py3-none-any.whl (8.6 kB)
Downloading grpcio_tools-1.57.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.6/2.6 MB 75.5 MB/s eta 0:00:00
Downloading grpcio_channelz-1.57.0-py3-none-any.whl (10 kB)
Downloading kubernetes-27.2.0-py2.py3-none-any.whl (1.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 63.9 MB/s eta 0:00:00
Downloading protobuf-4.24.1-cp37-abi3-manylinux2014_x86_64.whl (311 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 311.4/311.4 kB 24.1 MB/s eta 0:00:00
Downloading xds_protos-1.58.0rc1-py3-none-any.whl (1.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 34.2 MB/s eta 0:00:00
Downloading cachetools-5.3.1-py3-none-any.whl (9.3 kB)
Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.3/158.3 kB 13.8 MB/s eta 0:00:00
Downloading charset_normalizer-3.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (201 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 201.8/201.8 kB 16.6 MB/s eta 0:00:00
Downloading google_api_core-2.11.1-py3-none-any.whl (120 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.5/120.5 kB 10.5 MB/s eta 0:00:00
Downloading google_auth-2.22.0-py2.py3-none-any.whl (181 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.8/181.8 kB 13.7 MB/s eta 0:00:00
Downloading googleapis_common_protos-1.60.0-py2.py3-none-any.whl (227 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 227.6/227.6 kB 14.9 MB/s eta 0:00:00
Downloading grpcio_status-1.57.0-py3-none-any.whl (5.1 kB)
Downloading MarkupSafe-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Downloading proto_plus-1.22.3-py3-none-any.whl (48 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.1/48.1 kB 4.4 MB/s eta 0:00:00
Downloading pyparsing-3.1.1-py3-none-any.whl (103 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.1/103.1 kB 9.6 MB/s eta 0:00:00
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 5.2 MB/s eta 0:00:00
Downloading urllib3-1.26.16-py2.py3-none-any.whl (143 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.1/143.1 kB 12.8 MB/s eta 0:00:00
Downloading websocket_client-1.6.2-py3-none-any.whl (57 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.0/57.0 kB 4.6 MB/s eta 0:00:00
Installing collected packages: websocket-client, urllib3, uritemplate, six, PyYAML, pyparsing, Pygments, pyasn1, protobuf, packaging, oauthlib, MarkupSafe, idna, grpcio, charset-normalizer, certifi, cachetools, xds-protos, tenacity, rsa, requests, python-dateutil, pyasn1-modules, proto-plus, Mako, httplib2, grpcio-tools, grpcio-health-checking, grpcio-channelz, googleapis-common-protos, absl-py, requests-oauthlib, grpcio-status, google-auth, kubernetes, grpc-google-iam-v1, google-auth-httplib2, google-api-core, google-api-python-client, google-cloud-secret-manager
Successfully installed Mako-1.2.4 MarkupSafe-2.1.3 PyYAML-6.0 Pygments-2.14.0 absl-py-0.15.0 cachetools-5.3.1 certifi-2023.7.22 charset-normalizer-3.2.0 google-api-core-2.11.1 google-api-python-client-1.12.11 google-auth-2.22.0 google-auth-httplib2-0.1.0 google-cloud-secret-manager-2.15.1 googleapis-common-protos-1.60.0 grpc-google-iam-v1-0.12.6 grpcio-1.57.0 grpcio-channelz-1.57.0 grpcio-health-checking-1.57.0 grpcio-status-1.57.0 grpcio-tools-1.57.0 httplib2-0.22.0 idna-3.4 kubernetes-27.2.0 oauthlib-3.2.2 packaging-23.1 proto-plus-1.22.3 protobuf-4.24.1 pyasn1-0.5.0 pyasn1-modules-0.3.0 pyparsing-3.1.1 python-dateutil-2.8.2 requests-2.31.0 requests-oauthlib-1.3.1 rsa-4.9 six-1.16.0 tenacity-6.3.1 uritemplate-3.0.1 urllib3-1.26.16 websocket-client-1.6.2 xds-protos-1.58.0rc1
Installed Python packages:
Package Version
--------------------------- ---------
absl-py 0.15.0
cachetools 5.3.1
certifi 2023.7.22
charset-normalizer 3.2.0
google-api-core 2.11.1
google-api-python-client 1.12.11
google-auth 2.22.0
google-auth-httplib2 0.1.0
google-cloud-secret-manager 2.15.1
googleapis-common-protos 1.60.0
grpc-google-iam-v1 0.12.6
grpcio 1.57.0
grpcio-channelz 1.57.0
grpcio-health-checking 1.57.0
grpcio-status 1.57.0
grpcio-tools 1.57.0
httplib2 0.22.0
idna 3.4
kubernetes 27.2.0
Mako 1.2.4
MarkupSafe 2.1.3
oauthlib 3.2.2
packaging 23.1
pip 23.3.1
proto-plus 1.22.3
protobuf 4.24.1
pyasn1 0.5.0
pyasn1-modules 0.3.0
Pygments 2.14.0
pyparsing 3.1.1
python-dateutil 2.8.2
PyYAML 6.0
requests 2.31.0
requests-oauthlib 1.3.1
rsa 4.9
setuptools 69.0.2
six 1.16.0
tenacity 6.3.1
uritemplate 3.0.1
urllib3 1.26.16
websocket-client 1.6.2
xds-protos 1.58.0rc1
Generate python code from grpc.testing protos: protos/grpc/testing/test.proto protos/grpc/testing/messages.proto protos/grpc/testing/empty.proto
/tmp/tmp.C9b0mU2t71/psm-interop/venv/lib/python3.10/site-packages/grpc_tools/protoc.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
Generated files /tmp/tmp.C9b0mU2t71/psm-interop/protos/grpc/testing:
total 108
-rw-rw-r-- 1 kbuilder kbuilder 957 Dec 14 00:23 empty.proto
-rw-rw-r-- 1 kbuilder kbuilder 1007 Dec 14 00:24 empty_pb2.py
-rw-rw-r-- 1 kbuilder kbuilder 159 Dec 14 00:24 empty_pb2_grpc.py
-rw-rw-r-- 1 kbuilder kbuilder 11527 Dec 14 00:23 messages.proto
-rw-rw-r-- 1 kbuilder kbuilder 17206 Dec 14 00:24 messages_pb2.py
-rw-rw-r-- 1 kbuilder kbuilder 159 Dec 14 00:24 messages_pb2_grpc.py
-rw-rw-r-- 1 kbuilder kbuilder 4871 Dec 14 00:23 test.proto
-rw-rw-r-- 1 kbuilder kbuilder 4296 Dec 14 00:24 test_pb2.py
-rw-rw-r-- 1 kbuilder kbuilder 41870 Dec 14 00:24 test_pb2_grpc.py
Server image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
┌──────────────────────────────────────────────────┬──────────────┬─────────────────────┐
│ TAGS │ DIGEST │ TIMESTAMP │
├──────────────────────────────────────────────────┼──────────────┼─────────────────────┤
│ c4fe1175ee793f39fde25f358cbdfda1d27afffd,v1.59.x │ 8e10711f310c │ 2023-11-28T10:31:53 │
└──────────────────────────────────────────────────┴──────────────┴─────────────────────┘
Client image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
┌──────────────────────────────────────────────────┬──────────────┬─────────────────────┐
│ TAGS │ DIGEST │ TIMESTAMP │
├──────────────────────────────────────────────────┼──────────────┼─────────────────────┤
│ c4fe1175ee793f39fde25f358cbdfda1d27afffd,v1.59.x │ d89fbb55e454 │ 2023-11-28T10:31:55 │
└──────────────────────────────────────────────────┴──────────────┴─────────────────────┘
Skipping Java test app build
mkdir: created directory '/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/baseline_test'
+ python -m tests.baseline_test --flagfile=config/grpc-testing.cfg --kube_context=gke_grpc-testing_us-central1-a_psm-interop-security --server_image=gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd --client_image=gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd --testing_version=dev-v1.59.x --force_cleanup --collect_app_logs --log_dir=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/baseline_test --xml_output_file=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/baseline_test/sponge_log.xml
+ tee /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/baseline_test/sponge_log.log
Running tests under Python 3.10.12: /tmp/tmp.C9b0mU2t71/psm-interop/venv/bin/python
I1214 00:24:07.998420 139659008663552 xds_k8s_testcase.py:157] ----- Testing BaselineTest -----
I1214 00:24:07.998549 139659008663552 xds_k8s_testcase.py:158] Logs timezone: UTC
I1214 00:24:07.998752 139659008663552 xds_k8s_testcase.py:106] Detected language and version: TestConfig(client_lang='java', server_lang='java', version='dev-v1.59.x')
I1214 00:24:08.710988 139659008663552 k8s.py:242] Using kubernetes context "gke_grpc-testing_us-central1-a_psm-interop-security", active host: https://35.202.85.90
[ RUN ] BaselineTest.test_traffic_director_grpc_setup
I1214 00:24:08.876609 139659008663552 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0024-i6pqw
I1214 00:24:09.114912 139659008663552 logs.py:31] Log root dir: /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/baseline_test
I1214 00:24:09.485445 139659008663552 xds_k8s_testcase.py:663] Found unused xds port: 17481
I1214 00:24:09.485788 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.0_create_health_check ---
I1214 00:24:09.485910 139659008663552 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0024-i6pqw"
I1214 00:24:09.488274 139659008663552 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
portSpecification: USE_SERVING_PORT
name: psm-interop-health-check-20231214-0024-i6pqw
type: GRPC
...

I1214 00:24:10.243155 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513449550-60c6d4d62c1bf-07aab0ae-2e746969
I1214 00:24:12.539213 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.0_create_health_check ---
I1214 00:24:12.539414 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.1_create_backend_service ---
I1214 00:24:12.539503 139659008663552 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0024-i6pqw"
I1214 00:24:12.545012 139659008663552 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0024-i6pqw
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0024-i6pqw
protocol: GRPC
...

I1214 00:24:13.206840 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513452547-60c6d4d907cf9-e49f25a8-f85dabb4
I1214 00:24:34.602574 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.1_create_backend_service ---
I1214 00:24:34.602807 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.2_create_url_map ---
I1214 00:24:34.602940 139659008663552 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0024-i6pqw": psm-grpc-server:17481 -> psm-interop-backend-service-20231214-0024-i6pqw
I1214 00:24:34.610555 139659008663552 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0024-i6pqw
hostRules:
- hosts:
- psm-grpc-server:17481
pathMatcher: psm-interop-path-matcher-20231214-0024-i6pqw
name: psm-interop-url-map-20231214-0024-i6pqw
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0024-i6pqw
name: psm-interop-path-matcher-20231214-0024-i6pqw
...

I1214 00:24:35.383115 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513474612-60c6d4ee12e32-7e861b16-887b65fe
I1214 00:24:37.708859 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.2_create_url_map ---
I1214 00:24:37.709048 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.3_create_target_proxy ---
I1214 00:24:37.709135 139659008663552 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0024-i6pqw proxy "GRPC" to URL map psm-interop-url-map-20231214-0024-i6pqw
I1214 00:24:37.711174 139659008663552 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0024-i6pqw
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0024-i6pqw
validate_for_proxyless: true
...

I1214 00:24:38.335933 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513477713-60c6d4f107de9-6efc2f6e-ce4f8dd1
I1214 00:24:40.660931 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.3_create_target_proxy ---
I1214 00:24:40.661159 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.4_create_forwarding_rule ---
I1214 00:24:40.661287 139659008663552 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0024-i6pqw" in network "default-vpc": 0.0.0.0:17481 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0024-i6pqw
I1214 00:24:40.663364 139659008663552 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0024-i6pqw
network: global/networks/default-vpc
portRange: 17481
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0024-i6pqw
...

I1214 00:24:41.329560 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513480665-60c6d4f3d8b5a-a6cbf6a5-581ad827
I1214 00:24:54.200295 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.4_create_forwarding_rule ---
I1214 00:24:54.200514 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.5_start_test_server ---
I1214 00:24:54.200635 139659008663552 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0024-i6pqw: test_port=8080 maintenance_port=8080 secure_mode=False replica_count=1
I1214 00:24:54.200944 139659008663552 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0024-i6pqw%22;timeRange=2023-12-14T00:24:54.200818Z%2F2023-12-14T00:54:54.200818Z?project=grpc-testing
I1214 00:24:54.204674 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0024-i6pqw
labels:
name: psm-interop-server-20231214-0024-i6pqw
owner: xds-k8s-interop-test
...

I1214 00:24:54.278075 139659008663552 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0024-i6pqw created
I1214 00:24:54.280426 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0024-i6pqw
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0024-i6pqw-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 00:24:54.349987 139659008663552 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 00:24:54.350204 139659008663552 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0024-i6pqw
I1214 00:24:54.447479 139659008663552 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0024-i6pqw: neg_name=psm-interop-server-20231214-0024-i6pqw-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 00:24:54.447674 139659008663552 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0024-i6pqw/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:24:55.357557 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0024-i6pqw
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:24:55.418437 139659008663552 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 00:24:55.425328 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0024-i6pqw
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-aoeuyyow
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-aoeuyyow
template:
metadata:
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-aoeuyyow
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8080
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
ports:
- containerPort: 8080
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0024-i6pqw-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:24:55.503756 139659008663552 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 00:24:55.503994 139659008663552 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 00:24:55.617105 139659008663552 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-86dfc8457b-cfhlz']
I1214 00:24:55.617322 139659008663552 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-86dfc8457b-cfhlz to start
I1214 00:24:58.859684 139659008663552 k8s_base_runner.py:774] Pod psm-grpc-server-86dfc8457b-cfhlz ready, IP: 10.12.4.107
I1214 00:24:58.859925 139659008663552 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-86dfc8457b-cfhlz to baseline_test/test_app_logs/psm-interop-server-20231214-0024-i6pqw_psm-grpc-server-86dfc8457b-cfhlz.log
I1214 00:24:58.860397 139658915210816 k8s_log_collector.py:70] Starting log collection thread 139658915210816 for psm-grpc-server-86dfc8457b-cfhlz
I1214 00:24:58.860735 139659008663552 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 00:25:03.201357 139659008663552 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 00:25:03.201735 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.5_start_test_server ---
I1214 00:25:03.201841 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.6_add_server_backends_to_backend_service ---
I1214 00:25:03.239320 139659008663552 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 00:25:03.507745 139659008663552 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0024-i6pqw-psm-grpc-server" in zone us-central1-a
I1214 00:25:03.508003 139659008663552 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0024-i6pqw: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0024-i6pqw-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0024-i6pqw-psm-grpc-server', zone='us-central1-a')}
I1214 00:25:03.511220 139659008663552 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0024-i6pqw-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 00:25:05.161195 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513503513-60c6d509a2cd8-82fb4f37-eed0bf9e
I1214 00:25:47.958754 139659008663552 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0024-i6pqw to report all backends healthy: ['psm-interop-server-20231214-0024-i6pqw-psm-grpc-server']
I1214 00:26:21.712480 139659008663552 compute.py:494] Backend psm-interop-server-20231214-0024-i6pqw-psm-grpc-server in zone us-central1-a reported healthy
I1214 00:26:25.717167 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.6_add_server_backends_to_backend_service ---
I1214 00:26:25.717394 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.7_start_test_client ---
I1214 00:26:25.717518 139659008663552 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0024-i6pqw: server_target=xds:///psm-grpc-server:17481 rpc=UnaryCall qps=25 metadata='' secure_mode=False print_response=False
I1214 00:26:25.717726 139659008663552 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0024-i6pqw%22;timeRange=2023-12-14T00:26:25.717605Z%2F2023-12-14T00:56:25.717605Z?project=grpc-testing
I1214 00:26:25.719388 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0024-i6pqw
labels:
name: psm-interop-client-20231214-0024-i6pqw
owner: xds-k8s-interop-test
...

I1214 00:26:25.825709 139659008663552 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0024-i6pqw created
I1214 00:26:25.825916 139659008663552 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0024-i6pqw/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:26:26.416763 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0024-i6pqw
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:26:26.488439 139659008663552 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 00:26:26.494796 139659008663552 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0024-i6pqw
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-rz0xzpag
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-rz0xzpag
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-rz0xzpag
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:17481"
- "--stats_port=8079"
- "--qps=25"
- "--rpc=UnaryCall"
- "--metadata="
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RING_HASH
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_ENABLE_RETRY
value: "true"
- name: GRPC_EXPERIMENTAL_ENABLE_OUTLIER_DETECTION
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_CUSTOM_LB_CONFIG
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:26:26.577184 139659008663552 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 00:26:26.577411 139659008663552 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 00:26:26.692540 139659008663552 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-6488fbb8bd-drp7z']
I1214 00:26:26.692813 139659008663552 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-6488fbb8bd-drp7z to start
I1214 00:26:29.927726 139659008663552 k8s_base_runner.py:774] Pod psm-grpc-client-6488fbb8bd-drp7z ready, IP: 10.12.8.127
I1214 00:26:29.927976 139659008663552 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-6488fbb8bd-drp7z to baseline_test/test_app_logs/psm-interop-client-20231214-0024-i6pqw_psm-grpc-client-6488fbb8bd-drp7z.log
I1214 00:26:29.928416 139658906818112 k8s_log_collector.py:70] Starting log collection thread 139658906818112 for psm-grpc-client-6488fbb8bd-drp7z
I1214 00:26:29.928538 139659008663552 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 00:26:31.146783 139659008663552 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 00:26:31.147292 139659008663552 client_app.py:282] [psm-grpc-client-6488fbb8bd-drp7z] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 00:26:33.332049 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:26:43.379247 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:26:53.427145 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:27:03.474107 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:27:13.522156 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:27:29.576930 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:27:54.638272 139659008663552 client_app.py:310] [psm-grpc-client-6488fbb8bd-drp7z] xDS control plane channel:
I1214 00:27:54.638487 139659008663552 client_app.py:320] [psm-grpc-client-6488fbb8bd-drp7z] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 00:27:54.638620 139659008663552 client_app.py:292] [psm-grpc-client-6488fbb8bd-drp7z] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 00:27:54.638820 139659008663552 client_app.py:242] [psm-grpc-client-6488fbb8bd-drp7z] Waiting to report a READY channel to xds:///psm-grpc-server:17481
I1214 00:27:54.672633 139659008663552 client_app.py:356] [psm-grpc-client-6488fbb8bd-drp7z] Server channel:
I1214 00:27:54.716993 139659008663552 client_app.py:369] [psm-grpc-client-6488fbb8bd-drp7z] Found subchannel in state READY:
I1214 00:27:54.717312 139659008663552 client_app.py:253] [psm-grpc-client-6488fbb8bd-drp7z] Channel to xds:///psm-grpc-server:17481 transitioned to state READY:
I1214 00:27:54.717387 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.7_start_test_client ---
I1214 00:27:54.717443 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.8_test_client_xds_config_exists ---
I1214 00:27:54.717591 139659008663552 grpc.py:74] [psm-grpc-client-6488fbb8bd-drp7z:8079] >> RPC ClientStatusDiscoveryService.FetchClientStatus(request=ClientStatusRequest({}), timeout=90, wait_for_ready=True)
I1214 00:27:54.762749 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.8_test_client_xds_config_exists ---
I1214 00:27:54.762979 139659008663552 xds_k8s_testcase.py:269] --- Starting subTest __main__.BaselineTest.test_traffic_director_grpc_setup.9_test_server_received_rpcs_from_test_client ---
I1214 00:27:54.763255 139659008663552 grpc.py:74] [psm-grpc-client-6488fbb8bd-drp7z:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 00:27:58.780992 139659008663552 xds_k8s_testcase.py:601] [psm-grpc-client-6488fbb8bd-drp7z] << Received LoadBalancerStatsResponse:
num_failures: 0
rpcs_by_peer:
psm-grpc-server-86dfc8457b-cfhlz: 100
rpcs_by_method:
UnaryCall:
psm-grpc-server-86dfc8457b-cfhlz: 100

I1214 00:27:58.781219 139659008663552 xds_k8s_testcase.py:274] --- Finished subTest __main__.BaselineTest.test_traffic_director_grpc_setup.9_test_server_received_rpcs_from_test_client ---
I1214 00:27:58.781311 139659008663552 xds_k8s_testcase.py:687] ----- TestMethod __main__.BaselineTest.test_traffic_director_grpc_setup teardown -----
I1214 00:27:58.888525 139659008663552 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0024-i6pqw"
I1214 00:27:59.511904 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513678892-60c6d5b0e3d57-f033d861-84016f9e
I1214 00:28:10.334959 139659008663552 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0024-i6pqw"
I1214 00:28:10.472727 139659008663552 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0024-i6pqw"
I1214 00:28:10.828006 139659008663552 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0024-i6pqw"
I1214 00:28:11.263175 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513690830-60c6d5bc46885-4b370ab8-7bce1062
I1214 00:28:13.517904 139659008663552 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0024-i6pqw"
I1214 00:28:13.906867 139659008663552 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0024-i6pqw"
I1214 00:28:14.415174 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513693911-60c6d5bf3682e-e8a456c4-4edd367b
I1214 00:28:16.671733 139659008663552 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0024-i6pqw"
I1214 00:28:17.124211 139659008663552 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0024-i6pqw"
I1214 00:28:17.677570 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513697129-60c6d5c24834e-4dee3a55-09c81513
I1214 00:28:47.764103 139659008663552 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0024-i6pqw"
I1214 00:28:48.182350 139659008663552 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0024-i6pqw"
I1214 00:28:48.513899 139659008663552 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0024-i6pqw"
I1214 00:28:49.129274 139659008663552 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513728591-60c6d5e0497b6-093a5640-ea24840b
I1214 00:28:53.494340 139659008663552 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 00:29:03.721782 139659008663552 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 00:29:03.722083 139659008663552 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0024-i6pqw/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:29:04.264229 139659008663552 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 00:29:04.389999 139659008663552 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 00:29:04.390208 139659008663552 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0024-i6pqw
I1214 00:29:34.580985 139659008663552 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0024-i6pqw deleted
I1214 00:29:34.581238 139659008663552 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 00:29:44.753820 139659008663552 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 00:29:44.754096 139659008663552 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 00:29:44.874430 139659008663552 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 00:29:44.874713 139659008663552 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0024-i6pqw/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:29:45.502499 139659008663552 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 00:29:45.621575 139659008663552 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 00:29:45.621799 139659008663552 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0024-i6pqw
I1214 00:31:15.987548 139659008663552 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0024-i6pqw deleted
I1214 00:31:15.988001 139659008663552 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 00:31:15.988261 139659008663552 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-rz0xzpag:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0024-i6pqw%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-rz0xzpag%22;timeRange=2023-12-14T00:26:25.717598Z%2F2023-12-14T00:29:34.581207Z?project=grpc-testing
I1214 00:31:15.988476 139659008663552 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-aoeuyyow:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0024-i6pqw%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-aoeuyyow%22;timeRange=2023-12-14T00:24:54.200810Z%2F2023-12-14T00:31:15.987829Z?project=grpc-testing
[ OK ] BaselineTest.test_traffic_director_grpc_setup
I1214 00:31:15.988759 139659008663552 base_testcase.py:52] ----- TestCase __main__.BaselineTest.test_traffic_director_grpc_setup PASSED -----
----------------------------------------------------------------------
Ran 1 test in 427.993s

OK
+ for test in "${test_suites[@]}"
+ run_test security_test
+ local test_name=security_test
+ local out_dir=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test
+ mkdir -pv /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test
mkdir: created directory '/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test'
+ set -x
+ python -m tests.security_test --flagfile=config/grpc-testing.cfg --kube_context=gke_grpc-testing_us-central1-a_psm-interop-security --server_image=gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd --client_image=gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd --testing_version=dev-v1.59.x --force_cleanup --collect_app_logs --log_dir=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test --xml_output_file=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test/sponge_log.xml
+ tee /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test/sponge_log.log
Running tests under Python 3.10.12: /tmp/tmp.C9b0mU2t71/psm-interop/venv/bin/python
I1214 00:31:17.081391 140058089635840 xds_k8s_testcase.py:157] ----- Testing SecurityTest -----
I1214 00:31:17.081506 140058089635840 xds_k8s_testcase.py:158] Logs timezone: UTC
I1214 00:31:17.081767 140058089635840 xds_k8s_testcase.py:106] Detected language and version: TestConfig(client_lang='java', server_lang='java', version='dev-v1.59.x')
I1214 00:31:17.092572 140058089635840 k8s.py:242] Using kubernetes context "gke_grpc-testing_us-central1-a_psm-interop-security", active host: https://35.202.85.90
[ RUN ] SecurityTest.test_mtls
I1214 00:31:17.096634 140058089635840 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0031-3mtpg
I1214 00:31:17.501088 140058089635840 logs.py:31] Log root dir: /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/security_test
I1214 00:31:17.763997 140058089635840 xds_k8s_testcase.py:663] Found unused xds port: 57300
I1214 00:31:17.764385 140058089635840 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0031-3mtpg"
I1214 00:31:17.766937 140058089635840 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0031-3mtpg
type: GRPC
...

I1214 00:31:18.511219 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513877831-60c6d66e9d0ed-3a10d969-9054b964
I1214 00:31:20.818212 140058089635840 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0031-3mtpg"
I1214 00:31:20.823911 140058089635840 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0031-3mtpg
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0031-3mtpg
protocol: GRPC
...

I1214 00:31:21.761032 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513880826-60c6d6717811d-b4be05ff-c0c11900
I1214 00:31:56.215904 140058089635840 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0031-3mtpg": psm-grpc-server:57300 -> psm-interop-backend-service-20231214-0031-3mtpg
I1214 00:31:56.225018 140058089635840 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0031-3mtpg
hostRules:
- hosts:
- psm-grpc-server:57300
pathMatcher: psm-interop-path-matcher-20231214-0031-3mtpg
name: psm-interop-url-map-20231214-0031-3mtpg
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0031-3mtpg
name: psm-interop-path-matcher-20231214-0031-3mtpg
...

I1214 00:31:56.797309 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513916227-60c6d6933ae73-225d1cd8-dc37c0fa
I1214 00:31:59.111913 140058089635840 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0031-3mtpg proxy "GRPC" to URL map psm-interop-url-map-20231214-0031-3mtpg
I1214 00:31:59.113722 140058089635840 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0031-3mtpg
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0031-3mtpg
validate_for_proxyless: true
...

I1214 00:31:59.577908 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513919115-60c6d695fc152-ff4432a0-7d74d698
I1214 00:32:01.812470 140058089635840 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0031-3mtpg" in network "default-vpc": 0.0.0.0:57300 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0031-3mtpg
I1214 00:32:01.814702 140058089635840 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0031-3mtpg
network: global/networks/default-vpc
portRange: 57300
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0031-3mtpg
...

I1214 00:32:02.473368 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513921816-60c6d6988f7fa-4b902de0-65e1fcd4
I1214 00:32:11.179470 140058089635840 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0031-3mtpg
I1214 00:32:11.181775 140058089635840 api.py:468] Creating networksecurity resource:
---
clientCertificate: &id001
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
serverValidationCa:
- *id001
...

I1214 00:32:11.695801 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702513931298-60c6d6a19a52e-5aea2378-61021943
I1214 00:32:16.154337 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0031-3mtpg:
---
clientCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
createTime: '2023-12-14T00:32:11.378396258Z'
name: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0031-3mtpg
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T00:32:15.014647728Z'
...

I1214 00:32:16.154590 140058089635840 traffic_director.py:1095] Adding Client TLS Policy to Backend Service psm-interop-backend-service-20231214-0031-3mtpg: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0031-3mtpg, server spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0031-3mtpg/sa/psm-grpc-server
I1214 00:32:16.157609 140058089635840 compute.py:544] Patching compute resource:
---
securitySettings:
clientTlsPolicy: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0031-3mtpg
subjectAltNames:
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0031-3mtpg/sa/psm-grpc-server
...

I1214 00:32:17.242269 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513936162-60c6d6a63dd44-f12abf99-4ef51870
I1214 00:32:34.502838 140058089635840 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0031-3mtpg
I1214 00:32:34.504583 140058089635840 api.py:468] Creating networksecurity resource:
---
mtlsPolicy:
clientValidationCa:
- &id001
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
serverCertificate: *id001
...

I1214 00:32:34.762689 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702513954574-60c6d6b7ccff6-ecfee25a-3ad51705
I1214 00:32:39.230734 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0031-3mtpg:
---
createTime: '2023-12-14T00:32:34.643908161Z'
mtlsPolicy:
clientValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
name: projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0031-3mtpg
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T00:32:38.017495731Z'
...

I1214 00:32:39.230992 140058089635840 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0031-3mtpg
I1214 00:32:39.233346 140058089635840 api.py:468] Creating networkservices resource:
---
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0031-3mtpg-psm-grpc-server
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0031-3mtpg
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 00:32:39.601946 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702513959345-60c6d6bc59b85-d836be94-6440399f
I1214 00:32:44.059439 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0031-3mtpg:
---
createTime: '2023-12-14T00:32:39.426828665Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0031-3mtpg-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0031-3mtpg
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0031-3mtpg
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T00:32:43.002259413Z'
...

I1214 00:32:44.059667 140058089635840 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0031-3mtpg: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 00:32:44.059892 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0031-3mtpg%22;timeRange=2023-12-14T00:32:44.059760Z%2F2023-12-14T01:02:44.059760Z?project=grpc-testing
I1214 00:32:44.063502 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0031-3mtpg
labels:
name: psm-interop-server-20231214-0031-3mtpg
owner: xds-k8s-interop-test
...

I1214 00:32:44.198893 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0031-3mtpg created
I1214 00:32:44.201639 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0031-3mtpg
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0031-3mtpg-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 00:32:44.276282 140058089635840 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 00:32:44.276487 140058089635840 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0031-3mtpg
I1214 00:32:44.372401 140058089635840 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0031-3mtpg: neg_name=psm-interop-server-20231214-0031-3mtpg-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 00:32:44.372589 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0031-3mtpg/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:32:45.236859 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0031-3mtpg
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:32:45.311892 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 00:32:45.318243 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0031-3mtpg
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-tcq5b6fd
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-tcq5b6fd
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-tcq5b6fd
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0031-3mtpg-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:32:45.395766 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 00:32:45.395990 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 00:32:45.505857 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-7994b7ccc9-7prbf']
I1214 00:32:45.506128 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-7994b7ccc9-7prbf to start
I1214 00:32:49.858704 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-server-7994b7ccc9-7prbf ready, IP: 10.12.5.52
I1214 00:32:49.858970 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-7994b7ccc9-7prbf to security_test/test_app_logs/psm-interop-server-20231214-0031-3mtpg_psm-grpc-server-7994b7ccc9-7prbf.log
I1214 00:32:49.859549 140057994847808 k8s_log_collector.py:70] Starting log collection thread 140057994847808 for psm-grpc-server-7994b7ccc9-7prbf
I1214 00:32:49.859915 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 00:32:55.185346 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 00:32:55.223261 140058089635840 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 00:32:55.350397 140058089635840 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0031-3mtpg-psm-grpc-server" in zone us-central1-a
I1214 00:32:55.350618 140058089635840 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0031-3mtpg: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0031-3mtpg-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0031-3mtpg-psm-grpc-server', zone='us-central1-a')}
I1214 00:32:55.353923 140058089635840 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0031-3mtpg-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 00:32:56.766619 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702513975357-60c6d6cb9ee7c-f83c15d5-90d52d04
I1214 00:33:45.885604 140058089635840 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0031-3mtpg to report all backends healthy: ['psm-interop-server-20231214-0031-3mtpg-psm-grpc-server']
I1214 00:34:27.953778 140058089635840 compute.py:494] Backend psm-interop-server-20231214-0031-3mtpg-psm-grpc-server in zone us-central1-a reported healthy
I1214 00:34:31.958437 140058089635840 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0031-3mtpg: server_target=xds:///psm-grpc-server:57300 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 00:34:31.958805 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0031-3mtpg%22;timeRange=2023-12-14T00:34:31.958676Z%2F2023-12-14T01:04:31.958676Z?project=grpc-testing
I1214 00:34:31.960451 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0031-3mtpg
labels:
name: psm-interop-client-20231214-0031-3mtpg
owner: xds-k8s-interop-test
...

I1214 00:34:32.130616 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0031-3mtpg created
I1214 00:34:32.130845 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0031-3mtpg/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:34:32.860505 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0031-3mtpg
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:34:32.930685 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 00:34:32.936554 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0031-3mtpg
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-oar8rthq
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-oar8rthq
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-oar8rthq
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:57300"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:34:33.015760 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 00:34:33.016019 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 00:34:33.120429 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-8487996f65-4bddp']
I1214 00:34:33.120692 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-8487996f65-4bddp to start
I1214 00:34:37.405077 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-client-8487996f65-4bddp ready, IP: 10.12.8.129
I1214 00:34:37.405332 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-8487996f65-4bddp to security_test/test_app_logs/psm-interop-client-20231214-0031-3mtpg_psm-grpc-client-8487996f65-4bddp.log
I1214 00:34:37.405883 140057986455104 k8s_log_collector.py:70] Starting log collection thread 140057986455104 for psm-grpc-client-8487996f65-4bddp
I1214 00:34:37.406249 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 00:34:38.619770 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 00:34:38.620309 140058089635840 client_app.py:282] [psm-grpc-client-8487996f65-4bddp] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 00:34:51.480937 140058089635840 client_app.py:310] [psm-grpc-client-8487996f65-4bddp] xDS control plane channel:
I1214 00:35:01.528700 140058089635840 client_app.py:310] [psm-grpc-client-8487996f65-4bddp] xDS control plane channel:
I1214 00:35:11.576882 140058089635840 client_app.py:310] [psm-grpc-client-8487996f65-4bddp] xDS control plane channel:
I1214 00:35:21.625137 140058089635840 client_app.py:310] [psm-grpc-client-8487996f65-4bddp] xDS control plane channel:
I1214 00:35:37.679372 140058089635840 client_app.py:310] [psm-grpc-client-8487996f65-4bddp] xDS control plane channel:
I1214 00:35:37.679626 140058089635840 client_app.py:320] [psm-grpc-client-8487996f65-4bddp] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 00:35:37.679770 140058089635840 client_app.py:292] [psm-grpc-client-8487996f65-4bddp] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 00:35:37.679981 140058089635840 client_app.py:242] [psm-grpc-client-8487996f65-4bddp] Waiting to report a READY channel to xds:///psm-grpc-server:57300
I1214 00:35:37.715330 140058089635840 client_app.py:356] [psm-grpc-client-8487996f65-4bddp] Server channel:
I1214 00:35:37.768110 140058089635840 client_app.py:369] [psm-grpc-client-8487996f65-4bddp] Found subchannel in state READY:
I1214 00:35:37.768498 140058089635840 client_app.py:253] [psm-grpc-client-8487996f65-4bddp] Channel to xds:///psm-grpc-server:57300 transitioned to state READY:
I1214 00:35:37.803514 140058089635840 client_app.py:356] [psm-grpc-client-8487996f65-4bddp] Server channel:
I1214 00:35:37.839890 140058089635840 client_app.py:369] [psm-grpc-client-8487996f65-4bddp] Found subchannel in state READY:
I1214 00:35:38.241425 140058089635840 server_app.py:174] [psm-grpc-server-7994b7ccc9-7prbf] Found matching socket pair: server(local=10.12.5.52:8080, remote=10.12.8.129:49878) <-> client(local=10.12.8.129:49878, remote=10.12.5.52:8080)
I1214 00:35:38.241670 140058089635840 xds_k8s_testcase.py:989] Server certs: local: , remote:
I1214 00:35:38.241825 140058089635840 xds_k8s_testcase.py:990] Client certs: local: , remote:
I1214 00:35:38.242084 140058089635840 grpc.py:74] [psm-grpc-client-8487996f65-4bddp:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 00:35:42.280742 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-8487996f65-4bddp] << Received LoadBalancerStatsResponse:
num_failures: 0
rpcs_by_peer:
psm-grpc-server-7994b7ccc9-7prbf: 100
rpcs_by_method:
UnaryCall:
psm-grpc-server-7994b7ccc9-7prbf: 100

I1214 00:35:42.281030 140058089635840 security_test.py:62] [SUCCESS] mTLS security mode confirmed.
I1214 00:35:42.281136 140058089635840 xds_k8s_testcase.py:687] ----- TestMethod __main__.SecurityTest.test_mtls teardown -----
I1214 00:35:42.398652 140058089635840 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0031-3mtpg"
I1214 00:35:43.084904 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514142403-60c6d76aed9d6-e9523652-496a99b1
I1214 00:36:15.337019 140058089635840 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0031-3mtpg"
I1214 00:36:15.440298 140058089635840 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0031-3mtpg"
I1214 00:36:15.856540 140058089635840 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0031-3mtpg"
I1214 00:36:16.391175 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514175860-60c6d78ad5ebe-72431351-b470bdd6
I1214 00:36:18.628052 140058089635840 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0031-3mtpg"
I1214 00:36:18.853208 140058089635840 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0031-3mtpg"
I1214 00:36:19.402285 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514178857-60c6d78db1a14-4f1bb2fd-1065b86e
I1214 00:36:21.635149 140058089635840 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0031-3mtpg"
I1214 00:36:22.022796 140058089635840 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0031-3mtpg"
I1214 00:36:22.618810 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514182027-60c6d790b77b0-c2109194-1a951e74
I1214 00:36:50.456216 140058089635840 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0031-3mtpg"
I1214 00:36:50.864297 140058089635840 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0031-3mtpg"
I1214 00:36:51.313427 140058089635840 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0031-3mtpg"
I1214 00:36:51.871923 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514211393-60c6d7acb8fe2-4d1cc26c-e4696e4f
I1214 00:36:56.270446 140058089635840 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0031-3mtpg
I1214 00:36:56.775708 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702514216432-60c6d7b187556-d2a1591a-fd1d7117
I1214 00:37:13.772891 140058089635840 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0031-3mtpg
I1214 00:37:13.991650 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702514233839-60c6d7c220e13-a894d229-4c3196de
I1214 00:37:30.678591 140058089635840 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0031-3mtpg
I1214 00:37:31.055900 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702514250798-60c6d7d24d709-74cd2f1f-f93f11dc
I1214 00:37:35.332387 140058089635840 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0031-3mtpg
I1214 00:37:35.392722 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 00:37:45.672559 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 00:37:45.672925 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0031-3mtpg/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:37:46.522360 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 00:37:46.650184 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 00:37:46.650388 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0031-3mtpg
I1214 00:38:16.850395 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0031-3mtpg deleted
I1214 00:38:16.850681 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 00:38:27.101870 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 00:38:27.102165 140058089635840 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 00:38:27.219524 140058089635840 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 00:38:27.219750 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0031-3mtpg/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:38:27.788163 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 00:38:27.909040 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 00:38:27.909263 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0031-3mtpg
I1214 00:39:28.165035 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0031-3mtpg deleted
I1214 00:39:28.165375 140058089635840 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 00:39:28.165569 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-oar8rthq:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0031-3mtpg%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-oar8rthq%22;timeRange=2023-12-14T00:34:31.958668Z%2F2023-12-14T00:38:16.850639Z?project=grpc-testing
I1214 00:39:28.165747 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-tcq5b6fd:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0031-3mtpg%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-tcq5b6fd%22;timeRange=2023-12-14T00:32:44.059754Z%2F2023-12-14T00:39:28.165244Z?project=grpc-testing
[ OK ] SecurityTest.test_mtls
I1214 00:39:28.165986 140058089635840 base_testcase.py:52] ----- TestCase __main__.SecurityTest.test_mtls PASSED -----
[ RUN ] SecurityTest.test_mtls_error
I1214 00:39:28.166197 140058089635840 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0039-zxys5
I1214 00:39:28.330863 140058089635840 xds_k8s_testcase.py:663] Found unused xds port: 40733
I1214 00:39:28.331157 140058089635840 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0039-zxys5"
I1214 00:39:28.334169 140058089635840 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0039-zxys5
type: GRPC
...

I1214 00:39:29.111154 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514368406-60c6d84276401-55d63951-291db6df
I1214 00:39:31.406812 140058089635840 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0039-zxys5"
I1214 00:39:31.410291 140058089635840 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0039-zxys5
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0039-zxys5
protocol: GRPC
...

I1214 00:39:32.061304 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514371412-60c6d8455412f-eb04a097-cb80b46b
I1214 00:39:51.387176 140058089635840 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0039-zxys5: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 00:39:51.387485 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0039-zxys5%22;timeRange=2023-12-14T00:39:51.387380Z%2F2023-12-14T01:09:51.387380Z?project=grpc-testing
I1214 00:39:51.389287 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0039-zxys5
labels:
name: psm-interop-server-20231214-0039-zxys5
owner: xds-k8s-interop-test
...

I1214 00:39:51.480120 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0039-zxys5 created
I1214 00:39:51.482777 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0039-zxys5
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0039-zxys5-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 00:39:51.552198 140058089635840 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 00:39:51.552416 140058089635840 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0039-zxys5
I1214 00:39:51.646357 140058089635840 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0039-zxys5: neg_name=psm-interop-server-20231214-0039-zxys5-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 00:39:51.646578 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0039-zxys5/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:39:52.444533 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0039-zxys5
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:39:52.504053 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 00:39:52.509859 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0039-zxys5
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-6p13594c
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-6p13594c
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-6p13594c
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0039-zxys5-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:39:52.590661 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 00:39:52.590887 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 00:39:52.701628 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-5649468df5-d2kkx']
I1214 00:39:52.701886 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-5649468df5-d2kkx to start
I1214 00:39:56.984359 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-server-5649468df5-d2kkx ready, IP: 10.12.5.53
I1214 00:39:56.984665 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-5649468df5-d2kkx to security_test/test_app_logs/psm-interop-server-20231214-0039-zxys5_psm-grpc-server-5649468df5-d2kkx.log
I1214 00:39:56.985117 140057994847808 k8s_log_collector.py:70] Starting log collection thread 140057994847808 for psm-grpc-server-5649468df5-d2kkx
I1214 00:39:56.985392 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 00:40:02.307836 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 00:40:02.344256 140058089635840 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 00:40:02.617200 140058089635840 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0039-zxys5-psm-grpc-server" in zone us-central1-a
I1214 00:40:02.617386 140058089635840 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0039-zxys5: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0039-zxys5-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0039-zxys5-psm-grpc-server', zone='us-central1-a')}
I1214 00:40:02.620584 140058089635840 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0039-zxys5-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 00:40:03.862031 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514402622-60c6d86317cc3-485eaa81-4a78b8b9
I1214 00:40:59.625875 140058089635840 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0039-zxys5
I1214 00:40:59.627614 140058089635840 api.py:468] Creating networksecurity resource:
---
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 00:40:59.959254 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702514459687-60c6d89983c3c-c58160cc-d31bab2e
I1214 00:41:16.764107 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0039-zxys5:
---
createTime: '2023-12-14T00:40:59.772651321Z'
name: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0039-zxys5
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T00:41:15.258883443Z'
...

I1214 00:41:16.764366 140058089635840 traffic_director.py:1095] Adding Client TLS Policy to Backend Service psm-interop-backend-service-20231214-0039-zxys5: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0039-zxys5, server spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0039-zxys5/sa/psm-grpc-server
I1214 00:41:16.767581 140058089635840 compute.py:544] Patching compute resource:
---
securitySettings:
clientTlsPolicy: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0039-zxys5
subjectAltNames:
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0039-zxys5/sa/psm-grpc-server
...

I1214 00:41:17.369246 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514476771-60c6d8a9ce6e2-48319f65-42c52e6c
I1214 00:42:10.716925 140058089635840 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0039-zxys5
I1214 00:42:10.718766 140058089635840 api.py:468] Creating networksecurity resource:
---
mtlsPolicy:
clientValidationCa:
- &id001
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
serverCertificate: *id001
...

I1214 00:42:10.966498 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702514530786-60c6d8dd51bf2-4ac3d0e4-83313244
I1214 00:42:25.943713 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0039-zxys5:
---
createTime: '2023-12-14T00:42:10.850517563Z'
mtlsPolicy:
clientValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
name: projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0039-zxys5
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T00:42:25.227448733Z'
...

I1214 00:42:25.943966 140058089635840 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0039-zxys5
I1214 00:42:25.945907 140058089635840 api.py:468] Creating networkservices resource:
---
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0039-zxys5-psm-grpc-server
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0039-zxys5
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 00:42:26.378984 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702514546010-60c6d8ebd6880-5d1dbe42-3351ef29
I1214 00:42:49.573895 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0039-zxys5:
---
createTime: '2023-12-14T00:42:26.073404837Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0039-zxys5-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0039-zxys5
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0039-zxys5
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T00:42:48.201267346Z'
...

I1214 00:42:49.574095 140058089635840 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0039-zxys5": psm-grpc-server:40733 -> psm-interop-backend-service-20231214-0039-zxys5
I1214 00:42:49.577184 140058089635840 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0039-zxys5
hostRules:
- hosts:
- psm-grpc-server:40733
pathMatcher: psm-interop-path-matcher-20231214-0039-zxys5
name: psm-interop-url-map-20231214-0039-zxys5
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0039-zxys5
name: psm-interop-path-matcher-20231214-0039-zxys5
...

I1214 00:42:50.136185 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514569579-60c6d90250d6f-43cc5918-d2ab2062
I1214 00:42:52.391899 140058089635840 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0039-zxys5 proxy "GRPC" to URL map psm-interop-url-map-20231214-0039-zxys5
I1214 00:42:52.393552 140058089635840 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0039-zxys5
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0039-zxys5
validate_for_proxyless: true
...

I1214 00:42:53.117393 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514572395-60c6d90500481-6e32a257-9c3b9ee3
I1214 00:42:55.378578 140058089635840 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0039-zxys5" in network "default-vpc": 0.0.0.0:40733 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0039-zxys5
I1214 00:42:55.380909 140058089635840 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0039-zxys5
network: global/networks/default-vpc
portRange: 40733
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0039-zxys5
...

I1214 00:42:56.053117 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514575382-60c6d907d98e8-9fef8726-38a4e473
I1214 00:43:19.901144 140058089635840 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0039-zxys5 to report all backends healthy: ['psm-interop-server-20231214-0039-zxys5-psm-grpc-server']
I1214 00:43:20.326118 140058089635840 compute.py:494] Backend psm-interop-server-20231214-0039-zxys5-psm-grpc-server in zone us-central1-a reported healthy
I1214 00:43:24.331058 140058089635840 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0039-zxys5: server_target=xds:///psm-grpc-server:40733 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 00:43:24.331476 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0039-zxys5%22;timeRange=2023-12-14T00:43:24.331296Z%2F2023-12-14T01:13:24.331296Z?project=grpc-testing
I1214 00:43:24.333275 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0039-zxys5
labels:
name: psm-interop-client-20231214-0039-zxys5
owner: xds-k8s-interop-test
...

I1214 00:43:24.485566 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0039-zxys5 created
I1214 00:43:24.485781 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0039-zxys5/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:43:25.063915 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0039-zxys5
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:43:25.129874 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 00:43:25.135672 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0039-zxys5
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-sun5r2ih
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-sun5r2ih
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-sun5r2ih
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:40733"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:43:25.207362 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 00:43:25.207564 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 00:43:25.315403 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-6cd647bd94-xx7fv']
I1214 00:43:25.315639 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-6cd647bd94-xx7fv to start
I1214 00:43:28.556378 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-client-6cd647bd94-xx7fv ready, IP: 10.12.2.253
I1214 00:43:28.556608 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-6cd647bd94-xx7fv to security_test/test_app_logs/psm-interop-client-20231214-0039-zxys5_psm-grpc-client-6cd647bd94-xx7fv.log
I1214 00:43:28.557044 140057986455104 k8s_log_collector.py:70] Starting log collection thread 140057986455104 for psm-grpc-client-6cd647bd94-xx7fv
I1214 00:43:28.557276 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 00:43:30.813251 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 00:43:30.813794 140058089635840 client_app.py:282] [psm-grpc-client-6cd647bd94-xx7fv] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 00:43:32.313010 140058089635840 client_app.py:310] [psm-grpc-client-6cd647bd94-xx7fv] xDS control plane channel:
I1214 00:43:32.313271 140058089635840 client_app.py:320] [psm-grpc-client-6cd647bd94-xx7fv] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 00:43:32.313563 140058089635840 client_app.py:292] [psm-grpc-client-6cd647bd94-xx7fv] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 00:43:32.313796 140058089635840 client_app.py:242] [psm-grpc-client-6cd647bd94-xx7fv] Waiting to report a TRANSIENT_FAILURE channel to xds:///psm-grpc-server:40733
I1214 00:43:32.414229 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:43:32.414494 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:43:42.462142 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:43:42.462419 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:43:52.502412 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:43:52.502645 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:44:02.550330 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:44:02.550678 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:44:12.599002 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:44:12.599324 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:44:28.653181 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:44:28.653446 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:44:53.716408 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:44:53.716799 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:45:18.779851 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:45:18.780085 140058089635840 client_app.py:377] [psm-grpc-client-6cd647bd94-xx7fv] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 00:45:43.843966 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:45:43.883567 140058089635840 client_app.py:369] [psm-grpc-client-6cd647bd94-xx7fv] Found subchannel in state TRANSIENT_FAILURE:
I1214 00:45:43.883937 140058089635840 client_app.py:253] [psm-grpc-client-6cd647bd94-xx7fv] Channel to xds:///psm-grpc-server:40733 transitioned to state TRANSIENT_FAILURE:
I1214 00:45:43.920313 140058089635840 grpc.py:74] [psm-grpc-client-6cd647bd94-xx7fv:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 00:45:47.934956 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-6cd647bd94-xx7fv] << Received LoadBalancerStatsResponse:
num_failures: 100
rpcs_by_peer: {}
rpcs_by_method: {}

I1214 00:45:47.935256 140058089635840 xds_k8s_testcase.py:1162] Check 1 passed, waiting 0:00:10 before the next check
I1214 00:45:57.945727 140058089635840 client_app.py:242] [psm-grpc-client-6cd647bd94-xx7fv] Waiting to report a TRANSIENT_FAILURE channel to xds:///psm-grpc-server:40733
I1214 00:45:57.984209 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:45:58.021445 140058089635840 client_app.py:369] [psm-grpc-client-6cd647bd94-xx7fv] Found subchannel in state TRANSIENT_FAILURE:
I1214 00:45:58.021832 140058089635840 client_app.py:253] [psm-grpc-client-6cd647bd94-xx7fv] Channel to xds:///psm-grpc-server:40733 transitioned to state TRANSIENT_FAILURE:
I1214 00:45:58.060043 140058089635840 grpc.py:74] [psm-grpc-client-6cd647bd94-xx7fv:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 00:46:02.089119 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-6cd647bd94-xx7fv] << Received LoadBalancerStatsResponse:
num_failures: 100
rpcs_by_peer: {}
rpcs_by_method: {}

I1214 00:46:02.089390 140058089635840 xds_k8s_testcase.py:1162] Check 2 passed, waiting 0:00:10 before the next check
I1214 00:46:12.099873 140058089635840 client_app.py:242] [psm-grpc-client-6cd647bd94-xx7fv] Waiting to report a TRANSIENT_FAILURE channel to xds:///psm-grpc-server:40733
I1214 00:46:12.138063 140058089635840 client_app.py:356] [psm-grpc-client-6cd647bd94-xx7fv] Server channel:
I1214 00:46:12.173261 140058089635840 client_app.py:369] [psm-grpc-client-6cd647bd94-xx7fv] Found subchannel in state TRANSIENT_FAILURE:
I1214 00:46:12.173791 140058089635840 client_app.py:253] [psm-grpc-client-6cd647bd94-xx7fv] Channel to xds:///psm-grpc-server:40733 transitioned to state TRANSIENT_FAILURE:
I1214 00:46:12.215694 140058089635840 grpc.py:74] [psm-grpc-client-6cd647bd94-xx7fv:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 00:46:16.249181 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-6cd647bd94-xx7fv] << Received LoadBalancerStatsResponse:
num_failures: 100
rpcs_by_peer: {}
rpcs_by_method: {}

I1214 00:46:16.249410 140058089635840 security_test.py:160] [SUCCESS] Client's connectivity state is consistent with a mTLS error caused by not presenting mTLS certificate to the server.
I1214 00:46:16.249516 140058089635840 xds_k8s_testcase.py:687] ----- TestMethod __main__.SecurityTest.test_mtls_error teardown -----
I1214 00:46:16.480066 140058089635840 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0039-zxys5"
I1214 00:46:17.081534 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514776483-60c6d9c7a27d8-25d9d45b-a76d3c1d
I1214 00:46:27.899310 140058089635840 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0039-zxys5"
I1214 00:46:28.042433 140058089635840 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0039-zxys5"
I1214 00:46:28.441474 140058089635840 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0039-zxys5"
I1214 00:46:28.820820 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514788444-60c6d9d30a879-5199eaa6-9000a643
I1214 00:46:31.147402 140058089635840 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0039-zxys5"
I1214 00:46:31.400388 140058089635840 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0039-zxys5"
I1214 00:46:31.999010 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514791404-60c6d9d5dd383-45a697ee-acb64afb
I1214 00:46:34.230123 140058089635840 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0039-zxys5"
I1214 00:46:34.636360 140058089635840 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0039-zxys5"
I1214 00:46:35.350135 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514794641-60c6d9d8f36c5-37bf319d-bd95486f
I1214 00:46:59.048449 140058089635840 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0039-zxys5"
I1214 00:46:59.406256 140058089635840 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0039-zxys5"
I1214 00:46:59.907832 140058089635840 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0039-zxys5"
I1214 00:47:00.384194 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514819988-60c6d9f11fb5e-4f9e5142-006a2d96
I1214 00:47:04.735505 140058089635840 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0039-zxys5
I1214 00:47:05.191990 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702514824846-60c6d9f5c1ca2-0fb29a55-7c6d83be
I1214 00:47:21.944249 140058089635840 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0039-zxys5
I1214 00:47:22.239218 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702514842109-60c6da0638546-7ce1769d-32669e04
I1214 00:47:45.126964 140058089635840 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0039-zxys5
I1214 00:47:45.454656 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702514865224-60c6da1c43b11-4b5d9640-da377f74
I1214 00:47:49.645044 140058089635840 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0039-zxys5
I1214 00:47:49.712485 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 00:47:59.970575 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 00:47:59.970986 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0039-zxys5/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:48:00.547734 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 00:48:00.678273 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 00:48:00.678587 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0039-zxys5
I1214 00:48:30.948949 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0039-zxys5 deleted
I1214 00:48:30.949298 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 00:48:41.231778 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 00:48:41.232141 140058089635840 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 00:48:41.352409 140058089635840 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 00:48:41.352666 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0039-zxys5/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:48:42.154159 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 00:48:42.273318 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 00:48:42.273606 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0039-zxys5
I1214 00:49:42.546247 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0039-zxys5 deleted
I1214 00:49:42.546632 140058089635840 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 00:49:42.546875 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-sun5r2ih:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0039-zxys5%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-sun5r2ih%22;timeRange=2023-12-14T00:43:24.331287Z%2F2023-12-14T00:48:30.949267Z?project=grpc-testing
I1214 00:49:42.547025 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-6p13594c:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0039-zxys5%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-6p13594c%22;timeRange=2023-12-14T00:39:51.387372Z%2F2023-12-14T00:49:42.546479Z?project=grpc-testing
[ OK ] SecurityTest.test_mtls_error
I1214 00:49:42.547251 140058089635840 base_testcase.py:52] ----- TestCase __main__.SecurityTest.test_mtls_error PASSED -----
[ RUN ] SecurityTest.test_plaintext_fallback
I1214 00:49:42.547472 140058089635840 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0049-xdppp
I1214 00:49:42.722408 140058089635840 xds_k8s_testcase.py:663] Found unused xds port: 6995
I1214 00:49:42.722703 140058089635840 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0049-xdppp"
I1214 00:49:42.724842 140058089635840 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0049-xdppp
type: GRPC
...

I1214 00:49:43.493942 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514982824-60c6da8c6aaf4-21c2ffce-3be85a5f
I1214 00:49:45.730048 140058089635840 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0049-xdppp"
I1214 00:49:45.733385 140058089635840 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0049-xdppp
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0049-xdppp
protocol: GRPC
...

I1214 00:49:46.610845 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702514985735-60c6da8f31507-e03e9344-e17ca154
I1214 00:50:46.634392 140058089635840 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0049-xdppp": psm-grpc-server:6995 -> psm-interop-backend-service-20231214-0049-xdppp
I1214 00:50:46.638178 140058089635840 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0049-xdppp
hostRules:
- hosts:
- psm-grpc-server:6995
pathMatcher: psm-interop-path-matcher-20231214-0049-xdppp
name: psm-interop-url-map-20231214-0049-xdppp
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0049-xdppp
name: psm-interop-path-matcher-20231214-0049-xdppp
...

I1214 00:50:47.262181 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515046640-60c6dac946ac8-6dd6549b-c248e648
I1214 00:50:49.533908 140058089635840 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0049-xdppp proxy "GRPC" to URL map psm-interop-url-map-20231214-0049-xdppp
I1214 00:50:49.535608 140058089635840 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0049-xdppp
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0049-xdppp
validate_for_proxyless: true
...

I1214 00:50:50.251466 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515049537-60c6dacc0a1a1-fdbaee2c-25df027d
I1214 00:50:52.503210 140058089635840 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0049-xdppp" in network "default-vpc": 0.0.0.0:6995 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0049-xdppp
I1214 00:50:52.505629 140058089635840 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0049-xdppp
network: global/networks/default-vpc
portRange: 6995
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0049-xdppp
...

I1214 00:50:53.456652 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515052507-60c6dacedf30c-19ff1c4d-430d27e9
I1214 00:51:40.650348 140058089635840 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0049-xdppp
W1214 00:51:40.650572 140058089635840 traffic_director.py:1045] Client TLS Policy psm-interop-client-tls-policy-20231214-0049-xdppp neither TLS, nor mTLS policy. Skipping creation
W1214 00:51:40.650692 140058089635840 traffic_director.py:1082] Client TLS policy not created, skipping attaching to Backend Service psm-interop-backend-service-20231214-0049-xdppp
I1214 00:51:40.650764 140058089635840 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0049-xdppp
W1214 00:51:40.650821 140058089635840 traffic_director.py:934] Server TLS Policy psm-interop-server-tls-policy-20231214-0049-xdppp neither TLS, nor mTLS policy. Skipping creation
I1214 00:51:40.650879 140058089635840 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0049-xdppp
W1214 00:51:40.650933 140058089635840 traffic_director.py:1016] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0049-xdppp with no Server TLS policy attached
I1214 00:51:40.652899 140058089635840 api.py:468] Creating networkservices resource:
---
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0049-xdppp-psm-grpc-server
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 00:51:40.962823 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702515100726-60c6dafcdb5cf-fc66e152-46335302
I1214 00:51:45.446826 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0049-xdppp:
---
createTime: '2023-12-14T00:51:40.791372855Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0049-xdppp-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0049-xdppp
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T00:51:44.370594753Z'
...

I1214 00:51:45.447126 140058089635840 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0049-xdppp: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 00:51:45.447368 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0049-xdppp%22;timeRange=2023-12-14T00:51:45.447242Z%2F2023-12-14T01:21:45.447242Z?project=grpc-testing
I1214 00:51:45.449198 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0049-xdppp
labels:
name: psm-interop-server-20231214-0049-xdppp
owner: xds-k8s-interop-test
...

I1214 00:51:45.609696 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0049-xdppp created
I1214 00:51:45.612003 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0049-xdppp
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0049-xdppp-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 00:51:45.685242 140058089635840 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 00:51:45.685451 140058089635840 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0049-xdppp
I1214 00:51:45.781996 140058089635840 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0049-xdppp: neg_name=psm-interop-server-20231214-0049-xdppp-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 00:51:45.782182 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0049-xdppp/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:51:46.587115 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0049-xdppp
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:51:46.662435 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 00:51:46.668635 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0049-xdppp
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-pfuc4vv7
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-pfuc4vv7
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-pfuc4vv7
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0049-xdppp-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:51:46.745177 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 00:51:46.745397 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 00:51:46.858537 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-56b45bc94c-zl9kp']
I1214 00:51:46.858814 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-56b45bc94c-zl9kp to start
I1214 00:51:51.143998 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-server-56b45bc94c-zl9kp ready, IP: 10.12.0.101
I1214 00:51:51.144264 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-56b45bc94c-zl9kp to security_test/test_app_logs/psm-interop-server-20231214-0049-xdppp_psm-grpc-server-56b45bc94c-zl9kp.log
I1214 00:51:51.144601 140057994847808 k8s_log_collector.py:70] Starting log collection thread 140057994847808 for psm-grpc-server-56b45bc94c-zl9kp
I1214 00:51:51.144705 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 00:51:54.379680 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 00:51:54.416167 140058089635840 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 00:51:54.716864 140058089635840 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0049-xdppp-psm-grpc-server" in zone us-central1-a
I1214 00:51:54.717085 140058089635840 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0049-xdppp: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0049-xdppp-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0049-xdppp-psm-grpc-server', zone='us-central1-a')}
I1214 00:51:54.720451 140058089635840 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0049-xdppp-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 00:51:55.515285 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515114722-60c6db0a34689-c9c33a9d-987f1271
I1214 00:52:40.482975 140058089635840 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0049-xdppp to report all backends healthy: ['psm-interop-server-20231214-0049-xdppp-psm-grpc-server']
I1214 00:53:14.059759 140058089635840 compute.py:494] Backend psm-interop-server-20231214-0049-xdppp-psm-grpc-server in zone us-central1-a reported healthy
I1214 00:53:18.064408 140058089635840 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0049-xdppp: server_target=xds:///psm-grpc-server:6995 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 00:53:18.064913 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0049-xdppp%22;timeRange=2023-12-14T00:53:18.064638Z%2F2023-12-14T01:23:18.064638Z?project=grpc-testing
I1214 00:53:18.066511 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0049-xdppp
labels:
name: psm-interop-client-20231214-0049-xdppp
owner: xds-k8s-interop-test
...

I1214 00:53:18.108281 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0049-xdppp created
I1214 00:53:18.108506 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0049-xdppp/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:53:18.778618 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0049-xdppp
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:53:18.858864 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 00:53:18.864565 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0049-xdppp
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-gygztf4i
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-gygztf4i
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-gygztf4i
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:6995"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:53:18.940475 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 00:53:18.940702 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 00:53:19.062674 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7b4c5d8cf8-h6652']
I1214 00:53:19.062910 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-7b4c5d8cf8-h6652 to start
I1214 00:53:22.306418 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-client-7b4c5d8cf8-h6652 ready, IP: 10.12.8.132
I1214 00:53:22.306655 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-7b4c5d8cf8-h6652 to security_test/test_app_logs/psm-interop-client-20231214-0049-xdppp_psm-grpc-client-7b4c5d8cf8-h6652.log
I1214 00:53:22.307159 140057986455104 k8s_log_collector.py:70] Starting log collection thread 140057986455104 for psm-grpc-client-7b4c5d8cf8-h6652
I1214 00:53:22.307406 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 00:53:24.557384 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 00:53:24.557934 140058089635840 client_app.py:282] [psm-grpc-client-7b4c5d8cf8-h6652] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 00:53:26.029493 140058089635840 client_app.py:310] [psm-grpc-client-7b4c5d8cf8-h6652] xDS control plane channel:
I1214 00:53:36.077135 140058089635840 client_app.py:310] [psm-grpc-client-7b4c5d8cf8-h6652] xDS control plane channel:
I1214 00:53:46.126895 140058089635840 client_app.py:310] [psm-grpc-client-7b4c5d8cf8-h6652] xDS control plane channel:
I1214 00:53:56.175706 140058089635840 client_app.py:310] [psm-grpc-client-7b4c5d8cf8-h6652] xDS control plane channel:
I1214 00:54:06.225162 140058089635840 client_app.py:310] [psm-grpc-client-7b4c5d8cf8-h6652] xDS control plane channel:
I1214 00:54:22.279016 140058089635840 client_app.py:310] [psm-grpc-client-7b4c5d8cf8-h6652] xDS control plane channel:
I1214 00:54:22.279255 140058089635840 client_app.py:320] [psm-grpc-client-7b4c5d8cf8-h6652] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 00:54:22.279419 140058089635840 client_app.py:292] [psm-grpc-client-7b4c5d8cf8-h6652] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 00:54:22.279682 140058089635840 client_app.py:242] [psm-grpc-client-7b4c5d8cf8-h6652] Waiting to report a READY channel to xds:///psm-grpc-server:6995
I1214 00:54:22.314457 140058089635840 client_app.py:356] [psm-grpc-client-7b4c5d8cf8-h6652] Server channel:
I1214 00:54:22.360092 140058089635840 client_app.py:369] [psm-grpc-client-7b4c5d8cf8-h6652] Found subchannel in state READY:
I1214 00:54:22.360549 140058089635840 client_app.py:253] [psm-grpc-client-7b4c5d8cf8-h6652] Channel to xds:///psm-grpc-server:6995 transitioned to state READY:
I1214 00:54:22.394943 140058089635840 client_app.py:356] [psm-grpc-client-7b4c5d8cf8-h6652] Server channel:
I1214 00:54:22.429294 140058089635840 client_app.py:369] [psm-grpc-client-7b4c5d8cf8-h6652] Found subchannel in state READY:
I1214 00:54:22.804026 140058089635840 server_app.py:174] [psm-grpc-server-56b45bc94c-zl9kp] Found matching socket pair: server(local=10.12.0.101:8080, remote=10.12.8.132:54134) <-> client(local=10.12.8.132:54134, remote=10.12.0.101:8080)
I1214 00:54:22.804234 140058089635840 xds_k8s_testcase.py:989] Server certs: local: , remote:
I1214 00:54:22.804327 140058089635840 xds_k8s_testcase.py:990] Client certs: local: , remote:
I1214 00:54:22.804520 140058089635840 grpc.py:74] [psm-grpc-client-7b4c5d8cf8-h6652:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 00:54:26.819577 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-7b4c5d8cf8-h6652] << Received LoadBalancerStatsResponse:
num_failures: 0
rpcs_by_peer:
psm-grpc-server-56b45bc94c-zl9kp: 100
rpcs_by_method:
UnaryCall:
psm-grpc-server-56b45bc94c-zl9kp: 100

I1214 00:54:26.819788 140058089635840 security_test.py:107] [SUCCESS] Plaintext security mode confirmed.
I1214 00:54:26.819869 140058089635840 xds_k8s_testcase.py:687] ----- TestMethod __main__.SecurityTest.test_plaintext_fallback teardown -----
I1214 00:54:26.992489 140058089635840 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0049-xdppp"
I1214 00:54:27.871947 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515266996-60c6db9b6c960-e99c05d4-58ad12e2
I1214 00:54:55.752922 140058089635840 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0049-xdppp"
I1214 00:54:55.882164 140058089635840 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0049-xdppp"
I1214 00:54:56.356172 140058089635840 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0049-xdppp"
I1214 00:54:56.869418 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515296359-60c6dbb76d36c-eafd857c-b7c6e1fc
I1214 00:54:59.123529 140058089635840 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0049-xdppp"
I1214 00:54:59.412976 140058089635840 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0049-xdppp"
I1214 00:55:00.149355 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515299417-60c6dbba57c54-739a5a27-3a1ed659
I1214 00:55:02.376946 140058089635840 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0049-xdppp"
I1214 00:55:02.710136 140058089635840 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0049-xdppp"
I1214 00:55:03.263347 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515302714-60c6dbbd7cbc1-0dae3c6b-fcb61010
I1214 00:55:33.347963 140058089635840 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0049-xdppp"
I1214 00:55:33.695990 140058089635840 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0049-xdppp"
I1214 00:55:34.111643 140058089635840 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0049-xdppp"
I1214 00:55:34.721561 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515334207-60c6dbdb856e7-c8c5ffe3-8c6ebf9e
I1214 00:55:39.162117 140058089635840 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0049-xdppp
I1214 00:55:39.580732 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702515339249-60c6dbe054586-35d66173-f0acfe65
I1214 00:55:58.393836 140058089635840 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0049-xdppp
I1214 00:55:58.488011 140058089635840 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0049-xdppp
I1214 00:55:58.566128 140058089635840 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0049-xdppp
I1214 00:55:58.636972 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 00:56:08.922462 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 00:56:08.922766 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0049-xdppp/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:56:09.588941 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 00:56:09.727108 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 00:56:09.727320 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0049-xdppp
I1214 00:56:39.977404 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0049-xdppp deleted
I1214 00:56:39.977640 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 00:56:50.178003 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 00:56:50.178273 140058089635840 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 00:56:51.354893 140058089635840 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 00:56:51.355136 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0049-xdppp/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:56:52.181864 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 00:56:52.315359 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 00:56:52.315569 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0049-xdppp
I1214 00:57:52.564927 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0049-xdppp deleted
I1214 00:57:52.565181 140058089635840 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 00:57:52.565351 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-gygztf4i:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0049-xdppp%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-gygztf4i%22;timeRange=2023-12-14T00:53:18.064630Z%2F2023-12-14T00:56:39.977615Z?project=grpc-testing
I1214 00:57:52.565444 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-pfuc4vv7:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0049-xdppp%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-pfuc4vv7%22;timeRange=2023-12-14T00:51:45.447235Z%2F2023-12-14T00:57:52.565064Z?project=grpc-testing
[ OK ] SecurityTest.test_plaintext_fallback
I1214 00:57:52.565603 140058089635840 base_testcase.py:52] ----- TestCase __main__.SecurityTest.test_plaintext_fallback PASSED -----
[ RUN ] SecurityTest.test_server_authz_error
I1214 00:57:52.565756 140058089635840 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0057-m57u3
I1214 00:57:52.733987 140058089635840 xds_k8s_testcase.py:663] Found unused xds port: 61225
I1214 00:57:52.734237 140058089635840 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0057-m57u3"
I1214 00:57:52.736299 140058089635840 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0057-m57u3
type: GRPC
...

I1214 00:57:53.533237 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515472809-60c6dc5fb3e5e-b7e03ee9-6b5c3461
I1214 00:57:55.834086 140058089635840 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0057-m57u3"
I1214 00:57:55.837392 140058089635840 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0057-m57u3
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0057-m57u3
protocol: GRPC
...

I1214 00:57:56.835949 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515475839-60c6dc629790b-7b48a4cd-98e973db
I1214 00:58:14.067695 140058089635840 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0057-m57u3: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 00:58:14.068069 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0057-m57u3%22;timeRange=2023-12-14T00:58:14.067942Z%2F2023-12-14T01:28:14.067942Z?project=grpc-testing
I1214 00:58:14.069656 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0057-m57u3
labels:
name: psm-interop-server-20231214-0057-m57u3
owner: xds-k8s-interop-test
...

I1214 00:58:14.137092 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0057-m57u3 created
I1214 00:58:14.139290 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0057-m57u3
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0057-m57u3-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 00:58:14.229546 140058089635840 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 00:58:14.229763 140058089635840 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0057-m57u3
I1214 00:58:14.333182 140058089635840 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0057-m57u3: neg_name=psm-interop-server-20231214-0057-m57u3-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 00:58:14.333375 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0057-m57u3/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 00:58:15.168910 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0057-m57u3
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 00:58:15.238412 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 00:58:15.245249 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0057-m57u3
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-q1e0wscb
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-q1e0wscb
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-q1e0wscb
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0057-m57u3-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 00:58:15.330083 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 00:58:15.330295 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 00:58:15.452844 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-5bd7f5fbbd-jj2m8']
I1214 00:58:15.453074 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-5bd7f5fbbd-jj2m8 to start
I1214 00:58:19.783251 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-server-5bd7f5fbbd-jj2m8 ready, IP: 10.12.0.102
I1214 00:58:19.783543 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-5bd7f5fbbd-jj2m8 to security_test/test_app_logs/psm-interop-server-20231214-0057-m57u3_psm-grpc-server-5bd7f5fbbd-jj2m8.log
I1214 00:58:19.783922 140057994847808 k8s_log_collector.py:70] Starting log collection thread 140057994847808 for psm-grpc-server-5bd7f5fbbd-jj2m8
I1214 00:58:19.784198 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 00:58:23.119434 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 00:58:23.163887 140058089635840 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 00:58:27.317451 140058089635840 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0057-m57u3-psm-grpc-server" in zone us-central1-a
I1214 00:58:27.317667 140058089635840 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0057-m57u3: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0057-m57u3-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0057-m57u3-psm-grpc-server', zone='us-central1-a')}
I1214 00:58:27.321188 140058089635840 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0057-m57u3-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 00:58:28.998009 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515507323-60c6dc809e0d7-81c0e41a-0d617e4b
I1214 00:59:18.303072 140058089635840 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0057-m57u3
I1214 00:59:18.304829 140058089635840 api.py:468] Creating networksecurity resource:
---
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 00:59:18.613678 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702515558420-60c6dcb1591c6-103893f6-9a7c4338
I1214 00:59:23.004334 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0057-m57u3:
---
createTime: '2023-12-14T00:59:18.499395727Z'
name: projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0057-m57u3
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T00:59:21.864322047Z'
...

I1214 00:59:23.004621 140058089635840 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0057-m57u3
I1214 00:59:23.006640 140058089635840 api.py:468] Creating networkservices resource:
---
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0057-m57u3-psm-grpc-server
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0057-m57u3
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 00:59:23.509255 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702515563132-60c6dcb5d7766-aa71757d-b4c9f5e0
I1214 00:59:27.807630 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0057-m57u3:
---
createTime: '2023-12-14T00:59:23.207901192Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0057-m57u3-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0057-m57u3
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0057-m57u3
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T00:59:26.881167667Z'
...

I1214 00:59:27.807893 140058089635840 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0057-m57u3
I1214 00:59:27.809189 140058089635840 api.py:468] Creating networksecurity resource:
---
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 00:59:28.136485 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702515567867-60c6dcba5b775-2c2ac63a-32511322
I1214 00:59:32.411662 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0057-m57u3:
---
createTime: '2023-12-14T00:59:27.953129308Z'
name: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0057-m57u3
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T00:59:31.454497363Z'
...

I1214 00:59:32.411946 140058089635840 traffic_director.py:1095] Adding Client TLS Policy to Backend Service psm-interop-backend-service-20231214-0057-m57u3: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0057-m57u3, server spiffe://grpc-testing.svc.id.goog/ns/incorrect-namespace-8Niy14Ge/sa/psm-grpc-server
I1214 00:59:32.415181 140058089635840 compute.py:544] Patching compute resource:
---
securitySettings:
clientTlsPolicy: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0057-m57u3
subjectAltNames:
- spiffe://grpc-testing.svc.id.goog/ns/incorrect-namespace-8Niy14Ge/sa/psm-grpc-server
...

I1214 00:59:33.507371 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515572418-60c6dcbeb2629-c0694905-1d545121
I1214 01:00:25.174203 140058089635840 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0057-m57u3": psm-grpc-server:61225 -> psm-interop-backend-service-20231214-0057-m57u3
I1214 01:00:25.177864 140058089635840 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0057-m57u3
hostRules:
- hosts:
- psm-grpc-server:61225
pathMatcher: psm-interop-path-matcher-20231214-0057-m57u3
name: psm-interop-url-map-20231214-0057-m57u3
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0057-m57u3
name: psm-interop-path-matcher-20231214-0057-m57u3
...

I1214 01:00:25.921983 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515625180-60c6dcf103b68-12b1077c-d6f2a894
I1214 01:00:28.182472 140058089635840 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0057-m57u3 proxy "GRPC" to URL map psm-interop-url-map-20231214-0057-m57u3
I1214 01:00:28.184178 140058089635840 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0057-m57u3
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0057-m57u3
validate_for_proxyless: true
...

I1214 01:00:28.602308 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515628186-60c6dcf3e1a55-6a2a4ee0-2326c74c
I1214 01:00:30.889103 140058089635840 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0057-m57u3" in network "default-vpc": 0.0.0.0:61225 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0057-m57u3
I1214 01:00:30.891163 140058089635840 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0057-m57u3
network: global/networks/default-vpc
portRange: 61225
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0057-m57u3
...

I1214 01:00:31.701213 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515630893-60c6dcf67684f-1f07ad9e-6458dccd
I1214 01:01:10.446547 140058089635840 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0057-m57u3 to report all backends healthy: ['psm-interop-server-20231214-0057-m57u3-psm-grpc-server']
I1214 01:01:10.593401 140058089635840 compute.py:494] Backend psm-interop-server-20231214-0057-m57u3-psm-grpc-server in zone us-central1-a reported healthy
I1214 01:01:14.598157 140058089635840 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0057-m57u3: server_target=xds:///psm-grpc-server:61225 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 01:01:14.598522 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0057-m57u3%22;timeRange=2023-12-14T01:01:14.598384Z%2F2023-12-14T01:31:14.598384Z?project=grpc-testing
I1214 01:01:14.600070 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0057-m57u3
labels:
name: psm-interop-client-20231214-0057-m57u3
owner: xds-k8s-interop-test
...

I1214 01:01:15.444669 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0057-m57u3 created
I1214 01:01:15.444969 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0057-m57u3/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:01:15.991974 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0057-m57u3
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:01:16.048183 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 01:01:16.054023 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0057-m57u3
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-q0zdtx03
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-q0zdtx03
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-q0zdtx03
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:61225"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:01:16.126492 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 01:01:16.126692 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 01:01:16.232218 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-66d686b445-wrbpp']
I1214 01:01:16.232420 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-66d686b445-wrbpp to start
I1214 01:01:20.520267 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-client-66d686b445-wrbpp ready, IP: 10.12.4.112
I1214 01:01:20.520566 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-66d686b445-wrbpp to security_test/test_app_logs/psm-interop-client-20231214-0057-m57u3_psm-grpc-client-66d686b445-wrbpp.log
I1214 01:01:20.520998 140057986455104 k8s_log_collector.py:70] Starting log collection thread 140057986455104 for psm-grpc-client-66d686b445-wrbpp
I1214 01:01:20.521255 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 01:01:21.660183 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 01:01:21.660829 140058089635840 client_app.py:282] [psm-grpc-client-66d686b445-wrbpp] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 01:01:34.354926 140058089635840 client_app.py:310] [psm-grpc-client-66d686b445-wrbpp] xDS control plane channel:
I1214 01:01:44.403107 140058089635840 client_app.py:310] [psm-grpc-client-66d686b445-wrbpp] xDS control plane channel:
I1214 01:01:54.450988 140058089635840 client_app.py:310] [psm-grpc-client-66d686b445-wrbpp] xDS control plane channel:
I1214 01:02:04.499765 140058089635840 client_app.py:310] [psm-grpc-client-66d686b445-wrbpp] xDS control plane channel:
I1214 01:02:04.499969 140058089635840 client_app.py:320] [psm-grpc-client-66d686b445-wrbpp] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 01:02:04.500124 140058089635840 client_app.py:292] [psm-grpc-client-66d686b445-wrbpp] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 01:02:04.500327 140058089635840 client_app.py:242] [psm-grpc-client-66d686b445-wrbpp] Waiting to report a TRANSIENT_FAILURE channel to xds:///psm-grpc-server:61225
I1214 01:02:04.535038 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:02:04.535287 140058089635840 client_app.py:377] [psm-grpc-client-66d686b445-wrbpp] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 01:02:14.583276 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:02:14.583518 140058089635840 client_app.py:377] [psm-grpc-client-66d686b445-wrbpp] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 01:02:24.631995 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:02:24.632227 140058089635840 client_app.py:377] [psm-grpc-client-66d686b445-wrbpp] Not found a TRANSIENT_FAILURE subchannel for channel_id 5
I1214 01:02:34.683614 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:02:44.731868 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:02:44.772340 140058089635840 client_app.py:369] [psm-grpc-client-66d686b445-wrbpp] Found subchannel in state TRANSIENT_FAILURE:
I1214 01:02:44.772639 140058089635840 client_app.py:253] [psm-grpc-client-66d686b445-wrbpp] Channel to xds:///psm-grpc-server:61225 transitioned to state TRANSIENT_FAILURE:
I1214 01:02:44.808878 140058089635840 grpc.py:74] [psm-grpc-client-66d686b445-wrbpp:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 01:02:48.813196 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-66d686b445-wrbpp] << Received LoadBalancerStatsResponse:
num_failures: 100
rpcs_by_peer: {}
rpcs_by_method: {}

I1214 01:02:48.813394 140058089635840 xds_k8s_testcase.py:1162] Check 1 passed, waiting 0:00:10 before the next check
I1214 01:02:58.823818 140058089635840 client_app.py:242] [psm-grpc-client-66d686b445-wrbpp] Waiting to report a TRANSIENT_FAILURE channel to xds:///psm-grpc-server:61225
I1214 01:02:58.862882 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:02:58.898039 140058089635840 client_app.py:369] [psm-grpc-client-66d686b445-wrbpp] Found subchannel in state TRANSIENT_FAILURE:
I1214 01:02:58.898364 140058089635840 client_app.py:253] [psm-grpc-client-66d686b445-wrbpp] Channel to xds:///psm-grpc-server:61225 transitioned to state TRANSIENT_FAILURE:
I1214 01:02:58.934753 140058089635840 grpc.py:74] [psm-grpc-client-66d686b445-wrbpp:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 01:03:02.968568 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-66d686b445-wrbpp] << Received LoadBalancerStatsResponse:
num_failures: 100
rpcs_by_peer: {}
rpcs_by_method: {}

I1214 01:03:02.968841 140058089635840 xds_k8s_testcase.py:1162] Check 2 passed, waiting 0:00:10 before the next check
I1214 01:03:12.979248 140058089635840 client_app.py:242] [psm-grpc-client-66d686b445-wrbpp] Waiting to report a TRANSIENT_FAILURE channel to xds:///psm-grpc-server:61225
I1214 01:03:13.016726 140058089635840 client_app.py:356] [psm-grpc-client-66d686b445-wrbpp] Server channel:
I1214 01:03:13.052557 140058089635840 client_app.py:369] [psm-grpc-client-66d686b445-wrbpp] Found subchannel in state TRANSIENT_FAILURE:
I1214 01:03:13.053013 140058089635840 client_app.py:253] [psm-grpc-client-66d686b445-wrbpp] Channel to xds:///psm-grpc-server:61225 transitioned to state TRANSIENT_FAILURE:
I1214 01:03:13.096886 140058089635840 grpc.py:74] [psm-grpc-client-66d686b445-wrbpp:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 01:03:17.128593 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-66d686b445-wrbpp] << Received LoadBalancerStatsResponse:
num_failures: 100
rpcs_by_peer: {}
rpcs_by_method: {}

I1214 01:03:17.128832 140058089635840 security_test.py:212] [SUCCESS] Client's connectivity state is consistent with AuthZ error caused by server presenting incorrect SAN.
I1214 01:03:17.128951 140058089635840 xds_k8s_testcase.py:687] ----- TestMethod __main__.SecurityTest.test_server_authz_error teardown -----
I1214 01:03:17.366412 140058089635840 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0057-m57u3"
I1214 01:03:17.935891 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515797370-60c6dd953a521-0e26c99d-66f6682d
I1214 01:03:28.691827 140058089635840 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0057-m57u3"
I1214 01:03:28.806450 140058089635840 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0057-m57u3"
I1214 01:03:29.228337 140058089635840 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0057-m57u3"
I1214 01:03:29.619574 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515809231-60c6dda08a200-301041d8-65d13257
I1214 01:03:31.891448 140058089635840 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0057-m57u3"
I1214 01:03:32.300228 140058089635840 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0057-m57u3"
I1214 01:03:33.018117 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515812304-60c6dda3786c6-f71e3d09-1c22bd14
I1214 01:03:35.244669 140058089635840 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0057-m57u3"
I1214 01:03:35.635342 140058089635840 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0057-m57u3"
I1214 01:03:36.341014 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515815640-60c6dda6a6d07-1d2844e3-0a967f0e
I1214 01:04:04.334707 140058089635840 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0057-m57u3"
I1214 01:04:04.725360 140058089635840 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0057-m57u3"
I1214 01:04:05.121551 140058089635840 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0057-m57u3"
I1214 01:04:05.669654 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515845193-60c6ddc2d5da1-e54ee300-ca826850
I1214 01:04:10.062093 140058089635840 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0057-m57u3
I1214 01:04:10.479895 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702515850123-60c6ddc789979-be5b58b5-69da42f5
I1214 01:04:27.243620 140058089635840 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0057-m57u3
I1214 01:04:27.482972 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702515867363-60c6ddd7fa75f-f41b9873-4fbfa917
I1214 01:04:44.240820 140058089635840 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0057-m57u3
I1214 01:04:44.573307 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702515884298-60c6dde8211ad-d10df6f4-939bd35a
I1214 01:05:09.527346 140058089635840 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0057-m57u3
I1214 01:05:09.590671 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 01:05:19.883338 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 01:05:19.883620 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0057-m57u3/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:05:20.559926 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 01:05:20.682028 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 01:05:20.682241 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0057-m57u3
I1214 01:05:50.867053 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0057-m57u3 deleted
I1214 01:05:50.867304 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 01:06:01.057986 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 01:06:01.058270 140058089635840 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 01:06:01.186815 140058089635840 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 01:06:01.187058 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0057-m57u3/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:06:01.886333 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 01:06:02.007462 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 01:06:02.007730 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0057-m57u3
I1214 01:06:32.197135 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0057-m57u3 deleted
I1214 01:06:32.197516 140058089635840 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 01:06:32.197793 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-q0zdtx03:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0057-m57u3%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-q0zdtx03%22;timeRange=2023-12-14T01:01:14.598376Z%2F2023-12-14T01:05:50.867276Z?project=grpc-testing
I1214 01:06:32.197994 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-q1e0wscb:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0057-m57u3%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-q1e0wscb%22;timeRange=2023-12-14T00:58:14.067936Z%2F2023-12-14T01:06:32.197362Z?project=grpc-testing
[ OK ] SecurityTest.test_server_authz_error
I1214 01:06:32.198249 140058089635840 base_testcase.py:52] ----- TestCase __main__.SecurityTest.test_server_authz_error PASSED -----
[ RUN ] SecurityTest.test_tls
I1214 01:06:32.198512 140058089635840 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0106-rzwoj
I1214 01:06:32.354182 140058089635840 xds_k8s_testcase.py:663] Found unused xds port: 1147
I1214 01:06:32.354447 140058089635840 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0106-rzwoj"
I1214 01:06:32.356218 140058089635840 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0106-rzwoj
type: GRPC
...

I1214 01:06:33.156318 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515992423-60c6de4f3ec10-c82913b5-86109c95
I1214 01:06:35.468388 140058089635840 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0106-rzwoj"
I1214 01:06:35.471474 140058089635840 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0106-rzwoj
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0106-rzwoj
protocol: GRPC
...

I1214 01:06:36.089891 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702515995473-60c6de52276c8-b59a0a94-5fed14cc
I1214 01:06:53.353818 140058089635840 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0106-rzwoj": psm-grpc-server:1147 -> psm-interop-backend-service-20231214-0106-rzwoj
I1214 01:06:53.357516 140058089635840 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0106-rzwoj
hostRules:
- hosts:
- psm-grpc-server:1147
pathMatcher: psm-interop-path-matcher-20231214-0106-rzwoj
name: psm-interop-url-map-20231214-0106-rzwoj
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0106-rzwoj
name: psm-interop-path-matcher-20231214-0106-rzwoj
...

I1214 01:06:53.907381 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516013359-60c6de633622e-8456a569-539bb088
I1214 01:06:56.265304 140058089635840 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0106-rzwoj proxy "GRPC" to URL map psm-interop-url-map-20231214-0106-rzwoj
I1214 01:06:56.266824 140058089635840 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0106-rzwoj
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0106-rzwoj
validate_for_proxyless: true
...

I1214 01:06:56.757962 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516016268-60c6de65fc66d-165d2f03-5afe8fd7
I1214 01:06:59.092601 140058089635840 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0106-rzwoj" in network "default-vpc": 0.0.0.0:1147 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0106-rzwoj
I1214 01:06:59.095008 140058089635840 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0106-rzwoj
network: global/networks/default-vpc
portRange: 1147
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0106-rzwoj
...

I1214 01:06:59.724661 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516019097-60c6de68aee11-94632d13-95668c65
I1214 01:07:23.439752 140058089635840 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0106-rzwoj
I1214 01:07:23.441422 140058089635840 api.py:468] Creating networksecurity resource:
---
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 01:07:23.762577 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516043499-60c6de7ff4959-218c3e76-3ef58ee8
I1214 01:07:28.165310 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0106-rzwoj:
---
createTime: '2023-12-14T01:07:23.583181917Z'
name: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0106-rzwoj
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T01:07:27.083300090Z'
...

I1214 01:07:28.165560 140058089635840 traffic_director.py:1095] Adding Client TLS Policy to Backend Service psm-interop-backend-service-20231214-0106-rzwoj: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0106-rzwoj, server spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0106-rzwoj/sa/psm-grpc-server
I1214 01:07:28.168713 140058089635840 compute.py:544] Patching compute resource:
---
securitySettings:
clientTlsPolicy: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0106-rzwoj
subjectAltNames:
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0106-rzwoj/sa/psm-grpc-server
...

I1214 01:07:28.867254 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516048170-60c6de8468ed4-992090f9-810744c7
I1214 01:08:24.479405 140058089635840 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0106-rzwoj
I1214 01:08:24.481048 140058089635840 api.py:468] Creating networksecurity resource:
---
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 01:08:24.732452 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516104548-60c6deba2d056-32ee681e-0066c824
I1214 01:08:41.614123 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0106-rzwoj:
---
createTime: '2023-12-14T01:08:24.612820408Z'
name: projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0106-rzwoj
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T01:08:40.754316802Z'
...

I1214 01:08:41.614398 140058089635840 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0106-rzwoj
I1214 01:08:41.616319 140058089635840 api.py:468] Creating networkservices resource:
---
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0106-rzwoj-psm-grpc-server
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0106-rzwoj
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 01:08:41.928674 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702516121689-60c6deca85c79-478ec786-d8ccff17
I1214 01:08:58.809748 140058089635840 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0106-rzwoj:
---
createTime: '2023-12-14T01:08:41.754999204Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0106-rzwoj-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0106-rzwoj
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0106-rzwoj
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T01:08:56.924995849Z'
...

I1214 01:08:58.810014 140058089635840 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0106-rzwoj: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 01:08:58.810221 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0106-rzwoj%22;timeRange=2023-12-14T01:08:58.810108Z%2F2023-12-14T01:38:58.810108Z?project=grpc-testing
I1214 01:08:58.811668 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0106-rzwoj
labels:
name: psm-interop-server-20231214-0106-rzwoj
owner: xds-k8s-interop-test
...

I1214 01:08:58.965039 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0106-rzwoj created
I1214 01:08:58.967356 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0106-rzwoj
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0106-rzwoj-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 01:08:59.039393 140058089635840 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 01:08:59.039618 140058089635840 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0106-rzwoj
I1214 01:08:59.138262 140058089635840 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0106-rzwoj: neg_name=psm-interop-server-20231214-0106-rzwoj-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 01:08:59.138493 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0106-rzwoj/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:08:59.755477 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0106-rzwoj
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:08:59.814370 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 01:08:59.820234 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0106-rzwoj
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-8b57yzzu
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-8b57yzzu
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-8b57yzzu
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0106-rzwoj-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:08:59.901050 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 01:08:59.901323 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 01:09:00.008359 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-57b69b9c4-cmz4g']
I1214 01:09:00.008605 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-57b69b9c4-cmz4g to start
I1214 01:09:03.261913 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-server-57b69b9c4-cmz4g ready, IP: 10.12.5.55
I1214 01:09:03.262177 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-57b69b9c4-cmz4g to security_test/test_app_logs/psm-interop-server-20231214-0106-rzwoj_psm-grpc-server-57b69b9c4-cmz4g.log
I1214 01:09:03.262592 140057994847808 k8s_log_collector.py:70] Starting log collection thread 140057994847808 for psm-grpc-server-57b69b9c4-cmz4g
I1214 01:09:03.262871 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 01:09:08.600095 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 01:09:08.638222 140058089635840 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 01:09:08.916222 140058089635840 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0106-rzwoj-psm-grpc-server" in zone us-central1-a
I1214 01:09:08.916416 140058089635840 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0106-rzwoj: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0106-rzwoj-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0106-rzwoj-psm-grpc-server', zone='us-central1-a')}
I1214 01:09:08.919616 140058089635840 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0106-rzwoj-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 01:09:09.842294 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516148921-60c6dee47e65e-d9586473-435d27c1
I1214 01:10:03.677471 140058089635840 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0106-rzwoj to report all backends healthy: ['psm-interop-server-20231214-0106-rzwoj-psm-grpc-server']
I1214 01:10:16.737701 140058089635840 compute.py:494] Backend psm-interop-server-20231214-0106-rzwoj-psm-grpc-server in zone us-central1-a reported healthy
I1214 01:10:20.742378 140058089635840 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0106-rzwoj: server_target=xds:///psm-grpc-server:1147 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 01:10:20.742865 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0106-rzwoj%22;timeRange=2023-12-14T01:10:20.742646Z%2F2023-12-14T01:40:20.742646Z?project=grpc-testing
I1214 01:10:20.744669 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0106-rzwoj
labels:
name: psm-interop-client-20231214-0106-rzwoj
owner: xds-k8s-interop-test
...

I1214 01:10:20.787630 140058089635840 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0106-rzwoj created
I1214 01:10:20.787855 140058089635840 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0106-rzwoj/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:10:21.535068 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0106-rzwoj
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:10:21.596436 140058089635840 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 01:10:21.602809 140058089635840 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0106-rzwoj
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-6i79fy5q
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-6i79fy5q
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-6i79fy5q
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:1147"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:10:21.676736 140058089635840 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 01:10:21.677002 140058089635840 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 01:10:21.796437 140058089635840 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7b4d5777f6-pdm2q']
I1214 01:10:21.796729 140058089635840 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-7b4d5777f6-pdm2q to start
I1214 01:10:30.260215 140058089635840 k8s_base_runner.py:774] Pod psm-grpc-client-7b4d5777f6-pdm2q ready, IP: 10.12.4.114
I1214 01:10:30.260475 140058089635840 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-7b4d5777f6-pdm2q to security_test/test_app_logs/psm-interop-client-20231214-0106-rzwoj_psm-grpc-client-7b4d5777f6-pdm2q.log
I1214 01:10:30.260992 140057986455104 k8s_log_collector.py:70] Starting log collection thread 140057986455104 for psm-grpc-client-7b4d5777f6-pdm2q
I1214 01:10:30.261285 140058089635840 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 01:10:33.553284 140058089635840 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 01:10:33.553809 140058089635840 client_app.py:282] [psm-grpc-client-7b4d5777f6-pdm2q] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 01:10:34.685271 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:10:44.733612 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:10:54.781935 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:11:04.831017 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:11:14.879382 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:11:30.932941 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:11:55.995770 140058089635840 client_app.py:310] [psm-grpc-client-7b4d5777f6-pdm2q] xDS control plane channel:
I1214 01:11:55.996039 140058089635840 client_app.py:320] [psm-grpc-client-7b4d5777f6-pdm2q] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 01:11:55.996222 140058089635840 client_app.py:292] [psm-grpc-client-7b4d5777f6-pdm2q] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 01:11:55.996465 140058089635840 client_app.py:242] [psm-grpc-client-7b4d5777f6-pdm2q] Waiting to report a READY channel to xds:///psm-grpc-server:1147
I1214 01:11:56.032072 140058089635840 client_app.py:356] [psm-grpc-client-7b4d5777f6-pdm2q] Server channel:
I1214 01:11:56.081586 140058089635840 client_app.py:369] [psm-grpc-client-7b4d5777f6-pdm2q] Found subchannel in state READY:
I1214 01:11:56.082013 140058089635840 client_app.py:253] [psm-grpc-client-7b4d5777f6-pdm2q] Channel to xds:///psm-grpc-server:1147 transitioned to state READY:
I1214 01:11:56.117033 140058089635840 client_app.py:356] [psm-grpc-client-7b4d5777f6-pdm2q] Server channel:
I1214 01:11:56.155565 140058089635840 client_app.py:369] [psm-grpc-client-7b4d5777f6-pdm2q] Found subchannel in state READY:
I1214 01:11:56.549729 140058089635840 server_app.py:174] [psm-grpc-server-57b69b9c4-cmz4g] Found matching socket pair: server(local=10.12.5.55:8080, remote=10.12.4.114:48214) <-> client(local=10.12.4.114:48214, remote=10.12.5.55:8080)
I1214 01:11:56.550015 140058089635840 xds_k8s_testcase.py:989] Server certs: local: , remote:
I1214 01:11:56.550165 140058089635840 xds_k8s_testcase.py:990] Client certs: local: , remote:
I1214 01:11:56.550438 140058089635840 grpc.py:74] [psm-grpc-client-7b4d5777f6-pdm2q:8079] >> RPC LoadBalancerStatsService.GetClientStats(request=LoadBalancerStatsRequest({'numRpcs': 100, 'timeoutSec': 1200}), timeout=1200, wait_for_ready=True)
I1214 01:12:00.562613 140058089635840 xds_k8s_testcase.py:601] [psm-grpc-client-7b4d5777f6-pdm2q] << Received LoadBalancerStatsResponse:
num_failures: 0
rpcs_by_peer:
psm-grpc-server-57b69b9c4-cmz4g: 100
rpcs_by_method:
UnaryCall:
psm-grpc-server-57b69b9c4-cmz4g: 100

I1214 01:12:00.562854 140058089635840 security_test.py:83] [SUCCESS] TLS security mode confirmed.
I1214 01:12:00.562960 140058089635840 xds_k8s_testcase.py:687] ----- TestMethod __main__.SecurityTest.test_tls teardown -----
I1214 01:12:00.714194 140058089635840 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0106-rzwoj"
I1214 01:12:01.303031 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516320719-60c6df885544f-869cbc22-224feff5
I1214 01:12:22.876548 140058089635840 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0106-rzwoj"
I1214 01:12:22.966139 140058089635840 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0106-rzwoj"
I1214 01:12:23.401831 140058089635840 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0106-rzwoj"
I1214 01:12:23.784009 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516343405-60c6df9df7a3e-895bf11c-01919551
I1214 01:12:26.095086 140058089635840 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0106-rzwoj"
I1214 01:12:26.350723 140058089635840 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0106-rzwoj"
I1214 01:12:27.078908 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516346355-60c6dfa0c7dad-7cb320fa-f2ada4d0
I1214 01:12:29.357876 140058089635840 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0106-rzwoj"
I1214 01:12:29.818033 140058089635840 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0106-rzwoj"
I1214 01:12:30.511337 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516349822-60c6dfa416743-5a540b23-212f3dea
I1214 01:12:52.047016 140058089635840 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0106-rzwoj"
I1214 01:12:52.424665 140058089635840 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0106-rzwoj"
I1214 01:12:52.949510 140058089635840 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0106-rzwoj"
I1214 01:12:53.531841 140058089635840 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516373030-60c6dfba385c3-a8233039-c80e754c
I1214 01:12:57.997478 140058089635840 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0106-rzwoj
I1214 01:12:58.252883 140058089635840 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702516378052-60c6dfbf02722-3e988540-0dd5b9f7
I1214 01:13:17.105463 140058089635840 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0106-rzwoj
I1214 01:13:17.305635 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516397176-60c6dfd13f672-49ae49ad-3e418c45
I1214 01:13:25.708724 140058089635840 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0106-rzwoj
I1214 01:13:26.076055 140058089635840 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516405816-60c6dfd97cbcd-4514830a-f2990241
I1214 01:13:30.336602 140058089635840 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0106-rzwoj
I1214 01:13:30.394300 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 01:13:40.578658 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 01:13:40.578966 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0106-rzwoj/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:13:41.154337 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 01:13:41.276044 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 01:13:41.276281 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0106-rzwoj
I1214 01:14:11.507532 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0106-rzwoj deleted
I1214 01:14:11.507827 140058089635840 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 01:14:21.758088 140058089635840 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 01:14:21.758390 140058089635840 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 01:14:21.894719 140058089635840 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 01:14:21.894973 140058089635840 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0106-rzwoj/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:14:22.549239 140058089635840 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 01:14:22.681369 140058089635840 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 01:14:22.681622 140058089635840 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0106-rzwoj
I1214 01:16:53.199943 140058089635840 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0106-rzwoj deleted
I1214 01:16:53.200406 140058089635840 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 01:16:53.200660 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-6i79fy5q:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0106-rzwoj%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-6i79fy5q%22;timeRange=2023-12-14T01:10:20.742636Z%2F2023-12-14T01:14:11.507798Z?project=grpc-testing
I1214 01:16:53.200893 140058089635840 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-8b57yzzu:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0106-rzwoj%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-8b57yzzu%22;timeRange=2023-12-14T01:08:58.810103Z%2F2023-12-14T01:16:53.200237Z?project=grpc-testing
[ OK ] SecurityTest.test_tls
I1214 01:16:53.201189 140058089635840 base_testcase.py:52] ----- TestCase __main__.SecurityTest.test_tls PASSED -----
----------------------------------------------------------------------
Ran 5 tests in 2736.125s

OK
+ for test in "${test_suites[@]}"
+ run_test authz_test
+ local test_name=authz_test
+ local out_dir=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test
+ mkdir -pv /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test
mkdir: created directory '/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test'
+ set -x
+ python -m tests.authz_test --flagfile=config/grpc-testing.cfg --kube_context=gke_grpc-testing_us-central1-a_psm-interop-security --server_image=gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd --client_image=gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd --testing_version=dev-v1.59.x --force_cleanup --collect_app_logs --log_dir=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test --xml_output_file=/tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test/sponge_log.xml
+ tee /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test/sponge_log.log
Running tests under Python 3.10.12: /tmp/tmp.C9b0mU2t71/psm-interop/venv/bin/python
I1214 01:16:54.352102 139963526402048 xds_k8s_testcase.py:157] ----- Testing AuthzTest -----
I1214 01:16:54.352248 139963526402048 xds_k8s_testcase.py:158] Logs timezone: UTC
I1214 01:16:54.352500 139963526402048 xds_k8s_testcase.py:106] Detected language and version: TestConfig(client_lang='java', server_lang='java', version='dev-v1.59.x')
I1214 01:16:54.363313 139963526402048 k8s.py:242] Using kubernetes context "gke_grpc-testing_us-central1-a_psm-interop-security", active host: https://35.202.85.90
[ RUN ] AuthzTest.test_mtls_allow
I1214 01:16:54.367447 139963526402048 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0116-og81a
I1214 01:16:54.742644 139963526402048 logs.py:31] Log root dir: /tmpfs/src/artifacts/grpc/java/v1.59.x/branch/psm-security/authz_test
I1214 01:16:55.132335 139963526402048 xds_k8s_testcase.py:663] Found unused xds port: 45720
I1214 01:16:55.132745 139963526402048 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0116-og81a"
I1214 01:16:55.135546 139963526402048 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0116-og81a
type: GRPC
...

I1214 01:16:56.237817 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516615208-60c6e0a12dd43-d72030db-42523dac
I1214 01:16:58.535349 139963526402048 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0116-og81a"
I1214 01:16:58.541290 139963526402048 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0116-og81a
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0116-og81a
protocol: GRPC
...

I1214 01:16:59.263901 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516618543-60c6e0a45c14d-26fd1713-39953252
I1214 01:17:52.896520 139963526402048 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0116-og81a": psm-grpc-server:45720 -> psm-interop-backend-service-20231214-0116-og81a
I1214 01:17:52.904884 139963526402048 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0116-og81a
hostRules:
- hosts:
- psm-grpc-server:45720
pathMatcher: psm-interop-path-matcher-20231214-0116-og81a
name: psm-interop-url-map-20231214-0116-og81a
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0116-og81a
name: psm-interop-path-matcher-20231214-0116-og81a
...

I1214 01:17:53.482267 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516672907-60c6e0d834829-87fabfed-27a48264
I1214 01:17:55.736089 139963526402048 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0116-og81a proxy "GRPC" to URL map psm-interop-url-map-20231214-0116-og81a
I1214 01:17:55.737868 139963526402048 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0116-og81a
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0116-og81a
validate_for_proxyless: true
...

I1214 01:17:56.453181 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516675739-60c6e0dae80b3-5ef837c9-2eac5550
I1214 01:17:58.705788 139963526402048 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0116-og81a" in network "default-vpc": 0.0.0.0:45720 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0116-og81a
I1214 01:17:58.708032 139963526402048 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0116-og81a
network: global/networks/default-vpc
portRange: 45720
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0116-og81a
...

I1214 01:17:59.605887 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516678710-60c6e0ddbd409-f3bbb306-b50c5b49
I1214 01:18:31.842350 139963526402048 traffic_director.py:969] Creating Authz Policy psm-interop-authz-policy-20231214-0116-og81a
I1214 01:18:31.848926 139963526402048 api.py:468] Creating networksecurity resource:
---
action: ALLOW
rules:
- destinations:
hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:45720
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:45720
- psm-grpc-server:45720
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
hosts:
- not-the-host:45720
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0116-og81a/sa/psm-grpc-client
- destinations:
hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
...

I1214 01:18:32.175488 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516711962-60c6e0fd738d2-e52eabbf-b93792fe
I1214 01:18:51.002695 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0116-og81a:
---
action: ALLOW
createTime: '2023-12-14T01:18:32.048974457Z'
name: projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0116-og81a
rules:
- destinations:
- hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
- hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:45720
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:45720
- psm-grpc-server:45720
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
- hosts:
- not-the-host:45720
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
- hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
- hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0116-og81a/sa/psm-grpc-client
- destinations:
- hosts:
- '*:45720'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
updateTime: '2023-12-14T01:18:49.703668250Z'
...

I1214 01:18:51.003007 139963526402048 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0116-og81a
I1214 01:18:51.004541 139963526402048 api.py:468] Creating networksecurity resource:
---
clientCertificate: &id001
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
serverValidationCa:
- *id001
...

I1214 01:18:51.324187 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516731054-60c6e10fa8972-530999d2-91cdc780
I1214 01:19:10.109622 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0116-og81a:
---
clientCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
createTime: '2023-12-14T01:18:51.142390601Z'
name: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0116-og81a
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T01:19:08.684636630Z'
...

I1214 01:19:10.109884 139963526402048 traffic_director.py:1095] Adding Client TLS Policy to Backend Service psm-interop-backend-service-20231214-0116-og81a: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0116-og81a, server spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0116-og81a/sa/psm-grpc-server
I1214 01:19:10.113039 139963526402048 compute.py:544] Patching compute resource:
---
securitySettings:
clientTlsPolicy: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0116-og81a
subjectAltNames:
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0116-og81a/sa/psm-grpc-server
...

I1214 01:19:11.087970 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516750116-60c6e121d64b5-87b8bd2e-ec31b424
I1214 01:19:30.432457 139963526402048 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0116-og81a
I1214 01:19:30.434526 139963526402048 api.py:468] Creating networksecurity resource:
---
mtlsPolicy:
clientValidationCa:
- &id001
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
serverCertificate: *id001
...

I1214 01:19:30.715456 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702516770528-60c6e1354ddee-f2b1cd7a-0f30644e
I1214 01:19:35.076205 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0116-og81a:
---
createTime: '2023-12-14T01:19:30.600820896Z'
mtlsPolicy:
clientValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
name: projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0116-og81a
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T01:19:33.968464410Z'
...

I1214 01:19:35.076437 139963526402048 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0116-og81a
I1214 01:19:35.078926 139963526402048 api.py:468] Creating networkservices resource:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0116-og81a
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0116-og81a-psm-grpc-server
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0116-og81a
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 01:19:35.451483 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702516775199-60c6e139c233a-e20ecde1-6df616ad
I1214 01:19:39.892241 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0116-og81a:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0116-og81a
createTime: '2023-12-14T01:19:35.282903022Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0116-og81a-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0116-og81a
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0116-og81a
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T01:19:38.830997097Z'
...

I1214 01:19:39.892515 139963526402048 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0116-og81a: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 01:19:39.892834 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0116-og81a%22;timeRange=2023-12-14T01:19:39.892651Z%2F2023-12-14T01:49:39.892651Z?project=grpc-testing
I1214 01:19:39.896687 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0116-og81a
labels:
name: psm-interop-server-20231214-0116-og81a
owner: xds-k8s-interop-test
...

I1214 01:19:40.051059 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0116-og81a created
I1214 01:19:40.053503 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0116-og81a
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0116-og81a-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 01:19:40.125233 139963526402048 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 01:19:40.125452 139963526402048 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0116-og81a
I1214 01:19:40.230109 139963526402048 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0116-og81a: neg_name=psm-interop-server-20231214-0116-og81a-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 01:19:40.230307 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0116-og81a/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:19:41.152076 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0116-og81a
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:19:41.213310 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 01:19:41.219843 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0116-og81a
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-tc3m76wm
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-tc3m76wm
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-tc3m76wm
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0116-og81a-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:19:41.293198 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 01:19:41.293463 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 01:19:41.400171 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-7b77d644d5-m2psv']
I1214 01:19:41.400414 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-7b77d644d5-m2psv to start
I1214 01:19:45.752912 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-server-7b77d644d5-m2psv ready, IP: 10.12.0.104
I1214 01:19:45.753194 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-7b77d644d5-m2psv to authz_test/test_app_logs/psm-interop-server-20231214-0116-og81a_psm-grpc-server-7b77d644d5-m2psv.log
I1214 01:19:45.753830 139963432166976 k8s_log_collector.py:70] Starting log collection thread 139963432166976 for psm-grpc-server-7b77d644d5-m2psv
I1214 01:19:45.754134 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 01:19:50.118143 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 01:19:50.155553 139963526402048 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 01:19:50.282363 139963526402048 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0116-og81a-psm-grpc-server" in zone us-central1-a
I1214 01:19:50.282588 139963526402048 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0116-og81a: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0116-og81a-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0116-og81a-psm-grpc-server', zone='us-central1-a')}
I1214 01:19:50.285771 139963526402048 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0116-og81a-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 01:19:51.095838 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516790287-60c6e14825e31-e9aa191a-7c1f5868
I1214 01:20:38.212713 139963526402048 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0116-og81a to report all backends healthy: ['psm-interop-server-20231214-0116-og81a-psm-grpc-server']
I1214 01:20:50.866035 139963526402048 compute.py:494] Backend psm-interop-server-20231214-0116-og81a-psm-grpc-server in zone us-central1-a reported healthy
I1214 01:20:54.870748 139963526402048 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0116-og81a: server_target=xds:///psm-grpc-server:45720 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 01:20:54.871210 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0116-og81a%22;timeRange=2023-12-14T01:20:54.871008Z%2F2023-12-14T01:50:54.871008Z?project=grpc-testing
I1214 01:20:54.872912 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0116-og81a
labels:
name: psm-interop-client-20231214-0116-og81a
owner: xds-k8s-interop-test
...

I1214 01:20:54.914409 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0116-og81a created
I1214 01:20:54.914636 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0116-og81a/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:20:55.492919 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0116-og81a
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:20:55.561352 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 01:20:55.567243 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0116-og81a
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-3z5xfuej
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-3z5xfuej
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-3z5xfuej
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:45720"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:20:55.649065 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 01:20:55.649304 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 01:20:55.764495 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-59b58c5b59-2bj4f']
I1214 01:20:55.764737 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-59b58c5b59-2bj4f to start
I1214 01:21:00.053135 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-client-59b58c5b59-2bj4f ready, IP: 10.12.8.136
I1214 01:21:00.053402 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-59b58c5b59-2bj4f to authz_test/test_app_logs/psm-interop-client-20231214-0116-og81a_psm-grpc-client-59b58c5b59-2bj4f.log
I1214 01:21:00.053986 139963423774272 k8s_log_collector.py:70] Starting log collection thread 139963423774272 for psm-grpc-client-59b58c5b59-2bj4f
I1214 01:21:00.054197 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 01:21:01.201414 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 01:21:01.202004 139963526402048 client_app.py:282] [psm-grpc-client-59b58c5b59-2bj4f] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 01:21:03.824531 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:21:13.873071 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:21:23.920913 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:21:33.969294 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:21:44.016103 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:22:00.070249 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:22:25.129734 139963526402048 client_app.py:310] [psm-grpc-client-59b58c5b59-2bj4f] xDS control plane channel:
I1214 01:22:25.130030 139963526402048 client_app.py:320] [psm-grpc-client-59b58c5b59-2bj4f] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 01:22:25.130211 139963526402048 client_app.py:292] [psm-grpc-client-59b58c5b59-2bj4f] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 01:22:25.130472 139963526402048 client_app.py:242] [psm-grpc-client-59b58c5b59-2bj4f] Waiting to report a READY channel to xds:///psm-grpc-server:45720
I1214 01:22:25.165622 139963526402048 client_app.py:356] [psm-grpc-client-59b58c5b59-2bj4f] Server channel:
I1214 01:22:25.212438 139963526402048 client_app.py:369] [psm-grpc-client-59b58c5b59-2bj4f] Found subchannel in state READY:
I1214 01:22:25.212932 139963526402048 client_app.py:253] [psm-grpc-client-59b58c5b59-2bj4f] Channel to xds:///psm-grpc-server:45720 transitioned to state READY:
I1214 01:22:30.218264 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_mtls_allow.01_host_wildcard ---
I1214 01:22:30.218691 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:30.258409 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'host-wildcard'}]}), wait_for_ready=True, timeout=5)
I1214 01:22:30.295372 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:30.831166 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:30.867310 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-59b58c5b59-2bj4f] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 14
result:
(0, OK): 13

I1214 01:22:30.867841 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_mtls_allow.01_host_wildcard ---
I1214 01:22:30.867930 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_mtls_allow.02_no_match ---
I1214 01:22:30.868065 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL']}), wait_for_ready=True, timeout=5)
I1214 01:22:30.902040 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:31.438174 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:31.474170 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-59b58c5b59-2bj4f] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 14
result:
(7, PERMISSION_DENIED): 14

I1214 01:22:31.474672 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_mtls_allow.02_no_match ---
I1214 01:22:31.474767 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_mtls_allow.04_match_principal ---
I1214 01:22:31.474933 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'match-principal'}]}), wait_for_ready=True, timeout=5)
I1214 01:22:31.508919 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:32.045069 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:32.080868 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-59b58c5b59-2bj4f] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 13
result:
(0, OK): 14

I1214 01:22:32.081386 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_mtls_allow.04_match_principal ---
I1214 01:22:32.081504 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_mtls_allow.05_never_match_principal ---
I1214 01:22:32.081670 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'never-match-principal'}]}), wait_for_ready=True, timeout=5)
I1214 01:22:32.115336 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:32.651429 139963526402048 grpc.py:74] [psm-grpc-client-59b58c5b59-2bj4f:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:22:32.687472 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-59b58c5b59-2bj4f] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:22:32.688023 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_mtls_allow.05_never_match_principal ---
I1214 01:22:32.688159 139963526402048 xds_k8s_testcase.py:687] ----- TestMethod __main__.AuthzTest.test_mtls_allow teardown -----
I1214 01:22:32.914649 139963526402048 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0116-og81a"
I1214 01:22:33.679731 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516952918-60c6e1e33ea0f-839aec4e-a80e1ee9
I1214 01:22:57.267235 139963526402048 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0116-og81a"
I1214 01:22:57.373042 139963526402048 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0116-og81a"
I1214 01:22:57.715659 139963526402048 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0116-og81a"
I1214 01:22:58.103233 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516977718-60c6e1fae54a9-2e13507d-58887e36
I1214 01:23:00.366153 139963526402048 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0116-og81a"
I1214 01:23:00.651203 139963526402048 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0116-og81a"
I1214 01:23:01.237314 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516980655-60c6e1fdb25eb-2a610df0-bd83c213
I1214 01:23:03.578598 139963526402048 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0116-og81a"
I1214 01:23:04.011151 139963526402048 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0116-og81a"
I1214 01:23:04.492331 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702516984015-60c6e200e6c63-3b68230e-4fb8f3c2
I1214 01:23:25.950211 139963526402048 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0116-og81a"
I1214 01:23:26.414828 139963526402048 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0116-og81a"
I1214 01:23:26.814255 139963526402048 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0116-og81a"
I1214 01:23:27.406620 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517006903-60c6e216baaa9-ba6af72a-a091fb61
I1214 01:23:31.765991 139963526402048 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0116-og81a
I1214 01:23:32.069761 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702517011862-60c6e21b7553f-46d3fbfe-f7831da9
I1214 01:23:36.297588 139963526402048 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0116-og81a
I1214 01:23:36.544908 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702517016384-60c6e21fc52dc-8e1b789f-7792cfd4
I1214 01:23:40.786188 139963526402048 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0116-og81a
I1214 01:23:41.143122 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702517020888-60c6e22410bdd-b5f94d42-48cc8c7c
I1214 01:23:45.332997 139963526402048 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0116-og81a
I1214 01:23:45.556593 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702517025394-60c6e2285d02f-ea476441-639a85fb
I1214 01:23:49.792003 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 01:23:59.995790 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 01:23:59.996090 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0116-og81a/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:24:00.578784 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 01:24:00.723078 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 01:24:00.723371 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0116-og81a
I1214 01:24:30.927761 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0116-og81a deleted
I1214 01:24:30.928039 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 01:24:41.153687 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 01:24:41.153997 139963526402048 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 01:24:41.277521 139963526402048 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 01:24:41.277832 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0116-og81a/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:24:41.940965 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 01:24:42.064015 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 01:24:42.064233 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0116-og81a
I1214 01:27:12.571473 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0116-og81a deleted
I1214 01:27:12.571928 139963526402048 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 01:27:12.572196 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-3z5xfuej:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0116-og81a%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-3z5xfuej%22;timeRange=2023-12-14T01:20:54.871000Z%2F2023-12-14T01:24:30.928009Z?project=grpc-testing
I1214 01:27:12.572363 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-tc3m76wm:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0116-og81a%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-tc3m76wm%22;timeRange=2023-12-14T01:19:39.892644Z%2F2023-12-14T01:27:12.571730Z?project=grpc-testing
[ OK ] AuthzTest.test_mtls_allow
I1214 01:27:12.572641 139963526402048 base_testcase.py:52] ----- TestCase __main__.AuthzTest.test_mtls_allow PASSED -----
[ RUN ] AuthzTest.test_plaintext_allow
I1214 01:27:12.572954 139963526402048 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0127-ilph8
I1214 01:27:12.741955 139963526402048 xds_k8s_testcase.py:663] Found unused xds port: 13961
I1214 01:27:12.742290 139963526402048 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0127-ilph8"
I1214 01:27:12.744458 139963526402048 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0127-ilph8
type: GRPC
...

I1214 01:27:13.484891 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517232822-60c6e2ee2ea1c-89ba7160-3b99c083
I1214 01:27:15.809899 139963526402048 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0127-ilph8"
I1214 01:27:15.813318 139963526402048 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0127-ilph8
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0127-ilph8
protocol: GRPC
...

I1214 01:27:16.442312 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517235815-60c6e2f1095ae-b11fe8e9-636990bf
I1214 01:27:29.350518 139963526402048 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0127-ilph8": psm-grpc-server:13961 -> psm-interop-backend-service-20231214-0127-ilph8
I1214 01:27:29.355034 139963526402048 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0127-ilph8
hostRules:
- hosts:
- psm-grpc-server:13961
pathMatcher: psm-interop-path-matcher-20231214-0127-ilph8
name: psm-interop-url-map-20231214-0127-ilph8
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0127-ilph8
name: psm-interop-path-matcher-20231214-0127-ilph8
...

I1214 01:27:29.995346 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517249357-60c6e2fdf35be-81515348-aa21b992
I1214 01:27:32.270718 139963526402048 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0127-ilph8 proxy "GRPC" to URL map psm-interop-url-map-20231214-0127-ilph8
I1214 01:27:32.272347 139963526402048 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0127-ilph8
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0127-ilph8
validate_for_proxyless: true
...

I1214 01:27:32.707365 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517252275-60c6e300bbc8f-57af2e29-b12d5dbc
I1214 01:27:34.979591 139963526402048 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0127-ilph8" in network "default-vpc": 0.0.0.0:13961 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0127-ilph8
I1214 01:27:34.981974 139963526402048 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0127-ilph8
network: global/networks/default-vpc
portRange: 13961
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0127-ilph8
...

I1214 01:27:35.634589 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517254983-60c6e303510a2-c6bc6b09-10d8d0b8
I1214 01:27:46.442590 139963526402048 traffic_director.py:969] Creating Authz Policy psm-interop-authz-policy-20231214-0127-ilph8
I1214 01:27:46.450259 139963526402048 api.py:468] Creating networksecurity resource:
---
action: ALLOW
rules:
- destinations:
hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:13961
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:13961
- psm-grpc-server:13961
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
hosts:
- not-the-host:13961
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0127-ilph8/sa/psm-grpc-client
- destinations:
hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
...

I1214 01:27:46.785274 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702517266583-60c6e30e60e26-3b43274f-b78affa0
I1214 01:27:51.056541 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0127-ilph8:
---
action: ALLOW
createTime: '2023-12-14T01:27:46.662783245Z'
name: projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0127-ilph8
rules:
- destinations:
- hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
- hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:13961
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:13961
- psm-grpc-server:13961
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
- hosts:
- not-the-host:13961
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
- hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
- hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0127-ilph8/sa/psm-grpc-client
- destinations:
- hosts:
- '*:13961'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
updateTime: '2023-12-14T01:27:49.950231184Z'
...

I1214 01:27:51.056987 139963526402048 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0127-ilph8
W1214 01:27:51.057080 139963526402048 traffic_director.py:1045] Client TLS Policy psm-interop-client-tls-policy-20231214-0127-ilph8 neither TLS, nor mTLS policy. Skipping creation
W1214 01:27:51.057146 139963526402048 traffic_director.py:1082] Client TLS policy not created, skipping attaching to Backend Service psm-interop-backend-service-20231214-0127-ilph8
I1214 01:27:51.057209 139963526402048 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0127-ilph8
W1214 01:27:51.057261 139963526402048 traffic_director.py:934] Server TLS Policy psm-interop-server-tls-policy-20231214-0127-ilph8 neither TLS, nor mTLS policy. Skipping creation
I1214 01:27:51.057314 139963526402048 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0127-ilph8
W1214 01:27:51.057368 139963526402048 traffic_director.py:1016] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0127-ilph8 with no Server TLS policy attached
I1214 01:27:51.059256 139963526402048 api.py:468] Creating networkservices resource:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0127-ilph8
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0127-ilph8-psm-grpc-server
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 01:27:51.604905 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702517271235-60c6e312d0ae5-3127548d-753dbc6d
I1214 01:27:55.992174 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0127-ilph8:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0127-ilph8
createTime: '2023-12-14T01:27:51.309222201Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0127-ilph8-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0127-ilph8
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T01:27:54.998431007Z'
...

I1214 01:27:55.992450 139963526402048 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0127-ilph8: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 01:27:55.992723 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0127-ilph8%22;timeRange=2023-12-14T01:27:55.992589Z%2F2023-12-14T01:57:55.992589Z?project=grpc-testing
I1214 01:27:55.994307 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0127-ilph8
labels:
name: psm-interop-server-20231214-0127-ilph8
owner: xds-k8s-interop-test
...

I1214 01:27:56.066303 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0127-ilph8 created
I1214 01:27:56.068531 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0127-ilph8
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0127-ilph8-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 01:27:56.142245 139963526402048 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 01:27:56.142436 139963526402048 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0127-ilph8
I1214 01:27:56.246178 139963526402048 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0127-ilph8: neg_name=psm-interop-server-20231214-0127-ilph8-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 01:27:56.246371 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0127-ilph8/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:27:56.939507 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0127-ilph8
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:27:57.008883 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 01:27:57.014918 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0127-ilph8
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-jqmwtp9l
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-jqmwtp9l
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-jqmwtp9l
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0127-ilph8-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:27:57.092736 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 01:27:57.092950 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 01:27:57.216623 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-5ccf5d869b-zrx7s']
I1214 01:27:57.216922 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-5ccf5d869b-zrx7s to start
I1214 01:28:02.592064 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-server-5ccf5d869b-zrx7s ready, IP: 10.12.4.117
I1214 01:28:02.592351 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-5ccf5d869b-zrx7s to authz_test/test_app_logs/psm-interop-server-20231214-0127-ilph8_psm-grpc-server-5ccf5d869b-zrx7s.log
I1214 01:28:02.592842 139963432166976 k8s_log_collector.py:70] Starting log collection thread 139963432166976 for psm-grpc-server-5ccf5d869b-zrx7s
I1214 01:28:02.593032 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 01:28:05.943295 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 01:28:05.987767 139963526402048 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 01:28:06.293688 139963526402048 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0127-ilph8-psm-grpc-server" in zone us-central1-a
I1214 01:28:06.293919 139963526402048 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0127-ilph8: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0127-ilph8-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0127-ilph8-psm-grpc-server', zone='us-central1-a')}
I1214 01:28:06.297353 139963526402048 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0127-ilph8-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 01:28:07.055421 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517286299-60c6e3212e7d9-b5c5c4cc-c01a63c5
I1214 01:29:02.762066 139963526402048 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0127-ilph8 to report all backends healthy: ['psm-interop-server-20231214-0127-ilph8-psm-grpc-server']
I1214 01:29:07.014938 139963526402048 compute.py:494] Backend psm-interop-server-20231214-0127-ilph8-psm-grpc-server in zone us-central1-a reported healthy
I1214 01:29:11.019551 139963526402048 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0127-ilph8: server_target=xds:///psm-grpc-server:13961 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 01:29:11.019907 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0127-ilph8%22;timeRange=2023-12-14T01:29:11.019785Z%2F2023-12-14T01:59:11.019785Z?project=grpc-testing
I1214 01:29:11.021701 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0127-ilph8
labels:
name: psm-interop-client-20231214-0127-ilph8
owner: xds-k8s-interop-test
...

I1214 01:29:11.112497 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0127-ilph8 created
I1214 01:29:11.112832 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0127-ilph8/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:29:11.740067 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0127-ilph8
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:29:11.810812 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 01:29:11.816722 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0127-ilph8
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-y5q0ue2t
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-y5q0ue2t
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-y5q0ue2t
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:13961"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:29:11.895866 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 01:29:11.896100 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 01:29:12.015553 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7c8ddf95fb-jdz98']
I1214 01:29:12.015799 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-7c8ddf95fb-jdz98 to start
I1214 01:29:17.402249 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-client-7c8ddf95fb-jdz98 ready, IP: 10.12.8.138
I1214 01:29:17.402524 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-7c8ddf95fb-jdz98 to authz_test/test_app_logs/psm-interop-client-20231214-0127-ilph8_psm-grpc-client-7c8ddf95fb-jdz98.log
I1214 01:29:17.402897 139963423774272 k8s_log_collector.py:70] Starting log collection thread 139963423774272 for psm-grpc-client-7c8ddf95fb-jdz98
I1214 01:29:17.403041 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 01:29:20.728405 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 01:29:20.729072 139963526402048 client_app.py:282] [psm-grpc-client-7c8ddf95fb-jdz98] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 01:29:21.027985 139963526402048 client_app.py:310] [psm-grpc-client-7c8ddf95fb-jdz98] xDS control plane channel:
I1214 01:29:31.077671 139963526402048 client_app.py:310] [psm-grpc-client-7c8ddf95fb-jdz98] xDS control plane channel:
I1214 01:29:41.125677 139963526402048 client_app.py:310] [psm-grpc-client-7c8ddf95fb-jdz98] xDS control plane channel:
I1214 01:29:51.165209 139963526402048 client_app.py:310] [psm-grpc-client-7c8ddf95fb-jdz98] xDS control plane channel:
I1214 01:30:01.213655 139963526402048 client_app.py:310] [psm-grpc-client-7c8ddf95fb-jdz98] xDS control plane channel:
I1214 01:30:17.267838 139963526402048 client_app.py:310] [psm-grpc-client-7c8ddf95fb-jdz98] xDS control plane channel:
I1214 01:30:17.268113 139963526402048 client_app.py:320] [psm-grpc-client-7c8ddf95fb-jdz98] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 01:30:17.268295 139963526402048 client_app.py:292] [psm-grpc-client-7c8ddf95fb-jdz98] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 01:30:17.268555 139963526402048 client_app.py:242] [psm-grpc-client-7c8ddf95fb-jdz98] Waiting to report a READY channel to xds:///psm-grpc-server:13961
I1214 01:30:17.303666 139963526402048 client_app.py:356] [psm-grpc-client-7c8ddf95fb-jdz98] Server channel:
I1214 01:30:17.351924 139963526402048 client_app.py:369] [psm-grpc-client-7c8ddf95fb-jdz98] Found subchannel in state READY:
I1214 01:30:17.352340 139963526402048 client_app.py:253] [psm-grpc-client-7c8ddf95fb-jdz98] Channel to xds:///psm-grpc-server:13961 transitioned to state READY:
I1214 01:30:22.357640 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_allow.01_host_wildcard ---
I1214 01:30:22.358016 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:22.401872 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'host-wildcard'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:22.438964 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:22.974384 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:23.010684 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 13
result:
(0, OK): 14

I1214 01:30:23.011234 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_allow.01_host_wildcard ---
I1214 01:30:23.011380 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_allow.02_no_match ---
I1214 01:30:23.011553 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'no-such-rule'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:23.044983 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:23.581004 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:23.617189 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:30:23.617803 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL']}), wait_for_ready=True, timeout=5)
I1214 01:30:23.651612 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:24.187983 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:24.223843 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:30:24.224429 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_allow.02_no_match ---
I1214 01:30:24.224562 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_allow.03_header_regex ---
I1214 01:30:24.224751 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'header-regex-a'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:24.258563 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:24.795119 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:24.835708 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 14
result:
(0, OK): 14

I1214 01:30:24.836323 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'header-regex-aa'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:24.870886 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:25.406879 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:25.443227 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 14
result:
(0, OK): 14

I1214 01:30:25.443892 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'header-regex-'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:25.477869 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:26.013779 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:26.049545 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:30:26.050224 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'header-regex-ab'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:26.084128 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:26.620939 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:26.657799 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:30:26.658512 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'aheader-regex-a'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:26.692418 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:27.227878 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:27.263725 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:30:27.264251 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_allow.03_header_regex ---
I1214 01:30:27.264367 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_allow.04_host_match ---
I1214 01:30:27.264527 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'host-match1'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:27.297870 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:27.834767 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:27.870281 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 14
result:
(0, OK): 13

I1214 01:30:27.871162 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'host-match2'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:27.904862 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:28.440876 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:28.476821 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 14
result:
(0, OK): 14

I1214 01:30:28.477367 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_allow.04_host_match ---
I1214 01:30:28.477504 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_allow.05_never_match_host ---
I1214 01:30:28.477677 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'never-match-host'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:28.511247 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:29.047097 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:29.082763 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 14
result:
(7, PERMISSION_DENIED): 14

I1214 01:30:29.083274 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_allow.05_never_match_host ---
I1214 01:30:29.083386 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_allow.06_never_match_port ---
I1214 01:30:29.083543 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL'], 'metadata': [{'type': 'UNARY_CALL', 'key': 'test', 'value': 'never-match-port'}]}), wait_for_ready=True, timeout=5)
I1214 01:30:29.117259 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:29.652981 139963526402048 grpc.py:74] [psm-grpc-client-7c8ddf95fb-jdz98:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:30:29.688309 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7c8ddf95fb-jdz98] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 13
result:
(7, PERMISSION_DENIED): 13

I1214 01:30:29.688898 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_allow.06_never_match_port ---
I1214 01:30:29.689047 139963526402048 xds_k8s_testcase.py:687] ----- TestMethod __main__.AuthzTest.test_plaintext_allow teardown -----
I1214 01:30:29.811809 139963526402048 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0127-ilph8"
I1214 01:30:30.663684 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517429816-60c6e3aa0cc0c-ad263580-ce74cff4
I1214 01:31:05.029068 139963526402048 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0127-ilph8"
I1214 01:31:05.119436 139963526402048 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0127-ilph8"
I1214 01:31:05.510238 139963526402048 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0127-ilph8"
I1214 01:31:06.117446 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517465513-60c6e3cc17cfe-dd3f1c52-045d79d5
I1214 01:31:08.379946 139963526402048 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0127-ilph8"
I1214 01:31:08.713165 139963526402048 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0127-ilph8"
I1214 01:31:09.353324 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517468717-60c6e3cf261fc-c2123ff3-a27e115c
I1214 01:31:11.600120 139963526402048 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0127-ilph8"
I1214 01:31:11.912269 139963526402048 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0127-ilph8"
I1214 01:31:12.402401 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517471917-60c6e3d2335ad-1cf9a304-c4ae8c94
I1214 01:31:44.581348 139963526402048 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0127-ilph8"
I1214 01:31:45.034207 139963526402048 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0127-ilph8"
I1214 01:31:45.538436 139963526402048 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0127-ilph8"
I1214 01:31:46.100409 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517505629-60c6e3f259cb7-aa4662dc-8dd60392
I1214 01:31:50.536492 139963526402048 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0127-ilph8
I1214 01:31:50.943333 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702517510597-60c6e3f716cc5-c603fa6a-11357adb
I1214 01:32:07.833926 139963526402048 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0127-ilph8
I1214 01:32:07.920545 139963526402048 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0127-ilph8
I1214 01:32:07.990231 139963526402048 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0127-ilph8
I1214 01:32:08.236311 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702517528069-60c6e407c0549-51ef4881-47b8aad8
I1214 01:32:20.689548 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 01:32:31.767542 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 01:32:31.767844 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0127-ilph8/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:32:32.337528 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 01:32:32.470814 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 01:32:32.471040 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0127-ilph8
I1214 01:33:02.658463 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0127-ilph8 deleted
I1214 01:33:02.658663 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 01:33:12.839845 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 01:33:12.840137 139963526402048 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 01:33:12.960935 139963526402048 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 01:33:12.961173 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0127-ilph8/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:33:13.855323 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 01:33:13.986701 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 01:33:13.986987 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0127-ilph8
I1214 01:35:14.447898 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0127-ilph8 deleted
I1214 01:35:14.448290 139963526402048 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 01:35:14.448541 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-y5q0ue2t:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0127-ilph8%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-y5q0ue2t%22;timeRange=2023-12-14T01:29:11.019777Z%2F2023-12-14T01:33:02.658637Z?project=grpc-testing
I1214 01:35:14.448755 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-jqmwtp9l:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0127-ilph8%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-jqmwtp9l%22;timeRange=2023-12-14T01:27:55.992582Z%2F2023-12-14T01:35:14.448131Z?project=grpc-testing
[ OK ] AuthzTest.test_plaintext_allow
I1214 01:35:14.449040 139963526402048 base_testcase.py:52] ----- TestCase __main__.AuthzTest.test_plaintext_allow PASSED -----
[ RUN ] AuthzTest.test_plaintext_deny
I1214 01:35:14.449269 139963526402048 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0135-30mjd
I1214 01:35:14.614366 139963526402048 xds_k8s_testcase.py:663] Found unused xds port: 61275
I1214 01:35:14.614655 139963526402048 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0135-30mjd"
I1214 01:35:14.616903 139963526402048 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0135-30mjd
type: GRPC
...

I1214 01:35:15.325116 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517714682-60c6e4b9b81a2-ff29b34e-02602cae
I1214 01:35:17.636011 139963526402048 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0135-30mjd"
I1214 01:35:17.639460 139963526402048 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0135-30mjd
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0135-30mjd
protocol: GRPC
...

I1214 01:35:18.270260 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517717642-60c6e4bc8ac4e-d7534c23-c5662586
I1214 01:36:22.424832 139963526402048 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0135-30mjd": psm-grpc-server:61275 -> psm-interop-backend-service-20231214-0135-30mjd
I1214 01:36:22.428405 139963526402048 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0135-30mjd
hostRules:
- hosts:
- psm-grpc-server:61275
pathMatcher: psm-interop-path-matcher-20231214-0135-30mjd
name: psm-interop-url-map-20231214-0135-30mjd
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0135-30mjd
name: psm-interop-path-matcher-20231214-0135-30mjd
...

I1214 01:36:23.035921 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517782430-60c6e4fa5440d-ecd0729c-885652fb
I1214 01:36:25.331310 139963526402048 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0135-30mjd proxy "GRPC" to URL map psm-interop-url-map-20231214-0135-30mjd
I1214 01:36:25.332967 139963526402048 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0135-30mjd
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0135-30mjd
validate_for_proxyless: true
...

I1214 01:36:26.035843 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517785334-60c6e4fd1948d-05dd1d8c-5dba5558
I1214 01:36:28.387112 139963526402048 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0135-30mjd" in network "default-vpc": 0.0.0.0:61275 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0135-30mjd
I1214 01:36:28.389574 139963526402048 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0135-30mjd
network: global/networks/default-vpc
portRange: 61275
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0135-30mjd
...

I1214 01:36:29.441378 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517788391-60c6e50003a06-bd68189f-4e1fa239
I1214 01:37:12.413344 139963526402048 traffic_director.py:969] Creating Authz Policy psm-interop-authz-policy-20231214-0135-30mjd
I1214 01:37:12.419324 139963526402048 api.py:468] Creating networksecurity resource:
---
action: DENY
rules:
- destinations:
hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:61275
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:61275
- psm-grpc-server:61275
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
hosts:
- not-the-host:61275
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0135-30mjd/sa/psm-grpc-client
- destinations:
hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
...

I1214 01:37:12.705174 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702517832505-60c6e52a1591c-5b67d87f-23ddd9f3
I1214 01:37:35.795346 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0135-30mjd:
---
action: DENY
createTime: '2023-12-14T01:37:12.587562676Z'
name: projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0135-30mjd
rules:
- destinations:
- hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
- hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:61275
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:61275
- psm-grpc-server:61275
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
- hosts:
- not-the-host:61275
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
- hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
- hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0135-30mjd/sa/psm-grpc-client
- destinations:
- hosts:
- '*:61275'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
updateTime: '2023-12-14T01:37:33.956936011Z'
...

I1214 01:37:35.795641 139963526402048 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0135-30mjd
W1214 01:37:35.795740 139963526402048 traffic_director.py:1045] Client TLS Policy psm-interop-client-tls-policy-20231214-0135-30mjd neither TLS, nor mTLS policy. Skipping creation
W1214 01:37:35.795840 139963526402048 traffic_director.py:1082] Client TLS policy not created, skipping attaching to Backend Service psm-interop-backend-service-20231214-0135-30mjd
I1214 01:37:35.795906 139963526402048 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0135-30mjd
W1214 01:37:35.795970 139963526402048 traffic_director.py:934] Server TLS Policy psm-interop-server-tls-policy-20231214-0135-30mjd neither TLS, nor mTLS policy. Skipping creation
I1214 01:37:35.796031 139963526402048 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0135-30mjd
W1214 01:37:35.796088 139963526402048 traffic_director.py:1016] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0135-30mjd with no Server TLS policy attached
I1214 01:37:35.797810 139963526402048 api.py:468] Creating networkservices resource:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0135-30mjd
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0135-30mjd-psm-grpc-server
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 01:37:36.262432 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702517855875-60c6e5405f20a-eef37f66-b86635da
I1214 01:37:53.084259 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0135-30mjd:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0135-30mjd
createTime: '2023-12-14T01:37:35.939343720Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0135-30mjd-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0135-30mjd
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T01:37:52.616113422Z'
...

I1214 01:37:53.084502 139963526402048 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0135-30mjd: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 01:37:53.084716 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0135-30mjd%22;timeRange=2023-12-14T01:37:53.084604Z%2F2023-12-14T02:07:53.084604Z?project=grpc-testing
I1214 01:37:53.086520 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0135-30mjd
labels:
name: psm-interop-server-20231214-0135-30mjd
owner: xds-k8s-interop-test
...

I1214 01:37:53.246439 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0135-30mjd created
I1214 01:37:53.248909 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0135-30mjd
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0135-30mjd-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 01:37:53.317651 139963526402048 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 01:37:53.317871 139963526402048 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0135-30mjd
I1214 01:37:53.422189 139963526402048 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0135-30mjd: neg_name=psm-interop-server-20231214-0135-30mjd-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 01:37:53.422379 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0135-30mjd/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:37:54.140319 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0135-30mjd
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:37:54.197874 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 01:37:54.204011 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0135-30mjd
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-a63tc5g9
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-a63tc5g9
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-a63tc5g9
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0135-30mjd-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:37:54.275041 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 01:37:54.275277 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 01:37:54.390348 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-6fcd74fb76-n2q7v']
I1214 01:37:54.390595 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-6fcd74fb76-n2q7v to start
I1214 01:37:57.628828 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-server-6fcd74fb76-n2q7v ready, IP: 10.12.2.9
I1214 01:37:57.629083 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-6fcd74fb76-n2q7v to authz_test/test_app_logs/psm-interop-server-20231214-0135-30mjd_psm-grpc-server-6fcd74fb76-n2q7v.log
I1214 01:37:57.629503 139963432166976 k8s_log_collector.py:70] Starting log collection thread 139963432166976 for psm-grpc-server-6fcd74fb76-n2q7v
I1214 01:37:57.629695 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 01:38:02.953193 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 01:38:02.989831 139963526402048 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 01:38:03.257215 139963526402048 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0135-30mjd-psm-grpc-server" in zone us-central1-a
I1214 01:38:03.257450 139963526402048 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0135-30mjd: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0135-30mjd-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0135-30mjd-psm-grpc-server', zone='us-central1-a')}
I1214 01:38:03.261096 139963526402048 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0135-30mjd-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 01:38:04.136569 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702517883263-60c6e55a7d99f-daf2bd4d-cb7b4eea
I1214 01:38:55.679424 139963526402048 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0135-30mjd to report all backends healthy: ['psm-interop-server-20231214-0135-30mjd-psm-grpc-server']
I1214 01:39:25.273230 139963526402048 compute.py:494] Backend psm-interop-server-20231214-0135-30mjd-psm-grpc-server in zone us-central1-a reported healthy
I1214 01:39:29.277883 139963526402048 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0135-30mjd: server_target=xds:///psm-grpc-server:61275 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 01:39:29.278280 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0135-30mjd%22;timeRange=2023-12-14T01:39:29.278150Z%2F2023-12-14T02:09:29.278150Z?project=grpc-testing
I1214 01:39:29.280024 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0135-30mjd
labels:
name: psm-interop-client-20231214-0135-30mjd
owner: xds-k8s-interop-test
...

I1214 01:39:29.322325 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0135-30mjd created
I1214 01:39:29.322542 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0135-30mjd/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:39:29.930724 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0135-30mjd
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:39:29.992633 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 01:39:29.999599 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0135-30mjd
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-cyzy8t24
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-cyzy8t24
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-cyzy8t24
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:61275"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:39:30.077488 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 01:39:30.077736 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 01:39:30.186108 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-7b89f4749-7wc45']
I1214 01:39:30.186389 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-7b89f4749-7wc45 to start
I1214 01:39:34.475445 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-client-7b89f4749-7wc45 ready, IP: 10.12.4.119
I1214 01:39:34.475708 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-7b89f4749-7wc45 to authz_test/test_app_logs/psm-interop-client-20231214-0135-30mjd_psm-grpc-client-7b89f4749-7wc45.log
I1214 01:39:34.476123 139963423774272 k8s_log_collector.py:70] Starting log collection thread 139963423774272 for psm-grpc-client-7b89f4749-7wc45
I1214 01:39:34.476330 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 01:39:37.766160 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 01:39:37.766679 139963526402048 client_app.py:282] [psm-grpc-client-7b89f4749-7wc45] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 01:39:38.390152 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:39:48.438416 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:39:58.487211 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:40:08.535239 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:40:18.583494 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:40:34.707797 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:40:59.769607 139963526402048 client_app.py:310] [psm-grpc-client-7b89f4749-7wc45] xDS control plane channel:
I1214 01:40:59.769928 139963526402048 client_app.py:320] [psm-grpc-client-7b89f4749-7wc45] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 01:40:59.770124 139963526402048 client_app.py:292] [psm-grpc-client-7b89f4749-7wc45] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 01:40:59.770377 139963526402048 client_app.py:242] [psm-grpc-client-7b89f4749-7wc45] Waiting to report a READY channel to xds:///psm-grpc-server:61275
I1214 01:40:59.804532 139963526402048 client_app.py:356] [psm-grpc-client-7b89f4749-7wc45] Server channel:
I1214 01:40:59.849622 139963526402048 client_app.py:369] [psm-grpc-client-7b89f4749-7wc45] Found subchannel in state READY:
I1214 01:40:59.849983 139963526402048 client_app.py:253] [psm-grpc-client-7b89f4749-7wc45] Channel to xds:///psm-grpc-server:61275 transitioned to state READY:
I1214 01:41:04.855239 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_deny.01_host_wildcard ---
I1214 01:41:04.855595 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:41:04.897601 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'host-wildcard'}]}), wait_for_ready=True, timeout=5)
I1214 01:41:04.935527 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:41:05.471714 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:41:05.507754 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7b89f4749-7wc45] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 14
result:
(7, PERMISSION_DENIED): 14

I1214 01:41:05.508281 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_deny.01_host_wildcard ---
I1214 01:41:05.508396 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_plaintext_deny.02_no_match ---
I1214 01:41:05.508534 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL']}), wait_for_ready=True, timeout=5)
I1214 01:41:05.542204 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:41:06.078023 139963526402048 grpc.py:74] [psm-grpc-client-7b89f4749-7wc45:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:41:06.114659 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-7b89f4749-7wc45] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 13
result:
(0, OK): 13

I1214 01:41:06.115228 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_plaintext_deny.02_no_match ---
I1214 01:41:06.115395 139963526402048 xds_k8s_testcase.py:687] ----- TestMethod __main__.AuthzTest.test_plaintext_deny teardown -----
I1214 01:41:06.288983 139963526402048 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0135-30mjd"
I1214 01:41:07.033624 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518066292-60c6e6090a81b-b2fc40da-decda514
I1214 01:41:32.822751 139963526402048 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0135-30mjd"
I1214 01:41:32.924911 139963526402048 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0135-30mjd"
I1214 01:41:33.318727 139963526402048 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0135-30mjd"
I1214 01:41:33.984814 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518093321-60c6e622d1641-121cdec7-8bd62ecb
I1214 01:41:36.239237 139963526402048 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0135-30mjd"
I1214 01:41:36.657197 139963526402048 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0135-30mjd"
I1214 01:41:37.313280 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518096663-60c6e62601372-e95f5fc8-1d11c8f2
I1214 01:41:39.579096 139963526402048 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0135-30mjd"
I1214 01:41:39.934141 139963526402048 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0135-30mjd"
I1214 01:41:40.677820 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518099939-60c6e62920fc2-dc9174ad-415ff00b
I1214 01:42:08.434687 139963526402048 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0135-30mjd"
I1214 01:42:08.895599 139963526402048 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0135-30mjd"
I1214 01:42:09.323047 139963526402048 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0135-30mjd"
I1214 01:42:09.906780 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518129409-60c6e6453bea1-1198faaa-6d57cdf9
I1214 01:42:14.343808 139963526402048 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0135-30mjd
I1214 01:42:14.625524 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702518134419-60c6e64a02ff0-070a1cd7-fff5736b
I1214 01:42:18.902017 139963526402048 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0135-30mjd
I1214 01:42:18.982993 139963526402048 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0135-30mjd
I1214 01:42:19.148985 139963526402048 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0135-30mjd
I1214 01:42:19.384919 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518139219-60c6e64e96fa6-0bb6d2bb-82e6639c
I1214 01:42:23.739087 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 01:42:33.917848 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 01:42:33.918140 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0135-30mjd/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:42:34.477625 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 01:42:34.607198 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 01:42:34.607406 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0135-30mjd
I1214 01:43:04.791494 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0135-30mjd deleted
I1214 01:43:04.791731 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 01:43:15.033026 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 01:43:15.033309 139963526402048 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 01:43:15.152703 139963526402048 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 01:43:15.152942 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0135-30mjd/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:43:15.762501 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 01:43:15.885367 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 01:43:15.885592 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0135-30mjd
I1214 01:45:46.374814 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0135-30mjd deleted
I1214 01:45:46.375191 139963526402048 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 01:45:46.375450 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-cyzy8t24:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0135-30mjd%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-cyzy8t24%22;timeRange=2023-12-14T01:39:29.278142Z%2F2023-12-14T01:43:04.791705Z?project=grpc-testing
I1214 01:45:46.375606 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-a63tc5g9:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0135-30mjd%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-a63tc5g9%22;timeRange=2023-12-14T01:37:53.084598Z%2F2023-12-14T01:45:46.375033Z?project=grpc-testing
[ OK ] AuthzTest.test_plaintext_deny
I1214 01:45:46.375877 139963526402048 base_testcase.py:52] ----- TestCase __main__.AuthzTest.test_plaintext_deny PASSED -----
[ RUN ] AuthzTest.test_tls_allow
I1214 01:45:46.376106 139963526402048 xds_k8s_testcase.py:668] Test run resource prefix: psm-interop, suffix: 20231214-0145-v1wn4
I1214 01:45:46.529283 139963526402048 xds_k8s_testcase.py:663] Found unused xds port: 22591
I1214 01:45:46.529567 139963526402048 traffic_director.py:191] Creating GRPC Health Check "psm-interop-health-check-20231214-0145-v1wn4"
I1214 01:45:46.531765 139963526402048 compute.py:537] Creating compute resource:
---
grpcHealthCheck:
port: 8081
portSpecification: USE_FIXED_PORT
name: psm-interop-health-check-20231214-0145-v1wn4
type: GRPC
...

I1214 01:45:47.339221 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518346599-60c6e7145cb8a-5aacb3ec-f9bfd55b
I1214 01:45:49.581107 139963526402048 traffic_director.py:218] Creating GRPC Backend Service "psm-interop-backend-service-20231214-0145-v1wn4"
I1214 01:45:49.584887 139963526402048 compute.py:537] Creating compute resource:
---
healthChecks:
- https://www.googleapis.com/compute/v1/projects/grpc-testing/global/healthChecks/psm-interop-health-check-20231214-0145-v1wn4
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-backend-service-20231214-0145-v1wn4
protocol: GRPC
...

I1214 01:45:50.276281 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518349587-60c6e7173634e-bb814859-b6f99548
I1214 01:46:18.335375 139963526402048 traffic_director.py:479] Creating URL map "psm-interop-url-map-20231214-0145-v1wn4": psm-grpc-server:22591 -> psm-interop-backend-service-20231214-0145-v1wn4
I1214 01:46:18.339562 139963526402048 compute.py:537] Creating compute resource:
---
defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0145-v1wn4
hostRules:
- hosts:
- psm-grpc-server:22591
pathMatcher: psm-interop-path-matcher-20231214-0145-v1wn4
name: psm-interop-url-map-20231214-0145-v1wn4
pathMatchers:
- defaultService: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/backendServices/psm-interop-backend-service-20231214-0145-v1wn4
name: psm-interop-path-matcher-20231214-0145-v1wn4
...

I1214 01:46:19.107527 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518378341-60c6e732a25ab-51de6f6a-5c7f0218
I1214 01:46:21.373081 139963526402048 traffic_director.py:578] Creating target psm-interop-target-proxy-20231214-0145-v1wn4 proxy "GRPC" to URL map psm-interop-url-map-20231214-0145-v1wn4
I1214 01:46:21.374724 139963526402048 compute.py:537] Creating compute resource:
---
name: psm-interop-target-proxy-20231214-0145-v1wn4
url_map: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/urlMaps/psm-interop-url-map-20231214-0145-v1wn4
validate_for_proxyless: true
...

I1214 01:46:22.187201 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518381376-60c6e73587458-99e4601a-b074144b
I1214 01:46:24.722709 139963526402048 traffic_director.py:654] Creating forwarding rule "psm-interop-forwarding-rule-20231214-0145-v1wn4" in network "default-vpc": 0.0.0.0:22591 -> https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0145-v1wn4
I1214 01:46:24.725033 139963526402048 compute.py:537] Creating compute resource:
---
IPAddress: 0.0.0.0
loadBalancingScheme: INTERNAL_SELF_MANAGED
name: psm-interop-forwarding-rule-20231214-0145-v1wn4
network: global/networks/default-vpc
portRange: 22591
target: https://www.googleapis.com/compute/v1/projects/grpc-testing/global/targetGrpcProxies/psm-interop-target-proxy-20231214-0145-v1wn4
...

I1214 01:46:25.334918 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518384727-60c6e738b95a9-354bda9f-0aee5007
I1214 01:46:38.280857 139963526402048 traffic_director.py:969] Creating Authz Policy psm-interop-authz-policy-20231214-0145-v1wn4
I1214 01:46:38.286777 139963526402048 api.py:468] Creating networksecurity resource:
---
action: ALLOW
rules:
- destinations:
hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:22591
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:22591
- psm-grpc-server:22591
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
hosts:
- not-the-host:22591
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0145-v1wn4/sa/psm-grpc-client
- destinations:
hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
...

I1214 01:46:38.567545 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518398362-60c6e745ba2eb-a10ffb1e-4f18754a
I1214 01:46:42.904909 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0145-v1wn4:
---
action: ALLOW
createTime: '2023-12-14T01:46:38.445508090Z'
name: projects/grpc-testing/locations/global/authorizationPolicies/psm-interop-authz-policy-20231214-0145-v1wn4
rules:
- destinations:
- hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: host-wildcard
ports:
- 8080
- destinations:
- hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: header-regex-a+
ports:
- 8080
- destinations:
- hosts:
- psm-grpc-server:22591
httpHeaderMatch:
headerName: test
regexMatch: host-match1
ports:
- 8080
- hosts:
- a-not-it.com:22591
- psm-grpc-server:22591
- z-not-it.com:1
httpHeaderMatch:
headerName: test
regexMatch: host-match2
ports:
- 1
- 8080
- 65535
- destinations:
- hosts:
- not-the-host:22591
- not-the-host
httpHeaderMatch:
headerName: test
regexMatch: never-match-host
ports:
- 8080
- destinations:
- hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: never-match-port
ports:
- 1
- destinations:
- hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-client-20231214-0145-v1wn4/sa/psm-grpc-client
- destinations:
- hosts:
- '*:22591'
httpHeaderMatch:
headerName: test
regexMatch: never-match-principal
ports:
- 8080
sources:
- principals:
- spiffe://grpc-testing.svc.id.goog/not/the/client
updateTime: '2023-12-14T01:46:41.733879760Z'
...

I1214 01:46:42.905222 139963526402048 traffic_director.py:1043] Creating Client TLS Policy psm-interop-client-tls-policy-20231214-0145-v1wn4
I1214 01:46:42.906507 139963526402048 api.py:468] Creating networksecurity resource:
---
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 01:46:43.235472 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518402958-60c6e74a1c5a9-a6599fa0-c7bbe164
I1214 01:46:47.590308 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0145-v1wn4:
---
createTime: '2023-12-14T01:46:43.049628553Z'
name: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0145-v1wn4
serverValidationCa:
- certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T01:46:46.540777423Z'
...

I1214 01:46:47.590548 139963526402048 traffic_director.py:1095] Adding Client TLS Policy to Backend Service psm-interop-backend-service-20231214-0145-v1wn4: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0145-v1wn4, server spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0145-v1wn4/sa/psm-grpc-server
I1214 01:46:47.594493 139963526402048 compute.py:544] Patching compute resource:
---
securitySettings:
clientTlsPolicy: projects/grpc-testing/locations/global/clientTlsPolicies/psm-interop-client-tls-policy-20231214-0145-v1wn4
subjectAltNames:
- spiffe://grpc-testing.svc.id.goog/ns/psm-interop-server-20231214-0145-v1wn4/sa/psm-grpc-server
...

I1214 01:46:48.521891 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518407597-60c6e74e88d3b-1ad520d5-ad77cecb
I1214 01:47:38.020324 139963526402048 traffic_director.py:932] Creating Server TLS Policy psm-interop-server-tls-policy-20231214-0145-v1wn4
I1214 01:47:38.021971 139963526402048 api.py:468] Creating networksecurity resource:
---
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
...

I1214 01:47:38.288721 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518458093-60c6e77eb1137-d4e5c12e-10433c44
I1214 01:47:57.329486 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0145-v1wn4:
---
createTime: '2023-12-14T01:47:38.168150713Z'
name: projects/grpc-testing/locations/global/serverTlsPolicies/psm-interop-server-tls-policy-20231214-0145-v1wn4
serverCertificate:
certificateProviderInstance:
pluginInstance: google_cloud_private_spiffe
updateTime: '2023-12-14T01:47:55.011469911Z'
...

I1214 01:47:57.329709 139963526402048 traffic_director.py:994] Creating Endpoint Policy psm-interop-endpoint-policy-20231214-0145-v1wn4
I1214 01:47:57.331518 139963526402048 api.py:468] Creating networkservices resource:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0145-v1wn4
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0145-v1wn4-psm-grpc-server
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0145-v1wn4
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
...

I1214 01:47:57.635532 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702518477409-60c6e7911cbea-980e293b-32203fcf
I1214 01:48:01.899001 139963526402048 api.py:490] Loaded projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0145-v1wn4:
---
authorizationPolicy: psm-interop-authz-policy-20231214-0145-v1wn4
createTime: '2023-12-14T01:47:57.471852022Z'
endpointMatcher:
metadataLabelMatcher:
metadataLabelMatchCriteria: MATCH_ALL
metadataLabels:
- labelName: app
labelValue: psm-interop-server-20231214-0145-v1wn4-psm-grpc-server
name: projects/grpc-testing/locations/global/endpointPolicies/psm-interop-endpoint-policy-20231214-0145-v1wn4
serverTlsPolicy: psm-interop-server-tls-policy-20231214-0145-v1wn4
trafficPortSelector:
ports:
- '8080'
type: GRPC_SERVER
updateTime: '2023-12-14T01:48:01.007809251Z'
...

I1214 01:48:01.899260 139963526402048 k8s_xds_server_runner.py:145] Deploying xDS test server "psm-grpc-server" to k8s namespace psm-interop-server-20231214-0145-v1wn4: test_port=8080 maintenance_port=8081 secure_mode=True replica_count=1
I1214 01:48:01.899474 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0145-v1wn4%22;timeRange=2023-12-14T01:48:01.899360Z%2F2023-12-14T02:18:01.899360Z?project=grpc-testing
I1214 01:48:01.900958 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-server-20231214-0145-v1wn4
labels:
name: psm-interop-server-20231214-0145-v1wn4
owner: xds-k8s-interop-test
...

I1214 01:48:02.060765 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-server-20231214-0145-v1wn4 created
I1214 01:48:02.063211 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server.service.yaml:
---
apiVersion: v1
kind: Service
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0145-v1wn4
labels:
owner: xds-k8s-interop-test
annotations:
cloud.google.com/neg: '{"exposed_ports": {"8080":{"name":"psm-interop-server-20231214-0145-v1wn4-psm-grpc-server"}}}'
spec:
type: ClusterIP
selector:
app: psm-grpc-server
ports:
- port: 8080
protocol: TCP
targetPort: 8080
...

I1214 01:48:02.135249 139963526402048 k8s_base_runner.py:284] Service psm-grpc-server created
I1214 01:48:02.135431 139963526402048 k8s_base_runner.py:821] Waiting for 'cloud.google.com/neg-status' annotation for a NEG at port 8080 to be assigned to Kubernetes Service psm-grpc-server in namespace psm-interop-server-20231214-0145-v1wn4
I1214 01:48:02.228222 139963526402048 k8s_base_runner.py:835] Detected 'cloud.google.com/neg-status' annotation for Kubernetes Service psm-grpc-server, namespace psm-interop-server-20231214-0145-v1wn4: neg_name=psm-interop-server-20231214-0145-v1wn4-psm-grpc-server, port=8080, zones=['us-central1-a']
I1214 01:48:02.228428 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0145-v1wn4/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:48:04.470873 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0145-v1wn4
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:48:04.531387 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-server created
I1214 01:48:04.537288 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/server-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-server
namespace: psm-interop-server-20231214-0145-v1wn4
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-ij1337kf
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-server
deployment_id: psm-grpc-server-ij1337kf
template:
metadata:
annotations:
security.cloud.google.com/use-workload-certificates: ""
labels:
app: psm-grpc-server
deployment_id: psm-grpc-server-ij1337kf
owner: xds-k8s-interop-test
spec:
serviceAccountName: psm-grpc-server
containers:
- name: psm-grpc-server
image: gcr.io/grpc-testing/xds-interop/java-server:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8081
periodSeconds: 3
failureThreshold: 1000
args:
- "--port=8080"
- "--maintenance_port=8081"
- "--secure_mode=True"
ports:
- containerPort: 8080
- containerPort: 8081
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_RBAC
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
- "--node-metadata=app=psm-interop-server-20231214-0145-v1wn4-psm-grpc-server"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:48:04.616451 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-server created
I1214 01:48:04.616663 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-server to initialize 1 pod(s)
I1214 01:48:04.726164 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-server initialized 1 pod(s): ['psm-grpc-server-56f8fbf4df-b47h5']
I1214 01:48:04.726415 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-server-56f8fbf4df-b47h5 to start
I1214 01:48:11.101802 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-server-56f8fbf4df-b47h5 ready, IP: 10.12.4.120
I1214 01:48:11.102065 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-server-56f8fbf4df-b47h5 to authz_test/test_app_logs/psm-interop-server-20231214-0145-v1wn4_psm-grpc-server-56f8fbf4df-b47h5.log
I1214 01:48:11.102476 139963432166976 k8s_log_collector.py:70] Starting log collection thread 139963432166976 for psm-grpc-server-56f8fbf4df-b47h5
I1214 01:48:11.102849 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-server to report 1 available replica(s)
I1214 01:48:14.346885 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-server has 1 replicas available
I1214 01:48:14.383259 139963526402048 traffic_director.py:256] Waiting for Network Endpoint Groups to load endpoints.
I1214 01:48:14.685462 139963526402048 traffic_director.py:259] Loaded NEG "psm-interop-server-20231214-0145-v1wn4-psm-grpc-server" in zone us-central1-a
I1214 01:48:14.685683 139963526402048 traffic_director.py:277] Adding backends to Backend Service psm-interop-backend-service-20231214-0145-v1wn4: {ComputeV1.ZonalGcpResource(name='psm-interop-server-20231214-0145-v1wn4-psm-grpc-server', url='https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0145-v1wn4-psm-grpc-server', zone='us-central1-a')}
I1214 01:48:14.689005 139963526402048 compute.py:544] Patching compute resource:
---
backends:
- balancingMode: RATE
group: https://www.googleapis.com/compute/v1/projects/grpc-testing/zones/us-central1-a/networkEndpointGroups/psm-interop-server-20231214-0145-v1wn4-psm-grpc-server
maxRatePerEndpoint: 5
...

I1214 01:48:15.976748 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518494691-60c6e7a197ee2-3482dddc-ae3692df
I1214 01:49:11.734595 139963526402048 traffic_director.py:294] Waiting for Backend Service psm-interop-backend-service-20231214-0145-v1wn4 to report all backends healthy: ['psm-interop-server-20231214-0145-v1wn4-psm-grpc-server']
I1214 01:49:11.866451 139963526402048 compute.py:494] Backend psm-interop-server-20231214-0145-v1wn4-psm-grpc-server in zone us-central1-a reported healthy
I1214 01:49:15.871267 139963526402048 k8s_xds_client_runner.py:108] Deploying xDS test client "psm-grpc-client" to k8s namespace psm-interop-client-20231214-0145-v1wn4: server_target=xds:///psm-grpc-server:22591 rpc=UnaryCall qps=25 metadata='' secure_mode=True print_response=False
I1214 01:49:15.871669 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0145-v1wn4%22;timeRange=2023-12-14T01:49:15.871529Z%2F2023-12-14T02:19:15.871529Z?project=grpc-testing
I1214 01:49:15.873485 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/namespace.yaml:
---
apiVersion: v1
kind: Namespace
metadata:
name: psm-interop-client-20231214-0145-v1wn4
labels:
name: psm-interop-client-20231214-0145-v1wn4
owner: xds-k8s-interop-test
...

I1214 01:49:15.915399 139963526402048 k8s_base_runner.py:284] Namespace psm-interop-client-20231214-0145-v1wn4 created
I1214 01:49:15.915623 139963526402048 k8s_base_runner.py:341] Granting roles/iam.workloadIdentityUser to serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0145-v1wn4/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:49:16.655081 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/service-account.yaml:
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0145-v1wn4
labels:
owner: xds-k8s-interop-test
annotations:
iam.gke.io/gcp-service-account: xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
...

I1214 01:49:16.743282 139963526402048 k8s_base_runner.py:284] ServiceAccount psm-grpc-client created
I1214 01:49:16.749211 139963526402048 k8s_base_runner.py:264] Rendered template kubernetes-manifests/client-secure.deployment.yaml:
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: psm-grpc-client
namespace: psm-interop-client-20231214-0145-v1wn4
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-cihsm407
owner: xds-k8s-interop-test
spec:
replicas: 1
selector:
matchLabels:
app: psm-grpc-client
deployment_id: psm-grpc-client-cihsm407
template:
metadata:
labels:
app: psm-grpc-client
deployment_id: psm-grpc-client-cihsm407
owner: xds-k8s-interop-test
annotations:
security.cloud.google.com/use-workload-certificates: ""
spec:
serviceAccountName: psm-grpc-client
containers:
- name: psm-grpc-client
image: gcr.io/grpc-testing/xds-interop/java-client:c4fe1175ee793f39fde25f358cbdfda1d27afffd
imagePullPolicy: Always
startupProbe:
tcpSocket:
port: 8079
periodSeconds: 3
failureThreshold: 1000
args:
- "--server=xds:///psm-grpc-server:22591"
- "--stats_port=8079"
- "--secure_mode=True"
- "--qps=25"
- "--rpc=UnaryCall"
- "--print_response=False"
ports:
- containerPort: 8079
env:
- name: GRPC_XDS_BOOTSTRAP
value: "/tmp/grpc-xds/td-grpc-bootstrap.json"
- name: GRPC_XDS_EXPERIMENTAL_SECURITY_SUPPORT
value: "true"
- name: GRPC_XDS_EXPERIMENTAL_V3_SUPPORT
value: "true"
- name: GRPC_EXPERIMENTAL_XDS_ENABLE_OVERRIDE_HOST
value: "true"
volumeMounts:
- mountPath: /tmp/grpc-xds/
name: grpc-td-conf
readOnly: true
resources:
limits:
cpu: 800m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
initContainers:
- name: grpc-td-init
image: gcr.io/grpc-testing/td-grpc-bootstrap:7d8d90477792e2e1bfe3a3da20b3dc9ef01d326c
imagePullPolicy: Always
args:
- "--output=/tmp/bootstrap/td-grpc-bootstrap.json"
- "--vpc-network-name=default-vpc"
resources:
limits:
cpu: 100m
memory: 100Mi
requests:
cpu: 10m
memory: 100Mi
volumeMounts:
- mountPath: /tmp/bootstrap/
name: grpc-td-conf
volumes:
- name: grpc-td-conf
emptyDir:
medium: Memory
...

I1214 01:49:16.830314 139963526402048 k8s_base_runner.py:284] Deployment psm-grpc-client created
I1214 01:49:16.830553 139963526402048 k8s_base_runner.py:751] Waiting for deployment psm-grpc-client to initialize 1 pod(s)
I1214 01:49:16.936573 139963526402048 k8s_base_runner.py:761] Deployment psm-grpc-client initialized 1 pod(s): ['psm-grpc-client-cb48f4795-s9r88']
I1214 01:49:16.936883 139963526402048 k8s_base_runner.py:771] Waiting for pod psm-grpc-client-cb48f4795-s9r88 to start
I1214 01:49:20.189442 139963526402048 k8s_base_runner.py:774] Pod psm-grpc-client-cb48f4795-s9r88 ready, IP: 10.12.2.10
I1214 01:49:20.189707 139963526402048 k8s_base_runner.py:797] Enabling log collection from pod psm-grpc-client-cb48f4795-s9r88 to authz_test/test_app_logs/psm-interop-client-20231214-0145-v1wn4_psm-grpc-client-cb48f4795-s9r88.log
I1214 01:49:20.190020 139963423774272 k8s_log_collector.py:70] Starting log collection thread 139963423774272 for psm-grpc-client-cb48f4795-s9r88
I1214 01:49:20.190115 139963526402048 k8s_base_runner.py:733] Waiting for deployment psm-grpc-client to report 1 available replica(s)
I1214 01:49:22.376365 139963526402048 k8s_base_runner.py:742] Deployment psm-grpc-client has 1 replicas available
I1214 01:49:22.376916 139963526402048 client_app.py:282] [psm-grpc-client-cb48f4795-s9r88] ADS: Waiting for successful calls to xDS control plane to trafficdirector.googleapis.com:443
I1214 01:49:23.929558 139963526402048 client_app.py:310] [psm-grpc-client-cb48f4795-s9r88] xDS control plane channel:
I1214 01:49:23.929859 139963526402048 client_app.py:320] [psm-grpc-client-cb48f4795-s9r88] Detected successful calls to xDS control plane trafficdirector.googleapis.com:443, channel:
I1214 01:49:23.930121 139963526402048 client_app.py:292] [psm-grpc-client-cb48f4795-s9r88] ADS: Detected successful calls to xDS control plane trafficdirector.googleapis.com:443
I1214 01:49:23.930343 139963526402048 client_app.py:242] [psm-grpc-client-cb48f4795-s9r88] Waiting to report a READY channel to xds:///psm-grpc-server:22591
I1214 01:49:24.014592 139963526402048 client_app.py:356] [psm-grpc-client-cb48f4795-s9r88] Server channel:
I1214 01:49:34.062204 139963526402048 client_app.py:356] [psm-grpc-client-cb48f4795-s9r88] Server channel:
I1214 01:49:44.109823 139963526402048 client_app.py:356] [psm-grpc-client-cb48f4795-s9r88] Server channel:
I1214 01:49:54.157342 139963526402048 client_app.py:356] [psm-grpc-client-cb48f4795-s9r88] Server channel:
I1214 01:50:04.204658 139963526402048 client_app.py:356] [psm-grpc-client-cb48f4795-s9r88] Server channel:
I1214 01:50:20.258750 139963526402048 client_app.py:356] [psm-grpc-client-cb48f4795-s9r88] Server channel:
I1214 01:50:20.305803 139963526402048 client_app.py:369] [psm-grpc-client-cb48f4795-s9r88] Found subchannel in state READY:
I1214 01:50:20.306123 139963526402048 client_app.py:253] [psm-grpc-client-cb48f4795-s9r88] Channel to xds:///psm-grpc-server:22591 transitioned to state READY:
I1214 01:50:25.311454 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_tls_allow.01_host_wildcard ---
I1214 01:50:25.311885 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:50:25.355504 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['EMPTY_CALL'], 'metadata': [{'key': 'test', 'value': 'host-wildcard'}]}), wait_for_ready=True, timeout=5)
I1214 01:50:25.393023 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:50:25.928610 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:50:25.966038 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-cb48f4795-s9r88] << Received accumulated stats difference. Expecting RPCs with status (0, OK) for method EMPTY_CALL:
- method: EMPTY_CALL
rpcs_started: 14
result:
(0, OK): 13

I1214 01:50:25.966696 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_tls_allow.01_host_wildcard ---
I1214 01:50:25.966857 139963526402048 xds_k8s_testcase.py:269] --- Starting subTest __main__.AuthzTest.test_tls_allow.02_no_match ---
I1214 01:50:25.967048 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC XdsUpdateClientConfigureService.Configure(request=ClientConfigureRequest({'types': ['UNARY_CALL']}), wait_for_ready=True, timeout=5)
I1214 01:50:26.000112 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:50:26.535722 139963526402048 grpc.py:74] [psm-grpc-client-cb48f4795-s9r88:8079] >> RPC LoadBalancerStatsService.GetClientAccumulatedStats(request=LoadBalancerAccumulatedStatsRequest({}), wait_for_ready=True, timeout=600)
I1214 01:50:26.571544 139963526402048 xds_k8s_testcase.py:398] [psm-grpc-client-cb48f4795-s9r88] << Received accumulated stats difference. Expecting RPCs with status (7, PERMISSION_DENIED) for method UNARY_CALL:
- method: UNARY_CALL
rpcs_started: 14
result:
(7, PERMISSION_DENIED): 14

I1214 01:50:26.572131 139963526402048 xds_k8s_testcase.py:274] --- Finished subTest __main__.AuthzTest.test_tls_allow.02_no_match ---
I1214 01:50:26.572288 139963526402048 xds_k8s_testcase.py:687] ----- TestMethod __main__.AuthzTest.test_tls_allow teardown -----
I1214 01:50:26.744564 139963526402048 traffic_director.py:674] Deleting Forwarding rule "psm-interop-forwarding-rule-20231214-0145-v1wn4"
I1214 01:50:27.397367 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518626748-60c6e81f889b6-06f14fb7-95551dbc
I1214 01:50:36.137867 139963526402048 traffic_director.py:713] Deleting alternative Forwarding rule "psm-interop-forwarding-rule-alt-20231214-0145-v1wn4"
I1214 01:50:36.249543 139963526402048 traffic_director.py:605] Deleting HTTP Target proxy "psm-interop-target-proxy-20231214-0145-v1wn4"
I1214 01:50:36.743381 139963526402048 traffic_director.py:593] Deleting Target GRPC proxy "psm-interop-target-proxy-20231214-0145-v1wn4"
I1214 01:50:37.195553 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518636746-60c6e82911616-f5f21e74-6288c9ef
I1214 01:50:39.465501 139963526402048 traffic_director.py:633] Deleting alternative Target GRPC proxy "psm-interop-target-proxy-alt-20231214-0145-v1wn4"
I1214 01:50:39.782492 139963526402048 traffic_director.py:525] Deleting URL Map "psm-interop-url-map-20231214-0145-v1wn4"
I1214 01:50:40.303228 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518639787-60c6e82bf7c2a-8d5d5f13-ad901e6b
I1214 01:50:42.644473 139963526402048 traffic_director.py:561] Deleting alternative URL Map "psm-interop-url-map-alt-20231214-0145-v1wn4"
I1214 01:50:43.016921 139963526402048 traffic_director.py:243] Deleting Backend Service "psm-interop-backend-service-20231214-0145-v1wn4"
I1214 01:50:43.754386 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518643021-60c6e82f0d705-b228f314-605072f7
I1214 01:51:18.186074 139963526402048 traffic_director.py:332] Deleting Alternative Backend Service "psm-interop-backend-service-alt-20231214-0145-v1wn4"
I1214 01:51:18.631806 139963526402048 traffic_director.py:405] Deleting Affinity Backend Service "psm-interop-backend-service-affinity-20231214-0145-v1wn4"
I1214 01:51:19.035674 139963526402048 traffic_director.py:202] Deleting Health Check "psm-interop-health-check-20231214-0145-v1wn4"
I1214 01:51:19.611701 139963526402048 compute.py:614] Waiting 600 sec for compute operation id: operation-1702518679133-60c6e8517dbc1-9fa25b76-7b1ce2fa
I1214 01:51:24.063566 139963526402048 traffic_director.py:1037] Deleting Endpoint Policy psm-interop-endpoint-policy-20231214-0145-v1wn4
I1214 01:51:24.366879 139963526402048 api.py:524] Waiting 600 sec for networkservices operation id: projects/grpc-testing/locations/global/operations/operation-1702518684158-60c6e85648bad-0f8c840d-e4a03d2b
I1214 01:51:28.606549 139963526402048 traffic_director.py:963] Deleting Server TLS Policy psm-interop-server-tls-policy-20231214-0145-v1wn4
I1214 01:51:28.844003 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518688715-60c6e85aa1109-eb786597-3aecb883
I1214 01:51:33.051102 139963526402048 traffic_director.py:1072] Deleting Client TLS Policy psm-interop-client-tls-policy-20231214-0145-v1wn4
I1214 01:51:33.364278 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518693113-60c6e85ed2e9e-43912b7a-86f02b93
I1214 01:51:37.570436 139963526402048 traffic_director.py:986] Deleting Authz Policy psm-interop-authz-policy-20231214-0145-v1wn4
I1214 01:51:37.849282 139963526402048 api.py:524] Waiting 600 sec for networksecurity operation id: projects/grpc-testing/locations/global/operations/operation-1702518697694-60c6e86331503-f6893823-ffb2a05b
I1214 01:51:42.127545 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-client
I1214 01:51:52.329612 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-client deleted
I1214 01:51:52.329901 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-client-20231214-0145-v1wn4/psm-grpc-client] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:51:53.048084 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-client
I1214 01:51:53.177713 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-client deleted
I1214 01:51:53.177917 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-client-20231214-0145-v1wn4
I1214 01:52:23.377887 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-client-20231214-0145-v1wn4 deleted
I1214 01:52:23.378117 139963526402048 k8s_base_runner.py:662] Deleting deployment psm-grpc-server
I1214 01:52:33.598855 139963526402048 k8s_base_runner.py:677] Deployment psm-grpc-server deleted
I1214 01:52:33.599138 139963526402048 k8s_base_runner.py:680] Deleting service psm-grpc-server
I1214 01:52:33.721261 139963526402048 k8s_base_runner.py:693] Service psm-grpc-server deleted
I1214 01:52:33.721504 139963526402048 k8s_base_runner.py:360] Revoking roles/iam.workloadIdentityUser from serviceAccount:grpc-testing.svc.id.goog[psm-interop-server-20231214-0145-v1wn4/psm-grpc-server] for GCP Service Account xds-k8s-interop-tests@grpc-testing.iam.gserviceaccount.com
I1214 01:52:34.313574 139963526402048 k8s_base_runner.py:696] Deleting service account psm-grpc-server
I1214 01:52:34.432192 139963526402048 k8s_base_runner.py:710] Service account psm-grpc-server deleted
I1214 01:52:34.432401 139963526402048 k8s_base_runner.py:713] Deleting namespace psm-interop-server-20231214-0145-v1wn4
I1214 01:54:04.767701 139963526402048 k8s_base_runner.py:730] Namespace psm-interop-server-20231214-0145-v1wn4 deleted
I1214 01:54:04.768058 139963526402048 xds_k8s_testcase.py:711] ----- Test client/server logs -----
I1214 01:54:04.768283 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-client-cihsm407:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-client%22%0Aresource.labels.namespace_name%3D%22psm-interop-client-20231214-0145-v1wn4%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-client-cihsm407%22;timeRange=2023-12-14T01:49:15.871521Z%2F2023-12-14T01:52:23.378094Z?project=grpc-testing
I1214 01:54:04.768427 139963526402048 k8s_base_runner.py:913] GCP Logs Explorer link to psm-grpc-server-ij1337kf:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22grpc-testing%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22psm-interop-server-20231214-0145-v1wn4%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-ij1337kf%22;timeRange=2023-12-14T01:48:01.899354Z%2F2023-12-14T01:54:04.767910Z?project=grpc-testing
[ OK ] AuthzTest.test_tls_allow
I1214 01:54:04.768690 139963526402048 base_testcase.py:52] ----- TestCase __main__.AuthzTest.test_tls_allow PASSED -----
----------------------------------------------------------------------
Ran 4 tests in 2230.422s

OK
+ echo 'Failed test suites: 0'
Failed test suites: 0


[ID: 9686610] Command finished after 5454 secs, exit value: 0


Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
[17:54:05 PST] Collecting build artifacts from build VM
[17:54:06 PST] Kokoro builder finished