Netscaler-Kubernetes-Gateway-Controller Creates Service Group with Incorrect Protocol (HTTP instead of SSL) When Using HTTPS Listener (Terminate), HTTPRoute, and BackendTLSPolicy #208
Description
Our company is attempting to use the netscaler-kubernetes-gateway-controller in an rke2 cluster (Rancher) with Netscaler ADC VPX (Freemium) NS14.1.51.80.nc and have numerous microservices configured to use the Kubernetes Gateway API. We cannot get the netscaler-kubernetes-gateway-controller to create a service group using the SSL protocol. It always comes up as HTTP. Below are our yamls, the values.yaml file for the controller, and the logs for the controller.
values.yaml:
affinity: {}
fullnameOverride: ''
gatewayController:
createClusterRoleAndBinding: true
disableAPIServerCertVerify: true
enableLivenessProbe: true
enableReadinessProbe: true
entityPrefix: gwy
extraVolumeMounts: []
extraVolumes: []
gatewayControllerName: citrix.com/nsgw-controller
image: >-
{{ .Values.imageRegistry }}/{{ .Values.imageRepository }}:{{
.Values.imageTag }}
jsonLog: false
livenessProbe:
exec:
command:
- /bin/sh
- '-c'
- >
FILE_PATH="$LIVENESS_FILE_PATH"
[ -f "$FILE_PATH" ] && [ $(( $(date +%s) - $(stat -c %Y "$FILE_PATH")
)) -lt 60 ] && exit 0 || exit 1
initialDelaySeconds: 30
periodSeconds: 60
logLevel: info
nodeWatch: true
nsncPbr: false
openshift: false
optimizeEndpointBinding: true
pullPolicy: Always
readinessProbe:
exec:
command:
- cat
- /tmp/readiness
failureThreshold: 3
initialDelaySeconds: 10
periodSeconds: 60
successThreshold: 1
resources:
limits:
cpu: 100m
memory: 200Mi
requests:
cpu: 32m
memory: 128Mi
serviceAccount:
create: true
name: null
tokenExpirationSeconds: 31536000
defaultVip: <redacted>.68
imagePullSecrets: []
imageRegistry: quay.io
imageRepository: netscaler/netscaler-k8s-ingress-controller
imageTag: 3.2.22
license:
accept: true
nameOverride: ''
netscaler:
adcCredentialSecret: nslogin
certBundle: false
hostAlias: null
nitroReadTimeout: 40
nsCertSecret: null
nsIP: <redacted>.67
nsPort: 443
nsProtocol: HTTPS
nsSNIPs: <redacted>.69
nsVIP: <redacted>.68
nsValidateCert: false
podIPsforServiceGroupMembers: true
secretStore:
enabled: false
password: {}
username: {}
nodeSelector: {}
podAnnotations: {}
pullPolicy: IfNotPresent
tolerations: []
global:
cattle:
systemProjectId: <redacted>
GatewayClass:
apiVersion: gateway.networking.k8s.io/v1
kind: GatewayClass
metadata:
name: netscaler-gateway-class
spec:
controllerName: citrix.com/nsgw-controller
Gateway:
(Note: we installed this in kube-system and then tried the default namespaces with the same result)
apiVersion: gateway.networking.k8s.io/v1
kind: Gateway
metadata:
name: gateway-netscaler
namespace: default <kube-system>
spec:
addresses:
- type: IPAddress
value: <redacted>.68
gatewayClassName: netscaler-gateway-class
listeners:
- allowedRoutes:
namespaces:
from: Same
hostname: <redacted>.lab
name: default-https
port: 443
protocol: HTTPS
tls:
certificateRefs:
- group: ''
kind: Secret
name: <redacted>-cert
mode: Terminate
status:
addresses:
- type: IPAddress
value: <redacted>.68
conditions:
- lastTransitionTime: '2025-11-14T20:00:31Z'
message: Accepted by the controller.
reason: CreatedCRDInstance
status: 'True'
type: Accepted
- lastTransitionTime: '2025-11-14T20:00:52Z'
message: Config pushed by the controller.
reason: ConfigPushedToNetscaler
status: 'True'
type: Programmed
HTTPRoute:
apiVersion: gateway.networking.k8s.io/v1
kind: HTTPRoute
metadata:
name: <redacted>-service-httproute
namespace: default
spec:
hostnames:
- <redacted>.lab
- localhost
- 127.0.0.1
parentRefs:
- group: gateway.networking.k8s.io
kind: Gateway
name: gateway-netscaler
sectionName: default-https
rules:
- backendRefs:
- group: ''
kind: Service
name: <redacted>-service
port: <####>
weight: 1
matches:
- path:
type: PathPrefix
value: /<redacted>-service
BackendTLSPolicy:
(Note: Our service helm chart creates the configmap with the cert in it)
apiVersion: gateway.networking.k8s.io/v1
kind: BackendTLSPolicy
metadata:
name: <redacted>-service-backendtls
namespace: default
spec:
targetRefs:
- group: ''
kind: Service
name: <redacted>-service
sectionName: <redacted>-port
validation:
caCertificateRefs:
- group: ''
kind: ConfigMap
name: <redacted>-configmap
hostname: <redacted>-service.default.svc.cluster.local #We tried changing this to a non-k8 hostname
Controller logs:
User has accepted EULA. Starting Triton
The default port for Citrix ingress controller to communicate with Citrix ADC has been changed from 80 to 443 and the protocol has been changed from HTTP to HTTPS
Citrix Ingress Controller version: 3.2.22, build: Thu Sep 11 22:20:46 IST 2025 B:c310c4a50ec92415a2c6488d6f26e7fa8c484fe2
2025-11-14 20:33:51,762 - INFO - [nstriton.py:initalize_k8s_client:366] (MainThread) Initialize the k8s client interface and k8sclienthelper
2025-11-14 20:33:51,763 - DEBUG - [singleton.py:__call__:20] (MainThread) Singleton class <class 'triton.kubernetes.clienthelper.K8sClientHelper'> got created
2025-11-14 20:33:51,763 - INFO - [client.py:__init__:233] (MainThread) Kubernetes parameters:
2025-11-14 20:33:51,763 - INFO - [client.py:__init__:234] (MainThread) Cluster:
2025-11-14 20:33:51,763 - INFO - [client.py:__init__:235] (MainThread) Kube API Server URL: https://<redacted>.0.1:443
2025-11-14 20:33:51,853 - INFO - [client.py:build_session:289] (MainThread) API Server Cert Verification disabled. Cert verification set to False
2025-11-14 20:33:51,853 - INFO - [client.py:__init__:240] (MainThread) Setting Connect_timeout to 5 sec and Read_timeout to 10 sec for all requests methods.
2025-11-14 20:33:51,853 - DEBUG - [nstriton.py:get_configmap_details:529] (MainThread) Fetching configmap details given as arguments
2025-11-14 20:33:51,853 - INFO - [nstriton.py:get_configmap_details:538] (MainThread) NetScaler Ingress Controller Configmap name: gateway-controller-nsgc-configmap namespace:default
2025-11-14 20:33:51,853 - DEBUG - [singleton.py:__call__:20] (MainThread) Singleton class <class 'triton.kubernetes.configmapmgr.CfgVarManager'> got created
2025-11-14 20:33:51,853 - DEBUG - [pbrconfighandler.py:register_cfg_manager:44] (MainThread) Registering FEATURE-NODE-WATCH-CONFIG configmap
2025-11-14 20:33:51,853 - DEBUG - [configmapmgr.py:register_cfg_var:41] (MainThread) Successfully registered Config variable NS_SNIPS
2025-11-14 20:33:51,853 - INFO - [nstriton.py:main:913] (MainThread) configured NS_APPS_NAME_PREFIX as "gwy-"
2025-11-14 20:33:51,853 - INFO - [nstriton.py:main:932] (MainThread) configured NS_MC_PREFIX as "mc-"
2025-11-14 20:33:51,853 - INFO - [nstriton.py:main:965] (MainThread) ==============> Netscaler Kubernetes Gateway Controller with RBAC scope: cluster with Gateway Controller name: 'citrix.com/nsgw-controller' <================
2025-11-14 20:33:51,854 - INFO - [nstriton.py:main:992] (MainThread) NS is running as standalone
2025-11-14 20:33:51,854 - INFO - [nstriton.py:main:1002] (MainThread) Default VIP is <redacted>.68. NS IP is <redacted>.67
2025-11-14 20:33:51,854 - DEBUG - [nstriton.py:read_nslogin_file:609] (MainThread) loginfile /etc/citrix/username doesn't exist
2025-11-14 20:33:51,854 - DEBUG - [nstriton.py:read_nslogin_file:609] (MainThread) loginfile /etc/citrix/password doesn't exist
2025-11-14 20:33:51,854 - DEBUG - [singleton.py:__call__:20] (MainThread) Singleton class <class 'triton.libs.pbkdf2aes.PBKDF2AESCipher'> got created
2025-11-14 20:33:52,559 - DEBUG - [nstriton.py:main:1066] (MainThread) ADC CA Certificate config Cert validation = False Cert path =
2025-11-14 20:33:52,559 - INFO - [nstriton.py:main:1083] (MainThread) Desired service state is configured as True
2025-11-14 20:33:52,559 - DEBUG - [singleton.py:__call__:20] (MainThread) Singleton class <class 'kubernetes.kubernetes.EndpointsConfig'> got created
2025-11-14 20:33:52,560 - DEBUG - [configmapmgr.py:register_cfg_var:41] (MainThread) Successfully registered Config variable IGNORE_NODE_EXTERNAL_IP
2025-11-14 20:33:52,560 - DEBUG - [configmapmgr.py:register_cfg_var:41] (MainThread) Successfully registered Config variable POD_IPS_FOR_SERVICEGROUP_MEMBERS
2025-11-14 20:33:52,560 - DEBUG - [singleton.py:__call__:20] (MainThread) Singleton class <class 'triton.kubernetes.analyticsconfighandler.AnalyticsConfigurator'> got created
2025-11-14 20:33:52,560 - DEBUG - [configmapmgr.py:register_cfg_var:41] (MainThread) Successfully registered Config variable NS_ANALYTICS_CONFIG
2025-11-14 20:33:52,560 - DEBUG - [nstriton.py:main:1167] (MainThread) BGP advertisement is configurd as False
2025-11-14 20:33:52,560 - DEBUG - [singleton.py:__call__:20] (MainThread) Singleton class <class '__main__.ShutdownHandler'> got created
2025-11-14 20:33:52,560 - DEBUG - [nstriton.py:main:1182] (MainThread) CERT_BUNDLE is configured as False
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $service_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'last_update': 0, 'desc': 'Collects Service Eevents'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $endpoint_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'skip': 0, 'last_update': 0, 'desc': 'Collects End point events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $ingress_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'last_update': 0, 'desc': 'Collect ingress events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $secret_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'last_update': 0, 'desc': 'Collect Secret events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $nsapp => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'last_update': 0, 'desc': 'Collect total App events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $nsapp_time => Values ${'tot': 0, 'add_time': 0, 'delete_time': 0, 'modify_time': 0, 'last_update': 0, 'desc': 'Gives Total time taken to configure apps'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $system => Values ${'tot': 0, 'cpu': 0, 'desc': 'CIC CPU, Memory stats'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $handled_events => Values ${'tot': 0, 'last_update': 0, 'desc': 'Total CIC handled events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $queued_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'last_update': 0, 'desc': 'Total CIC queues events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $route_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'last_update': 0, 'desc': 'Collects Openshift Route events'}
2025-11-14 20:33:57,257 - DEBUG - [counter_framework.py:__init__:38] (MainThread) Key $configmap_events => Values ${'tot': 0, 'add': 0, 'delete': 0, 'modify': 0, 'skip': 0, 'last_update': 0, 'desc': 'Collects Config Map events'}
2025-11-14 20:33:57,261 - DEBUG - [configmapmgr.py:register_cfg_var:41] (MainThread) Successfully registered Config variable LOGLEVEL
2025-11-14 20:33:57,261 - DEBUG - [configmapmgr.py:register_cfg_var:41] (MainThread) Successfully registered Config variable JSONLOG
2025-11-14 20:33:57,261 - DEBUG - [configmapmgr.py:validate_configmap_api_access:174] (MainThread) CONFIGMAP: Validating api access.
2025-11-14 20:33:57,566 - DEBUG - [configmapmgr.py:_get_configmap_data:229] (MainThread) Processing get for configmap gateway-controller-nsgc-configmap in namespace default
2025-11-14 20:33:57,571 - DEBUG - [configmapmgr.py:_get_configmap_data:249] (MainThread) Configured configmap gateway-controller-nsgc-configmap in namespace default has data {'JSONLOG': 'false', 'LOGLEVEL': 'info', 'NS_PORT': '443', 'NS_PROTOCOL': 'https', 'POD_IPS_FOR_SERVICEGROUP_MEMBERS': 'true'}
2025-11-14 20:33:57,571 - DEBUG - [configmapmgr.py:get_init_configmap_data:210] (MainThread) CONFIGMAP: Configmap found
2025-11-14 20:33:57,571 - DEBUG - [yamlvalidator.py:load_yaml_data:34] (MainThread) Parsing yaml data for key: JSONLOG
2025-11-14 20:33:57,571 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for JSONLOG config variable value: false
2025-11-14 20:33:57,574 - DEBUG - [baseconfigmapvar.py:validate_schema:53] (MainThread) Schema validation successful for JSONLOG config variable
2025-11-14 20:33:57,574 - DEBUG - [logtypecfgvar.py:validate:29] (MainThread) Validation successful for JSONLOG config variable
2025-11-14 20:33:57,574 - DEBUG - [baseconfigmapvar.py:env_val:78] (MainThread) JSONLOG enviroment value set to false
2025-11-14 20:33:57,574 - DEBUG - [nstriton.py:apply_log_config:577] (MainThread) Applying LOGLEVEL after fetching value from cmap/env
2025-11-14 20:33:57,574 - DEBUG - [configmapmgr.py:set_cmap_var:48] (MainThread) Setting variables value as fetched in config map for keys dict_keys(['LOGLEVEL'])
2025-11-14 20:33:57,574 - DEBUG - [yamlvalidator.py:load_yaml_data:34] (MainThread) Parsing yaml data for key: LOGLEVEL
2025-11-14 20:33:57,574 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for LOGLEVEL config variable value: info
2025-11-14 20:33:57,576 - DEBUG - [baseconfigmapvar.py:validate_schema:53] (MainThread) Schema validation successful for LOGLEVEL config variable
2025-11-14 20:33:57,576 - DEBUG - [loglevelcfgvar.py:validate:29] (MainThread) Validation successful for LOGLEVEL config variable
2025-11-14 20:33:57,576 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) LOGLEVEL configmap value set to info
2025-11-14 20:33:57,576 - DEBUG - [configmapmgr.py:set_cmap_var:48] (MainThread) Setting variables value as fetched in config map for keys dict_keys(['JSONLOG'])
2025-11-14 20:33:57,576 - DEBUG - [yamlvalidator.py:load_yaml_data:34] (MainThread) Parsing yaml data for key: JSONLOG
2025-11-14 20:33:57,652 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for JSONLOG config variable value: false
2025-11-14 20:33:57,654 - DEBUG - [baseconfigmapvar.py:validate_schema:53] (MainThread) Schema validation successful for JSONLOG config variable
2025-11-14 20:33:57,654 - DEBUG - [logtypecfgvar.py:validate:29] (MainThread) Validation successful for JSONLOG config variable
2025-11-14 20:33:57,654 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) JSONLOG configmap value set to false
2025-11-14 20:33:57,654 - DEBUG - [configmapmgr.py:evaluate_cfg_var_values:55] (MainThread) Setting config variables as per priority
2025-11-14 20:33:57,654 - DEBUG - [configmapmgr.py:apply_cfg_var:87] (MainThread) CONFIGMAP: Applying config variable LOGLEVEL
2025-11-14 20:33:57,655 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_PROTOCOL config variable value: https
2025-11-14 20:33:57,656 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_PORT config variable value: 443
2025-11-14 20:33:57,658 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for IGNORE_NODE_EXTERNAL_IP config variable value: false
2025-11-14 20:33:57,659 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for POD_IPS_FOR_SERVICEGROUP_MEMBERS config variable value: false
2025-11-14 20:33:57,660 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_CONFIG_DNS_REC config variable value: false
2025-11-14 20:33:57,661 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for LOGLEVEL config variable value: info
2025-11-14 20:33:57,754 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) LOGLEVEL configmap value set to info
2025-11-14 20:33:57,755 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_PORT config variable value: 443
2025-11-14 20:33:57,757 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) NS_PORT configmap value set to 443
2025-11-14 20:33:57,757 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for JSONLOG config variable value: false
2025-11-14 20:33:57,760 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) JSONLOG configmap value set to false
2025-11-14 20:33:57,760 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_PROTOCOL config variable value: https
2025-11-14 20:33:57,762 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) NS_PROTOCOL configmap value set to https
2025-11-14 20:33:57,763 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for POD_IPS_FOR_SERVICEGROUP_MEMBERS config variable value: true
2025-11-14 20:33:57,854 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) POD_IPS_FOR_SERVICEGROUP_MEMBERS configmap value set to true
2025-11-14 20:33:57,855 - INFO - [nitrointerface.py:register_ns_cfg_vars:1656] (MainThread) register_ns_cfg_vars: CIC session variables updated successfully
2025-11-14 20:33:57,856 - INFO - [nitrointerface.py:apply_session_vars:1625] (MainThread) CIC session variables ns_protocol:https ns_port:443 updated successfully
2025-11-14 20:33:57,856 - INFO - [nitrointerface.py:__init__:1528] (MainThread) Netscaler ADC ip address <redacted>.67, NS vip = <redacted>.68 , Lbrole = server User nsroot Password *******
2025-11-14 20:33:57,858 - INFO - [config_dispatcher.py:run:172] (Dispatcher) Starting Dispatcher thread
2025-11-14 20:33:58,166 - INFO - [kubeeventwriter.py:write:119] (MainThread) CIC Event: CONNECTED: Citrix ADC:<redacted>.67:443
2025-11-14 20:33:58,377 - INFO - [nitrointerface.py:log_ns_info:1602] (MainThread) Netscaler ADC parameters:
2025-11-14 20:33:58,377 - INFO - [nitrointerface.py:log_ns_info:1603] (MainThread) ADC URL: https://<redacted>.67:443
2025-11-14 20:33:58,377 - INFO - [nitrointerface.py:log_ns_info:1604] (MainThread) ADC Entity Prefix is set: gwy-
2025-11-14 20:33:58,452 - INFO - [nitrointerface.py:log_ns_info:1605] (MainThread) Embedded ADC: False
2025-11-14 20:33:58,452 - INFO - [nitrointerface.py:log_ns_info:1606] (MainThread) Enable Certificate Validation: False
2025-11-14 20:33:58,453 - INFO - [nitrointerface.py:log_ns_info:1607] (MainThread) Monitor Netscaler ADC: auto
2025-11-14 20:33:58,453 - INFO - [nitrointerface.py:log_ns_info:1608] (MainThread) Monitor ADC probe frequency: 10
2025-11-14 20:33:58,453 - INFO - [NSAppInterfaceInitHandler.py:operation:47] (MainThread) Default VIP is configured as <redacted>.68
2025-11-14 20:33:58,453 - INFO - [kubeeventwriter.py:write:119] (MainThread) CIC Event: SUCCESS: GET Default VIP from Citrix ADC:
2025-11-14 20:33:58,667 - INFO - [nitrointerface.py:enable_ns_features:7669] (MainThread) ADC version major:14, minor:1, mr_major:51, mr_minor:80.
2025-11-14 20:33:58,954 - INFO - [kubeeventwriter.py:write:119] (MainThread) CIC Event: SUCCESS: ENABLING INIT features on Citrix ADC:
2025-11-14 20:33:58,962 - INFO - [nitrointerface.py:_test_user_edit_permission:7738] (MainThread) Processing test user permission to edit configuration
2025-11-14 20:33:58,962 - INFO - [nitrointerface.py:_test_user_edit_permission:7740] (MainThread) In this process, CIC will try to create a dummy lbvserver with name gwy-dummy_csvs_to_test_edit.deleteme
2025-11-14 20:33:59,469 - INFO - [nitrointerface.py:_test_user_edit_permission:7765] (MainThread) Successfully created test LB gwy-dummy_csvs_to_test_edit.deleteme in NetScaler
2025-11-14 20:33:59,671 - INFO - [nitrointerface.py:_test_user_edit_permission:7770] (MainThread) Finished processing test user permission to edit configuration
2025-11-14 20:33:59,752 - INFO - [kubeeventwriter.py:write:119] (MainThread) CIC Event: SUCCESS: Test LB Vserver Creation on Citrix ADC:
2025-11-14 20:33:59,971 - INFO - [upgrade_entity_names.py:rename_on_upgrade:135] (MainThread) UPGRADE: This module will upgrade entity names from old naming convention to new naming convention.
2025-11-14 20:34:00,668 - INFO - [upgrade_entity_names.py:rename_on_upgrade:208] (MainThread) UPGRADE: No CSActions found with old naming format. No need to upgrade names.
2025-11-14 20:34:00,669 - INFO - [NSAppInterfaceInitHandler.py:operation:115] (MainThread) Configuration upgrade is successful
2025-11-14 20:34:00,953 - INFO - [nitrointerface.py:_perform_post_configure_operation:1703] (MainThread) NetScaler UPTime is recorded as 1545
2025-11-14 20:34:00,954 - INFO - [nstriton.py:main:1316] (MainThread) Enabled Liveness Probe file: /tmp/liveness_path.log and interval Time: 165 Seconds
2025-11-14 20:34:00,954 - INFO - [kubernetes.py:__init__:153] (MainThread) Gateway Controller Name is: citrix.com/nsgw-controller
2025-11-14 20:34:00,954 - INFO - [kubernetes.py:__init__:160] (MainThread) Feature Node Watch is set:True
2025-11-14 20:34:00,957 - INFO - [clienthelper.py:get:78] (MainThread) Resource not found: namespace None
2025-11-14 20:34:01,961 - INFO - [clienthelper.py:get:78] (MainThread) Resource not found: /anthos.gke.io namespace None
2025-11-14 20:34:02,969 - INFO - [nodeWatch.py:__init__:39] (MainThread) CNI found: default
2025-11-14 20:34:02,972 - INFO - [kubernetes.py:get_kubernetes_version:6314] (MainThread) Kubernetes server version is discovered as: v1.31.8+rke2r1
2025-11-14 20:34:02,972 - INFO - [client.py:update_ingress_version_to_v1:68] (MainThread) Ingress V1 is supported. Setting the prefix to /apis/networking.k8s.io/v1 to fetch ingresses
2025-11-14 20:34:03,054 - INFO - [referencemanager.py:__init__:128] (MainThread) Initializing Reference manager singleton
2025-11-14 20:34:06,357 - INFO - [nitrointerface.py:check_usnip:1673] (MainThread) Checking if USNIP is enabled at ADC
2025-11-14 20:34:07,072 - INFO - [nitrointerface.py:add_ns_route:8515] (MainThread) Ignoring the exception while configuring Routes in ADC, Routes already exists network:<redacted>.0.0 gateway:<redacted>.51
2025-11-14 20:34:07,570 - INFO - [nitrointerface.py:add_ns_route:8515] (MainThread) Ignoring the exception while configuring Routes in ADC, Routes already exists network:<redacted>.1.0 gateway:<redacted>.53
2025-11-14 20:34:07,570 - INFO - [kubernetes.py:configure_cpx_for_all_apps:4946] (MainThread) ADC-SYNC:STARTED
2025-11-14 20:34:07,769 - INFO - [nitrointerface.py:sync_ns_cs_apps:8276] (MainThread) Starting Syncing existing Netscaler ADC configurations
2025-11-14 20:34:08,064 - INFO - [nitrointerface.py:_handle_cs_vserver_sync:7967] (MainThread) No csvserver found in NetScaler
2025-11-14 20:34:08,269 - INFO - [nitrointerface.py:_handle_lb_vserver_sync:8062] (MainThread) No lbvserver found in NetScaler
2025-11-14 20:34:08,554 - INFO - [nitrointerface.py:_handle_responderpolicy_sync:8156] (MainThread) No responder policies found in NetScaler
2025-11-14 20:34:08,554 - INFO - [nitrointerface.py:sync_ns_cs_apps:8281] (MainThread) Completed Syncing existing Netscaler ADC configurations
2025-11-14 20:34:08,554 - INFO - [kubernetes.py:kubernetes_service_to_nsapps:3223] (MainThread) Handling Service creation/Modification cattle-cluster-agent.cattle-system
2025-11-14 20:34:08,554 - INFO - [kubernetes.py:kubernetes_service_to_nsapps:3223] (MainThread) Handling Service creation/Modification rancher-webhook.cattle-system
2025-11-14 20:34:08,554 - INFO - [kubernetes.py:kubernetes_service_to_nsapps:3223] (MainThread) Handling Service creation/Modification kubernetes.default
2025-11-14 20:34:08,555 - INFO - [kubernetes.py:kubernetes_service_to_nsapps:3223] (MainThread) Handling Service creation/Modification <redacted>-service.default
2025-11-14 20:34:08,555 - INFO - [kubernetes.py:kubernetes_service_to_nsapps:3223] (MainThread) Handling Service creation/Modification rke2-coredns-rke2-coredns.kube-system
2025-11-14 20:34:08,555 - INFO - [kubernetes.py:kubernetes_service_to_nsapps:3223] (MainThread) Handling Service creation/Modification rke2-metrics-server.kube-system
2025-11-14 20:34:08,555 - INFO - [nitrointerface.py:_initialize_binding_priority_pool:2125] (MainThread) Skipping priority pool adjustment as no csvserver found in NetScaler
2025-11-14 20:34:08,770 - INFO - [nitrointerface.py:handle_ns_monitoring:1759] (MainThread) Starting Monitor thread that watches NetScaler state
2025-11-14 20:34:08,772 - INFO - [nitrointerface.py:configure_apps_during_sync:6352] (MainThread) ADC-SYNC: Ingress configuration completed. No downtime observed.
2025-11-14 20:34:08,772 - INFO - [nitrointerface.py:configure_apps_during_sync:6362] (MainThread) ADC-SYNC: Loadbalancer type service configuration completed. No downtime observed.
2025-11-14 20:34:08,857 - INFO - [endpointlabels.py:__init__:36] (MainThread) Endpoint labels functionality disabled
2025-11-14 20:34:09,153 - INFO - [kubernetes.py:configure_cpx_for_all_apps:5015] (MainThread) ADC-SYNC: Completed. Time Taken:0:00:01.583243.
2025-11-14 20:34:09,153 - INFO - [kubernetes.py:configure_cpx_for_all_apps:5016] (MainThread) ADC-SYNC: Nitro-Stats: defaultdict(<class 'int'>, {'get_filtered': 3, 'get': 1, 'clear': 1})
2025-11-14 20:34:09,154 - INFO - [nitrointerface.py:add_cic_policystrmap:9417] (MainThread) Adding CIC stringmap in ADC
2025-11-14 20:34:09,665 - INFO - [nitrointerface.py:add_cic_policystrmap:9432] (MainThread) Successfully added stringmap policy object
2025-11-14 20:34:11,459 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for LOGLEVEL config variable value: info
2025-11-14 20:34:11,461 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) LOGLEVEL configmap value set to info
2025-11-14 20:34:11,461 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_PORT config variable value: 443
2025-11-14 20:34:11,463 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) NS_PORT configmap value set to 443
2025-11-14 20:34:11,463 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for JSONLOG config variable value: false
2025-11-14 20:34:11,464 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) JSONLOG configmap value set to false
2025-11-14 20:34:11,464 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for NS_PROTOCOL config variable value: https
2025-11-14 20:34:11,466 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) NS_PROTOCOL configmap value set to https
2025-11-14 20:34:11,466 - INFO - [baseconfigmapvar.py:_load_data:60] (MainThread) Data loaded successful for POD_IPS_FOR_SERVICEGROUP_MEMBERS config variable value: true
2025-11-14 20:34:11,467 - INFO - [baseconfigmapvar.py:cmap_val:94] (MainThread) POD_IPS_FOR_SERVICEGROUP_MEMBERS configmap value set to true
2025-11-14 20:34:11,467 - INFO - [nitrointerface.py:apply_session_vars:1625] (MainThread) CIC session variables ns_protocol:https ns_port:443 updated successfully
2025-11-14 20:34:11,972 - INFO - [nitrointerface.py:add_ns_route:8515] (MainThread) Ignoring the exception while configuring Routes in ADC, Routes already exists network:<redacted>.0.0 gateway:<redacted>.51
2025-11-14 20:34:12,470 - INFO - [nitrointerface.py:add_ns_route:8515] (MainThread) Ignoring the exception while configuring Routes in ADC, Routes already exists network:<redacted>.1.0 gateway:<redacted>.53
2025-11-14 20:34:13,271 - INFO - [customresourcecontroller.py:sync_existing_events_from_k8s:480] (MainThread) Syncing all custom resource definitions first to look for Citrix CRD definitions.
2025-11-14 20:34:14,260 - INFO - [kubernetes.py:run:413] (SecretListener) Starting thread that watches /secrets, namespace: None...
2025-11-14 20:34:14,761 - INFO - [kubernetes.py:run:413] (DeploymentListener) Starting thread that watches /deployments, namespace: None...
2025-11-14 20:34:15,261 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD ANY-NS.GatewayClass.netscaler-gateway-class
2025-11-14 20:34:15,261 - INFO - [gatewayclass.py:_create_instance:97] (MainThread) Created instance for netscaler-gateway-class GatewayClass event_type:ADDED
2025-11-14 20:34:15,267 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:15,268 - INFO - [gateway.py:_validate:131] (MainThread) SUCCESS: VALIDATION for crd gateway-netscaler.default of kind Gateway
2025-11-14 20:34:15,268 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD Gateway.default.gateway-netscaler
2025-11-14 20:34:15,268 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: ANY-NS.GatewayClass.netscaler-gateway-class Filter: {}
2025-11-14 20:34:15,268 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: default.Secret.<redacted>-cert Filter: {}
2025-11-14 20:34:15,268 - INFO - [gateway.py:_create_instance:176] (MainThread) Successfully Created instance for Gateway gateway-netscaler.default event type:ADDED spec:{'addresses': [{'type': 'IPAddress', 'value': '<redacted>.68'}], 'gatewayClassName': 'netscaler-gateway-class', 'listeners': [{'allowedRoutes': {'namespaces': {'from': 'Same'}}, 'hostname': '<redacted>.lab', 'name': 'default-https', 'port': 443, 'protocol': 'HTTPS', 'tls': {'certificateRefs': [{'group': '', 'kind': 'Secret', 'name': '<redacted>-cert'}], 'mode': 'Terminate'}}]}
2025-11-14 20:34:15,352 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD default.Gateway.gateway-netscaler
2025-11-14 20:34:15,352 - INFO - [gateway.py:add_spec:288] (MainThread) add_spec called for name:gateway-netscaler namespace:default resourceVersion:153387475
2025-11-14 20:34:15,352 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:15,368 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Gateway.gateway-netscaler
2025-11-14 20:34:15,373 - INFO - [secret.py:_create_instance:140] (MainThread) Created Secret instance for <redacted>-cert default event type:ADDED
2025-11-14 20:34:15,373 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD Secret.default.<redacted>-cert
2025-11-14 20:34:15,373 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD default.Secret.<redacted>-cert
2025-11-14 20:34:15,373 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Secret.<redacted>-cert
2025-11-14 20:34:15,373 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Gateway.gateway-netscaler
2025-11-14 20:34:15,373 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:15,373 - INFO - [gateway.py:_handle_references:465] (MainThread) name:gateway-netscaler namespace:default resourceVersion:153387475 Reference resolved with kind:Secret name:<redacted>-cert namespace:default
2025-11-14 20:34:15,664 - INFO - [nitrointerface.py:add_customresource_secret:4799] (MainThread) Certkey gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP is already configured
2025-11-14 20:34:15,665 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD ANY-NS.GatewayClass.netscaler-gateway-class
2025-11-14 20:34:15,665 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node ANY-NS.GatewayClass.netscaler-gateway-class
2025-11-14 20:34:15,665 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Gateway.gateway-netscaler
2025-11-14 20:34:15,665 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:15,665 - INFO - [gateway.py:_handle_references:465] (MainThread) name:gateway-netscaler namespace:default resourceVersion:153387475 Reference resolved with kind:GatewayClass name:netscaler-gateway-class namespace:ANY-NS
2025-11-14 20:34:15,665 - INFO - [gateway.py:add_spec:288] (MainThread) add_spec called for name:gateway-netscaler namespace:default resourceVersion:153387475
2025-11-14 20:34:15,665 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:15,967 - INFO - [nitrointerface.py:add_customresource_secret:4799] (MainThread) Certkey gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP is already configured
2025-11-14 20:34:16,469 - INFO - [kubernetes.py:run:413] (GatewayclassListener) Starting thread that watches /gatewayclasses, namespace: None...
2025-11-14 20:34:16,663 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:16,663 - INFO - [gateway.py:_validate:131] (MainThread) SUCCESS: VALIDATION for crd gateway-netscaler.default of kind Gateway
2025-11-14 20:34:16,663 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD Gateway.default.gateway-netscaler
2025-11-14 20:34:16,663 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: ANY-NS.GatewayClass.netscaler-gateway-class Filter: {}
2025-11-14 20:34:16,663 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: default.Secret.<redacted>-cert Filter: {}
2025-11-14 20:34:16,663 - INFO - [gateway.py:_create_instance:176] (MainThread) Successfully Created instance for Gateway gateway-netscaler.default event type:ADDED spec:{'addresses': [{'type': 'IPAddress', 'value': '<redacted>.68'}], 'gatewayClassName': 'netscaler-gateway-class', 'listeners': [{'allowedRoutes': {'namespaces': {'from': 'Same'}}, 'hostname': '<redacted>.lab', 'name': 'default-https', 'port': 443, 'protocol': 'HTTPS', 'tls': {'certificateRefs': [{'group': '', 'kind': 'Secret', 'name': '<redacted>-cert'}], 'mode': 'Terminate'}}]}
2025-11-14 20:34:16,663 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD default.Gateway.gateway-netscaler
2025-11-14 20:34:16,663 - WARNING - [referencemanager.py:activate_crd:960] (MainThread) CRD Modifcation in progress : Skipping activation
2025-11-14 20:34:16,664 - INFO - [referencemanager.py:resolve_references:577] (MainThread) CRD Modification in progress: skipping resolve reference and processing as modification
2025-11-14 20:34:16,664 - INFO - [referencemanager.py:modify_references:891] (MainThread) Modify reference for CRD default.Gateway.gateway-netscaler
2025-11-14 20:34:16,664 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:16,664 - INFO - [gateway.py:_handle_references:465] (MainThread) name:gateway-netscaler namespace:default resourceVersion:153387475 Reference resolved with kind:GatewayClass name:netscaler-gateway-class namespace:ANY-NS
2025-11-14 20:34:16,664 - INFO - [gateway.py:add_spec:288] (MainThread) add_spec called for name:gateway-netscaler namespace:default resourceVersion:153387475
2025-11-14 20:34:16,664 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:16,970 - INFO - [nitrointerface.py:add_customresource_secret:4799] (MainThread) Certkey gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP is already configured
2025-11-14 20:34:16,971 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:16,971 - INFO - [gateway.py:_handle_references:465] (MainThread) name:gateway-netscaler namespace:default resourceVersion:153390120 Reference resolved with kind:GatewayClass name:netscaler-gateway-class namespace:ANY-NS
2025-11-14 20:34:16,971 - INFO - [gateway.py:add_spec:288] (MainThread) add_spec called for name:gateway-netscaler namespace:default resourceVersion:153390120
2025-11-14 20:34:16,971 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:17,269 - INFO - [nitrointerface.py:add_customresource_secret:4799] (MainThread) Certkey gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP is already configured
2025-11-14 20:34:17,269 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:17,269 - INFO - [gateway.py:_handle_references:465] (MainThread) name:gateway-netscaler namespace:default resourceVersion:153387475 Reference resolved with kind:Secret name:<redacted>-cert namespace:default
2025-11-14 20:34:17,553 - INFO - [nitrointerface.py:add_customresource_secret:4799] (MainThread) Certkey gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP is already configured
2025-11-14 20:34:17,553 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:17,553 - INFO - [gateway.py:_handle_references:465] (MainThread) name:gateway-netscaler namespace:default resourceVersion:153390120 Reference resolved with kind:Secret name:<redacted>-cert namespace:default
2025-11-14 20:34:17,766 - INFO - [nitrointerface.py:add_customresource_secret:4799] (MainThread) Certkey gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP is already configured
2025-11-14 20:34:17,766 - INFO - [gateway.py:add_spec:288] (MainThread) add_spec called for name:gateway-netscaler namespace:default resourceVersion:153387475
2025-11-14 20:34:17,766 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:17,783 - INFO - [gateway.py:add_spec:288] (MainThread) add_spec called for name:gateway-netscaler namespace:default resourceVersion:153390120
2025-11-14 20:34:17,783 - INFO - [gateway.py:is_gatewayclass_supported:119] (MainThread) GatewayClass netscaler-gateway-class is present and supported by this controller
2025-11-14 20:34:17,865 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Gateway.gateway-netscaler
2025-11-14 20:34:18,366 - INFO - [kubernetes.py:run:413] (GatewayListener) Starting thread that watches /gateways, namespace: None...
2025-11-14 20:34:18,554 - INFO - [k8shttproute.py:_validate:83] (MainThread) SUCCESS: VALIDATION for crd <redacted>-service-httproute.default of kind k8shttproute
2025-11-14 20:34:18,554 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD k8shttproute.default.<redacted>-service-httproute
2025-11-14 20:34:18,555 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: default.Gateway.gateway-netscaler Filter: {}
2025-11-14 20:34:18,555 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: default.Service.<redacted>-service Filter: {}
2025-11-14 20:34:18,555 - INFO - [referencemanager.py:register_crd_reference:467] (MainThread) Registering reference: default.Endpoints.<redacted>-service Filter: {}
2025-11-14 20:34:18,555 - INFO - [k8shttproute.py:_create_instance:134] (MainThread) Successfully Created instance for K8S HTTPRoute <redacted>-service-httproute.default event type:ADDED spec:{'hostnames': ['<redacted>.lab', 'localhost', '127.0.0.1'], 'parentRefs': [{'group': 'gateway.networking.k8s.io', 'kind': 'Gateway', 'name': 'gateway-netscaler'}], 'rules': [{'backendRefs': [{'group': '', 'kind': 'Service', 'name': '<redacted>-service', 'port': <####>, 'weight': 1}], 'matches': [{'path': {'type': 'PathPrefix', 'value': '/<redacted>-service'}}]}]}
2025-11-14 20:34:18,555 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD default.k8shttproute.<redacted>-service-httproute
2025-11-14 20:34:18,555 - INFO - [k8shttproute.py:add_spec:240] (MainThread) add_spec called on instance name:<redacted>-service-httproute namespace:default resourceVersion:153389966
2025-11-14 20:34:18,555 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.k8shttproute.<redacted>-service-httproute
2025-11-14 20:34:18,555 - INFO - [k8shttproute.py:reference_resolved:336] (MainThread) name:<redacted>-service-httproute namespace:default resourceVersion:153389966 Reference resolved with kind:Gateway name:gateway-netscaler namespace:default
2025-11-14 20:34:18,555 - INFO - [NSAppInterfacePriorityPoolManager.py:createPriorityPool:493] (MainThread) NSPriorityPoolManagerPerCSVS: Skipping since gwy_crd_k8shttproute_<redacted>-service-httproute_default_0_lb CS VS already has pool
2025-11-14 20:34:18,561 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD default.Endpoints.<redacted>-service
2025-11-14 20:34:18,561 - INFO - [endpoint.py:_create_instance:73] (MainThread) Created instance for <redacted>-service default Endpoints event_type:ADDED
2025-11-14 20:34:18,561 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD default.Endpoints.<redacted>-service
2025-11-14 20:34:18,561 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Endpoints.<redacted>-service
2025-11-14 20:34:18,561 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.k8shttproute.<redacted>-service-httproute
2025-11-14 20:34:18,561 - INFO - [k8shttproute.py:reference_resolved:336] (MainThread) name:<redacted>-service-httproute namespace:default resourceVersion:153389966 Reference resolved with kind:Endpoints name:<redacted>-service namespace:default
2025-11-14 20:34:18,561 - INFO - [servicehelper.py:handle_service_or_endpoints:90] (MainThread) Unable to fetch the service object for endpoint object with name:<redacted>-service and namespace:default, ignoring the event
2025-11-14 20:34:18,660 - INFO - [Service.py:_create_instance:86] (MainThread) Creating instance for <redacted>-service default Service event type:ADDED
2025-11-14 20:34:18,660 - INFO - [referencemanager.py:register_crd_instance:422] (MainThread) Adding new instance for CRD default.Service.<redacted>-service
2025-11-14 20:34:18,660 - INFO - [Service.py:_create_instance:91] (MainThread) Successfully created instance for <redacted>-service default Service event type:ADDED
2025-11-14 20:34:18,660 - INFO - [referencemanager.py:activate_crd:954] (MainThread) Activating CRD default.Service.<redacted>-service
2025-11-14 20:34:18,660 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.Service.<redacted>-service
2025-11-14 20:34:18,660 - INFO - [referencemanager.py:resolve:505] (MainThread) Resolving node default.k8shttproute.<redacted>-service-httproute
2025-11-14 20:34:18,660 - INFO - [k8shttproute.py:reference_resolved:336] (MainThread) name:<redacted>-service-httproute namespace:default resourceVersion:153389966 Reference resolved with kind:Service name:<redacted>-service namespace:default
2025-11-14 20:34:19,162 - INFO - [kubernetes.py:run:413] (K8shttprouteListener) Starting thread that watches /k8shttproutes, namespace: None...
2025-11-14 20:34:19,855 - INFO - [kubernetes.py:run:413] (AppqoepolicyListener) Starting thread that watches /appqoepolicies, namespace: None...
2025-11-14 20:34:20,463 - INFO - [kubernetes.py:run:413] (BotListener) Starting thread that watches /bots, namespace: None...
2025-11-14 20:34:20,969 - INFO - [nstriton.py:liveness_file_update_handler:1338] (Thread-1) Starting LivenessProbe Thread ...
2025-11-14 20:34:20,969 - ERROR - [nstriton.py:liveness_file_update_handler:1350] (Thread-1) LivenessProbe failed for thread <KubernetesWatchThread(EndpointsListener, initial daemon)>
2025-11-14 20:34:20,969 - ERROR - [nstriton.py:liveness_file_update_handler:1356] (Thread-1) LivenessProbe failed setting is_alive to false
2025-11-14 20:34:21,154 - INFO - [kubernetes.py:run:413] (RatelimitListener) Starting thread that watches /ratelimits, namespace: None...
2025-11-14 20:34:21,853 - INFO - [kubernetes.py:run:413] (RewritepolicyListener) Starting thread that watches /rewritepolicies, namespace: None...
2025-11-14 20:34:22,665 - INFO - [kubernetes.py:run:413] (VipListener) Starting thread that watches /vips, namespace: None...
2025-11-14 20:34:23,262 - INFO - [kubernetes.py:run:413] (WafListener) Starting thread that watches /wafs, namespace: None...
2025-11-14 20:34:23,262 - INFO - [customresourcecontroller.py:sync_existing_events_from_k8s:544] (MainThread) END: Executing processing of existing CRDs
2025-11-14 20:34:23,461 - INFO - [kubernetes.py:main_thread:790] (MainThread) Starting watch threads...
2025-11-14 20:34:23,552 - INFO - [kubernetes.py:run:413] (EndpointsListener) Starting thread that watches /endpoints, namespace: None...
2025-11-14 20:34:23,554 - INFO - [kubernetes.py:run:413] (ConfigMapListener) Starting thread that watches /configmaps, namespace: None...
2025-11-14 20:34:23,556 - INFO - [kubernetes.py:run:413] (ServiceListener) Starting thread that watches /services, namespace: None...
2025-11-14 20:34:23,557 - INFO - [kubernetes.py:run:413] (CRDListener) Starting thread that watches /customresourcedefinitions, namespace: False...
2025-11-14 20:34:23,961 - INFO - [kubernetes.py:run:413] (NodesListener) Starting thread that watches /nodes, namespace: False...
2025-11-14 20:34:24,054 - INFO - [config_dispatcher.py:_pull_crd_config_from_ns:560] (Dispatcher) Pulling CRD configuration from NetScaler started
2025-11-14 20:34:24,055 - INFO - [kubernetes.py:run:413] (PodListener) Starting thread that watches /pods, namespace: None...
2025-11-14 20:34:34,068 - INFO - [config_dispatcher.py:_pull_crd_config_from_ns:636] (Dispatcher) Pulling CRD configuration from NetScaler Completed
2025-11-14 20:34:34,068 - INFO - [config_dispatcher.py:_synchronize_config:229] (Dispatcher) Config Synchronization started
2025-11-14 20:34:34,068 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:NetScaler Configuration ConfigObjects(3)[DELETE_sslvserver_sslcertkey_binding_gwy_crd_Gateway_<redacted>.68_443_ssl_gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP_True DELETE_sslvserver_sslcertkey_binding_gwy_crd_Gateway_<redacted>.68_443_ssl_gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP_False ]}' started
2025-11-14 20:34:34,553 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'NetScaler Configuration' is successful
2025-11-14 20:34:34,554 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler.add_spec ConfigObjects(2)[ADD_csvserver_gwy_crd_Gateway_<redacted>.68_443_ssl SET_sslvserver_gwy_crd_Gateway_<redacted>.68_443_ssl ]}' started
2025-11-14 20:34:34,969 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler.add_spec' is successful
2025-11-14 20:34:34,969 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler.Secret_resolve_spec ConfigObjects(2)[ADD_sslvserver_sslcertkey_binding_gwy_crd_Gateway_<redacted>.68_443_ssl_gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP_true ADD_sslvserver_sslcertkey_binding_gwy_crd_Gateway_<redacted>.68_443_ssl_gwy-ERVMG5N44W3BOMX6QTNZ5PZ7BKP_false ]}' started
2025-11-14 20:34:35,455 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler.Secret_resolve_spec' is successful
2025-11-14 20:34:35,455 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler.add_spec ConfigObjects(2)[SET_sslvserver_gwy_crd_Gateway_<redacted>.68_443_ssl ]}' started
2025-11-14 20:34:35,667 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler.add_spec' is successful
2025-11-14 20:34:35,667 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler_default-https.default-https.GatewayClass_secret_add_spec ConfigObjects(2)[]}' started
2025-11-14 20:34:35,667 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler_default-https.default-https.GatewayClass_secret_add_spec' is successful
2025-11-14 20:34:35,667 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler.add_spec ConfigObjects(2)[SET_sslvserver_gwy_crd_Gateway_<redacted>.68_443_ssl ]}' started
2025-11-14 20:34:35,952 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler.add_spec' is successful
2025-11-14 20:34:35,952 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler.add_spec ConfigObjects(2)[SET_sslvserver_gwy_crd_Gateway_<redacted>.68_443_ssl ]}' started
2025-11-14 20:34:36,166 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler.add_spec' is successful
2025-11-14 20:34:36,166 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler_default-https.default-https.GatewayClass_secret_add_spec ConfigObjects(2)[]}' started
2025-11-14 20:34:36,166 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler_default-https.default-https.GatewayClass_secret_add_spec' is successful
2025-11-14 20:34:36,166 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:Gateway.default.gateway-netscaler.Secret_resolve_spec ConfigObjects(2)[]}' started
2025-11-14 20:34:36,166 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'Gateway.default.gateway-netscaler.Secret_resolve_spec' is successful
2025-11-14 20:34:36,166 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:k8shttproute.default.<redacted>-service-httproute.add_spec ConfigObjects(6)[ADD_lbvserver_gwy_crd_k8shttproute_<redacted>-service-httproute_default_0_lb ADD_servicegroup_gwy_crd_k8shttproute_<redacted>-service-httproute_default_<redacted>-service_default_<####>_http_svc ADD_lbvserver_servicegroup_binding_gwy_crd_k8shttproute_<redacted>-service-httproute_default_0_lb_gwy_crd_k8shttproute_<redacted>-service-httproute_default_<redacted>-service_default_<####>_http_svc ADD_csaction_gwy_crd_k8shttproute_<redacted>-service-httproute_default_0 ADD_cspolicy_gwy_crd_k8shttproute_<redacted>-service-httproute_default_0 ADD_csvserver_cspolicy_binding_gwy_crd_Gateway_<redacted>.68_443_ssl_gwy_crd_k8shttproute_<redacted>-service-httproute_default_0 ]}' started
2025-11-14 20:34:37,567 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'k8shttproute.default.<redacted>-service-httproute.add_spec' is successful
2025-11-14 20:34:37,567 - INFO - [config_dispatcher.py:__dispatch_config_pack:349] (Dispatcher) Processing of ConfigPack '{ID:k8shttproute.default.<redacted>-service-httproute.default.Service.<redacted>-service_resolve_spec ConfigObjects(1)[ADD_servicegroup_servicegroupmember_binding_gwy_crd_k8shttproute_<redacted>-service-httproute_default_<redacted>-service_default_<####>_http_svc_<####>_<redacted>.1.80 ]}' started
2025-11-14 20:34:37,769 - INFO - [config_dispatcher.py:__dispatch_config_pack:389] (Dispatcher) Processing of ConfigPack 'k8shttproute.default.<redacted>-service-httproute.default.Service.<redacted>-service_resolve_spec' is successful
2025-11-14 20:34:37,769 - INFO - [config_dispatcher.py:_synchronize_config:246] (Dispatcher) Config Synchronization ended