Host Authorization Failure with Error - Timed Out Waiting For "authn_webhook_listening"

Problem

1. Host authorization fails as the pf9-kube service fails to finish execution due to the error "Timed out waiting for "authn_webhook_listening".

None

Destroying container 'bouncer'bouncerc3eca2528cc8bf4749dc18f7152ba79f17ffd44904992b004ceac2486b10e0f2Waiting for "authn_webhook_listening" to evaluate to true ...Waiting for "authn_webhook_listening" to evaluate to true ...Waiting for "authn_webhook_listening" to evaluate to true ...Waiting for "authn_webhook_listening" to evaluate to true ...Waiting for "authn_webhook_listening" to evaluate to true ...Timed out waiting for "authn_webhook_listening"--- status at ---pf9-kube start failed to finish

1. We can observe that the bouncer logs on the host indicate that it cannot assign the requested address.

None

# less bouncer.log
...
{"log": Data as read from the mappings.json file : map[admin:system:masters _member_:ssu_users]<br>","stream":"stderr","time":"2020-02-07T08:11:45.765601799Z"}{"log": version: 1.1.0. listening on: localhost:9977. keystone-url: http://localhost:8158/keystone. project-id: abcdaa4176fa4ed18b1bb1bf9f1801af. auth-ttl: 5m0s. unauth-ttl: 1m0s. keystone-timeout: 30s. cache-size: 2048. bcrypt-cost: 7. log-stats-interval: 10m0s ca-file: /certs/ca.crt. cert-file: /certs/request.crt. key-file: /certs/request.key.<br>","stream":"stderr","time":"2020-02-07T08:11:45.765887905Z"}{"log": serve http:listen tcp 10.17.0.170:9977: bind: cannot assign requested address<br>","stream":"stderr","time":"2020-02-07T08:11:45.768343537Z"}
...

Environment

• Platform9 Managed Kubernetes - All Versions

Cause

1. DNS resolution for localhost resolves to the conflicting IP address observed in bouncer logs.

None

root@user:# nslookup localhostServer: 10.64.0.10Address: 10.64.0.10#53Non-authoritative answer:Name: localhost.lab.org.net[http://localhost.lab.org.net]Address: 10.17.0.170

Resolution

1. Remove the conflicting address from the DNS configuration and restart the pf9-kube service.

Additional Information

N/A