K8S Operator is not able to connect to kube api from within its process (network unreachable), but container can route fine

Open passcod opened this issue 2 years ago • 0 comments

What is the issue?

Running the tailscale-operator in proxy mode (with auth).

Connecting to the operator results in a TLS error client-side, and operator logs show it can't connect to the kubernetes.default.svc:

Get \"https://kubernetes.default.svc/api/v1/namespaces/tailscale/secrets/operator\":
dial tcp [fd10:416b:9c70::1]:443: connect: network is unreachable"

However, opening a shell inside the operator container can successfully connect:

$ kubectl exec ...
/ # apk add curl
/ # curl -ki https://kubernetes.default.svc/api/v1/namespaces/tailscale/secrets/operator
HTTP/2 403
...

This isn't transient either, trying to connect to the tailscale proxy again after running curl still returns unreachable in the logs, at the same time that curl can reach just fine.

This also affects the operator's ability to write its state to a kubernetes secret.

Also, this is an empty cluster. There's basically no actual workload here (yet).

In the tailnet, MagicDNS is on, only the 100.100.100.100 nameserver is set, no custom search domain, https certs are on. Plan is "Starter" (going off the "Tailscale Kubernetes operator is available for all plans." note in the documentation is what initially led me to try it here).

Steps to reproduce

Deployment:

apiVersion: apps/v1
kind: Deployment
metadata:
  name: operator
  namespace: tailscale
  labels:
    app.kubernetes.io/managed-by: Helm
  annotations:
    meta.helm.sh/release-name: tailscale-c74e4c8f
    meta.helm.sh/release-namespace: tailscale
spec:
  replicas: 1
  selector:
    matchLabels:
      app: operator
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: operator
    spec:
      volumes:
        - name: oauth
          secret:
            secretName: operator-oauth
            defaultMode: 420
      containers:
        - name: operator
          image: tailscale/k8s-operator:latest
          env:
            - name: OPERATOR_HOSTNAME
              value: k8s-operator-tamanu-internal-main
            - name: OPERATOR_SECRET
              value: operator
            - name: OPERATOR_LOGGING
              value: debug
            - name: OPERATOR_NAMESPACE
              valueFrom:
                fieldRef:
                  apiVersion: v1
                  fieldPath: metadata.namespace
            - name: CLIENT_ID_FILE
              value: /oauth/client_id
            - name: CLIENT_SECRET_FILE
              value: /oauth/client_secret
            - name: PROXY_IMAGE
              value: tailscale/tailscale:v1.58.2
            - name: PROXY_TAGS
              value: tag:k8s
            - name: APISERVER_PROXY
              value: 'true'
            - name: PROXY_FIREWALL_MODE
              value: auto
          resources: {}
          volumeMounts:
            - name: oauth
              readOnly: true
              mountPath: /oauth
          terminationMessagePath: /dev/termination-log
          terminationMessagePolicy: File
          imagePullPolicy: Always
      restartPolicy: Always
      terminationGracePeriodSeconds: 30
      dnsPolicy: ClusterFirst
      nodeSelector:
        kubernetes.io/os: linux
      serviceAccountName: operator
      serviceAccount: operator
      securityContext: {}
      affinity:
        nodeAffinity:
          requiredDuringSchedulingIgnoredDuringExecution:
            nodeSelectorTerms:
              - matchExpressions:
                  - key: bes.node.purpose
                    operator: In
                    values:
                      - ingress
      schedulerName: default-scheduler
  strategy:
    type: Recreate
  revisionHistoryLimit: 10
  progressDeadlineSeconds: 600

Debug log:

{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] using fake (no-op) tun device"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] using fake (no-op) OS network configurator"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] using fake (no-op) DNS configurator"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"dns: using dns.noopManager"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"link state: interfaces.State{defaultRoute=v4if0 ifs={eth0:[2406:da1c:5e2:ef03:2df1::d/128 llu6] v4if0:[llu4 llu6]} v4=false v6=true}"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] couldn't create raw v4 disco listener, using regular listener instead: raw disco listening disabled, SO_MARK unavailable"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] couldn't create raw v6 disco listener, using regular listener instead: raw disco listening disabled, SO_MARK unavailable"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"magicsock: disco key = d:95ad0d276350ea07"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Creating WireGuard device..."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Bringing WireGuard device up..."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wg: [v2] UDP bind has been updated"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wg: [v2] Interface state was Down, requested Up, now Up"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Bringing router up..."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.Up: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Clearing router settings..."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.Set: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Starting network monitor..."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Engine created."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wg: [v2] Routine: receive incoming mkReceiveFunc - started"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wg: [v2] Routine: receive incoming mkReceiveFunc - started"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wg: [v2] Routine: receive incoming receiveDERP - started"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"logpolicy: using system state directory \"/var/lib/tailscale\""}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] netmap packet filter: (not ready yet)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"tsnet starting with hostname \"k8s-operator-tamanu-internal-main\", varRoot \"/root/.config/tsnet-operator\""}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Start"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v\u0000JSON]1{\"Hostinfo\":{\"IPNVersion\":\"1.58.2-tb0e1bbb62\",\"BackendLogID\":\"fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f\",\"OS\":\"linux\",\"OSVersion\":\"5.10.209-198.812.amzn2.aarch64\",\"Container\":false,\"Env\":\"k8s\",\"Distro\":\"alpine\",\"DistroVersion\":\"3.18.5\",\"App\":\"k8s-operator-proxy\",\"Desktop\":false,\"Package\":\"tsnet\",\"Hostname\":\"operator-5894d4bc96-t4v2f\",\"Machine\":\"aarch64\",\"GoArch\":\"arm64\",\"GoVersion\":\"go1.21.5\",\"Cloud\":\"aws\",\"Userspace\":true,\"UserspaceRouter\":true,\"AppConnector\":false}}"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] netmap packet filter: (not ready yet)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] got initial portlist info in 1ms"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: [v1] HostInfo: {\"IPNVersion\":\"1.58.2-tb0e1bbb62\",\"BackendLogID\":\"fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f\",\"OS\":\"linux\",\"OSVersion\":\"5.10.209-198.812.amzn2.aarch64\",\"Container\":false,\"Env\":\"k8s\",\"Distro\":\"alpine\",\"DistroVersion\":\"3.18.5\",\"App\":\"k8s-operator-proxy\",\"Desktop\":false,\"Package\":\"tsnet\",\"Hostname\":\"k8s-operator-tamanu-internal-main\",\"Machine\":\"aarch64\",\"GoArch\":\"arm64\",\"GoVersion\":\"go1.21.5\",\"Cloud\":\"aws\",\"Userspace\":true,\"UserspaceRouter\":true,\"AppConnector\":false}"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Backend: logs: be:fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f fe:"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"Switching ipn state NoState -> NeedsLogin (WantRunning=true, nm=false)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"blockEngineUpdates(true)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring userspace WireGuard config (with 0/0 peers)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring router"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.Set: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring DNS"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"dns: Set: {DefaultResolvers:[] Routes:{} SearchDomains:[] Hosts:0}"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"dns: Resolvercfg: {Routes:{} Hosts:0 LocalDomains:[], cloud=\"aws\"}"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"dns: OScfg: {}"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"[v1] wgengine: Reconfig done"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"LocalBackend state is NeedsLogin; running StartLoginInteractive..."}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"StartLoginInteractive: url=false"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: client.Login(false, 10)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: [v1] authRoutine: state:new; wantLoggedIn=true"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: [v1] direct.TryLogin(token=false, flags=10)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: LoginInteractive -> regen=true"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: doLogin(regen=true, hasUrl=false)"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: state:authenticating"}
{"level":"debug","ts":"2024-02-16T10:31:15Z","logger":"tailscaled","msg":"health(\"overall\"): error: not in map poll"}
{"level":"debug","ts":"2024-02-16T10:31:16Z","logger":"tailscaled","msg":"control: control server key from https://controlplane.tailscale.com: ts2021=[fSeS+], legacy=[nlFWp]"}
{"level":"debug","ts":"2024-02-16T10:31:16Z","logger":"tailscaled","msg":"control: Generating a new nodekey."}
{"level":"debug","ts":"2024-02-16T10:31:16Z","logger":"tailscaled","msg":"control: RegisterReq: onode= node=[Ev/xi] fup=false nks=false"}
{"level":"debug","ts":"2024-02-16T10:31:16Z","logger":"tailscaled","msg":"control: [v1] creating new noise client"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"Start"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"[v\u0000JSON]1{\"Hostinfo\":{\"IPNVersion\":\"1.58.2-tb0e1bbb62\",\"BackendLogID\":\"fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f\",\"OS\":\"linux\",\"OSVersion\":\"5.10.209-198.812.amzn2.aarch64\",\"Container\":false,\"Env\":\"k8s\",\"Distro\":\"alpine\",\"DistroVersion\":\"3.18.5\",\"App\":\"k8s-operator-proxy\",\"Desktop\":false,\"Package\":\"tsnet\",\"Hostname\":\"operator-5894d4bc96-t4v2f\",\"Machine\":\"aarch64\",\"GoArch\":\"arm64\",\"GoVersion\":\"go1.21.5\",\"Cloud\":\"aws\",\"Userspace\":true,\"UserspaceRouter\":true,\"AppConnector\":false}}"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: client.Shutdown()"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: client.Shutdown"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: context done."}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: mapRoutine: exiting"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] TryLogin: register request: Post \"https://controlplane.tailscale.com/machine/register\": context canceled"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: authRoutine: exiting"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: updateRoutine: exiting"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: Client.Shutdown done."}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] HostInfo: {\"IPNVersion\":\"1.58.2-tb0e1bbb62\",\"BackendLogID\":\"fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f\",\"OS\":\"linux\",\"OSVersion\":\"5.10.209-198.812.amzn2.aarch64\",\"Container\":false,\"Env\":\"k8s\",\"Distro\":\"alpine\",\"DistroVersion\":\"3.18.5\",\"App\":\"k8s-operator-proxy\",\"Desktop\":false,\"Package\":\"tsnet\",\"Hostname\":\"k8s-operator-tamanu-internal-main\",\"Machine\":\"aarch64\",\"GoArch\":\"arm64\",\"GoVersion\":\"go1.21.5\",\"Cloud\":\"aws\",\"Userspace\":true,\"UserspaceRouter\":true,\"AppConnector\":false}"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"Backend: logs: be:fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f fe:"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"Switching ipn state NoState -> NeedsLogin (WantRunning=true, nm=false)"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"blockEngineUpdates(true)"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"[v1] wgengine: Reconfig done"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] authRoutine: state:new; goal=nil paused=false"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: state:new"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"StartLoginInteractive: url=false"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: client.Login(false, 10)"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"startup","msg":"requested login by authkey"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: context done."}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: state:new"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] authRoutine: context done."}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] authRoutine: state:new; wantLoggedIn=true"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] direct.TryLogin(token=false, flags=10)"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: LoginInteractive -> regen=true"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: doLogin(regen=true, hasUrl=false)"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: control server key from https://controlplane.tailscale.com: ts2021=[fSeS+], legacy=[nlFWp]"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: Generating a new nodekey."}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: RegisterReq: onode= node=[R0KfX] fup=false nks=false"}
{"level":"debug","ts":"2024-02-16T10:31:17Z","logger":"tailscaled","msg":"control: [v1] creating new noise client"}
{"level":"debug","ts":"2024-02-16T10:31:18Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:19Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:20Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:21Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: RegisterReq: got response; nodeKeyExpired=false, machineAuthorized=true; authURL=false"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] No AuthURL"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] sendStatus: authRoutine-success: state:authenticated"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] restartMap: synced=false"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] authRoutine: state:authenticated; goal=nil paused=false"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: context done."}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: state:authenticated"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] PollNetMap: stream=true ep=[]"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] PollNetMap: stream=false ep=[]"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"blockEngineUpdates(false)"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] authReconfig: netmap not yet valid. Skipping."}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] authReconfig: netmap not yet valid. Skipping."}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v\u0000JSON]1{\"controltime\":\"2024-02-16T10:31:22.29877616Z\"}"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: netmap: got new dial plan from control"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"using tailnet default auto-update setting: false"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"EditPrefs: MaskedPrefs{AutoUpdate={Apply=false}}"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] netmap packet filter: (not ready yet)"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] authReconfig: netmap not yet valid. Skipping."}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] new network map (periodic):\nnetmap: self: [R0KfX] auth=machine-authorized u=k8s-operator-tamanu-internal-main-1.tail53aef.ts.net [100.121.177.18/32 fd7a:115c:a1e0::a979:b112/128]\n"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: netmap received: state:synchronized"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] sendStatus: mapRoutine-got-netmap: state:synchronized"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] successful lite map update in 271ms"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"Failed to save new controlclient state: Get \"https://kubernetes.default.svc/api/v1/namespaces/tailscale/secrets/operator\": dial tcp [fd10:416b:9c70::1]:443: connect: network is unreachable"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v2] netstack: registered IP 100.121.177.18/32"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v2] netstack: registered IP fd7a:115c:a1e0::a979:b112/128"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"active login: k8s-operator-tamanu-internal-main-1.tail53aef.ts.net"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] netmap packet filter: 4 filters"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] magicsock: got updated network map; 24 peers"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"Switching ipn state NeedsLogin -> Starting (WantRunning=true, nm=true)"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"magicsock: SetPrivateKey called (init)"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring userspace WireGuard config (with 0/24 peers)"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"wg: [v2] UAPI: Updating private key"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring router"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.Set: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring DNS"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"dns: Set: {DefaultResolvers:[] Routes:{tail53aef.ts.net.:[] ts.net.:[199.247.155.53 2620:111:8007::53]}+65arpa SearchDomains:[tail53aef.ts.net.] Hosts:25}"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] authReconfig: ra=true dns=true 0x03: getting OS base config is not supported"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"health(\"dns\"): error: getting OS base config is not supported"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"health(\"dns-os\"): error: getting OS base config is not supported"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"peerapi: serving on http://100.121.177.18:58492"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"peerapi: serving on http://[fd7a:115c:a1e0::a979:b112]:58492"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] HostInfo: {\"IPNVersion\":\"1.58.2-tb0e1bbb62\",\"BackendLogID\":\"fec4b5232a55a27a0f96c8ca2f2ef76ea67eb856c4177a2df0bbde97e30dd16f\",\"OS\":\"linux\",\"OSVersion\":\"5.10.209-198.812.amzn2.aarch64\",\"Container\":false,\"Env\":\"k8s\",\"Distro\":\"alpine\",\"DistroVersion\":\"3.18.5\",\"App\":\"k8s-operator-proxy\",\"Desktop\":false,\"Package\":\"tsnet\",\"Hostname\":\"k8s-operator-tamanu-internal-main\",\"Machine\":\"aarch64\",\"GoArch\":\"arm64\",\"GoVersion\":\"go1.21.5\",\"Services\":[{\"Proto\":\"peerapi4\",\"Port\":58492},{\"Proto\":\"peerapi6\",\"Port\":58492},{\"Proto\":\"peerapi-dns-proxy\",\"Port\":1}],\"Cloud\":\"aws\",\"Userspace\":true,\"UserspaceRouter\":true,\"AppConnector\":false}"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] PollNetMap: stream=false ep=[]"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] wgengine: Reconfig done"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"[v1] authReconfig: ra=true dns=true 0x03: <nil>"}
{"level":"debug","ts":"2024-02-16T10:31:22Z","logger":"tailscaled","msg":"control: [v1] successful lite map update in 261ms"}
{"level":"debug","ts":"2024-02-16T10:31:23Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:23Z","logger":"startup","msg":"waiting for tailscale to start: Starting"}
{"level":"debug","ts":"2024-02-16T10:31:23Z","logger":"tailscaled","msg":"netcheck: [v2] checkCaptivePortal url=\"http://derp19c.tailscale.com/generate_204\" status_code=204 valid_response=true"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"startup","msg":"waiting for tailscale to start: Starting"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= captiveportal=false derp=0"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: home is now derp-24 (hnl)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: adding connection to derp-24 for home-keep-alive"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr0s,wr0s"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"Switching ipn state Starting -> Running (WantRunning=true, nm=true)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"derphttp.Client.Connect: connecting to derp-24 (hnl)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"control: NetInfo: NetInfo{varies= hairpin= ipv6=false ipv6os=true udp=false icmpv4=false derp=#24 portmap= link=\"\" firewallmode=\"\"}"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: endpoints changed: [2406:da1c:5e2:ef03:2df1::d]:57763 (local)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"control: [v2] client.newEndpoints([{[2406:da1c:5e2:ef03:2df1::d]:57763 local}])"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: last netcheck reported send error. Rebinding."}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"control: [v1] PollNetMap: stream=false ep=[]"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"Rebind; defIf=\"v4if0\", ips=[169.254.172.15/22 fe80::18b6:7aff:fe26:bfc1/64]"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"control: [v1] successful lite map update in 270ms"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"control: [v1] PollNetMap: stream=false ep=[[2406:da1c:5e2:ef03:2df1::d]:57763]"}
{"level":"debug","ts":"2024-02-16T10:31:24Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr387ms,wr387ms"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"tailscaled","msg":"control: [v1] successful lite map update in 272ms"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"tailscaled","msg":"magicsock: derp-24 connected; connGen=1"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"tailscaled","msg":"post-rebind ping of DERP region 24 okay"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"startup","msg":"querying tailscaled status"}
{"level":"info","ts":"2024-02-16T10:31:25Z","logger":"apiserver-proxy","msg":"listening on :443"}
{"level":"info","ts":"2024-02-16T10:31:25Z","logger":"startReconcilers","msg":"Startup complete, operator running, version: 1.58.2-tb0e1bbb62"}
{"level":"info","ts":"2024-02-16T10:31:25Z","logger":"controller-runtime.metrics","msg":"Starting metrics server"}
{"level":"info","ts":"2024-02-16T10:31:25Z","logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":":8080","secure":false}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"service-reconciler","source":"kind source: *v1.Service"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"ingress","controllerGroup":"networking.k8s.io","controllerKind":"Ingress","source":"kind source: *v1.Ingress"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"ingress","controllerGroup":"networking.k8s.io","controllerKind":"Ingress","source":"kind source: *v1.StatefulSet"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"ingress","controllerGroup":"networking.k8s.io","controllerKind":"Ingress","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"ingress","controllerGroup":"networking.k8s.io","controllerKind":"Ingress","source":"kind source: *v1.Service"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting Controller","controller":"ingress","controllerGroup":"networking.k8s.io","controllerKind":"Ingress"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"service-reconciler","source":"kind source: *v1.StatefulSet"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"service-reconciler","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting Controller","controller":"service-reconciler"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"connector","controllerGroup":"tailscale.com","controllerKind":"Connector","source":"kind source: *v1alpha1.Connector"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"connector","controllerGroup":"tailscale.com","controllerKind":"Connector","source":"kind source: *v1.StatefulSet"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting EventSource","controller":"connector","controllerGroup":"tailscale.com","controllerKind":"Connector","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting Controller","controller":"connector","controllerGroup":"tailscale.com","controllerKind":"Connector"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting workers","controller":"service-reconciler","worker count":1}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"cert-manager","service-name":"cert-manager-23483e93"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"cert-manager","service-name":"cert-manager-23483e93"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"cert-manager","service-name":"cert-manager-23483e93"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"cert-manager","service-name":"cert-manager-23483e93"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"kube-system","service-name":"aws-load-balancer-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"kube-system","service-name":"aws-load-balancer-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"kube-system","service-name":"aws-load-balancer-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"kube-system","service-name":"aws-load-balancer-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller-admission"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller-admission"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller-admission"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller-admission"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"metrics-system","service-name":"prometheus-kube-state-metrics"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"metrics-system","service-name":"prometheus-kube-state-metrics"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"metrics-system","service-name":"prometheus-kube-state-metrics"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"metrics-system","service-name":"prometheus-kube-state-metrics"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"metrics-system","service-name":"prometheus-prometheus-node-exporter"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"metrics-system","service-name":"prometheus-prometheus-node-exporter"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"metrics-system","service-name":"prometheus-prometheus-node-exporter"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"metrics-system","service-name":"prometheus-prometheus-node-exporter"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"cnpg-system","service-name":"cnpg-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"cnpg-system","service-name":"cnpg-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"cnpg-system","service-name":"cnpg-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"cnpg-system","service-name":"cnpg-webhook-service"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"ingress-system","service-name":"nginx-ingress-2341681d-ingress-nginx-controller"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"kube-system","service-name":"kube-dns"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"kube-system","service-name":"kube-dns"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"kube-system","service-name":"kube-dns"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"kube-system","service-name":"kube-dns"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"metrics-system","service-name":"grafana-74f0a483"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"metrics-system","service-name":"grafana-74f0a483"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"metrics-system","service-name":"grafana-74f0a483"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"metrics-system","service-name":"grafana-74f0a483"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"metrics-system","service-name":"prometheus-server"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"metrics-system","service-name":"prometheus-server"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"metrics-system","service-name":"prometheus-server"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"metrics-system","service-name":"prometheus-server"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"cert-manager","service-name":"cert-manager-23483e93-webhook"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"cert-manager","service-name":"cert-manager-23483e93-webhook"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"cert-manager","service-name":"cert-manager-23483e93-webhook"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"cert-manager","service-name":"cert-manager-23483e93-webhook"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"default","service-name":"kubernetes"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"default","service-name":"kubernetes"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"default","service-name":"kubernetes"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"default","service-name":"kubernetes"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"starting reconcile","service-ns":"metrics-system","service-name":"prometheus-server-headless"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"service is being deleted or is (no longer) referring to Tailscale ingress/egress, ensuring any created resources are cleaned up","service-ns":"metrics-system","service-name":"prometheus-server-headless"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"no finalizer, nothing to do","service-ns":"metrics-system","service-name":"prometheus-server-headless"}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"service-reconciler","msg":"reconcile finished","service-ns":"metrics-system","service-name":"prometheus-server-headless"}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting workers","controller":"ingress","controllerGroup":"networking.k8s.io","controllerKind":"Ingress","worker count":1}
{"level":"info","ts":"2024-02-16T10:31:25Z","msg":"Starting workers","controller":"connector","controllerGroup":"tailscale.com","controllerKind":"Connector","worker count":1}
{"level":"debug","ts":"2024-02-16T10:31:25Z","logger":"tailscaled","msg":"printAuthURLLoop: state is Running; stopping"}
{"level":"debug","ts":"2024-02-16T10:31:26Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= derp=0"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"magicsock: last netcheck reported send error. Rebinding."}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"Rebind; defIf=\"v4if0\", ips=[169.254.172.15/22 fe80::18b6:7aff:fe26:bfc1/64]"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr26s,wr26s"}
{"level":"debug","ts":"2024-02-16T10:31:50Z","logger":"tailscaled","msg":"post-rebind ping of DERP region 24 okay"}
{"level":"debug","ts":"2024-02-16T10:31:52Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= derp=0"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"magicsock: last netcheck reported send error. Rebinding."}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"Rebind; defIf=\"v4if0\", ips=[169.254.172.15/22 fe80::18b6:7aff:fe26:bfc1/64]"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr50s,wr50s"}
{"level":"debug","ts":"2024-02-16T10:32:14Z","logger":"tailscaled","msg":"post-rebind ping of DERP region 24 okay"}
{"level":"debug","ts":"2024-02-16T10:32:16Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= derp=0"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"control: [v\u0000JSON]1{\"controltime\":\"2024-02-16T10:53:36.178836082Z\"}"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"control: [v1] new network map (periodic):\nnetmap: self: [R0KfX] auth=machine-authorized u=k8s-operator-tamanu-internal-main.tail53aef.ts.net [100.121.177.18/32 fd7a:115c:a1e0::a979:b112/128]\n"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"control: [v1] mapRoutine: netmap received: state:synchronized"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"control: [v1] sendStatus: mapRoutine-got-netmap: state:synchronized"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"Failed to save new controlclient state: Get \"https://kubernetes.default.svc/api/v1/namespaces/tailscale/secrets/operator\": dial tcp [fd10:416b:9c70::1]:443: connect: network is unreachable"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"active login: k8s-operator-tamanu-internal-main.tail53aef.ts.net"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"[v1] netmap diff: (none)"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring router"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.Set: not implemented."}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring DNS"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"dns: Set: {DefaultResolvers:[] Routes:{tail53aef.ts.net.:[] ts.net.:[199.247.155.53 2620:111:8007::53]}+65arpa SearchDomains:[tail53aef.ts.net.] Hosts:25}"}
{"level":"debug","ts":"2024-02-16T10:53:36Z","logger":"tailscaled","msg":"[v1] authReconfig: ra=true dns=true 0x03: getting OS base config is not supported"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wgengine: idle peer [W+I2R] now active, reconfiguring WireGuard"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wgengine: Reconfig: configuring userspace WireGuard config (with 1/24 peers)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - UAPI: Created"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - UAPI: Updating endpoint"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - UAPI: Removing all allowedips"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - UAPI: Adding allowedip"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - UAPI: Adding allowedip"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - UAPI: Updating persistent keepalive interval"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - Starting"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"[v1] peer keys: [W+I2R]"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"[v1] v1.58.2-tb0e1bbb62 peers: 0/0"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - Received handshake initiation"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - Sending handshake response"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"[v1] magicsock: derp route for [W+I2R] set to derp-24 (our home)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"magicsock: last netcheck reported send error. Rebinding."}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"Rebind; defIf=\"v4if0\", ips=[169.254.172.15/22 fe80::18b6:7aff:fe26:bfc1/64]"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr23m0s,wr1ms"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"post-rebind ping of DERP region 24 okay"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"Accept: TCP{100.82.71.112:45502 > 100.121.177.18:443} 60 tcp ok\n"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"netcheck: [v2] checkCaptivePortal url=\"http://derp6.tailscale.com/generate_204\" status_code=204 valid_response=true"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"Accept: TCP{100.82.71.112:45502 > 100.121.177.18:443} 60 tcp ok\n"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"Accept: TCP{100.82.71.112:45502 > 100.121.177.18:443} 52 tcp non-syn\n"}
{"level":"debug","ts":"2024-02-16T10:54:04Z","logger":"tailscaled","msg":"cert(\"k8s-operator-tamanu-internal-main.tail53aef.ts.net\"): getCertPEM: Get \"https://kubernetes.default.svc/api/v1/namespaces/tailscale/secrets/operator\": dial tcp [fd10:416b:9c70::1]:443: connect: network is unreachable"}
2024/02/16 10:54:04 http: TLS handshake error from 100.82.71.112:45502: 500 Internal Server Error: Get "https://kubernetes.default.svc/api/v1/namespaces/tailscale/secrets/operator": dial tcp [fd10:416b:9c70::1]:443: connect: network is unreachable
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= captiveportal=false derp=0"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"magicsock: last netcheck reported send error. Rebinding."}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"Rebind; defIf=\"v4if0\", ips=[169.254.172.15/22 fe80::18b6:7aff:fe26:bfc1/64]"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr23m0s,wr823ms"}
{"level":"debug","ts":"2024-02-16T10:54:06Z","logger":"tailscaled","msg":"post-rebind ping of DERP region 24 okay"}
{"level":"debug","ts":"2024-02-16T10:54:08Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= derp=0"}
{"level":"debug","ts":"2024-02-16T10:54:15Z","logger":"tailscaled","msg":"wg: [v2] [W+I2R] - Receiving keepalive packet"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"magicsock: last netcheck reported send error. Rebinding."}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"onPortUpdate(port=57037, network=udp6)"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"onPortUpdate(port=57763, network=udp4)"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"[v1] warning: fakeRouter.UpdateMagicsockPort: not implemented."}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP read buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"magicsock: [warning] failed to force-set UDP write buffer size to 7340032: operation not permitted; using kernel default values (impacts throughput only)"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"[v1] magicsock: peermtu: peer MTU status is false"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"Rebind; defIf=\"v4if0\", ips=[169.254.172.15/22 fe80::18b6:7aff:fe26:bfc1/64]"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"magicsock: 1 active derp conns: derp-24=cr23m0s,wr27s"}
{"level":"debug","ts":"2024-02-16T10:54:33Z","logger":"tailscaled","msg":"post-rebind ping of DERP region 24 okay"}
{"level":"debug","ts":"2024-02-16T10:54:35Z","logger":"tailscaled","msg":"netcheck: [v1] report: udp=false v4=false icmpv4=false v6=false v6os=true mapvarydest= hair= portmap= derp=0"}

Are there any recent changes that introduced the issue?

No response

OS

Linux

OS version

Linux (5.10.209-198.812.amzn2.aarch64)

Also tried on Linux (5.10.209-198.812.amzn2.x86_64), didn't change anything.

Tailscale version

1.58.2

Other software

AWS EKS
Kubelet v1.29.0-eks-5e0fdde
AWS CNI plugin v1.16.2-eksbuild.1

Bug report

No response

Feb 16 '24 11:02 passcod