che icon indicating copy to clipboard operation
che copied to clipboard
verified publisher icon eclipse-che

Failed to set up networking for workspace

Open erkerb4 opened this issue 2 years ago • 3 comments

Summary

Hello,

We are running Che on a Kubernetes cluster, with a few users. One of the workspaces has abruptly closed with a message:

"The workspace has failed with the following error: Failed to setup networking for workspace: Could not get exposed endpoints for DevWorkspace: controller not ready to resolve the workspace routing"

This issue is present in one of the workspaces. This is a workspace that I've been using for a few weeks, and it's not a new workspace. I am able to start a brand-new workspace without issues. The other users and their current workspaces are not impacted, and they can start/stop their workspaces without any issues.

I am unable to start this workspace. The Dashboard (and kubectl describe) shows the following error every time I attempt to start the workspace:

Failed to set up networking for workspace: Could not get exposed endpoints for DevWorkspace: controller not ready to resolve the workspace routing

Relevant information

Software version Information: Kubernetes v1.26.4 Eclipse Che v7.75.0 Dev Workspace Operator v0.23.0

devworkspace-controller logs 

{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f","resolvedConfig":"workspace.storageClassName=ceph-filesystem-retain,workspace.progressTimeout=600s"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f","resolvedConfig":"workspace.storageClassName=ceph-filesystem-retain,workspace.progressTimeout=600s"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Updated object","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","kind":"v1alpha1.DevWorkspaceRouting","name":"routing-workspacedf2deb3bae74490f"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"v1alpha1.DevWorkspaceRouting routing-workspacedf2deb3bae74490f is not ready: Updated object","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Waiting on routing to be ready","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f","resolvedConfig":"workspace.storageClassName=ceph-filesystem-retain,workspace.progressTimeout=600s"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"DevWorkspace failed to start: Failed to set up networking for workspace: Could not get exposed endpoints for DevWorkspace: controller not ready to resolve the workspace routing","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Waiting on routing to be ready","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f","resolvedConfig":"workspace.storageClassName=ceph-filesystem-retain,workspace.progressTimeout=600s"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f","resolvedConfig":"workspace.storageClassName=ceph-filesystem-retain,workspace.progressTimeout=600s"}
{"level":"info","ts":"2023-10-04T14:09:46Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-ebaysal","Request.Name":"universal-developer-image-vnc","devworkspace_id":"workspacedf2deb3bae74490f","resolvedConfig":"workspace.storageClassName=ceph-filesystem-retain,workspace.progressTimeout=600s"}
che-dashboard logs 
[INFO] WS message: {
    method: 'SUBSCRIBE',
    channel: 'devWorkspace',
    params: { namespace: 'che-ebaysal', resourceVersion: '909915485' }
  }
  [INFO] WS message: {
    method: 'SUBSCRIBE',
    channel: 'pod',
    params: { namespace: 'che-ebaysal', resourceVersion: '909915498' }
  }
  [INFO] WS message: {
    method: 'SUBSCRIBE',
    channel: 'event',
    params: { namespace: 'che-ebaysal', resourceVersion: '909915499' }
  }
che-operator logs 
time="2023-10-04T14:08:03Z" level=info msg="Successfully reconciled."
time="2023-10-04T14:08:42Z" level=info msg="Custom resource status eclipse-che updated with DevfileRegistryURL: "
time="2023-10-04T14:08:48Z" level=info msg="Successfully reconciled."
time="2023-10-04T14:08:50Z" level=info msg="Custom resource status eclipse-che updated with DevfileRegistryURL: "
time="2023-10-04T14:08:55Z" level=info msg="Successfully reconciled."
time="2023-10-04T14:09:42Z" level=info msg="Custom resource status eclipse-che updated with DevfileRegistryURL: "
2023-10-04T14:09:46Z	INFO	controllers.DevWorkspaceRouting	Reconciling DevWorkspaceRouting	{"Request.Namespace": "che-ebaysal", "Request.Name": "routing-workspacedf2deb3bae74490f", "devworkspace_id": "workspacedf2deb3bae74490f"}
2023-10-04T14:09:46Z	INFO	controllers.DevWorkspaceRouting	Reconciling DevWorkspaceRouting	{"Request.Namespace": "che-ebaysal", "Request.Name": "routing-workspacedf2deb3bae74490f", "devworkspace_id": "workspacedf2deb3bae74490f"}
time="2023-10-04T14:09:48Z" level=info msg="Successfully reconciled."
time="2023-10-04T14:09:50Z" level=info msg="Custom resource status eclipse-che updated with DevfileRegistryURL: "
time="2023-10-04T14:09:55Z" level=info msg="Successfully reconciled."
che-gateway logs 
172.30.5.121:54982 - c24aede4-4815-4ea3-b084-d8d59b9ea97c - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 1180 0.004
172.30.5.121:54982 - c6ac37b2-7948-4f55-90df-fb6eb296091e - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/vendors.214c7c50b80bd9d2ee58.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 2585405 0.013
172.30.5.121:55030 - 34f1ff54-059c-4a6a-9155-5e70443fbeb2 - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/client.214c7c50b80bd9d2ee58.css" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 4575 0.013
172.30.5.121:55040 - 7a1325ce-90a8-45e2-8c6d-d1119e5313af - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/monaco.214c7c50b80bd9d2ee58.css" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 89237 0.014
172.30.5.121:55058 - 9f46f0e7-189a-4888-a2f6-a46f87208ba2 - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/service-worker.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 63 0.021
172.30.5.121:55020 - ff06b152-3334-40c6-b271-914aab53f59f - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/vendors.214c7c50b80bd9d2ee58.css" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 852917 0.094
172.30.5.121:55044 - 7852fa7b-3061-41ee-86e9-3dec2acda690 - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/client.214c7c50b80bd9d2ee58.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 168755 0.094
172.30.5.121:55044 - 38a1b971-9c52-407e-9029-3774bb0e21d1 - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/editor.worker.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 1606 0.003
172.30.5.121:55020 - d49a9f2b-9054-4e00-bcd7-d78d4db62c1e - [email protected] [2023/10/04 14:08:17] che.somedomain.com GET / "/dashboard/monaco.214c7c50b80bd9d2ee58.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 2260754 0.012
172.30.5.121:51210 - 16b1b3fd-553c-400b-8cc1-8f3c550d3086 - [email protected] [2023/10/04 14:08:21] che.somedomain.com GET / "/dashboard/service-worker.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 63 0.003
[2023/10/04 14:08:21] [oauthproxy.go:959] No valid authentication in request. Initiating login.
[2023/10/04 14:08:21] [oauthproxy.go:959] No valid authentication in request. Initiating login.
172.30.5.121:55020 - 008ec6f7-9232-4fe4-8b1e-d49182042b1c - [email protected] [2023/10/04 14:08:19] che.somedomain.com POST / "/api/kubernetes/namespace/provision" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 78 5.252
172.30.5.121:51232 - 47e505da-b1b0-43f4-8b8e-f88eaec2ee8d - [email protected] [2023/10/04 14:08:24] che.somedomain.com GET / "/dashboard/api/cluster-info" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 19 0.013
172.30.5.121:55020 - 03630979-8edf-44ed-abb5-009f23f97eb5 - [email protected] [2023/10/04 14:08:24] che.somedomain.com GET / "/api/kubernetes/namespace" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 56 0.449
172.30.5.121:51210 - c96ac4e3-8224-4419-9122-a9d9a9a14b4e - [email protected] [2023/10/04 14:08:24] che.somedomain.com GET / "/dashboard/api/server-config" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 889 1.075
172.30.5.121:51222 - fe33cbe5-5d63-4d50-a42e-ca6d27d86770 - [email protected] [2023/10/04 14:08:24] che.somedomain.com POST / "/api/kubernetes/namespace/provision" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 78 2.867
172.30.5.121:51222 - fea3f2fc-bb64-4dac-a69a-c93b4c204639 - [email protected] [2023/10/04 14:08:27] che.somedomain.com GET / "/dashboard/assets/branding/product.json" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 3 0.003
172.30.5.121:51222 - 5c30cd37-ef87-48ac-9941-c9c2b8c2a36a - [email protected] [2023/10/04 14:08:27] che.somedomain.com OPTIONS / "/api/" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 183 0.020
172.30.5.121:55020 - cd35c283-7773-4c45-afd8-cb5a80e1e9cb - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/namespace/che-ebaysal/devworkspaces" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 8169 0.102
172.30.5.121:51210 - 034c0422-ca07-4ef0-8590-221bafdf4ac4 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/userprofile/che-ebaysal" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 44 0.103
172.30.5.121:51210 - d74dcc34-39df-4467-8926-85d926e4c579 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/devfile?version=2.0.0" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 175221 0.007
172.30.5.121:51264 - 4e71f23b-6b65-4aad-9fcc-30c3def4b8c9 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/getting-started-sample" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 2 0.340
172.30.5.121:51264 - 81c819d2-eda1-4c5b-897e-51d99a38160f - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/devfile?version=2.1.0" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 91269 0.005
172.30.5.121:51260 - 0ad2252d-9bea-4d96-ad49-b1c19d3054a2 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/cluster-config" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 73 0.393
172.30.5.121:51252 - 487eef9f-ae34-4f3a-9e16-632ef7d5abf2 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/namespace/che-ebaysal/pods" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 90 0.396
172.30.5.121:51252 - 095af44b-bd5c-4db6-945a-263140ba0d10 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/devfile?version=2.2.0" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 195583 0.043
172.30.5.121:51252 - 6736e5d5-5798-4125-9c52-95397018df72 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/devfile?version=2.2.1-alpha" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 195591 0.011
172.30.5.121:51242 - a2ae9598-9ad5-4be2-bed5-7ccbead4a5e6 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/namespace/che-ebaysal/events" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 10321 0.704
172.30.5.121:51222 - f3bb146e-5a93-4034-9947-19d96d0801c3 - [email protected] [2023/10/04 14:08:28] che.somedomain.com GET / "/dashboard/api/namespace/che-ebaysal/devworkspacetemplates" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 3595 0.713
172.30.5.121:51242 - 0a8d11cd-d511-4a8e-9342-1ad61703d2b5 - [email protected] [2023/10/04 14:08:29] che.somedomain.com GET / "/dashboard/201.3241c0339089dc70aad4.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 3901 0.004
172.30.5.121:51242 - a1d1ea2e-12a9-4de6-a282-61c9e97b100c - [email protected] [2023/10/04 14:08:29] che.somedomain.com GET / "/dashboard/4a43a00f1c0c63f396ee.woff2" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 28169 0.007
172.30.5.121:51242 - e0a8852a-ef2a-41ae-8d46-d9a397092642 - [email protected] [2023/10/04 14:08:29] che.somedomain.com GET / "/dashboard/922.c4890fb7cb1388751989.js" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 14528 0.005
172.30.5.121:51252 - df74b846-54bb-430f-acf8-50b7ab2e09f3 - [email protected] [2023/10/04 14:08:29] che.somedomain.com GET / "/dashboard/922.214c7c50b80bd9d2ee58.css" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 571 0.005
172.30.5.121:51242 - 78830780-47f7-48df-b368-30dca15c161d - [email protected] [2023/10/04 14:08:29] che.somedomain.com GET / "/dashboard/09bac349bc9aa9b72bbe.woff2" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 28661 0.004
172.30.5.121:51252 - 0303c91f-bd0d-4fea-ace1-ff39a42a12e5 - [email protected] [2023/10/04 14:08:29] che.somedomain.com GET / "/dashboard/0227c8bb038eaf0264f7.woff2" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 29049 0.004
[2023/10/04 14:08:52] [oauthproxy.go:959] No valid authentication in request. Initiating login.
[2023/10/04 14:08:52] [oauthproxy.go:959] No valid authentication in request. Initiating login.
[2023/10/04 14:09:26] [oauthproxy.go:959] No valid authentication in request. Initiating login.
[2023/10/04 14:09:26] [oauthproxy.go:959] No valid authentication in request. Initiating login.
172.30.5.121:48106 - 7aa1343d-0cf7-47f0-8be9-271df48ef1ee - [email protected] [2023/10/04 14:09:41] che.somedomain.com POST / "/api/kubernetes/namespace/provision" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 78 4.821
172.30.5.121:48106 - 38ca1692-7691-4b99-9c94-69231703bad9 - [email protected] [2023/10/04 14:09:45] che.somedomain.com GET / "/dashboard/api/server-config" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 889 0.084
172.30.5.121:48106 - ec4ee92a-a3c8-467a-a2d3-42d53ceb7d74 - [email protected] [2023/10/04 14:09:46] che.somedomain.com PATCH / "/dashboard/api/namespace/che-ebaysal/devworkspaces/universal-developer-image-vnc" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 8029 0.308
172.30.5.121:48106 - ab11c137-cba8-475f-88b0-d4c30920e863 - [email protected] [2023/10/04 14:09:46] che.somedomain.com PATCH / "/dashboard/api/namespace/che-ebaysal/devworkspaces/universal-developer-image-vnc" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 8017 0.043
172.30.5.121:48106 - 57eedc60-2780-4b88-8b45-8357488cd9b7 - [email protected] [2023/10/04 14:09:46] che.somedomain.com GET / "/dashboard/api/namespace/che-ebaysal/devworkspaces/universal-developer-image-vnc" HTTP/1.1 "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 Edg/117.0.2045.47" 200 7347 0.024
[2023/10/04 14:09:58] [oauthproxy.go:959] No valid authentication in request. Initiating login.
[2023/10/04 14:09:58] [oauthproxy.go:959] No valid authentication in request. Initiating login.
kubectl describe -n che-ebaysal workspace Status Field 
Status:
  Conditions:
    Last Transition Time:  2023-10-04T14:10:25Z
    Message:               Failed to set up networking for workspace: Could not get exposed endpoints for DevWorkspace: controller not ready to resolve the workspace routing
    Reason:                InfrastructureFailure
    Status:                True
    Type:                  FailedStart
    Last Transition Time:  2023-10-04T14:10:26Z
    Message:               Workspace stopped due to error
    Status:                False
    Type:                  Started
    Last Transition Time:  2023-10-04T14:10:26Z
    Status:                Unknown
    Type:                  DevWorkspaceResolved
    Last Transition Time:  2023-10-04T14:10:26Z
    Status:                Unknown
    Type:                  StorageReady
    Last Transition Time:  2023-10-04T14:10:26Z
    Status:                Unknown
    Type:                  RoutingReady
  Devworkspace Id:         workspacedf2deb3bae74490f
  Main URL:                https://che.somedomain.com/ebaysal/universal-developer-image-vnc/3100/
  Message:                 Failed to set up networking for workspace: Could not get exposed endpoints for DevWorkspace: controller not ready to resolve the workspace routing
  Phase:                   Failed
Events:                    <none>

erkerb4 avatar Oct 04 '23 14:10 erkerb4

Is there anything additional I can provide to help diagnose this issue?

erkerb4 avatar Oct 05 '23 11:10 erkerb4

Probably the devfile or DevWorkspace of the workspace that is failing (how many endpoints are there?) and the Kubernetes events that shows up when the workspace fails to start.

l0rd avatar Oct 09 '23 21:10 l0rd

Issues go stale after 180 days of inactivity. lifecycle/stale issues rot after an additional 7 days of inactivity and eventually close.

Mark the issue as fresh with /remove-lifecycle stale in a new comment.

If this issue is safe to close now please do so.

Moderators: Add lifecycle/frozen label to avoid stale mode.

che-bot avatar Apr 06 '24 08:04 che-bot