che icon indicating copy to clipboard operation
che copied to clipboard
verified publisher icon eclipse-che

Eclipse Che: Workspace is not getting created - DevWorkspace failed to progress past step 'Waiting for editor to start' for longer than timeout (300s)

Open debkantap opened this issue 1 year ago • 10 comments

Summary

I am running Eclipse che verion 7.82 on k8s. This is using workspace template from devfile.io. While creating the devworksapces from the devfile hosted on devfile.io, I am getting the timeout error. This is the error coming in close: "DevWorkspace failed to progress past step 'Waiting for editor to start' for longer than timeout (300s)" I am not able to get any error from log from backend (my bad probably).

However if I try to create the devworkspace from the devfile hosted in embedded devfile registry, it is working.

Relevant information

No response

debkantap avatar Mar 15 '24 18:03 debkantap

@debkantap Hello, could you share what devfile from the devfile.io you use to start a workspace?

RomanNikitenko avatar Mar 18 '24 15:03 RomanNikitenko

@debkantap What you can do:

  • inspect events in a user namespace kubectl get events -n <...>
  • inspect DWO logs kubectl logs -n devworkspace-controller deploy/devworkspace-controller-manager -f

tolusha avatar Mar 18 '24 15:03 tolusha

@RomanNikitenko ..I am using "Maven Java" from devfile.io @tolusha ... I tried the options that you suggested, it is getting timeout due to 502 error. I am not able to understand why it is happening for devfile, but not for embedded devfile registry. here is the output

kubectl logs -n devworkspace-controller deploy/devworkspace-controller-manager -f

--output------ {"level":"info","ts":"2024-03-19T08:20:08Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:08Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:09Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:09Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:10Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:10Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:11Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:11Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:12Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:12Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:13Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:13Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:14Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:15Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:16Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:16Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:17Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:17Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:18Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:18Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:19Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:19Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:20Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:20Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:21Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:21Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:22Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:22Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:23Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:23Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:24Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:24Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:25Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:25Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:26Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:26Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:27Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:27Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:28Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:28Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:29Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:29Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"DevWorkspace failed to start: DevWorkspace failed to progress past step 'Waiting for editor to start' for longer than timeout (300s)","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Stopping workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"} {"level":"info","ts":"2024-03-19T08:20:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}

--output----

kubectl get events -n debkanta-pramanick-pil-com-che-p0nfvh

----------------------------output-----------------------

LAST SEEN TYPE REASON OBJECT MESSAGE 9m59s Normal Scheduled pod/cleanup-workspace739eb88e4b0e4068-m8mgk Successfully assigned debkanta-pramanick-pil-com-che-p0nfvh/cleanup-workspace739eb88e4b0e4068-m8mgk to k8sworker1.example.net 9m56s Normal Pulled pod/cleanup-workspace739eb88e4b0e4068-m8mgk Container image "registry.access.redhat.com/ubi8-micro:8.8-1" already present on machine 9m56s Normal Created pod/cleanup-workspace739eb88e4b0e4068-m8mgk Created container cleanup-workspace739eb88e4b0e4068 9m55s Normal Started pod/cleanup-workspace739eb88e4b0e4068-m8mgk Started container cleanup-workspace739eb88e4b0e4068 9m59s Normal SuccessfulCreate job/cleanup-workspace739eb88e4b0e4068 Created pod: cleanup-workspace739eb88e4b0e4068-m8mgk 9m37s Normal Completed job/cleanup-workspace739eb88e4b0e4068 Job completed 7m42s Normal Scheduled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully assigned debkanta-pramanick-pil-com-che-p0nfvh/workspace908729b913c849de-85fb56f559-h7968 to k8sworker1.example.net 7m41s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "quay.io/che-incubator/che-code@sha256:715c65869811e1f8ae3f337af014fa90eb64e9909c6d426eea990c5563ae92c6" 7m41s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "quay.io/che-incubator/che-code@sha256:715c65869811e1f8ae3f337af014fa90eb64e9909c6d426eea990c5563ae92c6" in 265ms (265ms including waiting) 7m41s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container che-code-injector 7m41s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container che-code-injector 7m31s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "quay.io/devfile/project-clone:v0.25.0" 7m31s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "quay.io/devfile/project-clone:v0.25.0" in 231ms (231ms including waiting) 7m31s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container project-clone 7m31s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container project-clone 7m29s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248" 7m29s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248" in 484ms (484ms including waiting) 7m29s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container tools 7m29s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container tools 7m28s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "docker.io/library/traefik:latest" 7m24s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "docker.io/library/traefik:latest" in 4.028s (4.028s including waiting) 7m24s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container che-gateway 7m24s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container che-gateway 2m24s Normal Killing pod/workspace908729b913c849de-85fb56f559-h7968 Stopping container tools 2m24s Normal Killing pod/workspace908729b913c849de-85fb56f559-h7968 Stopping container che-gateway 7m42s Normal SuccessfulCreate replicaset/workspace908729b913c849de-85fb56f559 Created pod: workspace908729b913c849de-85fb56f559-h7968 2m24s Normal SuccessfulDelete replicaset/workspace908729b913c849de-85fb56f559 Deleted pod: workspace908729b913c849de-85fb56f559-h7968 7m Normal Sync ingress/workspace908729b913c849de-tools-13131-code-redirect-1 Scheduled for sync 7m Normal Sync ingress/workspace908729b913c849de-tools-13132-code-redirect-2 Scheduled for sync 7m Normal Sync ingress/workspace908729b913c849de-tools-13133-code-redirect-3 Scheduled for sync 7m Normal Sync ingress/workspace908729b913c849de-tools-8080-http-maven Scheduled for sync 7m42s Normal ScalingReplicaSet deployment/workspace908729b913c849de Scaled up replica set workspace908729b913c849de-85fb56f559 to 1 2m24s Normal ScalingReplicaSet deployment/workspace908729b913c849de Scaled down replica set workspace908729b913c849de-85fb56f559 to 0 from 1

----------------------------output-----------------------

debkantap avatar Mar 19 '24 08:03 debkantap 

{"level":"info","ts":"2024-03-19T08:20:28Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}

@RomanNikitenko The same for me. I can't start a workspace from Maven Java on Kubernetes (minikube) but it works fine on OpenShift (Dogfooding cluster).

tolusha avatar Mar 19 '24 09:03 tolusha

there is an error in logs: image

we need investigate what's the cause of the problem...

RomanNikitenko avatar Mar 19 '24 12:03 RomanNikitenko

I think it fails here at userInfo() step. @vitaliy-guliy

in my case there is something wrong with user: image

RomanNikitenko avatar Mar 19 '24 13:03 RomanNikitenko

registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248 is used by "Maven Java" from devfile.io

$ kubectl run --image registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248 delme -- tail -f /dev/null
pod/delme created

$ kubectl exec -it delme -- bash
[default@delme ~]$ ls -la /etc/passwd
-rw-r--r-- 1 root root 590 Jan 18  2024 /etc/passwd

Only the root user can write /etc/passwd. So init-scripts will skip adding uid:1234.

# Add current (arbitrary) user to /etc/passwd and /etc/group
if ! whoami &> /dev/null; then
  if [ -w /etc/passwd ]; then
    echo "${USER_NAME:-user}:x:$(id -u):0:${USER_NAME:-user} user:${HOME}:/bin/bash" >> /etc/passwd
    echo "${USER_NAME:-user}:x:$(id -u):" >> /etc/group
  fi
fi

As @tolusha commented, this issue will be reproduced only on vanilla Kubernetes. OpenShift version of CRI-O will edit /etc/passwd before container running. refs: https://github.com/cri-o/cri-o/pull/2022/commits/77408ef1490002e62c88baacc5c994e97aa793c6

monaka avatar Aug 04 '24 02:08 monaka

I believe I'm running into this issue - I can start a VS Code workspace by cloning an existing Github repo without a devfile, and it also works fine when I start an empty workspace, but trying to start the "Maven + Java" example or the "Python" example will produce these errors in the devworkspace-controller-manager deployment:

{"level":"info","ts":"2024-10-04T16:24:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"user1-che","Request.Name":"java-maven","devworkspace_id":"workspace9cf55cc9565d4421","resolvedConfig":"workspace.progressTimeout=3000s,workspace.ignoredUnrecoverableEvents=FailedScheduling"}
{"level":"info","ts":"2024-10-04T16:24:41Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"user1-che","Request.Name":"java-maven","devworkspace_id":"workspace9cf55cc9565d4421","status-code":502}

I am running Che on Minikube in an Apple Silicon machine (using https://github.com/chipmk/docker-mac-net-connect to resolve the Minikube ingress issues on MacOS).

Is there anything we can do, besides running OpenShift instead of Minikube?

agarciadom avatar Oct 04 '24 16:10 agarciadom

I tried OpenShift Local, and I saw the same behaviour where the "Python" / "Maven + Java" examples would be stuck with the same messages as above, whereas creating an empty workspace worked as usual. OpenShift's console was a bit more helpful and did show the hook that was being executed at PostStart time, so I looked at the /checode/entrypoint-logs.txt file and saw this:

[INFO] Node.js dir for running VS Code: /checode/checode-linux-libc/ubi9
qemu-x86_64-static: Could not open '/lib64/ld-linux-x86-64.so.2': No such file or directory

It seems to be due to my use of an Apple Silicon machine, which may be complicating things. I verified the same problem in Minikube:

[INFO] Node.js dir for running VS Code: /checode/checode-linux-libc/ubi9
rosetta error: failed to open elf at /lib64/ld-linux-x86-64.so.2
 /checode/entrypoint-volume.sh: line 122:    34 Trace/breakpoint trap   (core dumped) "$VSCODE_NODEJS_RUNTIME_DIR/node" ./launcher/entrypoint.js

I'll remove myself from this discussion then, as it seems my issue is different than the one in this issue.

agarciadom avatar Oct 04 '24 18:10 agarciadom

@agarciadom the issue you're describing above seems to reassemble a bug I've been trying to figure out: https://github.com/eclipse-che/che/issues/23179. I think that bug may be a better place to discuss your issue.

I'm not certain, but the issue you're encountering might have to do with the UBI9 image used for the workspace (in the devfile) since you reported that the empty workspace sample works (which uses the UDI image instead).

Thank you so much for reporting your findings!

AObuchow avatar Oct 04 '24 19:10 AObuchow