ros-humble icon indicating copy to clipboard operation
ros-humble copied to clipboard

Linux_64 - build 7 - ros_core, ros_base, perception, simulation, desktop, desktop_full

Open sonelu opened this issue 1 year ago • 3 comments

Trigger for rebuild for:

  • ros_core
  • ros_base
  • perception
  • simulation
  • desktop
  • desktop_full

Worked on a local built.

I'll follow with simulation and desktop as soon as I can.

Will also do a cleanup of the packages that are bottom in the recipe once we have all packages from the main versions.

sonelu avatar Aug 26 '24 20:08 sonelu

This is good to go now. All build checked locally.

sonelu avatar Aug 27 '24 10:08 sonelu

Please also check the #207 that happened during build. Not sure if the ulimit -n 4096 needs to be setup on the build environment or is already taken care of.

sonelu avatar Aug 27 '24 10:08 sonelu

Finished all packs above "end of package support" - they are 615 packages that are now building on my machine. I think for linux-64 this is good to go and merge it.

sonelu avatar Sep 01 '24 17:09 sonelu

@Tobias-Fischer is this an issue with the sizing of the server, or something else?

sonelu avatar Sep 17 '24 15:09 sonelu

To be honest, I am not sure ..

If you clean up the vinca_linux_64.yaml (only bumping the build number, removing all the comments of the packages that are contained in the meta-packages), I think I'd be happy to merge.

Tobias-Fischer avatar Sep 17 '24 23:09 Tobias-Fischer

I just remembered - we should probably address https://github.com/RoboStack/ros-noetic/issues/477 (@traversaro) and https://github.com/RoboStack/ros-humble/issues/175 before merging. @traversaro - do you know how to change the mutex build string?

Tobias-Fischer avatar Sep 17 '24 23:09 Tobias-Fischer

We should also sync https://github.com/sonelu/ros-humble/blob/linux-64/.ci_support/conda_forge_pinnings.yaml with conda-forge

Tobias-Fischer avatar Sep 18 '24 01:09 Tobias-Fischer

I think I've addressed these points - @traversaro could you please take a look?

Tobias-Fischer avatar Sep 18 '24 02:09 Tobias-Fischer

Did a cleanup - I think I'd be happy if CI is going well.

Tobias-Fischer avatar Sep 18 '24 02:09 Tobias-Fischer

I think I've addressed these points - @traversaro could you please take a look?

Everything seems fine, thanks!

traversaro avatar Sep 18 '24 05:09 traversaro

We need https://github.com/conda-forge/ompl-feedstock/pull/39

Tobias-Fischer avatar Sep 18 '24 08:09 Tobias-Fischer

We need conda-forge/ompl-feedstock#39

Fixed in https://github.com/conda-forge/ompl-feedstock/pull/47 .

traversaro avatar Nov 27 '24 22:11 traversaro

It seems to me that a patch is outdated:

==> /usr/bin/git status <==

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-backward-ros.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-backward-ros.patch with args:
['-Np1', '-i', '/tmp/tmp6qzbkf3o/ros-humble-backward-ros.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmp6qzbkf3o/ros-humble-backward-ros.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.
Error: Process completed with exit code 1.

traversaro avatar Nov 28 '24 09:11 traversaro

Ok, I fixed the backward_ros patch, now the following failure is on moveit:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch with args:
['-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/bin/boa", line 10, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cli/boa.py", line 245, in main
    run_build(args)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

traversaro avatar Nov 28 '24 09:11 traversaro

Ok, I fixed the backward_ros patch, now the following failure is on moveit:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch with args:
['-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/bin/boa", line 10, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cli/boa.py", line 245, in main
    run_build(args)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

Fortunately the patch was superseded by https://github.com/moveit/moveit2/pull/2399, so we can just drop it.

traversaro avatar Nov 28 '24 09:11 traversaro

New round new failing patch:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch with args:
['-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

traversaro avatar Nov 28 '24 09:11 traversaro

New round new failing patch:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch with args:
['-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

Apparently the patch was integrated upstream in https://github.com/moveit/moveit2/pull/2395, so se can drop also this one.

traversaro avatar Nov 28 '24 09:11 traversaro

New moveit failing patch:

2024-11-28T09:46:10.6517812Z 
2024-11-28T09:46:10.6518156Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch
2024-11-28T09:46:10.6519045Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch with args:
2024-11-28T09:46:10.6519786Z ['-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary']
2024-11-28T09:46:10.6520232Z     raise e
2024-11-28T09:46:10.6520688Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
2024-11-28T09:46:10.6521191Z     build_recipe(
2024-11-28T09:46:10.6521661Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
2024-11-28T09:46:10.6522242Z     download_source(MetaData(recipe_path, o0), interactive)
2024-11-28T09:46:10.6522819Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
2024-11-28T09:46:10.6523335Z     _try_download(m, interactive)
2024-11-28T09:46:10.6523838Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
2024-11-28T09:46:10.6524343Z     source.provide(m)
2024-11-28T09:46:10.6524812Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
2024-11-28T09:46:10.6525398Z     apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
2024-11-28T09:46:10.6526015Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
2024-11-28T09:46:10.6526538Z     raise exception
2024-11-28T09:46:10.6527005Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
2024-11-28T09:46:10.6527523Z     try_apply_patch(
2024-11-28T09:46:10.6528000Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
2024-11-28T09:46:10.6528502Z     raise e
2024-11-28T09:46:10.6528959Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
2024-11-28T09:46:10.6529473Z     check_call_env(
2024-11-28T09:46:10.6529924Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
2024-11-28T09:46:10.6530534Z     return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
2024-11-28T09:46:10.6530922Z            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-11-28T09:46:10.6531528Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
2024-11-28T09:46:10.6532143Z     subprocess.check_call(_args, **kwargs)
2024-11-28T09:46:10.6532592Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
2024-11-28T09:46:10.6533034Z     raise CalledProcessError(retcode, cmd)
2024-11-28T09:46:10.6534182Z subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

traversaro avatar Nov 28 '24 10:11 traversaro

New moveit failing patch:

2024-11-28T09:46:10.6517812Z 
2024-11-28T09:46:10.6518156Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch
2024-11-28T09:46:10.6519045Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch with args:
2024-11-28T09:46:10.6519786Z ['-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary']
2024-11-28T09:46:10.6520232Z     raise e
2024-11-28T09:46:10.6520688Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
2024-11-28T09:46:10.6521191Z     build_recipe(
2024-11-28T09:46:10.6521661Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
2024-11-28T09:46:10.6522242Z     download_source(MetaData(recipe_path, o0), interactive)
2024-11-28T09:46:10.6522819Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
2024-11-28T09:46:10.6523335Z     _try_download(m, interactive)
2024-11-28T09:46:10.6523838Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
2024-11-28T09:46:10.6524343Z     source.provide(m)
2024-11-28T09:46:10.6524812Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
2024-11-28T09:46:10.6525398Z     apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
2024-11-28T09:46:10.6526015Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
2024-11-28T09:46:10.6526538Z     raise exception
2024-11-28T09:46:10.6527005Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
2024-11-28T09:46:10.6527523Z     try_apply_patch(
2024-11-28T09:46:10.6528000Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
2024-11-28T09:46:10.6528502Z     raise e
2024-11-28T09:46:10.6528959Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
2024-11-28T09:46:10.6529473Z     check_call_env(
2024-11-28T09:46:10.6529924Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
2024-11-28T09:46:10.6530534Z     return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
2024-11-28T09:46:10.6530922Z            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-11-28T09:46:10.6531528Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
2024-11-28T09:46:10.6532143Z     subprocess.check_call(_args, **kwargs)
2024-11-28T09:46:10.6532592Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
2024-11-28T09:46:10.6533034Z     raise CalledProcessError(retcode, cmd)
2024-11-28T09:46:10.6534182Z subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

Again upstreamed: https://github.com/moveit/moveit2/pull/2895/files, we can remove it.

traversaro avatar Nov 28 '24 10:11 traversaro

Ok, now the error is:

2024-11-28T10:44:00.6863253Z Reloading output folder: /home/runner/conda-bld
2024-11-28T10:44:00.8253063Z Finalizing build for ros-humble-ament-cmake-export-definitions
2024-11-28T10:44:01.1945945Z Finalizing host for ros-humble-ament-cmake-export-definitions
2024-11-28T10:44:01.5945084Z Mamba failed to solve:
2024-11-28T10:44:01.5945535Z  - numpy 1.23.*
2024-11-28T10:44:01.5945820Z  - pip
2024-11-28T10:44:01.5946093Z  - pkg-config
2024-11-28T10:44:01.5946393Z  - python 3.11.* *_cpython
2024-11-28T10:44:01.5946764Z  - ros-humble-ament-cmake-core
2024-11-28T10:44:01.5947140Z  - ros-humble-ros-environment
2024-11-28T10:44:01.5947522Z  - ros-humble-ros-workspace
2024-11-28T10:44:01.5947885Z  - ros2-distro-mutex 0.6.* humble_*
2024-11-28T10:44:01.5948265Z  - libstdcxx >=13
2024-11-28T10:44:01.5948555Z  - libgcc >=13
2024-11-28T10:44:01.5949205Z  - libgcc >=13
2024-11-28T10:44:01.5949499Z  - __glibc >=2.17,<3.0.a0
2024-11-28T10:44:01.5949708Z 
2024-11-28T10:44:01.5949828Z with channels:
2024-11-28T10:44:01.5950010Z 
2024-11-28T10:44:01.5950142Z The reported errors are:
2024-11-28T10:44:01.5950508Z - Encountered problems while solving:
2024-11-28T10:44:01.5951004Z -   - nothing provides requested ros-humble-ros-workspace
2024-11-28T10:44:01.5951483Z - 
2024-11-28T10:44:01.5952454Z ╭───────────────────── Traceback (most recent call last) ──────────────────────╮
2024-11-28T10:44:01.5953306Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5954148Z │ e/run_build.py:306 in build_recipe                                           │
2024-11-28T10:44:01.5954781Z │                                                                              │
2024-11-28T10:44:01.5955294Z │   303 │   │   │                                                              │
2024-11-28T10:44:01.5955925Z │   304 │   │   │   o.config._build_id = o0.config.build_id                    │
2024-11-28T10:44:01.5956544Z │   305 │   │   │                                                              │
2024-11-28T10:44:01.5957168Z │ ❱ 306 │   │   │   o.finalize_solve(sorted_outputs)                           │
2024-11-28T10:44:01.5958066Z │   307 │   │   │                                                              │
2024-11-28T10:44:01.5958920Z │   308 │   │   │   meta = MetaData(recipe_path, o)                            │
2024-11-28T10:44:01.5959641Z │   309 │   │   │   o.set_final_build_id(meta, sorted_outputs)                 │
2024-11-28T10:44:01.5960251Z │                                                                              │
2024-11-28T10:44:01.5960976Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5962018Z │ e/recipe_output.py:594 in finalize_solve                                     │
2024-11-28T10:44:01.5962680Z │                                                                              │
2024-11-28T10:44:01.5963216Z │   591 │                                                                      │
2024-11-28T10:44:01.5963854Z │   592 │   def finalize_solve(self, all_outputs):                             │
2024-11-28T10:44:01.5964591Z │   593 │   │   self._solve_env("build", all_outputs)                          │
2024-11-28T10:44:01.5965293Z │ ❱ 594 │   │   self._solve_env("host", all_outputs)                           │
2024-11-28T10:44:01.5965989Z │   595 │   │   self._solve_env("run", all_outputs)                            │
2024-11-28T10:44:01.5966614Z │   596 │   │                                                                  │
2024-11-28T10:44:01.5967224Z │   597 │   │   # TODO figure out if we can avoid this?!                       │
2024-11-28T10:44:01.5967828Z │                                                                              │
2024-11-28T10:44:01.5968552Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5969378Z │ e/recipe_output.py:544 in _solve_env                                         │
2024-11-28T10:44:01.5970009Z │                                                                              │
2024-11-28T10:44:01.5970577Z │   541 │   │   │   elif env == "build":                                       │
2024-11-28T10:44:01.5971248Z │   542 │   │   │   │   MambaContext().target_prefix = self.config.build_prefi │
2024-11-28T10:44:01.5971993Z │   543 │   │   │   │   # solver.replace_installed(self.config.build_prefix)   │
2024-11-28T10:44:01.5972702Z │ ❱ 544 │   │   │   t = solver.solve(specs, [pkg_cache])                       │
2024-11-28T10:44:01.5973307Z │   545 │   │   │                                                              │
2024-11-28T10:44:01.5973925Z │   546 │   │   │   _, install_pkgs, _ = t.to_conda()                          │
2024-11-28T10:44:01.5974579Z │   547 │   │   │   for _, _, p in install_pkgs:                               │
2024-11-28T10:44:01.5975271Z │                                                                              │
2024-11-28T10:44:01.5975998Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5976796Z │ e/solver.py:234 in solve                                                     │
2024-11-28T10:44:01.5977397Z │                                                                              │
2024-11-28T10:44:01.5978205Z │   231 │   │   │   #     error_string += f"\n\n{api_solver.explain_problems() │
2024-11-28T10:44:01.5978818Z │   232 │   │   │                                                              │
2024-11-28T10:44:01.5979412Z │   233 │   │   │   print(error_string)                                        │
2024-11-28T10:44:01.5980110Z │ ❱ 234 │   │   │   raise RuntimeError("Solver could not find solution." + err │
2024-11-28T10:44:01.5980758Z │   235 │   │                                                                  │
2024-11-28T10:44:01.5981381Z │   236 │   │   if pkg_cache_path is None:                                     │
2024-11-28T10:44:01.5982037Z │   237 │   │   │   # use values from conda                                    │
2024-11-28T10:44:01.5982724Z ╰──────────────────────────────────────────────────────────────────────────────╯
2024-11-28T10:44:01.5983334Z RuntimeError: Solver could not find solution.Mamba failed to solve:
2024-11-28T10:44:01.5983896Z  - numpy 1.23.*
2024-11-28T10:44:01.5984173Z  - pip
2024-11-28T10:44:01.5984428Z  - pkg-config
2024-11-28T10:44:01.5984727Z  - python 3.11.* *_cpython
2024-11-28T10:44:01.5985078Z  - ros-humble-ament-cmake-core
2024-11-28T10:44:01.5985453Z  - ros-humble-ros-environment
2024-11-28T10:44:01.5985807Z  - ros-humble-ros-workspace
2024-11-28T10:44:01.5986160Z  - ros2-distro-mutex 0.6.* humble_*
2024-11-28T10:44:01.5986642Z  - libstdcxx >=13
2024-11-28T10:44:01.5986927Z  - libgcc >=13
2024-11-28T10:44:01.5987230Z  - libgcc >=13
2024-11-28T10:44:01.5987510Z  - __glibc >=2.17,<3.0.a0
2024-11-28T10:44:01.5987711Z 
2024-11-28T10:44:01.5987829Z with channels:
2024-11-28T10:44:01.5988002Z 
2024-11-28T10:44:01.5988130Z The reported errors are:
2024-11-28T10:44:01.5988491Z - Encountered problems while solving:
2024-11-28T10:44:01.5988977Z -   - nothing provides requested ros-humble-ros-workspace

I vaguely remember something on a ros-workspace added as a custom recipe, but I can't remember more.

traversaro avatar Nov 28 '24 14:11 traversaro

ros-workspace is just a little stub that installs the env-hooks that set up the ament prefix, if I recall correctly; doesn't RoboStack do some of that a bit differently?

EzraBrooks avatar Nov 29 '24 13:11 EzraBrooks

Yes, I think that was defined as an additional recipe in https://github.com/sonelu/ros-humble/tree/linux-64/additional_recipes, but that is not there, I do not know if @Tobias-Fischer remembers something on that.

traversaro avatar Nov 29 '24 13:11 traversaro

@Tobias-Fischer do you remember anything related to ros-workspace not build? No problem if not, I can look into this myself.

traversaro avatar Dec 14 '24 08:12 traversaro

No, sorry - I do remember that something fishy was going on, and that locally at some point I needed to manually build it as it wasn't built in the correct order automatically. So probably something deeper down that's wrong.

Tobias-Fischer avatar Dec 15 '24 01:12 Tobias-Fischer

@traversaro I don't remember having an issue building locally, but what happens if you add back ros_workspace at the top of recipe? I think the problem is that there is no official dependency ros.index.

sonelu avatar Dec 16 '24 13:12 sonelu

Thanks @sonelu ! Indeed adding ros_workspace explicitly in packages_select_by_deps seems to be working fine, at least locally.

traversaro avatar Dec 17 '24 21:12 traversaro

After ~1 hour, there is a failure:

2024-12-17T22:38:33.0082499Z RuntimeError: Solver could not find solution.Mamba failed to solve:
2024-12-17T22:38:33.0083034Z  - gazebo 11.*
2024-12-17T22:38:33.0083312Z  - libabseil 20240116.*
2024-12-17T22:38:33.0083632Z  - libprotobuf 4.25.3*
2024-12-17T22:38:33.0083924Z  - numpy 1.23.*
2024-12-17T22:38:33.0084185Z  - pip
2024-12-17T22:38:33.0084430Z  - pkg-config
2024-12-17T22:38:33.0084696Z  - python 3.11.* *_cpython
2024-12-17T22:38:33.0085015Z  - ros-humble-ament-cmake
2024-12-17T22:38:33.0085347Z  - ros-humble-ros-environment
2024-12-17T22:38:33.0085710Z  - ros-humble-ros-workspace
2024-12-17T22:38:33.0086048Z  - ros2-distro-mutex 0.6.* humble_*
2024-12-17T22:38:33.0086399Z  - libstdcxx >=13
2024-12-17T22:38:33.0086669Z  - libgcc >=13
2024-12-17T22:38:33.0086916Z  - libgcc >=13
2024-12-17T22:38:33.0087282Z  - __glibc >=2.17,<3.0.a0
2024-12-17T22:38:33.0087473Z 
2024-12-17T22:38:33.0087577Z with channels:
2024-12-17T22:38:33.0087829Z 
2024-12-17T22:38:33.0087951Z The reported errors are:
2024-12-17T22:38:33.0088334Z - Encountered problems while solving:
2024-12-17T22:38:33.0088862Z -   - package gazebo-11.0.0-h2bf7b13_5 requires libprotobuf >=3.11.4,<3.12.0a0, 
2024-12-17T22:38:33.0089454Z but none of the providers can be installed

that is strange, as conda create -n gazebotest gazebo==11.* libabseil==20240116.* libprotobuf==4.25.3.* python==3.11.* can be solved without problems. From the error, it seems like boa thinks that gazebo 11.* constraint is actually gazebo==11.0.0. Unfortunately boa was archived recently (see https://github.com/mamba-org/boa/pull/403) so it is a bit pointless to debug these kind of errors. The two possible options that I see at this point are:

  • Try to find a boa+mamba version that works fine (if @sonelu has still some environment used to build everything, we could recover a good combination from there)
  • Just migrate everything to rattler-build, reusing what was done in https://github.com/RoboStack/ros-jazzy and https://github.com/RoboStack/vinca/tree/rattler-build .

traversaro avatar Dec 17 '24 22:12 traversaro

As discussed in https://github.com/RoboStack/vinca/pull/65, I switched this PR to use the boa vinca branch.

traversaro avatar Dec 17 '24 23:12 traversaro

After ~1 hour, there is a failure:

2024-12-17T22:38:33.0082499Z RuntimeError: Solver could not find solution.Mamba failed to solve:
2024-12-17T22:38:33.0083034Z  - gazebo 11.*
2024-12-17T22:38:33.0083312Z  - libabseil 20240116.*
2024-12-17T22:38:33.0083632Z  - libprotobuf 4.25.3*
2024-12-17T22:38:33.0083924Z  - numpy 1.23.*
2024-12-17T22:38:33.0084185Z  - pip
2024-12-17T22:38:33.0084430Z  - pkg-config
2024-12-17T22:38:33.0084696Z  - python 3.11.* *_cpython
2024-12-17T22:38:33.0085015Z  - ros-humble-ament-cmake
2024-12-17T22:38:33.0085347Z  - ros-humble-ros-environment
2024-12-17T22:38:33.0085710Z  - ros-humble-ros-workspace
2024-12-17T22:38:33.0086048Z  - ros2-distro-mutex 0.6.* humble_*
2024-12-17T22:38:33.0086399Z  - libstdcxx >=13
2024-12-17T22:38:33.0086669Z  - libgcc >=13
2024-12-17T22:38:33.0086916Z  - libgcc >=13
2024-12-17T22:38:33.0087282Z  - __glibc >=2.17,<3.0.a0
2024-12-17T22:38:33.0087473Z 
2024-12-17T22:38:33.0087577Z with channels:
2024-12-17T22:38:33.0087829Z 
2024-12-17T22:38:33.0087951Z The reported errors are:
2024-12-17T22:38:33.0088334Z - Encountered problems while solving:
2024-12-17T22:38:33.0088862Z -   - package gazebo-11.0.0-h2bf7b13_5 requires libprotobuf >=3.11.4,<3.12.0a0, 
2024-12-17T22:38:33.0089454Z but none of the providers can be installed

that is strange, as conda create -n gazebotest gazebo==11.* libabseil==20240116.* libprotobuf==4.25.3.* python==3.11.* can be solved without problems. From the error, it seems like boa thinks that gazebo 11.* constraint is actually gazebo==11.0.0. Unfortunately boa was archived recently (see mamba-org/boa#403) so it is a bit pointless to debug these kind of errors. The two possible options that I see at this point are:

* Try to find a boa+mamba version that works fine (if @sonelu has still some environment used to build everything, we could recover a good combination from there)

* Just migrate everything to rattler-build, reusing what was done in https://github.com/RoboStack/ros-jazzy and https://github.com/RoboStack/vinca/tree/rattler-build .

Actually I may found an easier solution in https://github.com/RoboStack/ros-humble/pull/206/commits/f32a8cb25edb8fc0a03fc021e7de2b3012eb7f46 .

traversaro avatar Dec 17 '24 23:12 traversaro

Actually I may found an easier solution in f32a8cb .

Now, that does not work. At this point my bet is on the rattler-build migration: https://github.com/RoboStack/ros-humble/pull/229 .

traversaro avatar Dec 18 '24 12:12 traversaro