versatile-data-kit icon indicating copy to clipboard operation
versatile-data-kit copied to clipboard

Pip's Dependency Resolver breaks vdk-core CI/CD

Open doks5 opened this issue 3 years ago • 0 comments

Describe the bug As of pip version 22.0, vdk-core's CI/CD fails due to a dependency issue. The issue is caused by pip's dependency resolver, trying to backtrack one of vdk-core's dependencies and failing with a ModuleNotFound error ( link ).

Workaround: Currently, a workaround is in place as part of https://github.com/vmware/versatile-data-kit/pull/682. It forces pip to use its legacy resolver to avoid dependency backtracking. NOTE: This is a temporary solution, and is in place to unblock the CI/CD. It should not be relied upon in the long term.

Steps To Reproduce Steps to reproduce the behavior:

  1. Make a change to vdk-core's source code
  2. Open a PR.
  3. Observe the CI/CD pipeline.
  4. See error

Alternative Steps:

  1. Install a python3.7 virtual environment locally
  2. Activate the virtual environment
  3. Navigate to vdk-core's build.sh script in https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-core/cicd
  4. Execute the script.
  5. See error

Expected behavior The CI/CD works with latest pip without any issues.

Version (please complete the following information):

  • OS: All Linux-based distributions, MacOS
  • Version: vdk-core in developer mode (-e flag)

Additional context This is a placeholder story to remind the team to revert the build.sh script back to its previous state once the latest pip works as expected.

doks5 avatar Feb 01 '22 07:02 doks5