workerd icon indicating copy to clipboard operation
workerd copied to clipboard

Use disk cache to run wd tests

Open garrettgu10 opened this issue 1 year ago • 1 comments

This PR does a few things:

  1. It updates the pyodide bucket to one that includes a file called all_wheels.zip in its GitHub release.
  2. It uses this file to create a bazel repo that contains all the wheels
  3. It passes a path to the bazel repo as --disk-cache-dir when the test is being run.

Open questions:

  1. Does this work on Windows
  2. Does this break tests on edgeworker somehow

Why not just download the wheels from R2? The main reason is that the R2 bucket is not accessible from our build infrastructure.

garrettgu10 avatar Apr 04 '24 20:04 garrettgu10

The main reason is that the R2 bucket is not accessible from our build infrastructure.

Why is that? Can't we make the R2 bucket accessible from there?

dom96 avatar Apr 05 '24 13:04 dom96