Thijs Marinussen

Stop given a depset as the first unnamed argument to the depset() con…

3

…structor. This is in preparation for flipping the Bazel flag --incompatible_disable_depset_items to true, making it an error to use the "items" parameter. See https://github.com/bazelbuild/bazel/issues/9017 for details.

fuse() breaking small example

3

Small example that works without fuse (it prints `2`). ``` t = Tensor.arange(4).realize() a = t[1:3].min() b = t[1:4].max() print((b-a).item()) ``` Introducing `.fuse()` like below: ``` print((b-a).fuse().item()) ``` Results in...

Don't assume all devices with the same runtime have compatible binaries

3

`python examples\beautiful_mnist_multigpu.py` fails on my machine. After adding some logging in opg_gpu.py I got this output: `Error: The program ISA amdgcn-amd-amdhsa--gfx1103 is not compatible with the device ISA amdgcn-amd-amdhsa--gfx1102` I'm...

Flash attention

1

This is very much an early draft, I'm sharing this to maybe avoid a bit of double work, and to have a good place to outline the areas of this...