tiktoken icon indicating copy to clipboard operation
tiktoken copied to clipboard

Add aarch64 musllinux wheel for 0.8.0

Open rhuddleston opened this issue 1 year ago • 5 comments

0.7.0 had aarch64 musllinux wheel can the same be made for 0.8.0?

thanks!

rhuddleston avatar Oct 07 '24 03:10 rhuddleston

Unfortunately, the QEMU emulation has become really flaky, it was painful even getting successful builds for the normal manylinux aarch64 wheels. If you can identify what's ailing the build, please open a PR and tag me, and I can release. Otherwise, I'm probably not going to do anything until Github has native aarch64 runners (I believe they said they'd make them available later this year)

hauntsaninja avatar Oct 07 '24 07:10 hauntsaninja

For what it's worth, we also rely on aarch64 musllinux wheels for our Docker images. It looks like aarch64 runners are already available in public preview, and they should be taken out of preview sometime in Q1 2025. It might be worth a shot to try out the builds using them now?

mwillfox avatar Jan 14 '25 18:01 mwillfox

accidentally opened another issue #386 not seeing this one. I closed in favor of focusing here. 🤞

codefromthecrypt avatar Mar 01 '25 01:03 codefromthecrypt

Yeah, the emulation made life difficult, but Github now has arm runners, so I should be able to add a musl aarch wheel for next release

hauntsaninja avatar Mar 01 '25 02:03 hauntsaninja

@hauntsaninja gentle reminder that this would be awesome to have in. with grpcio 1.71.0 now having musl aarch64 wheels, having tiktoken could lead to fast and slim alpine build

codefromthecrypt avatar Mar 13 '25 00:03 codefromthecrypt

Looking forward to binaries that work on alpine as well.

Currently, we require to build the binaries ourselves, which is annoying. Anyone who have a temporary workaround? Any binaries laying around?

andreped avatar Jun 25 '25 11:06 andreped

See pull request https://github.com/openai/tiktoken/pull/402

rhuddleston avatar Aug 01 '25 05:08 rhuddleston

@hauntsaninja AFAIK, GitHub Actions now offers native general public ARM64 hosted runners, for macOS (link), Linux (link), and Windows (link). So I would think creating the relevant wheels should be achievable.

When will there be a release that addresses this issue?

andreped avatar Aug 06 '25 07:08 andreped

Yeah, the emulation made life difficult, but Github now has arm runners, so I should be able to add a musl aarch wheel for next release

Any news @hauntsaninja? Since then, there has been another release, but the arm wheel has still not been incorporated.

bdovaz avatar Sep 21 '25 19:09 bdovaz

These wheels were built as part of 0.12.0

hauntsaninja avatar Oct 06 '25 20:10 hauntsaninja