tiktoken-node

tiktoken-node copied to clipboard

Cannot find module './dist/tiktoken-node.linux-x64-gnu.node' when deployed on Vercel - Nuxt 3

10

[nuxt] [request error] [unhandled] [500] Cannot find module './dist/tiktoken-node.linux-x64-gnu.node' Require stack: - /var/task/node_modules/tiktoken-node/index.mjs at Module._resolveFilename (node:internal/modules/cjs/loader:1039:15) at Module._load (node:internal/modules/cjs/loader:885:27) at Module.require (node:internal/modules/cjs/loader:1105:19) at require (node:internal/modules/cjs/helpers:103:18) at ./node_modules/tiktoken-node/index.mjs:11:21 at ModuleJob.run (node:internal/modules/esm/module_job:194:25)...

balsimpson

I am trying to use LlamaIndex in one of my projects on a Windows machine and facing this issue. Any idea how to fix it? Thanks.

Nithur-M

Not working in deno deploy

4

I am trying to load it in deno with the help of esm.sh but it is giving error: ``` error: Uncaught Error: createRequire only supports 'file://' URLs for the 'filename'...

deepak-coding-art

Can not work in aws lambda as it's lack of GLIBC_2.28

2

It would throw an error as : `node-loader:\nError: /lib64/libc.so.6: version GLIBC_2.28 not found (required by /var/task/tiktoken-node.linux-x64-gnu.node)` Need to rebuild the node module with GLIBC_2.27 or Amazon Linux 2 image.

bandaot

feat: support o200k_base

1

exKAZUu

gpt-4o and gpt-4o-2024-05-13 Please update to support both models!

Hoozia