Error 'slow down' on localhost e2e test

[chuckjewell]

Just installed, and kicked off dist/server and dist/runner.

Both start listening with no complaints.

Kick off a test with: OPENAI_API_BASE_URL='http://127.0.0.1:3000' npx tsx e2e

and get the below error on runner.

Note the only thing I can see wrong is that it is showing server: cloudflare though I have s3 configured with an s3:// address.

According to this thread on the opennai forums, this can sometimes be caused by lack of "Authorization" header. https://community.openai.com/t/getting-hit-with-429-slow-down-error/482704/16

Runner started for queue "openopenai" listening for "thread-run" jobs
Processing thread-run job "clrmgtt100005iwpwdp54i3mb" for run "clrmgtt100005iwpwdp54i3mb"
Job "clrmgtt100005iwpwdp54i3mb" run "clrmgtt100005iwpwdp54i3mb": >>> chat completion call {
  messages: [
    { role: 'system', content: 'You are a helpful assistant.' },
    {
      role: 'user',
      content: 'What is the weather in San Francisco today?'
    }
  ],
  model: 'gpt-4-1106-preview',
  tools: [ { type: 'function', function: [Object] } ],
  tool_choice: 'auto'
}
Error job "clrmgtt100005iwpwdp54i3mb" run "clrmgtt100005iwpwdp54i3mb": APIError: 429 "slow down"
    at <anonymous> (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/[email protected]/node_modules/openai-fetch/src/fetch-api.ts:43:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at fn (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/[email protected]/node_modules/ky/source/core/Ky.ts:55:14)
    at Promise.result.<computed> (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/[email protected]/node_modules/ky/source/core/Ky.ts:86:27)
    at OpenAIClient.createChatCompletion (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/[email protected]/node_modules/openai-fetch/src/openai-client.ts:73:45)
    at ChatModel.runModel (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/@[email protected]/node_modules/@dexaai/dexter/src/model/chat.ts:53:24)
    at ChatModel.run (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/@[email protected]/node_modules/@dexaai/dexter/src/model/model.ts:132:24)
    at Worker.Worker.connection (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/src/runner/index.ts:270:21)
    at async Worker.processJob (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:350:28)
    at async Worker.retryIfFailed (/Users/chuckjewell/git/123/repos/ai_dev/OpenOpenAI/node_modules/.pnpm/[email protected]/node_modules/bullmq/dist/cjs/classes/worker.js:537:24) {
  status: 429,
  headers: {
    'alt-svc': 'h3=":443"; ma=86400',
    'cf-ray': '8489bcf009a4efd2-PDX',
    connection: 'keep-alive',
    'content-length': '22',
    'content-type': 'application/json',
    date: 'Sat, 20 Jan 2024 19:31:29 GMT',
    server: 'cloudflare',
    'set-cookie': '__cf_bm=NIGNPPboVXD8fiY_rJBrhjexBEiM7x8_Q4Nkuof9gS4-1705779089-1-ATL5Ajgw+3zdT405fvUxZgi5nnc3+jPQ/+W+uEv1Tk8yuymYc0CDzU2F25WJ0zNVlrF4eVSTlCTvoHOZeG7ZH/A=; path=/; expires=Sat, 20-Jan-24 20:01:29 GMT; domain=.api.openai.com; HttpOnly; Secure; SameSite=None',
    vary: 'Accept-Encoding'
  },
  error: 'slow down',
  code: undefined,
  param: undefined,
  type: undefined
}