[BUG] The OpenAI Embedding Node for LamaIndex does not work for 3072 vector dimension

[toi500]

The OpenAI Embedding Node for LamaIndex is fixed at vector dimension 1536, independently if you select the text-embedding-3-large model which is 3072.

This produces a error message and it does not index any data at Pinecone.

The node works for text-embedding-ada-002 / 1536 as expected.

Version 1.6.0

[HenryHengZJ]

I dont think we hard-coded 1536, its undefined and we let the OpenAI SDK to figure out what dimension to use depending on the model.

[Codechilla]

Same problem, but with Qdrant (local) instead of Pincone.