Thomas Eng comments

Repositories
Issues
Comments

Results 3 comments of


                                            Thomas Eng

Initial token count exceeds token limit

You should probably chunk your documents when indexing them. Ie. ``` node_parser = SimpleNodeParser.from_defaults( chunk_size=1024, chunk_overlap=20, ) nodes = node_parser.get_nodes_from_documents(documents) ```

Does not work with Yarn@4

Btw, my install / build attempt is on a MB Pro.

Does not work with Yarn@4

[corepack](https://nodejs.org/api/corepack.html#enabling-the-feature) enabled