simdjson
API
Hi,
great work regarding the port to Java 👍
Do you plan on adding an API where I can successively call an iterator and peek for specific tokens as in [1]? As I'm working on an evolutionary database system based on persistent index-structures for JSON it would be awesome to use the fastest possible parser of course.
That said, I think it might not have the biggest impact as what's more costly is the creation of the nodes (like a DOM tree), GC and serialization of the index pages to disk during a commit. Maybe there's a clever, better way to ingest data faster, though :-)
Well, for sure I could also use your current API...
Kind regards Johannes
[1] https://github.com/sirixdb/sirix/blob/8945132b053438c8b9ae65bec6b7259b59f83050/bundles/sirix-core/src/main/java/org/sirix/service/json/shredder/JsonShredder.java#L166
Hi,
Thank you for the feedback!
I'm totally open to extending or (considering the early stage of the project) changing the API to make it more user-friendly, preferably without sacrificing performance.
Please tell me what your plans regarding the library are. Would you like to use/test it right now, or are you just considering using it in the future, and the API change is not very urgent? I'm asking because currently, I'm focused on delivering the most basic features (e.g. https://github.com/simdjson/simdjson-java/issues/5), and I'd be happy to postpone any API changes until this work is done. Also, It would be great to hear from other potential users and learn about their use cases. That would be helpful to see in which direction evolve the API.
BTW, very interesting project (SirixDB), I'd love to see simdjson-java used in it!
@JohannesLichtenberger I'm pasting your reply under this issue, assuming that was your intention to post it here 😉:
I'd have some time currently, because I have holidays and switching the job afterwards (maybe doing embedded stuff in the future, which would be completely new ;-)).
That said, I'm currently writing a technical design document about SirixDB: https://sirix.io/docs/concepts.html
So it's not urgent :-) and there's plenty of other stuff to do regarding SirixDB 🙄