janusgraph icon indicating copy to clipboard operation
janusgraph copied to clipboard

Provide documentation and/or code samples for bulk loading

Open mbrukman opened this issue 8 years ago • 3 comments

There have been a number of questions about bulk loading on the mailing list, as well as in GitHub issues, such as #268 and #602.

This is also a critical step in the getting started process for using a new database such as JanusGraph, and in many cases, users' first experience with using JanusGraph for a non-trivial exercise, so it's important to make this a smooth and simple process.

JanusGraph users would benefit from having:

  • simple and clear documentation for how to do bulk import of data, e.g., CSV/TSV, etc. into JanusGraph
  • whether there are any backend-specific optimizations or tuning parameters for bulk loading
  • code samples that users can either run as-is with just a few parameters, or build upon for custom bulk loading

mbrukman avatar Oct 05 '17 13:10 mbrukman

Excellent idea. For the case of using TinkerPop's BulkLoaderVertexProgram, please do not forget the instructions on OneTimeBulkLoader vs IncrementalBulkLoader and the need for an index for the latter as discussed in: https://groups.google.com/forum/#!topic/janusgraph-users/fO3PwKcHHCg

vtslab avatar Oct 10 '17 08:10 vtslab

See also issue #613

mbrukman avatar Oct 11 '17 00:10 mbrukman

Hi @mbrukman did we do anything about this?

dxtr-1-0 avatar Feb 12 '25 10:02 dxtr-1-0