[#714] feat(Java): Chunk Info Reader

[sapienza88]

This PR introduces a set of utility methods designed to efficiently read information pertaining to graph vertex chunks. These utilities will streamline the process of accessing and interpreting how vertices are grouped and stored, which is crucial for optimizing graph processing and analysis tasks.

Specifically, this PR provides:

Methods to query and retrieve metadata about vertex chunks.

Functions to read the boundaries and contents of individual vertex chunks.

Utilities to facilitate the navigation and processing of vertex data in a chunked manner.

This enhancement will benefit features requiring granular access to graph vertex data, such as distributed graph algorithms, incremental graph updates, and optimized data loading.

[sapienza88]

If m lines of data is split into n files:

• First n-1 files have chunkSize (get from VertexInfo/EdgeInfo getChunkSize()) entries each
• Last file has the remainder: m - (n-1)*chunkSize

So we don’t need to read file record count.

How to know about "m"? the count of the data file associated with the vertex?

[yangxk1]

If m lines of data is split into n files:

• First n-1 files have chunkSize (get from VertexInfo/EdgeInfo getChunkSize()) entries each
• Last file has the remainder: m - (n-1)*chunkSize

So we don’t need to read file record count.

How to know about "m"? the count of the data file associated with the vertex?

It can be read from vertex_count.

[sapienza88]

@yangxk1 pls provide review and merge

[sapienza88]

@yangxk1 pls allow CI to re-trigger automatically when a new code is commited by me so that I don't have to wait for you to do it manually. Thanks.

[yangxk1]

@yangxk1 pls allow CI to re-trigger automatically when a new code is commited by me so that I don't have to wait for you to do it manually. Thanks.

To ensure security, workflow execution for first-time contributors requires approval from a project committer.

You can change the branches setting in java-info.yml to trigger the workflow in your own fork, or running the script commands in java-info.yml directly in your local environment. Just remember to revert any changes to the .yml file before submitting your final PR.

[sapienza88]

@yangxk1 thanks for merging the PR on the version parsing, pls also do the same for this PR to let us merge this. PS: Allow edits by maintainers is enabled.

[yangxk1]

@yangxk1 thanks for updating the PR on the version parsing, pls also do the same for this PR to let us merge this. PS: Allow edits by maintainers is enabled.

This PR does not use protobuf, so it is not that urgent. I will still help you as soon as possible.

[sapienza88]

@yangxk1 pls approve and merge this or let me know the changes required to merge before the next release so it can be included in the next release.

[yangxk1]

Hi @unical1988 ,I think you should open an issue to discuss the necessity of this pr.

[sapienza88]

@yangxk1 i already describe here whats the pr intended for, couldnt be clearer

[yangxk1]

You need to think about these:

If m lines of data is split into n files:

• First n-1 files have chunkSize (get from VertexInfo/EdgeInfo getChunkSize()) entries each
• Last file has the remainder: m - (n-1)*chunkSize

So we don’t need to read file record count.

Open an Issue focus on discussion rather than description. This is also the specification of the CONTRIBUTING document.

[sapienza88]

@yangxk1 i can and will add tests anything else has been discussed here, pls note that this is implemented in C++

[sapienza88]

@yangxk1 i can and will add tests anything else has been discussed here, pls note that this is implemented in C++

@yangxk1 do you agree that this function doesn't require opening an issue ? why do you think it is not correct?

[yangxk1]

1. We have not discussed whether this function is necessary.
2. We don’t know whether it is implemented in java-info or java-io or other some modules.