database icon indicating copy to clipboard operation
database copied to clipboard

benchmark results

Open hashimkhanwazir opened this issue 5 years ago • 4 comments

Hi, I have some benchmark results about Blazegraph for academic purpose. I want to approve it from you. Can you share your email, so that I can share the results with you.

hashimkhanwazir avatar May 06 '20 16:05 hashimkhanwazir

@hashimkhanwazir We don't have a mechanism to approve the results, but we'd be happy to take a look.

beebs-systap avatar May 06 '20 17:05 beebs-systap

thanks, results are given below: I used two datasets, DBpedia3.5.1 and WatDiv (bechmark) and performed experiments for 1,2,4, ...., 128 parallel querying users and noted the Queries-per-Second (QpS) value i.e. throughput against them.

– DBpedia dataset   | WatDiv dataset –  1 user | 49.8154410605507 |   | 1 user | 62.6847973262134 2 | 50.1351842955662 |   | 2 | 62.8391450603273 4 | 49.7534716293985 |   | 4 | 60.7220921590627 8 | 46.5516491735092 |   | 8 | 54.7038866221093 16 | 29.8166311604489 |   | 16 | 29.0702971511934 32 | 14.5661498035299 |   | 32 | 14.2908607770476 64 | 7.22244226499895 |   | 64 | 7.10164807892719 128 | 3.59412580045351 |   | 128 | 3.53149430637796

hashimkhanwazir avatar May 08 '20 16:05 hashimkhanwazir

Metric reported is what?

On Fri, May 8, 2020 at 9:50 AM hashimkhanwazir [email protected] wrote:

thanks, results are given below: I used two datasets, DBpedia3.5.1 and WatDiv (bechmark) and performed experiments for 1,2,4, ...., 128 parallel querying users and noted the Queries-per-Second (QpS) value i.e. throughput against them.

– DBpedia dataset | WatDiv dataset – 1 user | 49.8154410605507 | | 1 user | 62.6847973262134 2 | 50.1351842955662 | | 2 | 62.8391450603273 4 | 49.7534716293985 | | 4 | 60.7220921590627 8 | 46.5516491735092 | | 8 | 54.7038866221093 16 | 29.8166311604489 | | 16 | 29.0702971511934 32 | 14.5661498035299 | | 32 | 14.2908607770476 64 | 7.22244226499895 | | 64 | 7.10164807892719 128 | 3.59412580045351 | | 128 | 3.53149430637796

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/blazegraph/database/issues/161#issuecomment-625910768, or unsubscribe https://github.com/notifications/unsubscribe-auth/AATW7YB5GMQDYYSMO4NS52DRQQZ4LANCNFSM4M2SVSDA .

thompsonbry avatar May 08 '20 17:05 thompsonbry

As mentioned, queries-per-second (QpS)

On Fri, May 8, 2020 at 7:02 PM Bryan Thompson [email protected] wrote:

Metric reported is what?

On Fri, May 8, 2020 at 9:50 AM hashimkhanwazir [email protected] wrote:

thanks, results are given below: I used two datasets, DBpedia3.5.1 and WatDiv (bechmark) and performed experiments for 1,2,4, ...., 128 parallel querying users and noted the Queries-per-Second (QpS) value i.e. throughput against them.

– DBpedia dataset | WatDiv dataset – 1 user | 49.8154410605507 | | 1 user | 62.6847973262134 2 | 50.1351842955662 | | 2 | 62.8391450603273 4 | 49.7534716293985 | | 4 | 60.7220921590627 8 | 46.5516491735092 | | 8 | 54.7038866221093 16 | 29.8166311604489 | | 16 | 29.0702971511934 32 | 14.5661498035299 | | 32 | 14.2908607770476 64 | 7.22244226499895 | | 64 | 7.10164807892719 128 | 3.59412580045351 | | 128 | 3.53149430637796

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub < https://github.com/blazegraph/database/issues/161#issuecomment-625910768>, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AATW7YB5GMQDYYSMO4NS52DRQQZ4LANCNFSM4M2SVSDA

.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/blazegraph/database/issues/161#issuecomment-625916322, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFDAXMGJCY6BFDLDJOETYYTRQQ3KFANCNFSM4M2SVSDA .

-- Hashim Khan

hashimkhanwazir avatar May 08 '20 17:05 hashimkhanwazir