Dong He

icon indicating a website link https://dongheuw.github.io

icon company Meta icon location Menlo Park, CA icon location Scaling Llama at Meta. CS PhD from UW.

Results 14 comments of Dong He

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti , Thanks for your prompt reply. I am a bit confused. I would like to run my benchmarks on my CPU with only one thread enabled at the...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti , Thanks a lot. I did this and using htop I still see all cores being used when executing the query. I was testing TPC-H Q1 which is...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti, Thanks a lot! I appreciate all the help. Honestly, I am not very sure. I need to check the log. Do you have any suggestions on how to...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti , I managed to import lineitem (SF 10) and tried run query 1 using python and pyomnisci. It gives me an error every time, "Traceback (most recent call...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Thanks @cdessanti . omnisql> show table details lineitem; table_id|table_name|column_count|is_sharded_table|shard_count|max_rows|fragment_size|max_rollback_epochs|min_epoch|max_epoch|min_epoch_floor|max_epoch_floor|metadata_file_count|total_metadata_file_size|total_metadata_page_count|total_free_metadata_page_count|data_file_count|total_data_file_size|total_data_page_count|total_free_data_page_count 2|lineitem|18|false|0|4611686018427387904|32000000|3|1|1|0|0|1|16777216|4096|NULL|10|5368709120|2560|NULL omnisql> \d lineitem; CREATE TABLE lineitem ( l_orderkey INTEGER, l_partkey INTEGER, l_suppkey INTEGER, l_linenumber INTEGER, l_quantity DECIMAL(15,2), l_extendedprice DECIMAL(15,2), l_discount...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

The log when I tried to run the query via pyomnisci, **omnisci_server.INFO:** 2022-01-20T08:52:13.431685 I 28433 0 0 CommandLineOptions.cpp:1244 Max import threads 32 2022-01-20T08:52:13.431973 I 28433 0 0 CommandLineOptions.cpp:1247 cuda block...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti, I'm using `select_ipc_gpu()` to execute the query. Do you know how I can execute queries in row mode? Thanks, Dong

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti, I was using `select_ipc_gpu()` to run Q1 and then the server crashed. You suggested running the query without using arrow with pyomnisci in rowmode, do you know how...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi @cdessanti , Thanks! Do you know how to set omniscidb to use CPU or GPU when using Connection.execute()? I don't see anything from the pyomnisci docs. (I'm aware that...

Is there a way to set the number of CPU cores (or threads) being used during query execution?

Hi Todd, No. The errors I pasted on the issue were all I saw. Best regards, Dong He On Thu, Jan 20, 2022 at 3:06 AM Todd Mostak ***@***.***> wrote:...