mjshare

Results 4 comments of mjshare

@lot-insts ,Is this problem solved?I had the same problem with the V100. (WorkerDict pid=1474051) /home/miniconda3/envs/verl/lib/python3.10/site-packages/torch/distributed/fsdp/fully_sharded_data_parallel.py:690: FutureWarning: FSDP.state_dict_type() and FSDP.set_state_dict_type() are being deprecated. Please use APIs, get_state_dict() and set_state_dict(), which can...

Is there a solution to this problem?

According to the lance file layout, the current lance V2 cancels the concept of row group. What is the relationship between DataFragment and row group in the code? The DataFragment...

Thank you. Here's another question. If lance supports different number of rows for different columns, and DataFragment needs to have the same number of rows, how is this DataFragment represented?...