Bin Zhu

s3dis test errors

2

When I tested the s3dis data set, I encountered the error "ValueError: attempt to get argmin of an empty sequence". I found that path="xxx/subsample/test",loader,_=data_loaders(path); in the test.py file; but there...

How many frames (seconds) are there in each video sample used in the training process?

1

How many frames (seconds) are there in each video sample used in the training process? Is it the same as the output sample of the 4-second clip of 32 frames?...

Does this dataset cooperate with Google? Is it licensed by Google?

1

Does this dataset cooperate with Google? Is it licensed by Google?

Does this dataset cooperate with Google? Is it licensed by Google?

1

Hello, expert. Does this dataset cooperate with Google? Is it licensed by Google? Thank you for your reply!

Why did you retrain a new module token_emb, have you ever tried to change the VQGAN codebook from dim=256 to dim=768 via MLP?

2

Great job, why did you retrain a new module token_emb, have you ever tried to change the VQGAN codebook from dim=256 to dim=768 via MLP?

nvrtc: error: invalid value for --gpu-architecture (-arch)

Some weights of MM_LLMs were not initialized from the model checkpoint at ./mm_llms_trainer/ and are newly initialized:

1

Thank you very much for your outstanding work. I encountered the following problem when loading model weights. When I used torch.load to load pytorch_model.bin, I found that this part of...

odel.load_state_dict:_IncompatibleKeys(missing_keys=[], unexpected_keys=['base_model.model.model.layers.0.mlp.gate_proj.lora_A.default.weight', 'base_model.model.model.layers.0.mlp.gate_proj.lora_B.default.weight', 'base_model.model.model.layers.0.mlp.up_proj.lora_A.default.weight', 'base_model.model.model.layers.0.mlp.up_proj.lora_B.default.weight', 'base_model.model.model.layers.0.mlp.down_proj.lora_A.default.weight', 'base_model.model.model.layers.0.mlp.down_proj.lora_B.default.weight', 'base_model.model.model.layers.1.mlp.gate_proj.lora_A.default.weight', 'base_model.model.model.layers.1.mlp.gate_proj.lora_B.default.weight', 'base_model.model.model.layers.1.mlp.up_proj.lora_A.default.weight', 'base_model.model.model.layers.1.mlp.up_proj.lora_B.default.weight', 'base_model.model.model.layers.1.mlp.down_proj.lora_A.default.weight', 'base_model.model.model.layers.1.mlp.down_proj.lora_B.default.weight', 'base_model.model.model.layers.2.mlp.gate_proj.lora_A.default.weight', 'base_model.model.model.layers.2.mlp.gate_proj.lora_B.default.weight', 'base_model.model.model.layers.2.mlp.up_proj.lora_A.default.weight', 'base_model.model.model.layers.2.mlp.up_proj.lora_B.default.weight', 'base_model.model.model.layers.2.mlp.down_proj.lora_A.default.weight', 'base_model.model.model.layers.2.mlp.down_proj.lora_B.default.weight', 'base_model.model.model.layers.3.mlp.gate_proj.lora_A.default.weight',