Tommy

Sorry forget to check model_init file, I adapted the config now it is working. `config = ExLlamaConfig(model_config_path) config.model_path = model_path config.max_seq_len = 2048 config.set_auto_map('16,24') config.gpu_peer_fix = True model = ExLlama(config)...