clement

@sayakpaul I need deepspeed, otherwise training won't start (nvidia out of memory error)

I have added the configuration in the command as ``` accelerate launch --config_file $ACCELERATE_CONFIG_FILE train_text_to_image_sdxl.py --pretrained_model_name_or_ path=$MODEL_NAME --pretrained_vae_model_name_or_path=$VAE_NAME --dataset_name=$DATASET_NAME --enable_xformers_memory_efficient_attention --resolution=512 --center_crop --random_flip --proportion_empty_prompts=0.2 --train_batch_size=1 --gradient_accumulation_steps=4 --gradient_checkpointing --max_train_steps=10000 --use_8bit_adam --learning_rate=1e-06...

@sayakpaul Trying ``` if isinstance(unwrap_model(model), type(unwrap_model(unet))): model.save_pretrained(os.path.join(output_dir, "unet")) ``` in the code didn't change the error

@sayakpaul The same error happens, even with ``` if isinstance(unwrap_model(model), type(unwrap_model(unet))): + unwrap_model(model).save_pretrained(os.path.join(output_dir, "unet")) ``` I have also tried running the train_text_to_image_lora_sdxl.py to see if worked and got the same...

@AoqunJin Thanks for your reply! I tried installing apex but the problem remains.

@AoqunJin I tried and it the same error appeared.