Vitor Alcantara Batista

I got the same error trying to use another model other than Bert-base/large-ucased. This occurs because of the constructor of BertModel Class in src/model/BERT/modeling_bert.py. There's a definition of classification layer...

I also tried to finetune a Mixtral 7x7B using A100 gpu and got OOM even with batch_size=1 and micro_batch_size=1. I'm using LoRA.

Hi @ThrawnCA , I finally got your branch of plugin working. I had some issues with ACL and SSL, because my company's policies. It is working, but I still getting...

@wardi , can you tell me if https://github.com/TkTech/ckanext-cloudstorage plugin can work with IAM role authorization, without having to pass access_key? My CKAN application runs in an ECS container within same...

@wardi, I inserted several `log.debug` statements in s3filestore plugin. I found that the problem with large files happens before calling any constructor or upload method. It seems CKAN "blows" before...

@ThrawnCA Sure! I'll comment on your repo.

Maybe you can also add support for Qwen 1.5.

Adding more information. Looks like this file: https://github.com/menloresearch/jan/blob/dev/web-app/src/services/providers/tauri.ts#L149 does not passes api-version parameter. My endpoint only lists the models passing the api-version parameter on URL: https://OUR-ID.openai.azure.com/openai/models?api-version=2025-01-01-preview Also, it is important...

Hi @LazyYuuki, I verified that the problem is the SSL certificate on our server. This model server is actualy an [Azure API Management product](https://learn.microsoft.com/en-us/azure/api-management/api-management-key-concepts) local deployment with self-signed certificate. I...

Please, change issue type to idea.