Akshat Shrivastava

Results 28 comments of Akshat Shrivastava

Hello @juntao @hydai , myself Akshat Shrivastava sophomore at IIT BHU(Varanasi) in past few days i have understood the workflow of finetuning and running llm's locally, i was wondering weather...

![Screenshot from 2024-05-18 01-59-41](https://github.com/WasmEdge/WasmEdge/assets/115527374/384f607d-4417-48b3-a63a-f2c7b2875b44) Till now i have made a small dataset , and have successfully converted to required prompt template , example: ['You are a reviewer of Rust source...

![Screenshot from 2024-05-18 14-13-37](https://github.com/WasmEdge/WasmEdge/assets/115527374/da187c49-3904-4840-b3a2-cdac2339961e) I successfully fine tuned llama3-8b-Instruct model with my small dataset, the attached image is of training loss which is decreasing steadily which is a good sign,...

![ll2](https://github.com/WasmEdge/WasmEdge/assets/115527374/f7ab79db-9280-4110-9352-e61600d3d627) ![mm2](https://github.com/WasmEdge/WasmEdge/assets/115527374/4a15fcf9-e46e-4faf-9f0e-d2f5479937ca) These are the direct comparison between vanilla llama3-8b-Instruct and my fine tuned model for Code Explanation, My model appears to be much more direct and on point which...

![Frame 1](https://github.com/WasmEdge/WasmEdge/assets/115527374/76c9e097-dc30-44a5-ade2-f670b44b78c9) I have created my dataset for task 2 and did some experimentation for objective 2 and found out that as asked in objective if i use 262k context...

![Screenshot from 2024-05-22 17-11-11](https://github.com/WasmEdge/WasmEdge/assets/115527374/a8eccd23-d068-4d05-b155-8186a98d2462) Got llamaedge up and running and inference via chat endpoint for my fine tuned model is working fine

![Frame 2](https://github.com/WasmEdge/WasmEdge/assets/115527374/37e36645-9a90-46cf-b869-1596e2f35293) There are my results for now for fine tuned model of objective 1 and objective 2, both of these models are running on LlamaEdge API server , for...

@juntao Thanks for selecting me as a mentee for this issue, how do you want me to get started with the issue?, and how should i structure my tasks, should...

I have created an [issue](https://github.com/WasmEdge/WasmEdge/issues/3495) , currently I have created a rough timeline for myself which I will be improving according to mentor reviews

@juntao @hydai Currently this is the rough timeline I have created for myself please do give your inputs to this and do review my current dataset which i have created