OpenAdapt icon indicating copy to clipboard operation
OpenAdapt copied to clipboard

Implement TextGrad (bounty)

Open abrichr opened this issue 1 year ago • 9 comments

Feature request

We would like to implement https://github.com/zou-group/textgrad.

Motivation

It works out-of-the-box for a variety of tasks, where the users only provide the objective function without tuning components or prompts of the framework.

image

Bounty

A paid bounty is available. Please suggest a price range 🙏

abrichr avatar Jun 13 '24 15:06 abrichr

@abrichr wanted to work on this in $750.looking forward to discuss more about it .

kernel-loophole avatar Sep 14 '24 08:09 kernel-loophole

Sounds good @kernel-loophole ! Please DM me on Discord 🙏

abrichr avatar Sep 14 '24 16:09 abrichr

@abrichr can you share your discord username

kernel-loophole avatar Sep 14 '24 16:09 kernel-loophole

@abrichr send you request on discord

kernel-loophole avatar Sep 18 '24 05:09 kernel-loophole

@abrichr I will implement TextGrad into OpenAdapt, leveraging its framework for textual gradients to optimize and automate GUI workflows with Large Multimodal Models (LMMs). By integrating TextGrad's natural-language loss function and optimization through textual feedback, I aim to enhance process automation in OpenAdapt. This will improve task accuracy, reduce repetitive manual input, and optimize performance across various desktop and web-based automation tasks.

kernel-loophole avatar Sep 20 '24 15:09 kernel-loophole

Hi @kernel-loophole , thank you for your interest. Can you please be more precise? e.g. where will you implement textgrad? How will you evaluate whether the implementation has been successful?

abrichr avatar Sep 21 '24 16:09 abrichr

@abrichr currently i do know the repo code architecture but i think where you pass the LLM the input ,the textgrad will be implement in that code where model can learn from backpropagation .and for evaluation we can use the same llm with textgrad and without textgrad ,then compares the performance

kernel-loophole avatar Sep 21 '24 17:09 kernel-loophole

hello @abrichr , you can create a bounty on Bountyhub, it's integrated into github, (a bot will comment to let other people know that there is a bounty) and if no one solves your bounty you can retract it and get your money back, it's a simple process where you import issues by pasting the issue URL and the payment is upfront so that developers attempting to solve the issue know that the amount is already available.

omarsoufiane avatar Sep 25 '24 14:09 omarsoufiane

hi there @abrichr have not hear from you on this, any suggestions or feedback where i can start .

kernel-loophole avatar Oct 07 '24 13:10 kernel-loophole