autogen icon indicating copy to clipboard operation
autogen copied to clipboard

[Bug]: [AutogenStudio] Agents no longer have access to previous conversations within a Session

Open dragosMC91 opened this issue 1 year ago • 3 comments

Describe the bug

This started happenning after I upgraded AutogenStudio from 0.0.44a0 -> 0.0.47. I then downgraded again, but the behavior persists. Tried removing the current python virtual envs, and installing autogenstudio in new venv, but the bug persists.

Steps to reproduce

  1. install autogenstudio pip install autogenstudio==0.0.44a0 (this was the last version which I know worked)
  2. start the server via autogenstudio ui --port 8084 --appdir /path/to/ui (I made sure to clean the ui artifacts)
  3. setup a basic workflow with 1 proxyuser and 1 primary assistant agent
  4. in the Playground, create a new session with the workflow from step 3.
  5. input a prompt which outputs a list (e.g give me 10 uses for ginger)
  6. ask a follow up question on any of the 10 points, without specifying exactly the text from the point (e.g pleae elaborate on point 6)

Model Used

I tried gpt 3.5 turbo, 4 turbo, mistral medium, claude 3 opus

Expected Behavior

When I ask the follow up question, a request is made to openai with all previous messages from the conversation. So considering the previous example, when I ask pleae elaborate on point 6, the model knows exactly which point I am refering to.

Screenshots and logs

userproxy (to primary_assistant):

give me 10 uses for ginger


primary_assistant (to userproxy):

To provide you with 10 uses for ginger, I will combine my knowledge with some research. Let's start by listing some common uses for ginger:

  1. Culinary Purposes: Ginger is widely used in cooking and baking to add flavor to dishes such as stir-fries, curries, soups, and desserts.
  2. Digestive Aid: Ginger is known for its ability to help with digestion and alleviate digestive issues like nausea, bloating, and indigestion.
  3. Anti-Inflammatory Properties: Ginger contains compounds that have anti-inflammatory effects, which can help reduce inflammation in the body.
  4. Immune System Booster: Ginger is rich in antioxidants and has immune-boosting properties that can help strengthen the immune system.
  5. Relief from Motion Sickness: Ginger is often used to alleviate symptoms of motion sickness and nausea.
  6. Sore Throat Relief: Ginger tea with honey can help soothe a sore throat and provide relief from coughing.
  7. Pain Relief: Ginger has been used traditionally to help alleviate pain, including menstrual cramps and muscle soreness.
  8. Blood Sugar Regulation: Some studies suggest that ginger may help regulate blood sugar levels.
  9. Skin Benefits: Ginger has antioxidant properties that can help improve skin health and reduce signs of aging.
  10. Hair Care: Ginger can be used in hair masks or shampoos to promote hair growth and improve scalp health.

Now, let's summarize these uses in a list format using Python:


userproxy (to primary_assistant):

TERMINATE


Modified files: 0 INFO: 127.0.0.1:55332 - "POST /api/messages HTTP/1.1" 200 OK userproxy (to primary_assistant):

give me 10 uses for ginger


primary_assistant (to userproxy):

TERMINATE


userproxy (to primary_assistant):

pleae elaborate on point 6


primary_assistant (to userproxy):

TERMINATE


Modified files: 0 INFO: 127.0.0.1:55336 - "POST /api/messages HTTP/1.1" 200 OK userproxy (to primary_assistant):

give me 10 uses for ginger


primary_assistant (to userproxy):

TERMINATE


userproxy (to primary_assistant):

pleae elaborate on point 6


primary_assistant (to userproxy):

TERMINATE


userproxy (to primary_assistant):

pleae elaborate on point 6


primary_assistant (to userproxy):

To elaborate on point 6, ginger can be used in various desserts such as gingerbread cookies, ginger snaps, ginger cake, ginger ice cream, ginger pudding, ginger scones, ginger muffins, ginger-flavored frosting, and ginger-infused custards. Ginger adds a warm and spicy flavor to these sweet treats, balancing out the sweetness and providing a unique taste profile. It can be used in both baked and frozen desserts to enhance the overall flavor and aroma. Ginger can be grated, minced, or powdered depending on the recipe requirements.


userproxy (to primary_assistant):

TERMINATE


Additional Information

AutoGenStudio Version: 0.0.44a0 Operating System: MacOS with M2 pro Python Version: 3.10.12 / 3.11.8

dragosMC91 avatar Mar 10 '24 07:03 dragosMC91