How can I deploy Chainlit with multiple instances

[GodgyQing]

How can I deploy Chainlit with multiple instances for load balancing, and ensure session or chat state is shared across all instances?

[GodgyQing]

this is my nginx conf

[GodgyQing]

How can I deploy Chainlit with multiple instances for load balancing, and ensure session or chat state is shared across all instances?

[nethi]

One simple solution is to set transport=websocket in your toml file.

[GodgyQing]

One simple solution is to set transport=websocket in your toml file.

Thank you, but when I upload an image and check the history, the image does not appear on other devices.

[lamsalsamip1]

Same here. This is a must fix issue to take Chainlit apps to production.

[jagerzhang]

In addition to using nginx to solve this problem, is there a way similar to redis caching to achieve multi-instance session sharing? Are there any brothers who can share

[KeemOnGithub]

This was brought up a few times before, in #1513 and #1872. There were some suggestions for resolving this in these threads, but nothing concrete as of yet.

[buzzCraft]

So I run with 3x pods on EKS, and solved it with enabling stickiness.. Not a perfect solution (since the load balancer cant move people around pods, but it works just fine)

https://docs.aws.amazon.com/elasticloadbalancing/latest/APIReference/API_TargetGroupAttribute.html

[github-actions[bot]]

This issue is stale because it has been open for 14 days with no activity.

[github-actions[bot]]

This issue was closed because it has been inactive for 7 days since being marked as stale.