self-hosted icon indicating copy to clipboard operation
self-hosted copied to clipboard

Use transactions python consumer

Open hubertdeng123 opened this issue 1 year ago • 7 comments

Seems like this is not used in prod, and not extensively tested and may be the reason why the Stats page is not properly showing events that are accepted/filtered/dropped.

hubertdeng123 avatar Mar 19 '24 22:03 hubertdeng123

nvm, stats page fix should be here: https://github.com/getsentry/self-hosted/pull/2909

hubertdeng123 avatar Mar 19 '24 23:03 hubertdeng123

I'm going to keep this open for now and merge if folks are still experiencing issues with transactions

hubertdeng123 avatar Mar 19 '24 23:03 hubertdeng123

I noticed a significant degradation in processing speed. Now events are displayed after an hour. At a measly 400-500 rps

zKoz210 avatar Mar 21 '24 09:03 zKoz210

@zKoz210 is this after switching to rust python transactions consumer? Or using the python transactions python consumer?

hubertdeng123 avatar Mar 21 '24 17:03 hubertdeng123

After changing to rust, python works for me without any problems.

zKoz210 avatar Mar 21 '24 22:03 zKoz210

@hubertdeng123 I'm still experiencing performance issues with event processing. Every new release I have to roll back Rust and return old workers. Can I somehow help find and solve this problem?

zKoz210 avatar Jun 05 '24 09:06 zKoz210

image

Here you can see how workers worked in Python, then I turned on Rust again and returned Python back

zKoz210 avatar Jun 05 '24 09:06 zKoz210