app icon indicating copy to clipboard operation
app copied to clipboard

Slack report are not sent anymore

Open XavierDeMontis opened this issue 5 months ago • 10 comments

Describe the bug We have set several slack reports. But all of a sudden they've stopped being sent. Recreating a new report rule did not solve the issue, while the webhook does work (test ok) and the rule matches the different runs.

To Reproduce On our Testomat project linkurious-develop-stable, we have several slack report rules. One of them as an example is as follows : automated and contains(run, "SYSTEM") and contains(env, "develop-stable") and has_failed It matches many runs (tested directly on Testomat as you can see on the printscreen Image And the webhook test is also ok (our slack receives it no problem). But in the end we do not receive the reports... We first noticed this issue around the end of July. We then updated our reporter version and are now using 2.2.1 (have used 1.6.17 in the past) but the situtation did not improve.

Expected behavior When a rule is matched, we expect the report to be sent to slack.

Screenshots If applicable, add screenshots or video to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Browser Version [e.g. 22]
  • Application: [production or beta]

Additional context Sometimes it looks like we are randomly receiving reports which make no sense, like the one on the following printscreen

Image

XavierDeMontis avatar Sep 11 '25 09:09 XavierDeMontis

reported by 2 more users

TetianaKhomenko avatar Oct 03 '25 10:10 TetianaKhomenko

Fixed by changed template (in project settings) for notification. Changed line1:

Was: *Test Run {{ run.id }} - {{ run.status | uppercase }}* 
Fix: *Test Run {{ run.id }} - {{ run.status }}* 

In next release "uppercase" function will be added, and than you can change it to:

*Test Run {{ run.id }} - {{ uppercase run.status }}* 

But in current version uppercase missing, so it will not working untill next release will be deployed.

trumenov avatar Oct 03 '25 17:10 trumenov

@XavierDeMontis could you please try the solution provided above?

TetianaKhomenko avatar Oct 08 '25 08:10 TetianaKhomenko

I'm afraid I don't understand @TetianaKhomenko . The current rule is as follows : automated and contains(run, "SYSTEM") and contains(env, "develop-stable") and has_failed What should I change ?

On Wed, Oct 8, 2025 at 10:54 AM Tetiana Khomenko @.***> wrote:

TetianaKhomenko left a comment (testomatio/app#1417) https://github.com/testomatio/app/issues/1417#issuecomment-3380491870

@XavierDeMontis https://github.com/XavierDeMontis could you please try the solution provided above?

— Reply to this email directly, view it on GitHub https://github.com/testomatio/app/issues/1417#issuecomment-3380491870, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQEOCFQFOVS5QICIGBWQ5KT3WTGM3AVCNFSM6AAAAACGHDJ5NSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTGOBQGQ4TCOBXGA . You are receiving this because you were mentioned.Message ID: @.***>

--

Xavier de Montis QA Lead @.***

XavierDeMontis avatar Oct 08 '25 09:10 XavierDeMontis

Image

Can you please add few run.id examples (you can find this id in url as shown at the screenshot) of runs, with missing notifications?

trumenov avatar Oct 09 '25 08:10 trumenov

Here are a few examples : 4af068af 381ab22a

XavierDeMontis avatar Oct 09 '25 08:10 XavierDeMontis

HI! Here some more runs 59192306 d09d030a 72de6073 077a50e3

iciarormaechea avatar Oct 09 '25 09:10 iciarormaechea

Received a feedback. Issue is still present.

YanaBaranova0909 avatar Oct 13 '25 12:10 YanaBaranova0909

Hi @XavierDeMontis @iciarormaechea! If the issue still persists, please double-check your Slack URL — the token in the URL might be invalid or expired.

TetianaKhomenko avatar Oct 30 '25 11:10 TetianaKhomenko

Hi Tetiana,

In our side, the reporting is working fine. I already noticed it in the tesyimat chat.

Thank you for all your support

Best regards

Itziar

Enviado desde mi iPhone

El 30 oct 2025, a las 12:13, Tetiana Khomenko @.***> escribió:

 No suele recibir correo electrónico de @.*** Por qué es esto importantehttps://aka.ms/LearnAboutSenderIdentification [https://avatars.githubusercontent.com/u/77803888?s=20&v=4]TetianaKhomenko left a comment (testomatio/app#1417)https://github.com/testomatio/app/issues/1417#issuecomment-3467439227

Hi @XavierDeMontishttps://github.com/XavierDeMontis @iciarormaecheahttps://github.com/iciarormaechea! If the issue still persists, please double-check your Slack URL — the token in the URL might be invalid or expired.

— Reply to this email directly, view it on GitHubhttps://github.com/testomatio/app/issues/1417#issuecomment-3467439227, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BOVXD7SEVEKVDB372ZCZRHD32HXGXAVCNFSM6AAAAACGHDJ5NSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTINRXGQZTSMRSG4. You are receiving this because you were mentioned.Message ID: @.***>

iciarormaechea avatar Oct 30 '25 16:10 iciarormaechea

  • [x] Slack Notification is received
  • [x] List of Failed Launch Tests: decreased it by 15
  • [x] Special symbols are accepted

Image

YanaBaranova0909 avatar Nov 19 '25 09:11 YanaBaranova0909