sentry-react-native icon indicating copy to clipboard operation
sentry-react-native copied to clipboard

test: e2e replay

Open vaind opened this issue 1 year ago • 5 comments

:loudspeaker: Type of change

  • [ ] Bugfix
  • [ ] New feature
  • [ ] Enhancement
  • [ ] Refactoring

:scroll: Description

Tests that a replay is part of the error event when session replay options are enabled.

:bulb: Motivation and Context

:green_heart: How did you test it?

:pencil: Checklist

  • [x] I reviewed submitted code
  • [x] I added tests to verify changes
  • [x] No new PII added or SDK only sends newly added PII if sendDefaultPII is enabled
  • [ ] All tests passing
  • [x] No breaking changes

:crystal_ball: Next steps

vaind avatar Aug 05 '24 20:08 vaind

Android (legacy) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 451.41 ms 466.80 ms 15.39 ms
Size 17.73 MiB 20.06 MiB 2.33 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
27ef4ee6faa6d5229b16fca7b728ca6b689ab916 317.40 ms 321.70 ms 4.30 ms
6e8584e8f1988b33cc24c85f32711c91358905fa 447.10 ms 474.71 ms 27.61 ms
148f9248007774c638943e03dc044cf71dec0c3d 492.65 ms 500.28 ms 7.63 ms
34aba0802bf802288f91fada55c0b133252fe67f 328.10 ms 342.84 ms 14.74 ms
70e6261eb7fdf57e3aba1f72d12c3eb518bcad99 482.65 ms 495.70 ms 13.05 ms
575f9da84059fc88110565adb1ffc0751799bcf4 415.26 ms 422.98 ms 7.72 ms
1c653243e2e4fd64d6c98a843b9aeccf235ba198 426.37 ms 460.36 ms 33.99 ms
15c80abcaf3bedf5d6f15c0eebefc9e7c1524da1+dirty 336.27 ms 350.58 ms 14.31 ms
1d86dd6360b3a0207437816b46e13d91fdeaf4aa 405.14 ms 411.06 ms 5.92 ms
31fcca2b37834863733f6f21677efb4b7a490aa8 391.22 ms 414.78 ms 23.56 ms

App size

Revision Plain With Sentry Diff
27ef4ee6faa6d5229b16fca7b728ca6b689ab916 17.73 MiB 19.82 MiB 2.08 MiB
6e8584e8f1988b33cc24c85f32711c91358905fa 17.73 MiB 19.86 MiB 2.12 MiB
148f9248007774c638943e03dc044cf71dec0c3d 17.73 MiB 19.94 MiB 2.21 MiB
34aba0802bf802288f91fada55c0b133252fe67f 17.73 MiB 19.80 MiB 2.07 MiB
70e6261eb7fdf57e3aba1f72d12c3eb518bcad99 17.73 MiB 19.94 MiB 2.21 MiB
575f9da84059fc88110565adb1ffc0751799bcf4 17.73 MiB 19.83 MiB 2.10 MiB
1c653243e2e4fd64d6c98a843b9aeccf235ba198 17.73 MiB 19.95 MiB 2.21 MiB
15c80abcaf3bedf5d6f15c0eebefc9e7c1524da1+dirty 17.73 MiB 20.04 MiB 2.31 MiB
1d86dd6360b3a0207437816b46e13d91fdeaf4aa 17.73 MiB 19.86 MiB 2.12 MiB
31fcca2b37834863733f6f21677efb4b7a490aa8 17.73 MiB 19.90 MiB 2.17 MiB

github-actions[bot] avatar Aug 05 '24 20:08 github-actions[bot]

iOS (legacy) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 1225.48 ms 1237.58 ms 12.10 ms
Size 2.36 MiB 3.08 MiB 733.94 KiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
dadc233f906b89b35cb320c3f7d1dfaf5db0cc5d+dirty 1223.20 ms 1236.88 ms 13.68 ms
5571a202e0c1fa9393e62c66ebd908444fee9c6e+dirty 1203.57 ms 1204.57 ms 1.00 ms
70e6261eb7fdf57e3aba1f72d12c3eb518bcad99+dirty 1220.09 ms 1230.04 ms 9.95 ms
62a750bd050f26dbf2553deb01e3f453f272de2c+dirty 1216.60 ms 1229.14 ms 12.54 ms
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 1264.38 ms 1290.06 ms 25.68 ms
6e8584e8f1988b33cc24c85f32711c91358905fa+dirty 1274.50 ms 1296.82 ms 22.32 ms
c398f670f92b4271a2da58363ef9b1d567162273+dirty 1219.67 ms 1225.66 ms 5.99 ms
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 1267.55 ms 1286.21 ms 18.66 ms
e5c9b8b6d5ce209fa4b3a77aa9de65bd590fa727+dirty 1258.57 ms 1267.32 ms 8.75 ms
31fcca2b37834863733f6f21677efb4b7a490aa8+dirty 1209.17 ms 1216.21 ms 7.04 ms

App size

Revision Plain With Sentry Diff
dadc233f906b89b35cb320c3f7d1dfaf5db0cc5d+dirty 2.36 MiB 2.84 MiB 486.85 KiB
5571a202e0c1fa9393e62c66ebd908444fee9c6e+dirty 2.36 MiB 2.92 MiB 569.93 KiB
70e6261eb7fdf57e3aba1f72d12c3eb518bcad99+dirty 2.36 MiB 3.03 MiB 680.42 KiB
62a750bd050f26dbf2553deb01e3f453f272de2c+dirty 2.36 MiB 2.92 MiB 570.00 KiB
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 2.36 MiB 2.83 MiB 480.37 KiB
6e8584e8f1988b33cc24c85f32711c91358905fa+dirty 2.36 MiB 2.88 MiB 533.17 KiB
c398f670f92b4271a2da58363ef9b1d567162273+dirty 2.36 MiB 3.04 MiB 696.27 KiB
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 2.36 MiB 2.82 MiB 462.82 KiB
e5c9b8b6d5ce209fa4b3a77aa9de65bd590fa727+dirty 2.36 MiB 2.87 MiB 520.43 KiB
31fcca2b37834863733f6f21677efb4b7a490aa8+dirty 2.36 MiB 2.90 MiB 552.95 KiB

github-actions[bot] avatar Aug 05 '24 20:08 github-actions[bot]

iOS (new) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 1246.06 ms 1244.00 ms -2.06 ms
Size 2.92 MiB 3.64 MiB 740.01 KiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
dadc233f906b89b35cb320c3f7d1dfaf5db0cc5d+dirty 1266.52 ms 1282.55 ms 16.03 ms
5571a202e0c1fa9393e62c66ebd908444fee9c6e+dirty 1228.09 ms 1233.45 ms 5.36 ms
70e6261eb7fdf57e3aba1f72d12c3eb518bcad99+dirty 1224.90 ms 1231.02 ms 6.12 ms
62a750bd050f26dbf2553deb01e3f453f272de2c+dirty 1228.12 ms 1230.53 ms 2.41 ms
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 1271.12 ms 1272.28 ms 1.16 ms
6e8584e8f1988b33cc24c85f32711c91358905fa+dirty 1271.71 ms 1281.26 ms 9.55 ms
c398f670f92b4271a2da58363ef9b1d567162273+dirty 1227.31 ms 1230.00 ms 2.69 ms
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 1291.62 ms 1296.80 ms 5.18 ms
e5c9b8b6d5ce209fa4b3a77aa9de65bd590fa727+dirty 1276.90 ms 1280.92 ms 4.02 ms
31fcca2b37834863733f6f21677efb4b7a490aa8+dirty 1222.04 ms 1226.51 ms 4.47 ms

App size

Revision Plain With Sentry Diff
dadc233f906b89b35cb320c3f7d1dfaf5db0cc5d+dirty 2.92 MiB 3.40 MiB 492.53 KiB
5571a202e0c1fa9393e62c66ebd908444fee9c6e+dirty 2.92 MiB 3.48 MiB 575.54 KiB
70e6261eb7fdf57e3aba1f72d12c3eb518bcad99+dirty 2.92 MiB 3.59 MiB 686.11 KiB
62a750bd050f26dbf2553deb01e3f453f272de2c+dirty 2.92 MiB 3.48 MiB 575.59 KiB
acadc0f974a0c234a3d9010117b076792d14d6e8+dirty 2.92 MiB 3.39 MiB 487.34 KiB
6e8584e8f1988b33cc24c85f32711c91358905fa+dirty 2.92 MiB 3.44 MiB 536.52 KiB
c398f670f92b4271a2da58363ef9b1d567162273+dirty 2.92 MiB 3.60 MiB 701.89 KiB
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 2.92 MiB 3.37 MiB 464.31 KiB
e5c9b8b6d5ce209fa4b3a77aa9de65bd590fa727+dirty 2.92 MiB 3.43 MiB 524.50 KiB
31fcca2b37834863733f6f21677efb4b7a490aa8+dirty 2.92 MiB 3.46 MiB 557.31 KiB

github-actions[bot] avatar Aug 05 '24 20:08 github-actions[bot]

Android (new) Performance metrics :rocket:

  Plain With Sentry Diff
Startup time 645.61 ms 724.43 ms 78.82 ms
Size 7.15 MiB 8.34 MiB 1.19 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
52a80311c249f8c654de5d063c8be172a2dc9e5a+dirty 330.72 ms 358.76 ms 28.03 ms
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 267.21 ms 325.24 ms 58.04 ms
25343377820b65409b646b44bc8e9bc9fbb51c8c+dirty 597.14 ms 665.04 ms 67.90 ms
22e31b6ad7bd629bf078367aee82121c08977ded+dirty 295.75 ms 346.73 ms 50.98 ms
dadc233f906b89b35cb320c3f7d1dfaf5db0cc5d+dirty 363.19 ms 370.37 ms 7.18 ms
148f9248007774c638943e03dc044cf71dec0c3d+dirty 347.36 ms 389.13 ms 41.77 ms
c398f670f92b4271a2da58363ef9b1d567162273+dirty 315.08 ms 345.60 ms 30.52 ms
5bb8d5f7daec6cd95071caf511b5c2d4006a55ac+dirty 356.71 ms 389.65 ms 32.94 ms
d197b5c9ca10ac3f729d1b3ef805328665aa0895+dirty 258.75 ms 313.61 ms 54.86 ms
15c80abcaf3bedf5d6f15c0eebefc9e7c1524da1+dirty 276.38 ms 327.54 ms 51.17 ms

App size

Revision Plain With Sentry Diff
52a80311c249f8c654de5d063c8be172a2dc9e5a+dirty 7.15 MiB 8.09 MiB 965.95 KiB
86d6d2c81bc42209de70f7f3b97a1fbbde04025f+dirty 7.15 MiB 8.09 MiB 962.69 KiB
25343377820b65409b646b44bc8e9bc9fbb51c8c+dirty 7.15 MiB 8.11 MiB 988.68 KiB
22e31b6ad7bd629bf078367aee82121c08977ded+dirty 7.15 MiB 8.10 MiB 981.29 KiB
dadc233f906b89b35cb320c3f7d1dfaf5db0cc5d+dirty 7.15 MiB 8.04 MiB 910.84 KiB
148f9248007774c638943e03dc044cf71dec0c3d+dirty 7.15 MiB 8.21 MiB 1.07 MiB
c398f670f92b4271a2da58363ef9b1d567162273+dirty 7.15 MiB 8.21 MiB 1.07 MiB
5bb8d5f7daec6cd95071caf511b5c2d4006a55ac+dirty 7.15 MiB 8.21 MiB 1.06 MiB
d197b5c9ca10ac3f729d1b3ef805328665aa0895+dirty 7.15 MiB 8.09 MiB 962.72 KiB
15c80abcaf3bedf5d6f15c0eebefc9e7c1524da1+dirty 7.15 MiB 8.09 MiB 966.13 KiB

github-actions[bot] avatar Aug 20 '24 08:08 github-actions[bot]

ping

bruno-garcia avatar Nov 12 '24 16:11 bruno-garcia

replaced by #4277

vaind avatar Nov 17 '24 16:11 vaind