appsmith icon indicating copy to clipboard operation
appsmith copied to clipboard
verified publisher icon appsmithorg

test: Automated tests for JSObjects + Flaky fixes test

Open Aishwarya-U-R opened this issue 3 years ago • 12 comments

Description

  • This PR includes cypress scripts for JSObject OnPageLoad and fixes flaky tests

Type of change

  • New tests (non-breaking change which tests functionality)

How Has This Been Tested?

  • CI runs

Checklist:

  • [X] My code follows the style guidelines of this project
  • [X] I have performed a self-review of my own code
  • [X] I have commented my code, particularly in hard-to-understand areas
  • [ ] I have made corresponding changes to the documentation
  • [X] My changes generate no new warnings
  • [X] I have added tests that prove my fix is effective or that my feature works
  • [X] New and existing unit tests pass locally with my changes

Aishwarya-U-R avatar Aug 09 '22 16:08 Aishwarya-U-R

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Updated
appsmith ⬜️ Ignored (Inspect) Aug 10, 2022 at 2:17PM (UTC)

vercel[bot] avatar Aug 09 '22 16:08 vercel[bot]

/ok-to-test sha=8bcea34

Aishwarya-U-R avatar Aug 09 '22 16:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2826782749. Workflow: Appsmith External Integration Test Workflow. Commit: 8bcea34. PR: 15878.

github-actions[bot] avatar Aug 09 '22 16:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2826782749. Commit: 8bcea34. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1090.1 1080.6 1118.92 1111.39 1063.2 1090.1 1092.84 2.08 1.86
painting 12.38 7.68 5.76 6.38 5.25 6.38 7.49 38.45 34.45
rendering 858.5 901.11 870.32 856.82 823.05 858.5 861.96 3.26 2.91
SELECT_WIDGET_SELECT_OPTION
scripting 149.07 166.29 169.8 162.48 167.92 166.29 163.11 5.09 4.55
painting 6.63 7.08 5.39 14.49 4.03 6.63 7.52 54.12 48.40
rendering 314.37 306.53 316.23 314.85 301.64 314.37 310.72 2.04 1.82

github-actions[bot] avatar Aug 09 '22 17:08 github-actions[bot]

/ok-to-test sha=0262d94

Aishwarya-U-R avatar Aug 10 '22 03:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2829742961. Workflow: Appsmith External Integration Test Workflow. Commit: 0262d94. PR: 15878.

github-actions[bot] avatar Aug 10 '22 03:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2829742961. Commit: 0262d94. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1040.3 1066.93 1065.13 1028.41 1033.16 1040.3 1046.79 1.73 1.54
painting 13.29 5.74 5.35 7.82 8.88 7.82 8.22 38.81 34.67
rendering 814.05 822.28 829.24 822.44 801.46 822.28 817.89 1.30 1.16
SELECT_WIDGET_SELECT_OPTION
scripting 148.81 163.7 167.07 160.75 149.16 160.75 157.9 5.35 4.78
painting 4.94 2.12 3.48 3.62 3.93 3.62 3.62 27.90 25.14
rendering 304.5 300.86 306.5 295.5 299.98 300.86 301.47 1.41 1.26

github-actions[bot] avatar Aug 10 '22 03:08 github-actions[bot]

/ok-to-test sha=cb58750

Aishwarya-U-R avatar Aug 10 '22 05:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2830163954. Workflow: Appsmith External Integration Test Workflow. Commit: cb58750. PR: 15878.

github-actions[bot] avatar Aug 10 '22 05:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2830163954. Commit: cb58750. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1126 1104.23 1077.06 1174.64 1152.06 1126 1126.8 3.41 3.05
painting 13.9 6.95 10.74 7.29 14.28 10.74 10.63 32.83 29.35
rendering 873.18 894.52 851.2 931.14 906.86 894.52 891.38 3.45 3.08
SELECT_WIDGET_SELECT_OPTION
scripting 160.26 162.79 161.87 150.72 164.33 161.87 159.99 3.37 3.01
painting 3.74 2.05 4.65 4.12 5.7 4.12 4.05 33.09 29.63
rendering 314.99 312.49 310.12 313.62 320.51 313.62 314.35 1.23 1.10

github-actions[bot] avatar Aug 10 '22 05:08 github-actions[bot]

/ok-to-test sha=54992d2

Aishwarya-U-R avatar Aug 10 '22 06:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2830622676. Workflow: Appsmith External Integration Test Workflow. Commit: 54992d2. PR: 15878.

github-actions[bot] avatar Aug 10 '22 06:08 github-actions[bot]

/ok-to-test sha=4ce4027

Aishwarya-U-R avatar Aug 10 '22 07:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2830786901. Workflow: Appsmith External Integration Test Workflow. Commit: 4ce4027. PR: 15878.

github-actions[bot] avatar Aug 10 '22 07:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2830622676. Commit: 54992d2. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1237.81 1391.24 1376.69 1108.14 1165.87 1237.81 1255.95 10.01 8.95
painting 16.36 15.06 11.87 12.02 14.41 14.41 13.94 14.06 12.55
rendering 1015.87 1310.61 1066.89 849.52 951.33 1015.87 1038.84 16.58 14.83
SELECT_WIDGET_SELECT_OPTION
scripting 170.43 150.71 158.77 232.14 186.04 170.43 179.62 17.94 16.05
painting 5.03 5.03 5.32 11.41 4.45 5.03 6.25 46.40 41.60
rendering 314.79 309.06 330.79 387.28 316.63 316.63 331.71 9.67 8.65

github-actions[bot] avatar Aug 10 '22 07:08 github-actions[bot]

/ok-to-test sha=e7ba0aa

Aishwarya-U-R avatar Aug 10 '22 07:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2830962714. Workflow: Appsmith External Integration Test Workflow. Commit: e7ba0aa. PR: 15878.

github-actions[bot] avatar Aug 10 '22 07:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2830786901. Commit: 4ce4027. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1040.39 1053.06 1064.55 1045.87 1047.7 1047.7 1050.31 0.87 0.78
painting 6.48 7.33 7.13 11.82 12.03 7.33 8.96 30.47 27.23
rendering 816.02 837.51 872.5 819.31 815.45 819.31 832.16 2.92 2.61
SELECT_WIDGET_SELECT_OPTION
scripting 159.74 153.72 151.61 151.51 147.54 151.61 152.82 2.93 2.61
painting 2.31 2.38 3.23 2.71 8.62 2.71 3.85 69.87 62.60
rendering 308.93 305.33 319.33 302.12 296.78 305.33 306.5 2.76 2.47

github-actions[bot] avatar Aug 10 '22 08:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2830962714. Commit: e7ba0aa. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1030.46 1034.45 1058.37 1034.75 1043.85 1034.75 1040.38 1.08 0.96
painting 5.59 5.78 8.04 11.95 11.41 8.04 8.55 35.32 31.58
rendering 790.69 814.83 812.49 812.48 819.36 812.49 809.97 1.38 1.23
SELECT_WIDGET_SELECT_OPTION
scripting 152.67 141.9 150.13 148.53 154.2 150.13 149.49 3.20 2.86
painting 2.08 7.94 9.55 2.38 2.19 2.38 4.83 74.95 67.08
rendering 301.81 295.42 302.03 294.42 305.45 301.81 299.83 1.57 1.41

github-actions[bot] avatar Aug 10 '22 08:08 github-actions[bot]

/ok-to-test sha=1039e9f

Aishwarya-U-R avatar Aug 10 '22 10:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2831918132. Workflow: Appsmith External Integration Test Workflow. Commit: 1039e9f. PR: 15878.

github-actions[bot] avatar Aug 10 '22 10:08 github-actions[bot]

/ok-to-test sha=22f0bed

Aishwarya-U-R avatar Aug 10 '22 11:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2832297727. Workflow: Appsmith External Integration Test Workflow. Commit: 22f0bed. PR: 15878.

github-actions[bot] avatar Aug 10 '22 11:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2832297727. Commit: 22f0bed. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1058.41 1052.25 1031.42 1038.11 1072.87 1052.25 1050.61 1.57 1.40
painting 5.72 4.87 6.45 9.25 5.47 5.72 6.35 27.09 24.25
rendering 832.79 818.15 813.73 811.86 821.4 818.15 819.59 1.01 0.90
SELECT_WIDGET_SELECT_OPTION
scripting 154.35 147.02 146.44 147.96 147.8 147.8 148.71 2.16 1.93
painting 3.72 2.99 3.49 2.71 9.29 3.49 4.44 61.71 55.18
rendering 306.97 296.63 299.3 307.51 300.04 300.04 302.09 1.61 1.44

github-actions[bot] avatar Aug 10 '22 12:08 github-actions[bot]

/ok-to-test sha=e6b381e

Aishwarya-U-R avatar Aug 10 '22 12:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2832660493. Workflow: Appsmith External Integration Test Workflow. Commit: e6b381e. PR: 15878.

github-actions[bot] avatar Aug 10 '22 12:08 github-actions[bot]

/ok-to-test sha=3db11fb

Aishwarya-U-R avatar Aug 10 '22 13:08 Aishwarya-U-R

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/2832815176. Workflow: Appsmith External Integration Test Workflow. Commit: 3db11fb. PR: 15878.

github-actions[bot] avatar Aug 10 '22 13:08 github-actions[bot]

UI Performance test run logs and artifacts: https://github.com/appsmithorg/appsmith/actions/runs/2832815176. Commit: 3db11fb. Results:

Click to view performance test results

Run 1 Run 2 Run 3 Run 4 Run 5 Median Mean SD.Sample SD.Population
SELECT_WIDGET_MENU_OPEN
scripting 1118.48 1075.71 1053.43 1057.58 1059.77 1059.77 1072.99 2.50 2.23
painting 7.7 6.82 7.42 14.2 10.34 7.7 9.3 32.90 29.35
rendering 867.37 836.94 819.46 821.12 811.47 821.12 831.27 2.67 2.39
SELECT_WIDGET_SELECT_OPTION
scripting 154.21 170.35 155.82 149.1 172.15 155.82 160.33 6.42 5.74
painting 19.32 2.11 7.44 4.81 2.1 4.81 7.16 99.86 89.39
rendering 308.61 311.41 304.55 308.39 330.51 308.61 312.69 3.28 2.93

github-actions[bot] avatar Aug 10 '22 13:08 github-actions[bot]

/ok-to-test sha=2d464bf

Aishwarya-U-R avatar Aug 10 '22 14:08 Aishwarya-U-R