Some of the UI tests fail on Indigo and Indigo SR1
As part of issue #206, we patched the following plug-ins of Eclipse Indigo.
-
org.eclipse.jdt.core.manipulation -
org.eclipse.jdt.ui -
org.eclipse.ltk.core.refactoring -
org.eclipse.ltk.ui.refactoring
Then, we ran all of CodingSpectator's automated tests in edu.illinois.codingspectator.monitor.tests and edu.illinois.codingspectator.ui.tests. Overall, CodingSpectator seems to work find on Indigo except that some of the tests in edu.illinois.codingspectator.ui.tests fail because CodingSpectator sometimes generates slightly different logs on Indigo.
The following tests fail on Indigo because the wording of a compilation error has changed in Indigo. Eclipse Indigo has replaced the the error message "... is never read locally" by "... is not used".
-
move.T28 -
pushdown.T04 -
pushdown.T05 -
pushdown.T07 -
pushdown.T08 -
rename.T17 -
rename.T23
And, test rename.T07 fails on Indigo because the input attribute of the rename refactoring has slightly changed in Indigo.
We are planning to fix this issue by adding expected logs for Indigo to edu.illinois.codingspectator.ui.tests whenever they are different than those for Helios. Then, we will update the UI tests to detect the version of Eclipse and check the actual log files against the right expected logs.
Test pullup.T01 fails on Indigo because the status attribute is different in Indigo. And, pullup.T02 fails on Indigo because the actual refactoring-problems.log file does not exist.
The UI tests exhibit similar behaviors on Indigo and Indigo SR1. The differences in Indigo SR1 with respect to Indigo are the following:
- Test
pushdown.T03fails on Indigo SR1 because of unexpected changes of compilation problems. - Tests
pullup.T01andpullup.T02pass on Indigo SR1.