dkpro
PennTree-Asl Test case is failing if locally executed, but not on Jenkins?
Hi,
In the de.tudarmstadt.ukp.dkpro.core.io.penntree-asl is a test called testFromUimaConversion()
On Jenkins this test passes, but if I run it locally it does not. If run locally the actual output does not fit the expected output. Can someone confirm this issue of the locally failing test?
Good question. I think the failure is due to the recent upgrade of OpenNlp in DKPro Core. But that doesn't really explain why it only fails locally and not on Jenkins.
The following test, the PennTreebankCombindedReaderTest works only 1 time. If you execute it two times it fails the second time.
Could this be related to the aforementioned issue?
Theoretically yes. Maybe OpenNLP exhibits some non-deterministic behavior or it shows different behaviours on different platforms/JVMs or depending on how it is run (Eclipse vs. Maven, single test vs. sequence of tests). But what exactly... no idea.
are there maybe some left overs from previous runs that let the test pass? On our Jenkins this particular test is failing quite reliably every time.
I am trying to tell Jenkins to use the latest Java 8u66 (it was still using 8u51). Let's see if that makes the build fail.
Analyzing this a bit, the missing PRN constituent is not annotated by the OpenNLP parser in my fresh checkout of Core. I am unsure why this still works on Jenkins and I see no good way for me to change the behavior there. My suggestion would be to ignore the test for now (or commit the test as works locally for everyone to increase the pressure to fix it on Jenkins ;)
