saul icon indicating copy to clipboard operation
saul copied to clipboard

DataModel population efficiency

Open kordjamshidi opened this issue 9 years ago • 2 comments

I am re-running SRL experiments and I am not sure why the population so extremely slow. I wonder, who is available to re-check the data model population code and see where the redundant searches are happening?

kordjamshidi avatar Nov 16 '16 16:11 kordjamshidi

According to @bhargav this line causes the issue, and that is true for my experience too,

joinNodes.foreach(_.addFromChild(this, instance, train, populateEdge))

but needs investigation, since we even do not call it when runnig SRL.

kordjamshidi avatar Nov 16 '16 17:11 kordjamshidi

Also as an update to the cause of this, it started happening in SRL because the usage of JoinNodes in the DataModel was added in line 42 of SRLMultiGraphDataModel.scala

Older version of SRL did not have this usage of joinNodes thus no population was happening before.

bhargav avatar Feb 12 '17 03:02 bhargav