A-SOID icon indicating copy to clipboard operation
A-SOID copied to clipboard

Error with Create New Dataset Following Refinement

Open eacrummy opened this issue 1 year ago • 3 comments

Describe the bug Initial warning of feature length not matching targets after refining samples in the Create New Dataset tab. This is followed by an error in Active Learning ('input with inconsistent number of samples')

To Reproduce Steps to reproduce the behavior:

  1. Refine behaviors 2.. Go to 'Create New Dataset' --> first warning appears
  2. Create Dataset
  3. Go to 'Active Learning'
  4. Start Active Learning --> error appears

Expected behavior Following behavior refinement of samples, create new dataset would update the config file and could redo the active learning step with new data.

Screenshots CreateNewDatasetError ActiveLearningError

Desktop (please complete the following information):

  • OS: Windows 11
  • Browser Chrome
  • Version [e.g. 22]

Project Config (please post the content of the corresponding config.ini file)

image

Additional context Add any other context about the problem here.

eacrummy avatar May 22 '24 15:05 eacrummy

1231232132312 I've now encountered the same issue even though the frame rate, etc. is entirely the same.

Any fix for that yet @JensBlack ?

It seems to me that ASOID assumes different time stamps for the refinement. E.g. for me the displayed table of bouts is factor x 2.5 longer than each video.

JHartig avatar Jun 10 '24 12:06 JHartig

@JHartig @eacrummy Thank you for reporting this. Sorry for the delay.

We are actively looking into this. The refinement steps seems to have some issues that did not occur during our testing and are more complex to solve than issues from the other steps. Thank you for your patience so far! I will let you know as soon as it is fixed.

JensBlack avatar Jul 02 '24 08:07 JensBlack

Just checking back on this issue–maybe some extra information will be helpful. I am experiencing the same issues. I see the issue with feature length not matching, and when I create a new dataset, I get the same error that found input variables were inconsistent with number of samples. This error seems to occur when the data tables under "Default Filled" and "Previously saved" are not the same length. Moreover, "Previously Saved" does not seem to change even after repeated clicking the "save/update refinements" button. The data that I ended up refining does not seem to save at all in this case.

Notably, when the tables in "Previously Saved" and "Default filled" were the same length, the error did not occur, the "Save/update refinements" button actually successfully saved the data, and I was able to successfully create a new dataset and retrain the classifier. But for some reason that was only true for one of the videos I had uploaded for refinements, and I am unable to reproduce the occurrence where "Previously Saved" and "Default filled" were the same length and the "Save/Update refinements" button was actually working. All of the other had the above table-length/saving issues I had described above, and did not allow for training after creation of a new dataset due to the errors mentioned by the original poster.

See the below screenshot:

Video length is 0.9 seconds

Screenshot 2024-08-01 at 7 04 47 PM Screenshot 2024-08-01 at 7 05 02 PM Screenshot 2024-08-01 at 7 11 50 PM Screenshot 2024-08-01 at 7 12 24 PM

Setup Mac M1 Sonoma 14.5 Chrome

config file Screenshot 2024-08-01 at 7 15 38 PM

vmani123 avatar Aug 01 '24 23:08 vmani123