Inference directory structure is out of date

[DilipSequeira]

The directory structure in 5.6 for inference doesn't conform with the de facto structure in the inference submission repo.