diffae icon indicating copy to clipboard operation
diffae copied to clipboard

Unsupervised Domain Adaptation

Open rik030 opened this issue 3 years ago • 7 comments

Can this method be used for unsupervised domain adaptation?

rik030 avatar Nov 16 '22 12:11 rik030

In what sense of domain adaptation on you which to apply DiffAE, mind providing more specific details? One thing I can say though. DiffAE might have some hope on unsupervised image translation problem, e.g. transforming male to female or a cat to a dog and etc. To what extent DiffAE is applicable is a bit underexplored in that regard.

konpatp avatar Nov 19 '22 06:11 konpatp

Yes, I was asking about the unsupervised image-to-image translation. To be more specific, translating ceT1 modality to hrT2 modality. These modalities are unpaired. So, can DiffAE be used for an unpaired image-to-image translation?

rik030 avatar Nov 19 '22 15:11 rik030

They seem to be medical images, e.g. from https://www.researchgate.net/publication/359141212_Automated_Koos_Classification_of_Vestibular_Schwannoma/figures?lo=1. image

We have even less clue on medical images. Do both modalities share mostly the same structure? Like cropped the same way? Are the differences between domains are spatially located on the same correspoding regions?

My feeling tells me that you have a good chance on this task. Good luck!

If you have any success, mind you keep we keep in touch? I'm curious how well could in work on medical image domains. You can mail me directly at konpatp (at) gmail.com

konpatp avatar Nov 20 '22 03:11 konpatp

Yes, sir, the two modalities share an almost identical structure. I am going through your paper and the methodology used in your code to check whether domain translation on medical images can be possible with diffae. Sure, I will be in touch with you :)

rik030 avatar Nov 23 '22 11:11 rik030

well, I am interested in same object 스크린샷 2022-12-15 오후 3 12 50

I try to T1w mri image (2nd column) to T2w mri image (1st column) image translation all model trained mixed T1w and T2w mri image . and given xT = T1w, cond = T2w slice (similar slice, because of using only T1w) but prediction(3rd column) is not good... any advice?

han-yeol avatar Dec 15 '22 06:12 han-yeol

스크린샷 2022-12-15 오후 5 19 00

This is my best, honestly, This is cherry-picking...

han-yeol avatar Dec 15 '22 08:12 han-yeol

Without the domain (medical) knowledge, I am not sure what's the problem with the prediction you have?

konpatp avatar Feb 03 '23 01:02 konpatp