yeluoo

Results 11 comments of yeluoo

@PC-god @EvanZune 解决了吗

@happyharrycn @fmu2 @YichengWu

I wrote the LISRD code with the weights he @sanersbug provided, have you tried it? @xmba15

this is link : [https://github.com/Shiaoming/ALIKE.git](https://github.com/Shiaoming/ALIKE.git),you can try, I get bad result from your descriptor.

@zengyh1900 这里的prompt是整张图对应的caption,还是mask区域对应的caption,论文似乎说的是mask区域对应的反caption,那么问题来了,prompt不是训练t2i吗,那为什么是mask区域的caption呢

> @zengyh1900 我下载的laion数据集,每一张图会对应一个json ![image](https://private-user-images.githubusercontent.com/17424385/370217425-11f80e98-f61b-4990-a6b6-dcf3bdf53ca7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzE5MTU4NDcsIm5iZiI6MTczMTkxNTU0NywicGF0aCI6Ii8xNzQyNDM4NS8zNzAyMTc0MjUtMTFmODBlOTgtZjYxYi00OTkwLWE2YjYtZGNmM2JkZjUzY2E3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDExMTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMTE4VDA3MzkwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNjNDk1YTU2NTkxMjAwNjlkMGE4M2FhMzg0ODg0MmQ3MmU4YWI2MmQ4MmZjNjRmYzQxYzJkM2IwMTliMmYxNjgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.yA89jr-JHi3pA4dkkJUken9JddJn0y74582gBoaJmF4) 问题1:你的laion数据集中,随机mask对应的提示词是上面json里面的caption吗? 问题2:如果是,我理解anno_info["remark"]是对应上面json,为什么prompt来自anno_info["content"],而不是来自remark 问题3:如果不是,anno_info["content"]是怎么来的,我理解随机mask对应的提示词是不是也得通过blip来获取? 问题4:可以提供几个样本和对应的annotation文件吗或者有一个文档能解释一下每一个文件的意义和构建来源,以及每一个字段的意义?方便我们清晰地知道你的数据结构是什么样的。 ![image](https://private-user-images.githubusercontent.com/17424385/370219524-33f9a160-925b-4dd4-8cfa-cc7af0d3dc9e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzE5MTU4NDcsIm5iZiI6MTczMTkxNTU0NywicGF0aCI6Ii8xNzQyNDM4NS8zNzAyMTk1MjQtMzNmOWExNjAtOTI1Yi00ZGQ0LThjZmEtY2M3YWYwZDNkYzllLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDExMTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMTE4VDA3MzkwN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWVhNjk1OTdjNzA2N2M1NTBhMGI1YzIxOWY0NDAyODRiOTIwNjk5NDRiY2ZjNTYyNWM4YjQzZjE3ZjBlOGMwNGQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.dESerFXCN9jR_D_-Tkc1PGGnwcZx7w5EbPg7luXLhS4) 哈喽,你问题解决了吗,能分享一下你的数据集吗,我也遇到相同的问题