HumanML3D icon indicating copy to clipboard operation
HumanML3D copied to clipboard

Difference on texts between w/ and w/o mirroring?

Open LinghaoChan opened this issue 2 years ago • 7 comments

Hi, @EricGuo5513 I have a question here.

How to get the M*.txt from *.txt?

In KIL-ML, for A person turns around left on their right foot#A/DET person/NOUN turn/VERB around/ADV left/VERB on/ADP their/DET right/ADJ foot/NOUN#0.0#0.0 in M00471.txt and A person turns around right on their left foot#A/DET person/NOUN turn/VERB around/ADP right/ADV on/ADP their/DET left/ADJ foot/NOUN#0.0#0.0 in 00471.txt, the 'around', 'left' and 'right' part-of-speech tags are different.

- A person turns around right on their left foot#A/DET person/NOUN turn/VERB around/ADP right/ADV on/ADP their/DET left/ADJ foot/NOUN#0.0#0.0
?                            --------------                                           ^^^^^^  --                   ^^^

+ A person turns around left on their right foot#A/DET person/NOUN turn/VERB around/ADV left/VERB on/ADP their/DET right/ADJ foot/NOUN#0.0#0.0
?                       ++++++++++++++                                                ^^^^^   +++                  ^^^^

LinghaoChan avatar Aug 01 '23 02:08 LinghaoChan

Hi, we have a predefined “mirror” dictionary, for example left->right, clockwise->counterclockwise, e.g.

On Mon, Jul 31, 2023 at 8:23 PM Ling-Hao CHEN @.***> wrote:

Hi, @EricGuo5513 https://github.com/EricGuo5513 I have a question here.

How to get the M*.txt from *.txt?

In KIL-ML, for A person turns around left on their right foot#A/DET person/NOUN turn/VERB around/ADV left/VERB on/ADP their/DET right/ADJ foot/NOUN#0.0#0.0 in M00471.txt and A person turns around right on their left foot#A/DET person/NOUN turn/VERB around/ADP right/ADV on/ADP their/DET left/ADJ foot/NOUN#0.0#0.0 in 00471.txt, the 'around', 'left' and 'right' part-of-speech tags are different.

  • A person turns around right on their left foot#A/DET person/NOUN turn/VERB around/ADP right/ADV on/ADP their/DET left/ADJ foot/NOUN#0.0#0.0 ? -------------- ^^^^^^ -- ^^^
  • A person turns around left on their right foot#A/DET person/NOUN turn/VERB around/ADV left/VERB on/ADP their/DET right/ADJ foot/NOUN#0.0#0.0 ? ++++++++++++++ ^^^^^ +++ ^^^^

— Reply to this email directly, view it on GitHub https://github.com/EricGuo5513/HumanML3D/issues/77, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNBZM5O6ZCZ7CANZTWK3XTBSCXANCNFSM6AAAAAA27CI3EQ . You are receiving this because you were mentioned.Message ID: @.***>

EricGuo5513 avatar Aug 01 '23 04:08 EricGuo5513

@EricGuo5513 However, why it will affect part-of-speech tags annotation?

around/ADP right/ADV
around/ADV left/VERB

LinghaoChan avatar Aug 01 '23 04:08 LinghaoChan

We replaced the words first, and then applied PoS tagging libraries. I guess here it detects "left" as a verb (i.e., leave).

Ling-Hao CHEN @.***> 于2023年7月31日周一 22:59写道:

@EricGuo5513 https://github.com/EricGuo5513 However, why it will affect part-of-speech tags annotation?

around/ADP right/ADV around/ADV left/VERB

— Reply to this email directly, view it on GitHub https://github.com/EricGuo5513/HumanML3D/issues/77#issuecomment-1659568869, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNB276A56ZPVCHBFHV33XTCEKZANCNFSM6AAAAAA27CI3EQ . You are receiving this because you were mentioned.Message ID: @.***>

EricGuo5513 avatar Aug 02 '23 05:08 EricGuo5513

We replaced the words first, and then applied PoS tagging libraries. I guess here it detects "left" as a verb (i.e., leave). Ling-Hao CHEN @.> 于2023年7月31日周一 22:59写道: @EricGuo5513 https://github.com/EricGuo5513 However, why it will affect part-of-speech tags annotation? around/ADP right/ADV around/ADV left/VERB — Reply to this email directly, view it on GitHub <#77 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNB276A56ZPVCHBFHV33XTCEKZANCNFSM6AAAAAA27CI3EQ . You are receiving this because you were mentioned.Message ID: @.>

And what makes 'around' ADP and ADV?

LinghaoChan avatar Aug 02 '23 05:08 LinghaoChan

Moreover, does this be implemented by nltk?

LinghaoChan avatar Aug 02 '23 12:08 LinghaoChan

You can refer to the RawTextDataset. https://github.com/EricGuo5513/text-to-motion/blob/main/data/dataset.py

On Wed, Aug 2, 2023 at 6:46 AM Ling-Hao CHEN @.***> wrote:

Moreover, does this be implemented by nltk?

— Reply to this email directly, view it on GitHub https://github.com/EricGuo5513/HumanML3D/issues/77#issuecomment-1662146796, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNB5BIOIXISZ3A7DHYNLXTJDZNANCNFSM6AAAAAA27CI3EQ . You are receiving this because you were mentioned.Message ID: @.***>

EricGuo5513 avatar Aug 02 '23 13:08 EricGuo5513

Hi, we have a predefined “mirror” dictionary, for example left->right, clockwise->counterclockwise, e.g. On Mon, Jul 31, 2023 at 8:23 PM Ling-Hao CHEN @.> wrote: Hi, @EricGuo5513 https://github.com/EricGuo5513 I have a question here. How to get the M.txt from .txt? In KIL-ML, for A person turns around left on their right foot#A/DET person/NOUN turn/VERB around/ADV left/VERB on/ADP their/DET right/ADJ foot/NOUN#0.0#0.0 in M00471.txt and A person turns around right on their left foot#A/DET person/NOUN turn/VERB around/ADP right/ADV on/ADP their/DET left/ADJ foot/NOUN#0.0#0.0 in 00471.txt, the 'around', 'left' and 'right' part-of-speech tags are different. - A person turns around right on their left foot#A/DET person/NOUN turn/VERB around/ADP right/ADV on/ADP their/DET left/ADJ foot/NOUN#0.0#0.0 ? -------------- ^^^^^^ -- ^^^ + A person turns around left on their right foot#A/DET person/NOUN turn/VERB around/ADV left/VERB on/ADP their/DET right/ADJ foot/NOUN#0.0#0.0 ? ++++++++++++++ ^^^^^ +++ ^^^^ — Reply to this email directly, view it on GitHub <#77>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNBZM5O6ZCZ7CANZTWK3XTBSCXANCNFSM6AAAAAA27CI3EQ . You are receiving this because you were mentioned.Message ID: @.>

Hi, thanks for the clarification. I am wondering if it would be possible to share this dictionary or the processing code for the text part with respect to the mirroring. Thank you very much!

Coral79 avatar Jan 06 '24 15:01 Coral79