Generate KIE Output Json from Any LayoutLM Variant

[purnasai-cyient]

Hi @NielsRogge,

I am trying to convert the key, Value information that is generated from Any layoutLM variant into a JSON File. Need little help in doing that. Any Idea or way to convert to JSON.

Current output Format:

Required Format: Map Question--->Answer: { "Fax":"614-466-5087", "TO":"George Baroody", "PHONE NUMBER":"(336) 335-7363", "DATE":"12/10/98", "NUMBER OF PAGES INCLUDING COVER SHEET:":"3" }

If the above looks easy, I have a complex layout format like the below, then How do we do, key-value mapping better and efficiently?

Thank you So much.

[jyotiyadav94]

@purnasai-cyient Did you find an answer to get the KIE Output for the complex layout ?

[purnasai-cyient]

Not by following the above way of annotation. I changed the way I annotate. I need only a set of labels from the document.

Currently, I annotated the required text for these classes and all other text as "others" labels.

After Inference, I am doing post-processing to get those labels' text only. But I still want to know, How others approaching this with the Above annotation

[jyotiyadav94]

@purnasai-cyient

Yeah I agree with few set of labels its easy to get extract the values.I haven't find a good approach for question & answer

[NielsRogge]

Hi,

I've uploaded some notebooks illustrating how to fine-tune LayoutLMv2/LayoutXLM for relation extraction here: https://github.com/NielsRogge/Transformers-Tutorials/tree/master/LayoutXLM

[imrankh46]

Hi,

I've uploaded some notebooks illustrating how to fine-tune LayoutLMv2/LayoutXLM for relation extraction here: https://github.com/NielsRogge/Transformers-Tutorials/tree/master/LayoutXLM

hey NielsRogge, i want to get output in json formate. how i can do this? your example will be appreciated. thanks