DOM-LM - Pytorch (wip)

Unofficial implementation of Dom-LM paper.

Masked LM Training

1. Download SWDE
   • Or: Download from torrent SWDE
2. Run preprocess_swde.py for features extraction
3. Run either train.py or train_mlm notebook

TODO

• [ ] Add Fine-tuning code for Attribute Extraction
• [ ] Add Fine-tuning code for Open Information Extraction
• [ ] Add Fine-tuning code for QA
• [ ] Train some models and compare results