rajicon
rajicon
Hi, Is there any intuition as to why fixing the K-shot number has an impact? Is there any strategies to mitigate this and make it more robust to different context...
I've looked deeper into the problem, and it seems it is because getattr() returns an error which then makes the property tag not work correctly. Here is the error when...
So I think this is solved by changing line 193 in bertram.py to: if form_and_context and not isinstance(self.transformer.embeddings.word_embeddings, OverwriteableEmbedding): By switching the conditions, self.transformer is not called if form_and_context is...
@timoschick Thanks! Also another quick question: When running the form-only section, it seems to take quite long (for comparison, I believe training the context was roughly 3.5 hours per epoch...