Kaarthik Sivashanmugam

icon indicating a website link https://www.linkedin.com/in/kaarthik

icon company VMware Tanzu

Results 58 comments of Kaarthik Sivashanmugam

updated url of download_glue_data.py

@kbjiang thanks for the PR. Looks like the old script is still available. What is the difference between these versions?

Bert Data for Pretraining: No such file or directory: 'bert_data/validation_512_only'

Thanks @nigaregr for reporting this. @jingyanwangms can you update the tar file mentioned in https://github.com/microsoft/AzureML-BERT/blob/master/docs/artifacts.md#preprocessed-data with the newly generated wikipedia dataset and the validation folder?

Bert Data for Pretraining: No such file or directory: 'bert_data/validation_512_only'

Hi @Howal, what @usuyama did is a reasonable workaround in the absence of some other validation set.

Preprocessed data are in the wrong path 512/wikipedia_pretrain.

@kaiidams thanks for reporting this issue. We will update the tar file soon. In the meantime, download and use the data referenced in https://github.com/microsoft/AzureML-BERT/blob/master/docs/artifacts.md#preprocessed-data and you will not need the...

Example's on a custom dataset

@xiaoyongzhu , @aribornstein are there any plans to address this open issue?

ds.upload causing AzureHttpError: Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature. ErrorCode: AuthenticationFailed

@Darek-S thanks for the suggestion on this. @xiaoyongzhu should we update the notebook based on the comments from @Darek-S ?

[Mobius 1.6.2] Invalid pickle opcode 0 on ToLocalIterator call

@Aaronontheweb `ToLocalIterator` and `Collect` implementations do not seem to share the code that could be shared (hence the difference in behavior). I do not know the reason for that. I...

[Mobius 1.6.2] Invalid pickle opcode 0 on ToLocalIterator call

@grozeille - seems like the root cause of both issues are the same. I do not have any additional info on this issue. Will update the issue after investigation.

Missing SparkFiles.get implementation?

@assafi Mobius does not have that API. It should be easy to add that if you really need it. Please share your scenario if you can. Also, consider contributing by...

Missing SparkFiles.get implementation?

Looks like it should be straightforward to add this to Mobius