Pham Van Ngoan

[ALBERT] How to know memory consumption on GPU/TPU of a model?

1

Hi all, With parameters such as batch size, max sequence length,... How to know the number of megabyte/gigabyte/.. of TPU/GPU need to train the model? Could you please give me...

[ALBERT] Pre-training on TPU Pod

1

Hi all, Could I do pre-training on TPU Pod v2-256 on large/xlarge V2 config (batch 4096, 3M steps,...)? Any config to working on it?

Processing book corpus

1

Hi team et al, I'd like to know how to process bookcorpus to pre-training. I am confusing to process this data. Should I treat 1 book as a document including...

[MEMORY] How to know memory consumption on GPU/TPU of a model?

1

Hi all, With parameters such as batch size, max sequence length,... How to know the number of megabyte/gigabyte/.. of TPU/GPU need to train the model? Thanks.

Which loss value I should stop pre-trainning?

1

Hi, I am confused how to know time to stop pre-training, please tell me? Because I see the loss value is not always decrease in the step that you stop.

Lexical or Preprocessor Issue (Xcode): 'TensorFlowLiteC.h' file not found

4

I have the error when running the project using this plugin? Any solution for this?

Process run on a single CPU core

2

I serve the model on CPU and I notice the process only run on a single CPU core (100%), how to config process run on multi core CPU?

Chromium not render and the error: Session closed. Most likely the page has been closed.

2

Hello, I don't see the chromium open when I start the code. The error is shown as below: ``` /Users/node_modules/puppeteer/lib/cjs/puppeteer/common/Connection.js:218 return Promise.reject(new Error(`Protocol error (${method}): Session closed. Most likely the...

Did you train with only RGB image?

1

Hi @SoftwareGift If you trained model with only RGB image, please provide me the results. Thanks for your contributions.