community icon indicating copy to clipboard operation
community copied to clipboard

Added DynamicEmbedding RFC

Open divyashreepathihalli opened this issue 2 years ago • 1 comments

Added DynamicEmbedding RFC

divyashreepathihalli avatar May 16 '23 22:05 divyashreepathihalli

Dynamic embedding is a very important feature for us.

When training the sorting model that supports scenarios such as search, recommendation, and advertisement, we encountered the following problems:

  1. For the feature selection of the sorting model in the e-commerce search and promotion scenario, the current industry mostly adopts the idea of large-scale discrete IDs. ID features (product IDs, user IDs, brand IDs, etc.) are large and sparse, and the native TF framework is not applicable.
  2. The TensorFlow variable has a fixed size and cannot dynamically increase the ID without restarting training.

With this feature, the main reasons:

  1. Support dynamic scale-out of dynamic embedding features at the TB level.

Mr-Nineteen avatar Jun 05 '23 05:06 Mr-Nineteen