All MicroEvals
In the embedding layer of transformers why is the input embe...
Create MicroEval

In the embedding layer of transformers why is the input embe...

Prompt

In the embedding layer of transformers why is the input embedding is multiplied by sqrt(d_model) ? what is the significance of this operation?

Drag to resize
Drag to resize