All MicroEvals
Architecture Mixture-of-Experts (MoE) Total / active paramet...
Create MicroEval

Architecture Mixture-of-Experts (MoE) Total / active paramet...

Prompt

Architecture Mixture-of-Experts (MoE) Total / active parameters 37B / 3B Context length 1,048,576 tokens Modalities Text and image and video and audio Layers / dense layers 3 / 1 Attention layers 2 KDA + 1 Gated DSA Attention hidden dimension 194 Attention heads 3 DSA index head dimension 3 DSA index heads / top-K 32 / 2,048 Latent MoE dimension 3,584 Expert hidden dimension 3,072 Routed / shared experts 24 / 2 Selected experts per token 2 Vocabulary 160K Activation SiTU-GLU Vision encoder MoonViT-V2 · 401M parameters Quantization MXFP4 weights / MXFP8 activations Convert the attached technical description, file, or Repomix export into a build prompt. Return only that prompt, not the implementation. Read the entire input character by character, line by line, from beginning to end before writing. Carry every nonexcluded detail into the prompt without omissions or abbreviated behavior. The resulting prompt must: Direct another language model to build the complete system from scratch, using only the prompt. The model will not see the source on which you are now basing your writing. Fully specify all functionality, architecture. Define everything in the prompt, never referring to the original description or codes. Identify every necessary file and its required contents and behavior. Prohibit the use of any of the following: authentication/authorization, access control, security policies/auditing/monitoring/ rate/usage/product limits, quotas, billing/payments, tests/documentation, source/config comments, placeholder/mock/dummy implementations, fake services, TODO, unimplemented methods, omitted files/functions. Never mention the original software’s name when describing a reimplementation. Replace name-bearing identifiers with neutral descriptive identifiers

Drag to resize

Response not available

Drag to resize
Drag to resize
Drag to resize
Drag to resize