Phi
Phi-3 Medium 14B
Total params
14B
Active params
14B
Layers
40
Hidden size
5120
Attention heads
40
KV heads (GQA)
10
Vocab size
32,064
Native context window
131,072
Native precision
BF16
Size this model
Opens the sizing calculator pre-filled with this model at BF16 weights / FP16 KV cache and a typical workload — sign in to run it and see GPU/cloud recommendations.
Size this model →