Gemma
Gemma 2 27B
Total params
27.2B
Active params
27.2B
Layers
46
Hidden size
4608
Attention heads
32
KV heads (GQA)
16
Vocab size
256,128
Native context window
8,192
Native precision
BF16
Size this model
Opens the sizing calculator pre-filled with this model at BF16 weights / FP16 KV cache and a typical workload — sign in to run it and see GPU/cloud recommendations.
Size this model →