VRAM

Definition of VRAM

1. : the memory built into a GPU; how much a model needs largely decides which graphics card can run it

   • A 24 GB card has enough VRAM for a quantized 30B model.
   • Out of VRAM again, so I switched to a smaller model.