LLM (Large Language Model)

The neural networks behind ChatGPT, Llama, Mistral, and other AI chatbots. LLMs are measured by parameter count (7B, 70B, 405B) which directly correlates with how much VRAM you need to run them. Choosing AI hardware is largely about figuring out which LLMs you want to run and buying enough VRAM to fit them.

Related Articles

More Terms