ἵστωρ Download

What does 7B mean in a model name?

Seven billion parameters. The letter is just shorthand for billions, and the count is the single most useful number for telling whether a model will run on your machine.

7B means seven billion parameters, the learned numbers that carry everything a model knows. More parameters generally means more capability, and always means more memory, so the count is the number to check before downloading anything. A 7B to 8B model quantized to 4 bits fits in about 5 gigabytes, which is why that range runs comfortably on ordinary laptops and has become the practical sweet spot for local work.

Parameters are the learned numbers.

A model is not a file of rules, it is a file of parameters: billions of weights, each adjusted during training until the network's predictions fit the text it studied. Nothing about the model is stored anywhere else. When you download a 7B model you are downloading those seven billion numbers, and running the model is nothing more than multiplying through them. This is also why two models with the same count can behave differently: the parameter count says how big the memory is, never what was written into it.

The count sets the size.

Each parameter is a stored number, so seven billion parameters take seven billion numbers of space, compressed by quantization from their full 16-bit form down to 4 bits or less. The arithmetic is direct: a 7B model at 4 bits lands near 5 gigabytes, a 13B model near 10. That makes the count the practical gate for how much memory your machine needs, which is why hardware guides read like parameter guides.

Bigger is not automatically better.

A 70B model outperforms a 7B one on hard reasoning, but only if your hardware can actually hold it. A model too large for the memory either swaps to disk and crawls, or gets squeezed into a quantization so low that the quality advantage disappears. The honest way to choose is to start from what fits, then take the largest model that runs comfortably, since a smaller model answering quickly beats a larger one unusable slowly. For most consumer machines that lands in the 7B to 8B range, which is exactly where local research tools aim.