DEPLOY

Open-weight LLM comparison

Command R+ vs Mixtral 8x7B

Side-by-side

Straight from each model's release page and Hugging Face card. Memory shown is for the weights alone: add roughly 15% for real serving. Bold column marks the more parameters and the smaller memory footprint.

FieldCommand R+Mixtral 8x7B
Total parameters104 B46.7 B
Active parameters (MoE)—12.9 B
ArchitecturedenseMoE (46.7B total, 12.9B active per token)
VendorCohereMistral AI
LicenseCC-BY-NC-4.0 (non-commercial)Apache 2.0
Released2024-04-042023-12-11
Weights @ FP16208 GB93 GB
Weights @ INT8104 GB47 GB
Weights @ INT452 GB23 GB

Which is smarter (published benchmarks)

Vendor-reported quality scores on the standard leaderboards. Bold column marks the higher score on the same test.

BenchmarkCommand R+Mixtral 8x7B
MMLU (5-shot)75.770.6
HumanEval70.740.2
MATH (maj@4)not published28.4

Sources: Command R+ model card · Mixtral 8x7B model card. Benchmark methodology and prompt template can shift these numbers by several points, so treat these as relative rankings, not absolute scores.

Common questions

Command R+ vs Mixtral 8x7B: which is bigger?

Command R+ has more parameters (Command R+: 104 B; Mixtral 8x7B: 46.7 B). More parameters usually means higher ceiling on capability and higher memory requirement, though MoE architectures decouple total parameters from per-token compute.

Command R+ vs Mixtral 8x7B: which is newer?

Command R+ released 2024-04-04; Mixtral 8x7B released 2023-12-11.

Command R+ vs Mixtral 8x7B: which needs less memory to serve?

Mixtral 8x7B needs less HBM. Weights-only footprint at FP16: Command R+ 208 GB; Mixtral 8x7B 93 GB. Half those numbers at INT8, quarter at INT4. Real serving adds 10-30% for KV cache.

Command R+ vs Mixtral 8x7B: which license is more permissive?

Command R+: CC-BY-NC-4.0 (non-commercial). Mixtral 8x7B: Apache 2.0. Apache 2.0 and MIT allow unrestricted commercial use; Llama Community License allows commercial use but restricts training larger models on outputs; CC-BY-NC and vendor-specific licenses (Qwen 72B, Gemma) have narrower terms. Check the model card for the exact clauses.

See also: every LLM comparison · Command R+ full page · Mixtral 8x7B full page.