Mixtral 8x7B

Mistral AI · · 75 days after Mistral 7B

Partially verified

2 of 3 published values traced to a source2 primary sources, 2 archived

Why this status

Cited to the lab's own announcement. Not verified because the context window and the parameter count could not be found in any cited primary source — the value may be correct, but this dataset cannot yet show where it came from. Modalities recorded as text-to-text. No image, audio or video capability appears anywhere in the primary sources, which labs advertise prominently when present.

What these states mean · How records are judged · Has this record changed?

The first open mixture-of-experts model to rival much larger dense models.

codingopen-weights

Details

ReleasedDecember 11, 2023
stated in mistral.ai, mistral.ai

Mixtral 8x7B was released on December 11, 2023.

CompanyMistral AI
FamilyMixtral
EraThe assistant boom
TypeLanguage model · LLM
ModalitiesText → Text
CapabilitiesCoding
WeightsOpen weights
LicenceApache-2.0
Context window33K tokens
stated in mistral.ai, mistral.ai

Mixtral 8x7B supports a context window of 32,768 tokens.

Parameters47B

Current information, elsewhere

This record is a historical one: every figure above is traced to a dated primary source. For what is true today — live pricing, current rankings, availability — these are better maintained than anything here could be.

Sources

Record status: partly verified · confidence 75/100 · 2 of 2 primary

Cited to the lab's own announcement. Not verified because the context window and the parameter count could not be found in any cited primary source — the value may be correct, but this dataset cannot yet show where it came from. Modalities recorded as text-to-text. No image, audio or video capability appears anywhere in the primary sources, which labs advertise prominently when present.

Primary means published by the organisation that made the model. Verified records require at least one.

Mixtral family

  1. Mixtral 8x7B December 11, 2023

Browse models

Compare Mixtral 8x7B with another model →
See Mixtral 8x7B on the interactive timeline →