The day in AI
No written reading for this day yet. Here is everything that was logged.
Everything from this day
Research
8 Jan 2024Mistral AIMixtral of Experts (paper) Documents Mixtral 8x7B: a sparse MoE with 47B total and 13B active parameters that matches or beats Llama 2 70B and GPT-3.5.8 Jan 2024Mistral AIMixtral of Experts (paper) The Mixtral paper documents the 8-expert top-2 sparse MoE: 47B total, 13B active parameters, 32K context, and claims parity with Llama 2 70B and GPT-3.5.