Skip to content
Subscribe
The Day in AI
Thu 11 Jan 2024
Thursday 11 January 2024
←
→
No written reading for this day yet. Here is everything that was logged.
Everything from this day
Research
11 Jan 2024
DeepSeek
DeepSeekMoE
DeepSeekMoE uses fine-grained expert segmentation plus always-on shared experts, the MoE design that V2, V3, R1 and V4 all inherit.