Skip to content
The day in AI
Wed 28 Aug 2024
Wednesday 28 August 2024
←
→
No written reading for this day yet. Here is everything that was logged.
Everything from this day
Research
28 Aug 2024
DeepSeek
Auxiliary-loss-free load balancing for MoE
Balances MoE expert load with a per-expert routing bias updated from recent load, avoiding the interference gradients of an auxiliary loss.