Subscribe

Phi-4-Mini and Phi-4-Multimodal

3.8B Phi-4-Mini with 200K vocabulary, and Phi-4-Multimodal handling text, vision and speech through Mixture-of-LoRAs.

Modality-specific LoRA adapters and routers let one backbone take vision, audio and text without interference; its 460M-parameter audio adapter ranked first on the OpenASR leaderboard per the report.

Date
Monday 3 March 2025
Lab
Microsoft
Kind
open-weights
Access
open weights

Figures

MeasureValueMeasured by
OpenASR leaderboardrank 1
460M-parameter audio LoRA; per technical report
company

Dated by the first arXiv version of the technical report, submitted on 2025-03-03.

Sources

  1. arxiv.org/abs/2503.01743

This record was checked against its sources on 6 October 2026. How we check

Related