Specifications
Multimodal
Text + images or text + audio (up to 30 s)
Zero Output Tokens
Answers read from the distribution, no generation
Edge-Sized
587M parameters for on-device deployment
Quick Start
- Transformers
- llama.cpp
Install:Text input:Image input:Audio input (16 kHz mono, 0.5–30 s):
Other Formats
- MLX: d1-omni-600M-MLX-8bit and d1-omni-600M-MLX-fp16 run on Apple Silicon with mlx-vlm, including image and audio input. They require mlx-vlm 0.7.8 or later, installed with
pip install -U "mlx-vlm>=0.7.8". See the model cards for Python, CLI, and server usage.