> ## Documentation Index
> Fetch the complete documentation index at: https://docs.liquid.ai/llms.txt
> Use this file to discover all available pages before exploring further.
# d1-omni-600M
> 587M parameter multimodal decision model for text, images, and audio, built on LFM2.5-Encoder-350M
← Back to Decision Models
d1-omni-600M is a 587M parameter decision model built on [LFM2.5-Encoder-350M](/lfm/models/lfm25-encoder-350m) with a SigLIP2-based vision encoder and audio encoder jointly fine-tuned for single-pass decisions. It evaluates text with images or text with audio and returns typed answers with zero output tokens.
## Specifications
| Property | Value |
| - | - |
| Parameters | 587M (381M shared trunk + 94M vision encoder + 112M audio encoder) |
| Context Length | 16K tokens |
| Architecture | LFM2.5-Encoder (Bidirectional) — 350M backbone + SigLIP2 vision + FastConformer audio |
Text + images or text + audio (up to 30 s)
Answers read from the distribution, no generation
587M parameters for on-device deployment
## Quick Start
**Install:**
```bash theme={"theme":{"light":"github-light","dark":"github-dark"}}
pip install "transformers>=5.15" torch torchvision pillow soundfile
```
**Text input:**
```python theme={"theme":{"light":"github-light","dark":"github-dark"}}
from transformers import AutoModel
model_id = "LiquidAI/d1-omni-600M"
model = AutoModel.from_pretrained(model_id, trust_remote_code=True, dtype="float16", device_map="auto")
state = "I was charged twice this month, please refund one of them."
questions = {
"refund": {"type": "noul", "instructions": "Is the customer asking for a refund?"},
"team": {"type": "choice", "instructions": "Which team should handle this?",
"criteria": {"billing": "Charges, refunds, invoices", "technical": "App or site faults",
"fraud": "Suspected unauthorised use"}},
"urgency": {"type": "score", "instructions": "How urgent is this?",
"criteria": ["Can wait", "Today", "Blocking the customer now"]},
}
output = model.system_one(state, questions)
print(output)
```
**Image input:**
```python theme={"theme":{"light":"github-light","dark":"github-dark"}}
import io
import urllib.request
from PIL import Image
from transformers import AutoModel
model_id = "LiquidAI/d1-omni-600M"
model = AutoModel.from_pretrained(model_id, trust_remote_code=True, dtype="float16", device_map="auto")
url = "http://images.cocodataset.org/val2017/000000039769.jpg"
photo = Image.open(io.BytesIO(urllib.request.urlopen(url).read()))
questions = {"cats": {"type": "choice", "instructions": "How many cats are there?",
"criteria": {"one": "One", "two": "Two", "more": "Three or more"}}}
output = model.system_one(None, questions, images=[photo])
print(output)
```
**Audio input** (16 kHz mono, 0.5–30 s):
```python theme={"theme":{"light":"github-light","dark":"github-dark"}}
import soundfile as sf
from transformers import AutoModel
model_id = "LiquidAI/d1-omni-600M"
model = AutoModel.from_pretrained(model_id, trust_remote_code=True, dtype="float16", device_map="auto")
wave, rate = sf.read("command.wav", dtype="int16")
assert rate == 16000
questions = {"kind": {"type": "choice", "instructions": "What kind of utterance is this?",
"criteria": {"request": "A request to do something",
"question": "A question asking for information",
"conversation": "Small talk or a greeting"}}}
output = model.system_one(None, questions, audio=wave)
print(output)
```
**Start the server:**
```bash theme={"theme":{"light":"github-light","dark":"github-dark"}}
llama-server -hf LiquidAI/d1-omni-600M-GGUF:Q8_0 -b 4096 -ub 4096
```
**Text input:**
```bash theme={"theme":{"light":"github-light","dark":"github-dark"}}
curl http://127.0.0.1:8080/v1/systemone -H "Content-Type: application/json" -d '{
"state": "I was charged twice this month, please refund one of them.",
"questions": {
"refund": {"type": "noul", "instructions": "Is the customer asking for a refund?"},
"team": {"type": "choice", "instructions": "Which team should handle this?",
"criteria": {"billing": "Charges, refunds, invoices", "technical": "App or site faults",
"fraud": "Suspected unauthorised use"}},
"urgency": {"type": "score", "instructions": "How urgent is this?",
"criteria": ["Can wait", "Today", "Blocking the customer now"]}
}
}'
```
**Image input:**
```bash theme={"theme":{"light":"github-light","dark":"github-dark"}}
curl -sL -o cats.jpg http://images.cocodataset.org/val2017/000000039769.jpg
curl http://127.0.0.1:8080/v1/systemone -H "Content-Type: application/json" -d @- <
This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.