> ## Documentation Index
> Fetch the complete documentation index at: https://docs.liquid.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Baseten

> Baseten is an AI infrastructure platform for deploying and serving ML models with optimized inference, autoscaling, and multi-cloud support.

<Tip>
  Use Baseten for production ML model deployments with optimized inference, autoscaling, and multi-cloud support.
</Tip>

## Clone the repository[​](#clone-the-repository "Direct link to Clone the repository")

```
git clone https://github.com/Liquid4All/lfm-inference
```

## Deployment[​](#deployment "Direct link to Deployment")

The deployment script is based on Baseten's [documentation](https://docs.baseten.co/examples/vllm) of `Run any LLM with vLLM`.

Launch command:

```
cd bastenpip install trusstruss push lfm2-8b --publish
```

## Test call[​](#test-call "Direct link to Test call")

```bash theme={"theme":{"light":"github-light","dark":"github-dark"}}
curl -X POST https://<model-id>.api.baseten.co/environments/production/predict \
  -H "Authorization: Api-Key $BASETEN_API_KEY" \
  -d '{
    "model": "LiquidAI/LFM2-8B-A1B",
    "messages": [
      {
        "role": "user",
        "content": "What is the melting temperature of silver?"
      }
    ],
    "max_tokens": 32,
    "temperature": 0
  }'
```

<Note>
  Baseten endpoints expect the `Api-Key` prefix in the `Authorization` header.
</Note>