# OpenMOSS-Team/MOSS-VoiceGenerator — vLLM serving recipe

> OpenMOSS's 1.7B zero-shot voice-design model — generate diverse voices and styles directly from a text prompt with no reference speech — served via vLLM-Omni through the OpenAI /v1/audio/speech API (24 kHz mono).

Configuration: hardware `h200` (8× H200) · variant `default` (BF16) · task `t2a`

- Interactive page: https://vllm-recipes-cimvhk5sf-inferact-inc.vercel.app/OpenMOSS-Team/MOSS-VoiceGenerator
- This configuration as JSON: https://vllm-recipes-cimvhk5sf-inferact-inc.vercel.app/OpenMOSS-Team/MOSS-VoiceGenerator.json?hardware=h200

The commands below were rendered for exactly this configuration and take precedence over any example in the guide.

## Other configurations

Change the query string (the same parameters as the page URL) and fetch this URL again. Unknown or incompatible values fall back to the recipe default, so check the Configuration line.

- `hardware`: `h100`, `h200`, `b200`, `gb200`, `b300`, `gb300`, `mi300x`, `mi325x`, `mi350x`, `mi355x`
- `variant`: `default`
- `task`: `t2a`

## Install

Requires vLLM >= 0.22.0.

```bash
uv venv
source .venv/bin/activate
uv pip install -U vllm --torch-backend auto
```

Extra dependencies:

- vLLM-Omni provides the TTS serving backend and the `--omni` serve path. See the installation guide for pre-built wheels or building from source.

```bash
uv pip install git+https://github.com/vllm-project/vllm-omni.git
```

## Serve

vLLM-Omni recipe — the generation endpoints and request examples are in the guide below.

```bash
vllm serve OpenMOSS-Team/MOSS-VoiceGenerator \
  --deploy-config vllm_omni/deploy/moss_voice_generator.yaml \
  --omni
```

## Guide

> Background reference. Commands in it are examples and may target another configuration — use the Serve section above.

### Overview

[MOSS-VoiceGenerator](https://huggingface.co/OpenMOSS-Team/MOSS-VoiceGenerator)
is the **voice-design** member of OpenMOSS's MOSS-TTS Family, served through
**vLLM-Omni** with the OpenAI-compatible `/v1/audio/speech` API. It generates
diverse voices and styles **directly from a text prompt, with no reference
speech**, unifying voice design, style control, and synthesis. It can run
standalone or as a design layer that produces a voice for the downstream TTS
members of the family. Output is **24 kHz mono**.

### Prerequisites

- **Hardware**: a single CUDA GPU. ~6 GB for the 1.7B talker + ~8 GB for the
  codec decoder (comparable to MOSS-TTS-Realtime).
- **vLLM-Omni** targeting vLLM >= 0.22.

### Installation

```bash
uv venv && source .venv/bin/activate
uv pip install git+https://github.com/vllm-project/vllm-omni.git
```

### Launch the server

MOSS-VoiceGenerator shares `model_type=moss_tts_delay`, so pass its deploy
config explicitly:

```bash
vllm serve OpenMOSS-Team/MOSS-VoiceGenerator --omni \
  --deploy-config vllm_omni/deploy/moss_voice_generator.yaml --port 8000
```

### Client usage

```bash
curl -X POST http://localhost:8000/v1/audio/speech \
  -H "Content-Type: application/json" \
  -d '{
    "model": "OpenMOSS-Team/MOSS-VoiceGenerator",
    "input": "Hello, this voice was designed entirely from a text prompt.",
    "instructions": "A warm, friendly young female voice with a calm pace.",
    "response_format": "wav"
  }' --output designed.wav
```

### Known limitations

- Output is **24 kHz mono**.
- No reference speech is used — voice identity comes from the text prompt /
  `instructions`. The exact prompt schema follows the upstream model card.

### References

- [Model card](https://huggingface.co/OpenMOSS-Team/MOSS-VoiceGenerator)
- [MOSS-TTS Family](https://huggingface.co/OpenMOSS-Team/MOSS-TTS) · [GitHub](https://github.com/OpenMOSS/MOSS-TTS)