Skip to content
worth noting New models

Granite-Switch-4.1-8B and Granite-Switch-4.1-30B combine chat, decision-making and speech transcription

clearly official source

Granite-Switch-4.1-8B and Granite-Switch-4.1-30B have been released with adapters for decision-making tasks and integrated speech transcription. According to the authors, they require approximately the same GPU memory capacity as the base model alone.

The released models Granite-Switch-4.1-8B and Granite-Switch-4.1-30B include a preconfigured set of adapters and combine chat, decision-making tasks and speech transcription through a single access point. The Decision aLoRA adapter handles general decision-making tasks, while the Guardian aLoRA adapter handles safety decisions. Speech transcription is provided by the integrated Granite-Speech-5.0-Turbo-CTC model.

According to the authors, the full setup uses approximately as much VRAM as the base model alone. The adapters use Activated LoRA technology, which the authors say allows the KV cache created during generation by the base model to be reused for subsequent decisions. Users can also assemble their own variant by selecting adapters from Granite Libraries.

What changed

Why it matters

Developers of voice and text applications can combine transcription, responses and content checks in a single setup. If the claimed memory requirements are confirmed in their own operations, adding these features may not require GPU capacity equivalent to several separate models.

Two audiences, two different impacts

What this means

01

For individuals

When prototyping, developers can assemble their own combination of adapters to suit specific classification and language tasks.

What to do For your prototype, select adapters from Granite Libraries that match the required tasks.
More practical updates →
02

For a business

For companies running speech transcription and subsequent text processing, a combined deployment may change infrastructure requirements; the reported memory savings remain a claim by the authors.

Development
What to decide Verify VRAM usage and the speed of the full setup on a representative business workload before deciding whether to deploy it.
More business impacts →
aLoRA Granite Libraries Granite-Speech-5.0-Turbo-CTC Granite Switch 4.1 vLLM

Check the original

Event sources

clearly official source · 1 publisher, 0 independent. We count feeds from the same owner only once.

1
Hugging Face Blog primary source · first detected Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint