Search results

Feature Request: Add grammar support (BNF/xgrammar) to vLLM backend

enhancementNew feature or requestNew feature or request

roadmap

Status: Open.

#6857 In mudler/LocalAI;

· localai-bot opened on Oct 28, 2025

cache corruption in mlx backend

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6747 In mudler/LocalAI;

· blightbow opened on Oct 25, 2025

mlx backend's seeds are not thread safe

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6734 In mudler/LocalAI;

· blightbow opened on Oct 24, 2025

Reranker ignores top_n

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6700 In mudler/LocalAI;

· mkhludnev opened on Oct 23, 2025

Certain model defaults globally align to llama.cpp backend

bugSomething isn't workingSomething isn't working

confirmed

roadmap

Status: Open.

#6632 In mudler/LocalAI;

· blightbow opened on Oct 21, 2025

Let me sort the model gallery results by model size

enhancementNew feature or requestNew feature or request

Status: Open.

#6456 In mudler/LocalAI;

· spotlesscoder opened on Oct 15, 2025

The chat keeps repeating the word 'pered' endlessly

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6453 In mudler/LocalAI;

· VINDICATORs64 opened on Oct 14, 2025

Error loading certain models with "no triggers set for lazy grammar"

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6441 In mudler/LocalAI;

· johndev168 opened on Oct 13, 2025

Response mangled when using tool calls with specific models like gpt-oss-20b

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6412 In mudler/LocalAI;

· johndev168 opened on Oct 9, 2025

Add support for AMD Ryzen Strix Point Halo and Strix Halo APU's

enhancementNew feature or requestNew feature or request

Status: Open.

#6369 In mudler/LocalAI;

· CleverLittleMaker opened on Oct 1, 2025

install.sh failing when trying to install CUDA drivers. (ubuntu 25)

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6364 In mudler/LocalAI;

· JackBekket opened on Sep 30, 2025

LocalAI requires AVX2 on CPU — rpc error on older CPUs

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#6348 In mudler/LocalAI;

· dennisvanderpool opened on Sep 26, 2025