Search results

Dynamic Memory Management incurs error when running 4 instances on 2 * A100 GPUs

Status: Open.

#221 In ovg-project/kvcached;

· Ltryxcy opened on Dec 2, 2025

Hybrid models with more than one KV cache type are not supported yet

Status: Open.

#215 In ovg-project/kvcached;

· alecngo opened on Nov 13, 2025

Using nvfp4 + kvcached + sglang results in a type mismatch error

Status: Open.

#214 In ovg-project/kvcached;

· jiahe7ay opened on Nov 10, 2025

Running Llama3.1 + Llama3.3 70bs on 8 x A100s

Status: Open.

#210 In ovg-project/kvcached;

· Nujjy opened on Nov 5, 2025

Using kvcached + sglang + qwen-fp8 directly causes an out-of-bounds error. [bug]

bugSomething isn't workingSomething isn't working

Status: Open.

#203 In ovg-project/kvcached;

· jiahe7ay opened on Oct 30, 2025

[RFC] Support multiple attention types

enhancementNew feature or requestNew feature or request

Status: Open.

#202 In ovg-project/kvcached;

· ivanium opened on Oct 29, 2025

Output is corrupted after around 2000 tokens

bugSomething isn't workingSomething isn't working

Status: Open.

#201 In ovg-project/kvcached;

· cduk opened on Oct 29, 2025

Two Qwen3-32B-FP8 instances on an H20 96G GPU using vLLM fails to process requests

questionFurther information is requestedFurther information is requested

Status: Open.

#200 In ovg-project/kvcached;

· shpgy-shpgy opened on Oct 29, 2025

[FEAT] Any plans to support TensortRT-LLM?

enhancementNew feature or requestNew feature or request

Status: Open.

#199 In ovg-project/kvcached;

· troycheng opened on Oct 29, 2025

KVCached support for gpt-oss-20b attention type not supported in SGLang

enhancementNew feature or requestNew feature or request

Status: Open.

#198 In ovg-project/kvcached;

· deepak-vij opened on Oct 28, 2025

ValueError: Cannot get 31 free blocks from the pool

bugSomething isn't workingSomething isn't working

Status: Open.

#197 In ovg-project/kvcached;

· alecngo opened on Oct 27, 2025

Questions about the Baseline in Prism

questionFurther information is requestedFurther information is requested

Status: Open.

#195 In ovg-project/kvcached;

· Skeleton-L opened on Oct 27, 2025