WEKA News

WEKA pitches shared flash KV cache to reduce LLM inference recomputation

WEKA is pitching its Augmented Memory Grid, running on NeuralMesh storage software, as a way to reuse LLM context across GPU servers. The system captures KV cache and makes it available across a data...