L
llm-inference

Any
Blade
C
C#
C++
CMake
CSS
Dockerfile
Go
HCL
HTML
Java
JavaScript
Jupyter Notebook
Kotlin
Makefile
Objective-C
PHP
Python
Ruby
SCSS
Shell
Swift
TSX
TypeScript
Vue

Projects with this topic

Sort by:

Sort by
Updated date
Name
Name, descending
Oldest updated
Oldest created
Last created
Most stars
Hide archived projects
Show archived projects
Show archived projects only

View KVortex project

Ayi NEDJIMI / KVortex

VRAM to RAM Offloader for AI and vLLM - High-Performance C++23 KV Cache Engine with Multi-Stream GPU Transfers

https://ayinedjimi-consultants.fr

AI cpp23 cuda GPU-computing high-perform... kv-cache llm-inference machine-lear... vllm vram-offload cpp deep-learning gpu inference nvidia vRAM

0

Updated May 22, 2026

0 0 0 0

Updated May 22, 2026