Popular repositories Loading

1. Prism-Infer Prism-Infer Public

   Compression-aware Qwen3-VL inference engine with torch.compile, CUDA Graph, scaled-FP8 KV, visual compaction, and multimodal prefix caching.

   Python 1

2. My_single_RPC My_single_RPC Public

   Makefile

3. llaisys llaisys Public

   Forked from InfiniTensor/llaisys

   基于C++/CUDA实现LLAISYS（大模型轻量化异构推理引擎）

   Python

4. InfiniLM InfiniLM Public

   Forked from InfiniTensor/InfiniLM

   spring competition for InfiniTensor

   C++

5. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

6. obsitian-sync obsitian-sync Public

   学习知识库

   PowerShell