Home
Trending
Shorts
Developers
Insights
Stats
Trending
/ tags
inference
GitHub Trending repositories tagged with inference.
1
kvcache-ai/ktransformers
KTransformers is a Python framework for experimenting with efficient large language model inference and fine-tuning across CPU and GPU resources. It focuses on heterogeneous computing, letting researchers and engineers test optimization strategies for serving and adapting LLMs with different hardware layouts. The project targets practical inference, supervised fine-tuning, and future performance work for large models.
Back to trending
·
View stats