Pinned Loading

1. sohu-mptc/FlashRec sohu-mptc/FlashRec Public

   FlashRec is a CUDA-graph engine for generative recommendation: wide beam search (3–5 SID steps, n=50–512+) over a trie-constrained catalog, in-process FP8 serving, and ranked beams on /v1/chat/comp…

   Python 107 5

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 37k 9.4k

3. galeselee/Awesome_LLM_System-PaperList galeselee/Awesome_LLM_System-PaperList Public

   Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of papers on accelerating LLMs, currently focusing mainly on infer…

   285 15

4. awesome-graph-structure-learning awesome-graph-structure-learning Public

   A collection of research papers related to graph structure learning(GSL).

   16 2

5. marco-jeffrey/awesome-llm-resources marco-jeffrey/awesome-llm-resources Public

   a collection of resources around LLMs, aggregated for the workshop "Mastering LLMs: End-to-End Fine-Tuning and Deployment" by Dan Becker and Hamel Husain"

   107 11

6. CQUPT-GML/2021Sohu_Text_Matching CQUPT-GML/2021Sohu_Text_Matching Public

   2021搜狐校园文本匹配算法大赛决赛第八名解决方案

   Python 23 2