Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDAgithub.com
92 points by yu3zhou4 7 hours ago | 9 comments