Surpassing vLLM with a Generated Inference Stackinfinity.inc
28 points by lukebechtel 7 hours ago | 8 comments