Speculative Decoding in vLLM on AMD GPUsvllm.ai
51 points by ankitg12 4 hours ago | 15 comments