LLM Gateway / AI Gateway Research
A long-running research thread around Envoy AI Gateway, Gateway API Inference Extension, kgateway, and vLLM Semantic Router.
Projects
Systems work, open-source contributions, and technical experiments.
vllm-project/semantic-router
Intelligent semantic routing for Mixture-of-Models, AI Gateway, and production LLM traffic governance in the vLLM ecosystem.