uvicorn
fastapi
vllm==0.10.0
transformers==4.55.0