Microsoft-fara/endpoint_configs/vllm_config.json at windows_support - Microsoft-fara - lrssGit

AI/Microsoft-fara

mirror of https://github.com/microsoft/fara.git synced 2026-06-10 02:54:01 +08:00

Files

Alexey Taymanov 2606c8e1c4 self-hosted scenario fix (#13 )

* import fix

* vllm requirements

* vllm config

* readme update

2025-11-24 20:12:38 -08:00

5 lines

118 B

JSON

Executable File

Raw Permalink Blame History

 {
     "model": "gpt-4o-mini-2024-07-18",
     "base_url": "http://localhost:5000/v1",
     "api_key": "<YOUR API KEY>"
 }