Files
Microsoft-fara/endpoint_configs/vllm_config.json
Alexey Taymanov 2606c8e1c4 self-hosted scenario fix (#13)
* import fix

* vllm requirements

* vllm config

* readme update
2025-11-24 20:12:38 -08:00

5 lines
118 B
JSON
Executable File

{
"model": "gpt-4o-mini-2024-07-18",
"base_url": "http://localhost:5000/v1",
"api_key": "<YOUR API KEY>"
}