Multi Model Config #56

New issue

Closed

opened 2025-10-14 15:43:27 -06:00 by navan · 0 comments

navan commented

2025-10-14 15:43:27 -06:00

Owner

Originally created by @amphetamarina on 5/22/2024

Related Issue: #47

Refactor ifs/elifs into separate prepare{model} functions
- Discuss if this refactor makes sense
Adds 'custom' option on devon configure, giving the user freedom to choose whatever LiteLLM-compatible model they want.
Example .devon.config working with mixtral using OpenRouter:

{
  "modelName": "openrouter/mistralai/mixtral-8x22b-instruct",
  "apiKey": "sk-or-v1-<openrouter-api-key>",
  "apiBase": "https://openrouter.ai/api/v1",
  "promptType": "llama3"
}

*Originally created by @amphetamarina on 5/22/2024* Related Issue: #47 - Refactor ifs/elifs into separate _prepare_{model} functions - [ ] Discuss if this refactor makes sense - Adds 'custom' option on devon configure, giving the user freedom to choose whatever LiteLLM-compatible model they want. - Example .devon.config working with mixtral using OpenRouter: ``` { "modelName": "openrouter/mistralai/mixtral-8x22b-instruct", "apiKey": "sk-or-v1-<openrouter-api-key>", "apiBase": "https://openrouter.ai/api/v1", "promptType": "llama3" } ```