feat: model provider supports baseURL #752

New issue

Closed

opened 2025-10-14 16:12:59 -06:00 by navan · 0 comments

navan commented

2025-10-14 16:12:59 -06:00

Owner

Originally created by @shenysun on 5/12/2025

Add Support for Custom API Base URLs across AI Providers

Description

This PR enhances the AI service providers by adding support for custom API base URLs. This improvement allows users to configure alternative API endpoints for each AI provider, enabling more flexibility when working with proxies, self-hosted models, or custom API deployments.

Changes

Added new _resolveBaseURL function to resolve base URLs from environment variables
Implemented uniform parameter handling across all AI provider clients
Refactored provider modules to accept and use custom base URLs:
- Anthropic
- Google
- OpenAI
- OpenRouter
- Perplexity
- xAI
Updated _unifiedServiceRunner to resolve and pass base URLs to providers

Benefits

Enables connecting to self-hosted AI model deployments
Supports configuring region-specific API endpoints
Facilitates using API proxies for improved latency or access control
Maintains consistent interface across all providers

Testing Done

Verified functionality with default endpoints
Tested custom base URL configurations for primary providers
Ensured backward compatibility with existing configurations

Resolves #287

*Originally created by @shenysun on 5/12/2025* # Add Support for Custom API Base URLs across AI Providers ## Description This PR enhances the AI service providers by adding support for custom API base URLs. This improvement allows users to configure alternative API endpoints for each AI provider, enabling more flexibility when working with proxies, self-hosted models, or custom API deployments. ## Changes - Added new `_resolveBaseURL` function to resolve base URLs from environment variables - Implemented uniform parameter handling across all AI provider clients - Refactored provider modules to accept and use custom base URLs: - Anthropic - Google - OpenAI - OpenRouter - Perplexity - xAI - Updated `_unifiedServiceRunner` to resolve and pass base URLs to providers ## Benefits - Enables connecting to self-hosted AI model deployments - Supports configuring region-specific API endpoints - Facilitates using API proxies for improved latency or access control - Maintains consistent interface across all providers ## Testing Done - Verified functionality with default endpoints - Tested custom base URL configurations for primary providers - Ensured backward compatibility with existing configurations ## Related Issues - Resolves #287