Skip to content

config: Keep a custom API base path - #40

Open
ChengyuZhu6 wants to merge 1 commit into
NVIDIA:mainfrom
ChengyuZhu6:apipath
Open

ChengyuZhu6 wants to merge 1 commit into
NVIDIA:mainfrom
ChengyuZhu6:apipath

Conversation

@ChengyuZhu6

Copy link
Copy Markdown

normalize_boro_base_url appended /v1 unless the base already ended in /v1. A custom path such as /v2 became /v2/v1, so chat/completions 404'd.

Gateways also mount under other prefixes: Azure uses /openai/deployments/{id}, Gemini uses /v1beta/openai, and Cloudflare AI Gateway ends in /openai or /compat.

Keep any URL that already has a path. Bare hosts still get /v1.

normalize_boro_base_url appended /v1 unless the base already ended in
/v1. A custom path such as /v2 became /v2/v1, so chat/completions
404'd.

Gateways also mount under other prefixes: Azure uses
/openai/deployments/{id}, Gemini uses /v1beta/openai, and Cloudflare
AI Gateway ends in /openai or /compat.

Keep any URL that already has a path. Bare hosts still get /v1.

Signed-off-by: ChengyuZhu6 <hudson@cyzhu.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant