Skip to content

feat(llm): extend Gateway and Model contracts with region options and thinking defaults #26

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Patel230 merged 2 commits into from
Aug 1, 2026
Merged

feat(llm): extend Gateway and Model contracts with region options and thinking defaults #26

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
12409a1
feat(llm): extend Gateway and Model contracts with region options and…
Patel230 Jul 31, 2026
99721f3
Merge provider-logic-migration: gateway region options + thinking def…
Patel230 Aug 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 31 additions & 14 deletions llm/provider.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,6 +168,14 @@ type Model struct {
Capabilities []string `json:"capabilities,omitempty"`
Source string `json:"source,omitempty"`
LiveMetadata json.RawMessage `json:"live_metadata,omitempty"`

// SupportsThinkingToggle indicates this model's provider wire protocol
// honors the ThinkingEnabled toggle. Populated by the engine catalog.
SupportsThinkingToggle bool `json:"supports_thinking_toggle,omitempty"`
// DefaultThinkingEnabled is the provider-default thinking state for this
// model when no explicit user preference is set. nil means no provider
// default (fall through to global settings).
DefaultThinkingEnabled *bool `json:"default_thinking_enabled,omitempty"`
}

// ModelClass is a provider-neutral relative model cost/capability band.
Expand Down Expand Up @@ -272,22 +280,31 @@ type GatewayInspector interface {
RoutingPreview(ctx context.Context, modelID string) (string, error)
}

// GatewayRegionOption describes one selectable region for a regional gateway.
type GatewayRegionOption struct {
Value string `json:"value"`
DisplayName string `json:"display_name"`
Endpoint string `json:"endpoint,omitempty"`
}

// Gateway is a provider/gateway descriptor.
type Gateway struct {
ID string `json:"id"`
DisplayName string `json:"display_name"`
DeploymentID string `json:"deployment_id,omitempty"`
CredentialEnv string `json:"credential_env"`
RequiresKey bool `json:"requires_key"`
SortOrder int `json:"sort_order"`
ChatPreference int `json:"chat_preference"`
SupportsLiveDiscovery bool `json:"supports_live_discovery"`
CredentialConfigured bool `json:"credential_configured"`
DeploymentConfigured bool `json:"deployment_configured"`
ModelCount int `json:"model_count"`
RegionLabel string `json:"region_label,omitempty"`
RegionRequired bool `json:"region_required"`
Active bool `json:"active"`
ID string `json:"id"`
DisplayName string `json:"display_name"`
DeploymentID string `json:"deployment_id,omitempty"`
CredentialEnv string `json:"credential_env"`
RequiresKey bool `json:"requires_key"`
SortOrder int `json:"sort_order"`
ChatPreference int `json:"chat_preference"`
SupportsLiveDiscovery bool `json:"supports_live_discovery"`
CredentialConfigured bool `json:"credential_configured"`
DeploymentConfigured bool `json:"deployment_configured"`
ModelCount int `json:"model_count"`
RegionLabel string `json:"region_label,omitempty"`
RegionRequired bool `json:"region_required"`
RegionOptions []GatewayRegionOption `json:"region_options,omitempty"`
DNSHost string `json:"dns_host,omitempty"`
Active bool `json:"active"`
}

// DeploymentSummary summarizes deployment routing for a model (host-facing).
Expand Down
Loading