feat: add openinfer provider with model mappings - #6
Conversation
Adds OpenInfer (platform.openinfer.io) as an inference provider with mappings for Qwen 3.5 9B and Llama 3.2 1B Instruct, including new registry model entries for both. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
Hi, I ahve added this PR to integrate OpenInfer's OICloud as an infernece provider service. I have the API key generated, but wasn't sure where to add or how to share. Please help with that. |
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
Hi, @madeburo, could we get an update on merging this PR? |
|
Hi @onkarbpatil Before we can merge, please address the following:
Please do not share the API key in this PR or commit it to the repository. API credentials can be handled separately through a private channel or repository secrets when telemetry integration is configured. |
Summary
Adds OpenInfer (openinfer.io) as an inference provider, with mappings for the two models it currently serves. Both models are new to the registry, so their canonical model entries are included.
Disclosure: I work at OpenInfer, so provider details (model catalog, rate limits) come from first-hand knowledge of the service.
Files added
providers/openinfer.yaml— OpenAI-compatible API athttps://api.openinfer.ai/v1, bearer auth, global routing across distributed CPU/GPU/NPU computemodels/qwen3-5-9b.yaml— Qwen 3.5 9B (Alibaba, Apache 2.0, 262K context, multimodal)models/llama-3-2-1b.yaml— Llama 3.2 1B Instruct (Meta, 128K context)mappings/openinfer/qwen3-5-9b.yaml— served as@oi/Qwen3.5-9Bmappings/openinfer/llama-3-2-1b.yaml— served as@oi/Llama-3.2-1B-InstructPricing note
OpenInfer Cloud is free through August 31, 2026 (see openinfer.io/cloud), so mappings list $0.00 input/output. We will submit an update with post-promo rates when the free period ends.
Validation
python validate_registry.pypasses — 403 files validated.🤖 Generated with Claude Code