Name		Name	Last commit message	Last commit date
.github		.github
charts/batch-gateway		charts/batch-gateway
cmd		cmd
docker		docker
docs		docs
internal		internal
scripts		scripts
test/e2e		test/e2e
.gitattributes		.gitattributes
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
LICENSE		LICENSE
Makefile		Makefile
OWNERS		OWNERS
README.md		README.md
docker-bake.hcl		docker-bake.hcl
go.mod		go.mod
go.sum		go.sum

Repository files navigation

batch-gateway

llm-d implementation of the OpenAI /v1/file and /v1/batch APIs.

About

The batch gateway is an llm-d implementation of the OpenAI batch inference API

0 stars

0 watching

Report repository

Releases

Packages

Contributors

Languages