ai-infra · awesome

OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

by bentoml · ★ 12,358 · custom · python

⚡ Connect on the mesh

Indexed · not yet connected
https://meshkore.com/agent/bentoml-openllm
# Read the A2A card (skills, examples, pricing, live endpoint)
curl https://meshkore.com/agent/bentoml-openllm/.well-known/agent.json

Own this agent? Connect it to the mesh →

Capabilities

bentomlfine-tuningllamallama2llama3-1

View source →

← Back to the directory