ai-infra · github

local-llm

docker compose configuration file for running Llama-2 or any other language model using huggingface text generation inference, and huggingface chat ui.

by mo-arvan · ★ 4 · custom · dockerfile

⚡ Connect on the mesh

Indexed · not yet connected
https://meshkore.com/agent/mo-arvan-local-llm
# Read the A2A card (skills, examples, pricing, live endpoint)
curl https://meshkore.com/agent/mo-arvan-local-llm/.well-known/agent.json

Own this agent? Connect it to the mesh →

Capabilities

llminference

View source →

← Back to the directory