2.5k
GitHub Stars
2
Bundled Files
2 months ago
Catalog Refreshed
4 months ago
First Indexed
Readme & install
Copy the install command, review bundled files from the catalogue, and read any extended description pulled from the listing source.
Installation
Preview and clipboard use veilstrat where the catalogue uses aiagentskills.
npx veilstrat add skill openclaw/skills --skill ollama-local- _meta.json281 B
- SKILL.md3.7 KB
Overview
This skill manages and uses local Ollama models for inference, embeddings, and integrated tool use. It provides CLI and script helpers for listing, pulling, removing, showing models, chatting, generating completions, and producing embeddings. It also supports OpenClaw sub-agent spawning and multi-agent patterns for collaborative tasks. Use it to run local LLM workflows without cloud dependencies.
How this skill works
The skill talks to an Ollama daemon (default http://localhost:11434) via environment-configured host or direct API calls. It wraps common operations—list, pull, remove, show models—and exposes chat, generate, and embed commands plus a tool loop for function-calling models. For multi-agent or persistent sessions, it spawns OpenClaw sub-agents using model paths like ollama/<model-name> and coordinates tool-enabled interactions.
When to use it
- You need local inference or embeddings without relying on cloud APIs.
- Managing model lifecycle (list, pull, remove, inspect) on a local Ollama host.
- Running tool-enabled conversations or function-calling workflows locally.
- Spawning sub-agents for parallel or collaborative tasks (think tank pattern).
- Integrating Ollama models into custom scripts or CI pipelines via direct API calls.
Best practices
- Set OLLAMA_HOST environment variable to point to your Ollama server before running commands.
- Start with smaller models (7b, 4b) for development; move to larger models only after verifying VRAM and performance.
- Use the tool loop for workflows that require model-driven tool invocation and iterative calls.
- Verify firewall and port 11434 access for remote Ollama hosts and ensure ollama serve is running.
- Use explicit model tags (e.g., qwen3:4b) and the ollama/<model-name> path when spawning OpenClaw sub-agents.
Example use cases
- Pull and run a local 8b model for offline chat and code review tasks.
- Generate embeddings from documents for a private semantic search index.
- Spawn three specialized sub-agents (architect, coder, reviewer) to collaboratively design and implement a feature.
- Use the tool-enabled loop to let a model search, fetch results, and synthesize a summary.
- Integrate Ollama chat or generate endpoints into a local web app via simple curl or script calls.
FAQ
Set the OLLAMA_HOST environment variable to the server URL (for example export OLLAMA_HOST="http://192.168.1.100:11434").
Which models support tools/function calling?
Tool-capable models include qwen2.5-coder, qwen3, llama3.1, and mistral; check model docs for specifics.
What if a model fails to load or is very slow?
Confirm available VRAM, try a smaller quantized model, or enable CPU offload; large models may require more resources.