Run AI locally

Run GLM-5.2 fully local on a Mac Studio and drive it with Hermes

Serve GLM-5.2's 2-bit GGUF on a Mac Studio over an OpenAI-compatible endpoint, point Hermes at it as a custom provider, and hand it long hands-off agentic jobs.

Prove your meeting-notes pipeline never phones home (and gates on consent)

Run capture -> whisper.cpp transcription -> Ollama summary fully on your machine, with a CI check that every endpoint is loopback, no cloud host or API key appears anywhere in the config, and recording is gated on a consent acknowledgment.

Wire GLM-5.2 into Hermes: valid route, 64k-context check, no key in config

Validate a Hermes Agent config that runs GLM-5.2 through a real provider route (direct Z.AI or OpenRouter), clears Hermes's 64k minimum context, and keeps the API key out of config.yaml, before you start a session.

Route through a gateway with a tested open-weights fallback

Keep model access from being a single point of failure: route through an OpenAI-compatible gateway and pin a fallback that is open-weights and has actually been tested, so a pulled or deprecated model is a two-minute config change, not a lost week.

Run GLM-5.2 for the bulk, escalate the hard turns to Opus 4.8

Wire a cost-routing config that sends most work to cheap hosted GLM-5.2 and only the hardest turns to Opus 4.8, instead of paying Opus prices for everything.

Serve NVIDIA Nemotron 3 Ultra yourself for high-throughput agents (vLLM)

Stand up the NVFP4 Nemotron 3 Ultra checkpoint as an OpenAI-compatible endpoint for fast, long-running agent loops, validated serve flags + endpoint.

Serve GLM-5.1 yourself for long-horizon agentic coding (vLLM)

Stand up the MIT-licensed GLM-5.1 FP8 checkpoint as an OpenAI-compatible endpoint for long agentic runs, validated serve config + endpoint.

Serve MiniMax M3 yourself for agentic coding (vLLM)

Stand up MiniMax M3 on an 8x H200 node as an OpenAI-compatible endpoint and point any coding agent at it, validated serve flags + endpoint config.

Local model chore: read a photo with a vision model, on-device

Snap a receipt, a medication label, or a handwritten note, and have a free offline vision model read out the details so you do not have to squint and retype.

Local model chore: draft a sensitive message in private

Ask a free, offline model to draft or soften a delicate message (a note about money, a reply to a doctor, a careful complaint) knowing the contents stay on your machine.

Local model chore: summarize a long PDF without it leaving your laptop

Attach a 30-page PDF or a dense terms-of-service to a local model and get five plain bullets plus anything you need to act on, with the document staying on your machine.

Local model chore: turn a brain-dump into a clean to-do list

Paste messy meeting notes into a free, offline model on your own laptop and get back an organized to-do list, with nothing leaving the machine.

Hermes + DeepSeek V4 Flash: a one-line reasoning-effort throttle

Run one model from cheap-and-fast to deep-and-careful with a single reasoning_effort setting, so you don't pay for deep thinking on easy turns.

Obsidian × MCPVault: Write a Note from Any MCP Client

Create or patch a note in your Obsidian vault through MCPVault, from any MCP client, with frontmatter preserved.

Obsidian × MCPVault: Read a Note from Any MCP Client

Read a note from your Obsidian vault through MCPVault, from any MCP client, including a fully local LM Studio + open-model setup.

Fine-Tune an Open LLM to Make It Yours

Adapt an open-weight model to your domain with a small dataset.

Guaranteed JSON from Local LLMs with Outlines

Force valid, schema-conformant JSON out of any local model.

Vectorless RAG with PageIndex

Build high-accuracy RAG without embeddings, chunking, or a vector DB.

Self-Hosted Self-Improving Agent with Hermes

Stand up a Hermes agent that remembers and improves over time on your own VPS.

Run LLMs Locally to Replace ChatGPT Plus

Serve a capable open model locally with Ollama and drop the ChatGPT Plus subscription.

Replaces ChatGPT Plus