Guide

Get started with Hermes

Let a local model do real tasks, all on your own computer.

What Hermes is

Hermes Agent is a free tool from Nous Research. It lets an AI model do tasks, not just chat. It can use LM Studio as its engine, so it all runs on your computer.

Hermes needs a model with a memory window of at least 64K tokens. Hermes docs.

Steps

  1. Set up LM Studio and download a model first. See our LM Studio guide.
  2. Install Hermes. On Mac or Linux, open Terminal and run the command below. Windows users can follow the install guide.
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
  1. In LM Studio, load your model with a context length of at least 64000.
  2. Open the Developer tab in LM Studio and start the server.
  3. In Terminal, run hermes model. Choose LM Studio. Press Enter to keep http://localhost:1234/v1.
  4. Pick your model. Then run hermes and start working.

The install command runs a script from the internet. Only run it if you trust the source. It comes from the official Hermes project.

Models that fit Hermes

These have a memory window of 64K or more, checked from their config files.

Models compared
ModelMakerTrustQualityRAM neededBusinessSign-up
Olmo 3 7BAi2 100Good8 GB YesNo
Olmo 3.1 32BAi2 100Very strong26 GB YesNo
SmolLM3 3BHugging Face 100Basic5 GB YesNo
GPT-OSS 20BOpenAI 84Very strong17 GB YesNo
GPT-OSS 120BOpenAI 84Top home tier87 GB YesNo
Qwen3.5 9BAlibaba Qwen 84Good9 GB YesNo
Qwen3.8 27BAlibaba Qwen 84Very strong23 GB YesNo
Qwen3 4B 2507Alibaba Qwen 84Good5 GB YesNo
Qwen3 30B-A3B 2507Alibaba Qwen 84Very strong24 GB YesNo
Qwen3 Coder 30BAlibaba Qwen 84Very strong24 GB YesNo
Qwen2.5 VL 7BAlibaba Qwen 84Good8 GB YesNo
Gemma 4 12BGoogle 84Strong11 GB YesNo
Gemma 4 E4BGoogle 84Good8 GB YesNo
DeepSeek R1 Distill 7BDeepSeek 84Good8 GB YesNo
DeepSeek R1 Distill 14BDeepSeek 84Strong13 GB YesNo
DeepSeek R1 0528 8BDeepSeek 84Good8 GB YesNo
Phi-4 miniMicrosoft 84Basic5 GB YesNo
Mistral Nemo 12BMistral AI 84Strong11 GB YesNo
Mistral Small 3.2Mistral AI 84Very strong20 GB YesNo
Devstral SmallMistral AI 84Very strong19 GB YesNo
Granite 3.3 2BIBM 84Basic4 GB YesNo
Granite 3.3 8BIBM 84Good8 GB YesNo
Granite 4.0 H TinyIBM 84Good8 GB YesNo
Granite 4.0 H SmallIBM 84Very strong26 GB YesNo
GLM-4.5 AirZ.ai 84Top home tier82 GB YesNo
Hermes 3 8BNous Research 64Good8 GB With limitsNo
Nemotron Nano 9B v2NVIDIA 64Good9 GB With limitsNo
LFM2 1.2BLiquid AI 64Basic3 GB With limitsNo