What Is Hermes Agent?

Hermes Agent is a personal AI assistant framework that goes far beyond a simple chatbot. Unlike ChatGPT or other conversational AI tools that simply respond to your messages, Hermes Agent can take real actions. it can write reports, research topics, draft emails, manage your calendar, and execute tasks autonomously in the background, 24 hours a day, 7 days a week.

Developed by Nous Research, Hermes Agent has rapidly become one of the most popular AI agent frameworks available today. What sets it apart from competitors like OpenClaw is its self-learning capability. the more you use it, the smarter it gets. It automatically builds its own skills, remembers your preferences, and improves its performance over time without requiring manual configuration.

Key Characteristics

  • Always-on: Runs on a virtual private server (VPS) or your own hardware, 24/7
  • Action-oriented: Not just a chatbot. it can execute real-world tasks
  • Self-improving: Learns from your interactions and builds skills automatically
  • Multi-model: Works with any LLM provider. OpenAI, Anthropic, MiniMax, and more
  • No coding required: Interact with it using plain English (or any language)
  • Multi-platform: Message it from Telegram, Slack, email, or the terminal

Why Use Hermes Agent?

Hermes Agent is designed for people who want a dedicated AI assistant that handles multiple aspects of their digital life. It's not meant for one-off automations. if you need a single, simple workflow, tools like OpenClaw or Claude Code might be more appropriate. Hermes Agent shines when you want a persistent assistant that you interact with consistently to manage various tasks.

Things Hermes Agent Can Do

  • Email management: Read, triage, and draft emails
  • Calendar management: Check schedules, create events, optimize your time
  • Web research: Search the web, take screenshots, browse websites
  • Daily digests: Morning briefs with action items from your inbox
  • Automated accounting: Scan emails for receipts and organize them
  • Security audits: Monitor your server for unusual activity
  • Habit tracking: Teach you new skills, quiz you daily
  • File management: Create, edit, and organize files and projects

The Five Core Concepts

Before diving into setup, it's essential to understand the five key components that make Hermes Agent work:

1. Memory

Hermes Agent uses a memory system to store information about you and its interactions. When you install Hermes Agent, you get a directory structure that includes:

  • user.md: Stores personal information about you. your name, age, location, and preferences
  • memory.md: Stores long-term facts and important information the agent should always remember

These files are automatically updated as you interact with the agent. You never need to manually edit them, but understanding their purpose helps you understand how the agent builds context over time.

2. Skills

Skills are repeatable workflows stored as markdown files (sometimes accompanied by scripts). They tell the agent how to accomplish specific tasks predictably. Rather than explaining how to check your email every single time, you simply invoke the email skill.

  • 90+ built-in skills come with Hermes Agent by default
  • 500+ community skills are available to install
  • You can create your own custom skills
  • Skills use progressive disclosure. only the name and description are loaded initially; full instructions are loaded only when needed, saving tokens and memory

3. Soul (Personality)

The soul is a markdown file that defines how the agent behaves. You can configure it to be:

  • Harsh or nice
  • Formal or casual
  • Verbose or concise
  • Use emojis or not
  • Act like a specific persona

You don't need to write this file manually. just tell the agent how you want it to behave, and it updates the soul automatically.

4. Cron (Scheduled Tasks)

Cron jobs enable proactive automation. While reactive agents wait for instructions, proactive agents work on a schedule. You can set up tasks like:

  • Every morning at 7 AM: Email triage and summary
  • Every Sunday at midnight: Security audit
  • Every day at 5 PM: Daily wrap-up report
  • Every Wednesday at 3 PM: Tennis star reminder (or whatever you need!)

5. Self-Improvement Loop

This is Hermes Agent's killer feature. The agent automatically:

  • Reviews what you've done together
  • Builds its own skills based on repeated tasks
  • Remembers your preferences
  • Improves its performance over time

No other major agent framework does this automatically. in most tools, you'd have to manually create skills and update configurations.


Security Best Practices

Before setting up Hermes Agent, it's critical to understand the security implications. Because you're giving an AI agent significant autonomy, you need to treat it like a new team member. start with limited access and gradually build trust.

Potential Risks

  • Overspending: Without spending limits, an agent could burn through hundreds of dollars in API costs per day
  • Prompt injection: Malicious actors could trick your agent into executing harmful tasks through crafted emails or messages
  • Data leaks: Exposed agents can leak API keys and sensitive files
  • Destructive actions: Without guardrails, an agent could delete files, send unauthorized emails, or make unintended payments

Security Checklist

  • Use named API keys with spending limits
  • Apply the principle of least privilege. only give access to what's needed
  • Start with read-only mode before granting write/edit/delete permissions
  • Never paste API keys directly in chat. use the hermes config set command instead
  • Rotate your keys regularly
  • Use a private GitHub repo for backups
  • Restrict who can message your bot (e.g., via Telegram user ID whitelisting)
  • Harden your server to prevent unauthorized internet access
  • Give the agent its own email address rather than using your primary one
  • Use one API key per agent/tool for easy rotation and revocation

Setting Up Hermes Agent

Option 1: Hostinger VPS (Recommended for Beginners)

The easiest way to get started is using Hostinger's one-click Hermes Agent deployment. Here's the step-by-step process:

  1. Go to Hostinger (link in the video description) and choose a plan. the KVM 2 plan at ~$9/month is recommended
  2. Use the code techwithtim for an additional 10% discount
  3. Copy the admin password shown during deployment. you'll need it to sign in
  4. Wait for provisioning. it takes a few minutes
  5. handle to Docker Manager in the Hostinger dashboard
  6. Find the Hermes Agent container and wait for it to show "Running"
  7. Click "Open" to access the Hermes Agent terminal UI
  8. Sign in with username hermes (lowercase) and the admin password

> Why a VPS? A virtual private server runs in a secure data center, costs less than physical hardware, runs 24/7 without interruption, and can be instantly terminated if there's a security breach. Physical devices (like a Mac Mini) are more expensive and vulnerable to theft, fire, or disconnection.

Option 2: Manual Installation

If you have your own hardware or server:

``bash # Run the installation command from the Hermes Agent website curl [install-url] | bash

# Then run the setup hermes setup `

This will bring you to the same setup interface as the Hostinger deployment.


Configuration Walkthrough

Once you're in the Hermes Agent terminal UI, handle using arrow keys (the mouse doesn't work in the terminal). Select "Full Setup" and follow these steps:

Step 1: AI Provider

  • Select your LLM provider (e.g., OpenAI, Anthropic, etc.)
  • For OpenAI users with a Codex subscription, select OpenAI Codex
  • You'll be prompted to authenticate via a URL and code
  • Note: ChatGPT subscriptions no longer work for API usage. you need a proper API plan

Step 2: Model Selection

  • Choose your model (e.g., GPT-5.5)
  • You can connect multiple models later if you want different models for different tasks

Step 3: Text-to-Speech Provider

  • Keep the default Edge TTS (free)
  • For more natural voices, consider Eleven Labs

Step 4: Terminal Backend

  • Keep the local terminal backend (default)

Step 5: Agent Settings

  • Maximum iterations: Keep at 90 (default). This is how many times the LLM is called per task. You can increase to 250+ for deep exploration, but 90 is sufficient for most use cases.
  • Tool progress mode: Set to "all" (default). This shows you what the agent is doing as it works. which tools it's using, what it's searching for, etc.
  • Context compression: Set to 0.8 (80%). This determines when the agent starts compressing conversation history to save memory. Setting it to 0.8 means it uses 80% of the context window before compressing, giving you longer memory.

Step 6: Session Reset Mode

  • Choose "Inactivity + Daily Reset"
  • This creates a fresh session after a period of inactivity and once per day
  • Important for keeping context window size manageable and costs lower

Step 7: Messaging Platform

  • Select Telegram (recommended for beginners)
  • See the next section for detailed Telegram setup

Step 8: Tools and Browser

  • Browser provider: Start with local browser (free). For heavy web automation, consider Browserbase or Firecrawl (~$20/month)
  • Image generation: Select your provider (e.g., OpenAI Codex)
  • Search provider: Use the default SearXNG (free, self-hosted)

Connecting Telegram

Setting up Telegram lets you message your Hermes Agent from your phone or any device:

Step 1: Create a Telegram Bot

  1. Open Telegram and search for @BotFather (with the blue checkmark)
  2. Type /newbot
  3. Give your bot a display name (e.g., "Hermes Agent")
  4. Set a unique username ending in _bot (e.g., hermes_agent_12345_bot)
  5. Copy the token BotFather provides

Step 2: Configure in Hermes Agent

  1. Paste the bot token when prompted during setup
  2. Restrict access by adding your Telegram user ID:
  • Search for @userinfobot in Telegram
  • Type /start to get your user ID
  • Paste this ID in the Hermes Agent setup
  • Multiple IDs can be added, separated by commas
  • Step 3: Test the Connection

    1. Find your bot on Telegram (tap the link from BotFather or search for its username)
    2. Press Start and send a test message
    3. If the bot doesn't respond, go to the Hermes terminal UI and ask it to diagnose the issue. it can often fix connection problems automatically

    handling the Terminal UI

    • Type hermes to open the terminal UI from any terminal
    • Press Ctrl+C to exit the Hermes application
    • Type hermes setup to re-enter the setup flow
    • Type hermes again to return to the chat interface

    Setting Up Automated GitHub Backups

    Backing up your Hermes Agent configuration to GitHub is essential. As you use the agent, it becomes more valuable. losing it would mean losing all your memories, skills, and customizations.

    Step 1: Create a GitHub Repository

    1. Go to GitHub.com and create a new private repository
    2. Name it something like hermes-agent-backup
    3. Make sure it's private. this contains sensitive configuration data

    Step 2: Generate a Personal Access Token

    1. Go to Settings → Developer Settings → Personal Access Tokens → Fine-grained tokens
    2. Click Generate new token
    3. Name it (e.g., "Hermes Backup Repo")
    4. Set no expiration (for convenience)
    5. Under Repository access, select "Only select repositories" and choose your backup repo
    6. Under Permissions, set Contents to Read and write
    7. Copy the generated token

    Step 3: Configure the Token in Hermes Agent

    Exit the Hermes terminal UI (Ctrl+C) and run:

    `bash hermes config set GITHUB_TOKEN your_token_here `

    > Important: Always use hermes config set` for secret keys, never paste them directly in chat. Keys pasted in chat are stored in session logs and sent to your LLM provider.

    Step 4: Run the Backup

    Open the Hermes terminal UI and prompt:

    > "I've given you access to a GitHub personal access token for one repository. Please back up the current Hermes configuration and state without saving any secret keys or credentials. The repository URL is: [your-repo-url]"

    The agent will clone the repository, copy your configuration files, and push the backup. You can verify by refreshing your GitHub repository page.

    Step 5: Enable Automatic Backups

    Tell the agent:

    > "Please update your memory so that whenever you make any significant changes, you automatically make a new commit to GitHub."

    Now your agent will continuously back up its state, creating a version history you can roll back to if something goes wrong.


    Voice, Image, and Browser Automation

    Voice Interaction

    Hermes Agent supports speech-to-text and text-to-speech out of the box:

    • Send voice messages via Telegram. the agent transcribes and responds
    • The agent can send voice messages back using text-to-speech
    • For better voice quality, configure Eleven Labs as your TTS provider
    • Tools like WhisperFlow can be used for fast voice dictation when interacting with the agent

    Image Understanding

    • Upload images directly in Telegram (if using an image-enabled model like GPT-4o or Claude Opus)
    • Multiple images can be attached at once
    • The agent can analyze, describe, and respond to visual content

    Browser Automation

    To enable web browsing and screenshot capabilities:

    1. Ask the agent to visit a website and take a screenshot
    2. If it fails (which it will on first use), it will typically automatically install the agent browser
    3. If it doesn't self-correct, tell it: "Install agent browser"
    4. Once installed, the agent can:
  • Visit websites and take screenshots
  • Extract information from web pages
  • Perform basic web automation tasks
  • For heavy browser operations, consider paid services like Browserbase or Firecrawl, which provide full remote browser instances capable of handling complex JavaScript, CAPTCHAs, and multi-window browsing.


    Connecting Real-World Tools with Composio

    Composio is a powerful integration platform that connects Hermes Agent to thousands of real-world applications. It's free to use (20,000 tool calls/month) and acts as a unified bridge between your agent and your personal accounts.

    How to Set Up Composio

    1. Go to composio.dev and create a free account
    2. handle to Connect Apps in the dashboard
    3. Connect the apps you want your agent to access:
  • Gmail. for email reading, writing, and management
  • Google Calendar. for scheduling and event management
  • Google Drive. for file storage and organization
  • GitHub. for code repository management
  • Slack. for team communication
  • And thousands more...
    1. Grant the necessary permissions for each connected app
    2. Go to Install in Composio and find the OpenClaw integration instructions
    3. Copy those instructions and paste them into your Hermes Agent chat
    4. The agent will guide you through the authentication flow

    What This Enables

    Once Composio is connected, you can:

    • "Read my last two emails". the agent accesses your Gmail via Composio
    • "Create a calendar event for tomorrow at 3 PM". the agent manages your Google Calendar
    • "Upload this receipt to my Google Drive receipts folder". the agent organizes your files
    • "Check my Slack messages". the agent reads your team communications

    > Tip: If the agent uses the wrong skill for a task (e.g., using a Google Workspace skill instead of Composio), simply tell it: "Whenever you need to look up an email, use Composio." It will learn and update its behavior.


    Practical Use Cases and Workflows

    Here are real, practical workflows you can set up with Hermes Agent:

    1. Daily Email Triage

    Prompt: "Every day at 7 AM, read through my emails from the past 24 hours and send me a concise summary of any important messages or action items."

    This creates a cron job that automatically scans your inbox every morning and delivers a neat summary to your Telegram.

    2. Security Audit

    Prompt: "Every Sunday at midnight, run a security audit on the virtual private server, check for unusual activity, and send me a report with suggestions for improvement."

    3. Morning Brief / Digest

    Connect multiple sources (email, calendar, news) and have the agent pull everything into a single morning brief with prioritized action items.

    4. Automated Accounting

    Prompt: "Anytime I receive a new email, check if it contains a receipt. If it does, upload it to Google Drive in the receipts folder."

    5. Calendar Optimization

    Have the agent check your calendar daily and automatically schedule blocks for workouts, meals, and focused work time.

    6. Daily Wrap-Up

    Prompt: "At the end of each day, tell me what you achieved, what was completed, and how we're going to improve for tomorrow."

    7. Habit Tracker

    Prompt: "Every day, teach me five new Indonesian words in this format: [word] - [meaning] - [example sentence]. Then quiz me on them."

    8. Content Research

    Prompt: "Research the latest developments in AI agent frameworks and send me a weekly summary every Friday."


    Tips for Beginners

    Start Simple

    Don't try to set up everything at once. Start with:

    1. Basic setup and Telegram connection
    2. GitHub backup
    3. One or two simple cron jobs
    4. Gradually add integrations as you get comfortable

    Be Specific with Prompts

    The more specific your instructions, the better the agent performs. Instead of "check my email," say "check my email from the past 24 hours and summarize any messages that require action."

    Let the Agent Fix Itself

    When something goes wrong, ask the agent to fix it. It can diagnose issues, install missing components, and reconfigure settings. This is one of its most powerful features.

    Build Trust Gradually

    Start by giving the agent read-only access to your tools. Once you're comfortable with its behavior, gradually grant more permissions (write, edit, delete, send).

    Use the Self-Learning Feature

    Repeat tasks naturally. The agent will automatically build skills based on your patterns. If you ask it to format emails a certain way multiple times, it will create a skill for that format.

    Monitor Costs

    Set spending limits on your API keys. Monitor your usage regularly, especially in the beginning when you're testing and iterating.

    Keep Your Backups Private

    Your GitHub backup repository contains sensitive configuration data. Always keep it private and periodically review what's being committed to ensure no secrets are accidentally stored.

    Join the Community

    With 500+ community skills available, there's likely already a skill for what you want to do. Explore the community resources before building custom solutions.


    Conclusion

    Hermes Agent represents a significant step forward in personal AI assistance. Its combination of always-on availability, real-world tool integration, self-learning capabilities, and proactive automation makes it one of the most powerful agent frameworks available today.

    The key to success with Hermes Agent is starting with clear, legitimate use cases and gradually expanding its capabilities as you build trust and familiarity. It's not magic. it won't make you a millionaire overnight. but when set up correctly, it can genuinely save you time and automate meaningful parts of your digital life.

    By following this guide, you should have a fully functioning Hermes Agent that can manage your email, calendar, daily digests, and much more. all accessible from your phone via Telegram, running 24/7 on a secure server, and continuously improving as you use it.


    This article is based on the video "Hermes Agent - Full Course & Setup Guide - For COMPLETE Beginners" by Tech With Tim (29,037 views). Video URL: https://www.youtube.com/watch?v=mTYxpIRK7xA