LLMgram · AI News · 2026-08-09

Hermes Desktop lets you point at an app and say “this”

Hermes Desktop lets you point at an app and say “this”

A short X demo shows Hermes Desktop resolving the app beneath its command bar without requiring its name. The bar is placed over a window and the user refers to that target as “this.” In follow-up replies, she says the capability is available after updating Hermes Desktop and works on Windows. The useful change is small but concrete: part of the prompt is replaced by on-screen position. The demo does not show how consistently Hermes resolves the target when windows overlap, an app is full-screen or the user works across several monitors, so those edge cases remain the most useful tests.

Sources

Hermes Desktop lets you point at an app and say “this”

Hermes Desktop lets you point at an app and say “this”

A demo shows the command bar placed over an app so Hermes can resolve “this” without the user naming the application. In replies, the post’s author says the feature is available after updating Hermes Desktop and works on Windows.

Key takeaway

The interaction uses on-screen location as an extra grounding signal, so the voice command can omit an application’s proper name.

What happened

In the demo, the Hermes command bar is positioned over an application window while the user refers to that target as “this,” avoiding an explicit app name in the prompt.

In follow-up replies to the same post, the author says the capability is available now after updating Hermes Desktop and confirms that it works on Windows.

Evidence

  • The demo shows Hermes targeting the app beneath its command bar when the user says “this.”

    Brooklyn on X · demonstrated

    You don't tell Hermes which app you mean anymore. Put the bar over it and say "this" xx

  • The author says the feature works on Windows.

    Brooklyn on X · author reply

    Yes it works on windows, remote gateway would require like.. a wormhole

  • The author says the feature is available after updating Hermes Desktop.

    Brooklyn on X · author reply

    Now! Just update your hermes desktop

Why it matters

This replaces part of the verbal prompt with screen position, a useful interaction pattern for desktop agents that already see several open applications.

Limits and uncertainties

The evidence is a short product demo and replies from its author, not formal release notes from Nous Research.

The demo does not establish reliability across overlapping windows, full-screen apps or multiple monitors.

Practical implications

The interaction reduces the amount of app-identification language the user has to put into a command.

Desktop-agent builders can use overlapping windows and multi-monitor setups as immediate edge-case tests.

What to watch

Whether target selection remains reliable when windows overlap, an app is full-screen or several displays are connected.

Sources

LLMgram editorial selection and synthesis · @llmgram. LLMgram is not the original publisher of this information.
Continue on LLMgram: Open in AI Signal →
Original reporting: Brooklyn on X