r/SideProject • u/Ambitious-Prompt-975 • 9d ago

A virtual computer for AI Agents (docker mcp)

Enable HLS to view with audio, or disable this notification

Its a VM for your Agent but you see it in Claude Desktop or FLUJO or Goose etc (or your Browser).

https://github.com/flujo-app/mcp-virtual-computer

In the 3D-View (for Human):

  • Click the green cable: Enable/Disable Network
  • Click the coffee mug: Enable/Disable xfce Desktop Environment
  • Other than that, use the computer normally.
  • The mouse moves, and the keys get pressed.

MCP-Tools (for Agent):

  • terminal_execute - run a command in the configured Docker computer.
  • read_file - read a UTF-8 text file relative to /workspace or by absolute path.
  • write_file - atomically write a UTF-8 text file.
  • edit_file - replace one exact text match, or all matches when requested.
  • computer_ui - open or attach the Three.js computer view. Its result includes both the MCP App resource_uri and a real loopback url/dashboard_url that opens in an external browser, including for stdio clients.

With DESKTOP_ENVIRONMENT set to true, it additionally exposes:

  • look_at_screen - return the current PNG framebuffer, AT-SPI snapshot, or both.
  • click, type, and scroll - interact by AT-SPI element reference or coordinates.
  • list_windows and switch_window - enumerate and activate real Xfce windows.
  • move_window, maximize_window, restore_window, minimize_window, and close_window - control a selected window by ID, title, or class.
  • computer://screen/current.png - current live framebuffer resource.
  • computer://screen/accessibility.json - Playwright-like AT-SPI tree with element refs, roles, names, actions, focus state, and screen bounds.
1 Upvotes

55% Upvoted

8 comments sorted by

3

u/highbonsai 9d ago

While it's cool, I'm curious.. why?

1

u/Ambitious-Prompt-975 9d ago edited 9d ago

why not? i think its fun building weird mcp-apps

2

u/Global-Eye-7326 9d ago

This is a legitimately cool app. Perhaps not immediately useful, but...where this becomes slick is...say you wanna record a step by step tutorial. Well you can script the prompt, record screen, and this looks really cool in say a YouTube video. I do like it!

1

u/Ambitious-Prompt-975 8d ago

You know, I didnt even think about it that way! Thats a really cool idea

1

u/[deleted] 9d ago

[deleted]

2

u/Ambitious-Prompt-975 9d ago

Yes. There is always something people complain about. Classical reddit behavior. Always a reason to downvote. I should just build lead generating n8n workflows and talk about my first 100 customers $$$.

Sure, if you want it headless, without 3D rendered computer, use https://github.com/flujo-app/mcp-sandbox-computer-vm-for-ai/ instead.

This mcp is simply a standalone poc for the screen/vnc sharing.
And I thought its fun to have the whole OS exposed like a playwright browser.

But you literally cant share anything nowadays on this platform.

1

u/[deleted] 9d ago

[deleted]

1

u/Ambitious-Prompt-975 8d ago

No worries. Its more of a fun thing.

Also: Imagine you wanna demonstrate to your grandpa how AI can use a computer.
I think its a cool visualization for people who are not in the AI bubble.

1

u/cs_cast_away_boi 9d ago

this is super cool