MCPGame

You can run and connect to the MCP Game server to interact with a virtual house environment, access the MCP terminal, and manage image displays on the TV. This MCP setup lets you execute AI-driven tasks, run backend MCP commands, and explore real-time server communication through an immersive 3D frontend and a responsive terminal interface.

How to use

You interact with the MCP Game by entering the virtual house, moving around with the WASD keys, and looking around with your mouse. Near interactive objects like the door, the TV, or the computer desk, press ENTER to engage. Use the ESC key to exit interfaces or unlock the mouse when needed.

How to install

Prerequisites: you will need Node.js installed on your development machine. You should also have npm available to install dependencies and run the server.

npm install

Start the server in production mode with a standard start command.

npm start

For development with automatic restarts on code changes, use the development script.

npm run dev

Connecting to MCP Backend and Image Servers

The system connects to two backend endpoints: the MCP terminal backend and the image server. Use the following configuration to point the MCP frontend to your backends.

// --- Configuration ---
const MCP_BACKEND_URL = 'http://localhost:3001'; // MCP Terminal backend connection
const IMAGE_SERVER_URL = 'http://localhost:3002'; // Image server connection

Troubleshooting and notes

If you encounter issues with image loading on the TV, verify the image directory contains valid image files and that the image server is running on the expected port. Ensure the MCP backend server is reachable at the configured URL.

The server is designed to avoid image generation failures by using existing images from the designated directory and loading them on demand.

Available tools

imageGeneration

Generates images or selects existing images to display on the TV screen via the image server.

terminalAccess

Provides access to the MCP terminal to input commands and retrieve responses.

toolsEmailWeb

Access tools like email and web search from the MCP Terminal to perform common information tasks.

realTimeComm

Maintains real-time communication between the frontend MCP client and backend servers.