RDP / VNC / Android / X11 / Wayland

Control desktops and Android with your AI agent

Explore remote screenshots, keyboard and mouse control, file transfer, clipboard, audio and multiple monitors. See what each protocol supports and how to take over the same session.

One remote desktop. A complete workflow.

Let your AI agent work on remote devices. Join whenever you need to.

Control RDP desktops, VNC desktops, X11 applications and Android without opening a local viewer. Watch or take over the same session through rdp-cli’s GUI or web viewer.

One executable for your operating system and processor. Check the downloaded file’s capabilities before using the commands below.

See the part that matters

Request a screen region or a smaller image. Compare it with an earlier observation and skip the image when nothing changed; coordinates remain tied to the remote screen.

Wait for a change or a completed transfer

Wait for a region to change or settle, or for a connection, operation or file transfer to reach a specified state. Verify the actual outcome before continuing.

Send a short sequence, with a place to stop

Combine actions your agent has chosen, include a new observation and stop at a checkpoint. Errors or a control change stop later steps; already sent actions are not rolled back.

Keep a record and continue deliberately

Save task progress, checkpoints and selected images. Export a local report, inspect what completed after an interruption, and start new steps without replaying uncertain actions.

Give each agent a name and a turn

Registered agents explicitly hand control to each other. A person can take over through the GUI or web viewer, then hand back to a chosen agent, which observes again before acting.

Connect your agent and find connection problems

Use the executable’s built-in MCP interface or CLI. Save named connection profiles with credential references and use doctor to inspect the available connection layers.

Choose the phone’s main screen or a virtual display

On a supported Android device, explicitly create a virtual display and start an app there. Agent, GUI and web viewer use that display; app behavior and system audio permissions still apply.

Quick start →
01

Let your agent work

Connect to the right device, inspect its screen and send one action at a time. Verify each result before continuing.

RDP / VNC / X11 / Android

Command-driven remote work

Capture the desktop, click, drag, scroll, enter text and send shortcuts. The agent reads the returned JSON and checks the next screenshot to see what actually happened. A successful input dispatch alone does not confirm the task result.

  • JSON results, error codes, operation queries and event subscriptions help your agent decide whether to continue, wait or recover. Inspect a fresh screenshot to verify the application outcome.

Take a screenshot, act using its observation token, then capture again.

Quick start
01 / Commands do the work
rdp-cli screenshot --session SESSION --out before.png

rdp-cli clipboard set --session SESSION \
  --text "Result: report completed and ready for review." \
  --observation OBSERVATION

rdp-cli key --session SESSION \
  --keys CTRL+V --observation OBSERVATION

rdp-cli screenshot --session SESSION --out result.png

RDP / VNC / X11 / Android

RDP / VNC / Android / X11 / Wayland

rdp-cli is a free remote access tool built for AI agents: control RDP and VNC desktops, Android phones and Linux X11 applications. Access Wayland desktops through an existing RDP or VNC server. Watch the same session in a desktop window or browser and take over whenever you need.

  • Control desktop applications, exchange files, and use audio or multiple displays when the remote server supports them.
  • Use an existing VNC server to view and control its desktop. Text clipboard support depends on the server; file transfer, audio and display layout changes are not available through VNC.
  • View and control Android 12+ phones over ADB via USB or Wi-Fi. Debugging authorization is required. Tested on Pixel 3 with Android 12; compatibility with other devices may vary.

View and control Android 12+ phones over ADB via USB or Wi-Fi. Debugging authorization is required. Tested on Pixel 3 with Android 12; compatibility with other devices may vary.

Quick start

Connect from Linux to Windows RDP with one executable →

Connect to VNC and verify input from the command line →

RDP / VNC / X11 / Android

Several desktops. Persistent sessions.

Keep multiple sessions connected and address each one by its session ID. Closing a read-only viewer keeps the connection. Reconnection invalidates old observations and leaves control paused; review the current screen before explicitly resuming.

  • One command can finish while the remote connection remains open. Session IDs keep later actions attached to the right desktop; reconnecting pauses input for a fresh observation.

List current sessions, inspect one session, and disconnect only the session you no longer need.

Quick start

Troubleshoot RDP connections, black screens and blocked input →

02

See, guide and take over

Watch the same session from a window or an authorized browser. Pause, make a change yourself and hand control back.

RDP / VNC / X11 / Android

Watch, pause and take over

Work headlessly by default. When you want to watch or intervene, open the same session in the desktop window or an authorized browser. Windows and Mac use system controls; Linux includes its lightweight interface in the executable. The interface supports ten languages, with light and dark viewer windows. Taking control pauses agent input; handing back lets the agent continue from a fresh view.

  • Opening another viewer reuses the existing connection. Several people can watch; one controller acts at a time. After a person hands control back, the agent observes the updated screen.

Watch a task, take control for a correction, then return the same session to the agent.

Quick start
See a real handoff

An agent prepares a service report in LibreOffice Calc on a remote Windows desktop. A person reviews it in the browser and hands control back.

  1. Watch the agent work

    The agent checks the report and leaves it ready for review.

  2. Pause the task

    Pause remote input while keeping the report visible.

  3. Take control and review

    Take control in the browser and add an approval to the same workbook.

  4. Release and verify

    Return control. The agent saves the reviewed workbook and retrieves the file.

The saved workbook contains both the agent’s note and the human approval. Download the actual file.

Download the actual result · XLSX (11.9 KB)

Download the actual result · XLSX (11.9 KB)

Real running software, captured separately in ten languages and two themes. The report uses fictional sample data.

RDP / VNC / X11 / Android

Your active sessions, together

Manage sessions from the Mac menu bar, Windows tray or Linux panel. See the target, connection, controller, current or recent actions, file progress and errors. Supported desktop icons indicate Agent activity. Open a viewer, pause or disconnect the selected session.

  • Find a Mac session by name or address, or select it from the Windows tray. Pause all sessions from the status menu when you need a break. On Linux, use the searchable session panel; a status icon is also available when the desktop supports it. Without a tray, open the panel with presence show --panel.

Open the existing session without a second login. On Linux, the status icon depends on the desktop; presence show --panel opens the panel directly.

Quick start

RDP / VNC / X11 / Android

Follow each remote action

In desktop and Web viewers, follow the Agent pointer, left/right/middle clicks, double-clicks, dragging, scrolling, shortcuts and typing counts. File progress appears separately, with its human or Agent origin. Hints do not repeat entered text or appear in screenshots; the remote screen itself is not redacted.

  • A held key or mouse button remains visible alongside a separate file-transfer line, even with the file panel closed. Transfers identify their human or Agent origin. Sensitive input hides text and character counts. Hints follow the viewer’s language and theme; adjust or hide them without changing the remote task.

Hints show input activity; check the remote result before calling a task complete.

Quick start

RDP / VNC / X11 / Android

Use your existing access

Connect with a local or domain account. Save and reference credentials using the supported credential store, and grant browser resources explicitly. RDP certificate settings and VNC security modes have different boundaries; choose them for your environment.

  • Save a credential in the system credential store and reference it later. Give browser viewers only the resources they need, and revoke their access when the task ends.

Separate permission to view a session from permission to control input, files or microphone.

Quick start
03

Move the whole task forward

Use multiple displays, send project folders, exchange text and listen to remote sound. Bring the results back when they are ready.

RDP

Work across screens

For a negotiated multi-monitor RDP session, capture the full desktop or one monitor, target a screen and drag across screens. Native viewers can open separate monitor windows; browser viewers can switch screens. Resizing a viewer changes its presentation, not the remote layout.

  • Capture and target individual displays. Drag across screens.
  • Open per-display native windows, or switch screens in the browser.
  • View a remote dual-display workspace even from a single-screen computer.

Inspect one screen while keeping an overview of the complete desktop.

Quick start

RDP / X11 / Android

Exchange files and folders

Upload and download files or folders with their directory structure. Follow individual transfer progress and results. Cancel when needed. Choose whether to replace existing files; transferred content is verified.

Transfer a report folder, edit a document remotely and retrieve the saved result; this is not arbitrary access to remote disks.

Quick start
  • RDP: exchange files through the redirected session drive. Remote policy must allow drive redirection.
  • X11 / SSH: transfer files through the server’s existing SFTP service, within the directory you select. X11 →
  • Android: transfer files within the phone’s session folder. VNC has no file-transfer channel. Android →

RDP

  1. Upload

    Files and folders → session exchange drive

  2. Process remotely

    Open, edit and save the resulting file

  3. Download

    Follow transfer progress and verify the completed file

Upload a prepared workbook → update it in remote Calc → save → download. The downloaded workbook’s note, formulas, totals and chart were checked.

See the real spreadsheet and video workflows →

Upload and download files over RDP from the command line →

RDP / VNC / X11 / Android

Use the remote text clipboard

Read or set remote clipboard text explicitly, and paste it with a shortcut. This does not automatically synchronize your local clipboard. RDP clipboard access depends on server policy; VNC text encoding depends on negotiation.

  • Move an address, a paragraph or tabular text through the remote clipboard. The type command can enter supported text directly without replacing the clipboard.

Set the remote clipboard, send CTRL+V and inspect the application result.

Quick start

RDP

Route RDP sound and microphone independently

Choose RDP playback and microphone routing independently: viewer, controlled computer or off. Controlled-computer audio requires the matching Windows rdp-cli audio service. Recording always starts explicitly and depends on device availability and server policy.

  • Multiple authorized viewers can listen at the same time.
  • Take control and explicitly enable a microphone when voice input is needed.
  • Handing back control or disconnecting stops capture. Enable it again to resume.

Prepare a voice-enabled remote task without sending sound or microphone data to the wrong computer.

Quick start

Choose where RDP sound and microphone work →

Android · USB / Wi-Fi

Give your AI agent a real Android screen.

Connect a phone over USB or Wi-Fi. Let your agent observe, tap, type and retrieve results with commands, while you follow the same session in a window or browser.

Android phone · USB / Wi-Fi →

Android-enabled downloads: macOS · Apple silicon · macOS · Intel · Windows · x64 · Windows · x86 · Windows · ARM64 · Linux · x86_64 · Linux · ARM64

See and act

Capture the real screen, use taps, swipes, drags and two-finger gestures, and check the result with a new screenshot.

Text, files and apps

Explicitly paste Unicode text, transfer files and folders, and install, launch or stop a single-APK application.

Observe and take over

Share one persistent session with an agent, a native viewer and authorized browsers. Pause or take control when needed.

Android 12 or later is the support baseline. The verified device is Google Pixel 3 running Android 12; this does not claim testing of every manufacturer or later Android release.

Connect an Android phone →

What to expect

Linux · X11 / SSH · Wayland RDP / VNC

Let an AI Agent Control Linux Apps over X11 and SSH

Connect an existing Linux desktop or forward one X11 application, work through screenshot and input commands, transfer results, and let a person join the same session.

Download: macOS · Apple siliconmacOS · IntelWindows · x64Windows · x86Windows · ARM64Linux · x86_64Linux · ARM64

One session for your agent and you

rdp-cli lets an AI agent see and operate a Linux application through commands. The agent captures a screen, acts on the observed target and checks the next screen. You can open a native window or an authorized web viewer to watch, pause or take control of that same session.

Open one application

This example opens an already installed Gedit in an isolated display managed inside rdp-cli. It opens no local viewer by default. Save data.session from the response as SESSION. A host whose normal desktop uses Wayland can still forward an X11-compatible application this way.

Or join an existing X11 desktop

Use the actual display and its existing authorization-file path. The SSH account needs permission to access that display; SSH authentication alone does not grant desktop access. This mode joins the existing desktop rather than creating another login session.

Your active sessions, together
Choose the protocol for the task. · X11
FeaturesX11
Screenshots and keyboard / mouseSupported
Text clipboardDepends on server policy
Files & foldersDepends on server policy
Sound and microphoneNot available
Requested multi-monitor layoutNot available

Native X11 has no playback or microphone redirection. A whole Wayland desktop requires an already configured compatible RDP or VNC endpoint, using its actual negotiated capabilities. rdp-cli does not install or enable a remote service. An application can exit when its display connection is disconnected or lost; save first, and do not assume automatic relaunch or a preserved workspace.

Quick start →

Let an AI Agent Control Linux Apps over X11 and SSH →

From a remote task to a file you can use

Two real workflows: an Agent used rdp-cli commands on a Mac to operate Windows 11 applications over RDP, then retrieved the finished files.

LibreOffice Calc · RDP

Update a report and retrieve the workbook

  1. rdp-cli files upload

    Upload a prepared workbook with twelve months of sample data, a chart and totals.

  2. rdp-cli screenshot → click / type / key

    Open it in remote Calc, paste a completion note through rdp-cli and save the workbook.

  3. rdp-cli files download

    Save and retrieve the XLSX. Verify the chart and totals: 15,230 requests, 14,933 resolved, 14,140 within target.

Shotcut · RDP

Export a video project and retrieve the MP4

  1. rdp-cli files upload

    Upload the original animation and a prepared four-second Shotcut project.

  2. rdp-cli screenshot → click / type / key

    Open the project in remote Shotcut and start the MP4 export through its interface.

  3. rdp-cli files download

    Export MP4 and retrieve it. Verify 96 video frames at 24 fps, 960 × 540, and a matching transfer checksum.

Real application recordings, captured on 20 October 2026 in ten languages and both light and dark themes. The data is fictional and the animation is original. These are task examples, not performance benchmarks.

Choose the protocol for the task.

RDP and VNC share the command workflow. The table below compares their extra capabilities, which depend on the protocol and the remote server.

FeaturesRDPVNC
Screenshots and keyboard / mouseSupportedSupported
Text clipboardDepends on server policyDepends on negotiated encoding
Files & foldersDepends on server policyNot available
Sound and microphoneDepends on server policyNot available
Requested multi-monitor layoutDepends on server policyNot available

VNC security depends on the selected mode. Classic VNC is unencrypted; use a trusted network or VPN. VeNCrypt X509Plain uses TLS and requires certificate verification.

Browser viewing and control work on your LAN or VPN.