The controlui-runner consists of two main components: controlui-server and controlui-client. The controlui-server acts as a control server, which takes screenshots, records the screen and controls the keyboard and mouse. Additionally, it starts a websocket connection on host 127.0.0.1 and port 6769 to allow controls from the controlui-client. The server can be controlled over the controlui protocol (CUP).The controlui-client creates the execution, runs the steps against the controlui-server and uploads the results.

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/8c084a0d-6107-4fd8-9852-2910681b78c5/grafik-20210923-122414.png

Controlui Server

The controlui-server is a desktop application and consists of only one window and the tray.

<aside> ℹ️ Only on screen can be automated in a multi screen environment

</aside>

Supported Operating Systems:

Download

Here you can download the controlui-server binaries:

Windows:

Untitled Database

Linux:

Untitled Database

Tutorial

Start controlui-server and select screen

  1. Open controlui-server.*

  2. Application shows all connected screens:

    https://s3-us-west-2.amazonaws.com/secure.notion-static.com/a3334985-fc46-44b7-9143-db7f35691808/grafik-20210923-114523.png

  3. Click on “Screen 0” → Application minimizes and is available as a tray icon.

    https://s3-us-west-2.amazonaws.com/secure.notion-static.com/673dbbc3-aeae-454f-ae65-b4c71715e27d/grafik-20210923-123435.png

    1. Stop Recording: Unselect a screen
    2. Show: Opens window again
    3. Quit: Closes the control-server

Commandline Interface