This is the Linux app named Midscene whose latest release can be downloaded as v1.7.3sourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Midscene with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
Midscene
DESCRIPTION:
Midscene.js is an open source AI-driven UI automation framework designed to control user interfaces across multiple platforms using natural language instructions. Instead of relying on traditional selectors, DOM structures, or accessibility attributes, it uses a vision-first approach where screenshots are analyzed by visual-language models to identify interface elements and perform actions. It allows developers to automate interactions on web applications, desktop software, and mobile devices without needing platform-specific automation logic. Developers can describe tasks such as clicking buttons, filling forms, or extracting information, and the system interprets these commands to interact with the interface accordingly. Midscene.js includes SDKs, scripting options, and integration capabilities that allow automation workflows to be written in JavaScript, TypeScript, or YAML-based scripts. Midscene also provides debugging and development tools.
Features
- Vision-based UI element detection using screenshots instead of DOM selectors
- Natural language automation that interprets user instructions into UI actions
- Cross-platform support for web browsers, desktop applications, and mobile devices
- JavaScript and YAML scripting support for building automation workflows
- Built-in debugging tools including visual replay reports and playground tools
- Integration with automation tools and frameworks for browser and device control
Programming Language
JavaScript, TypeScript
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/midscene.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.