This is the Linux app named Seamless Communication whose latest release can be downloaded as seamless_communicationsourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Seamless Communication with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
Seamless Communication
DESCRIPTION
Seamless Communication is a research project focused on building more integrated, low-latency multimodal communication between humans and AI agents. The motivation is to move beyond “text in, text out” and enable direct, live, multi-turn exchange involving language, gesture, gaze, vision, and modality switching without user friction. The system architecture includes a real-time multimodal signal pipeline for audio, video, and sensor data, a dialog manager that can decide when to act (speak, gesture, point) or query, and a cross-modal reasoning layer that fuses perception with semantic context. The research prototype includes components for visual grounding (understanding when a user references something in view), gesture recognition and synthesis, and turn-taking mechanisms that mirror human conversational timing. Because latency and synchronization are critical, the codebase invests in asynchronous scheduling, overlap of perception and reasoning, and fast fallback responses.
Features
- Real-time pipeline for audio, video, sensor fusion and synchronization
- Dialogue manager coordinating actions, queries, gestures, and speech
- Visual grounding to resolve references to objects in view
- Gesture recognition and synthesis to complement verbal output
- Asynchronous scheduling to minimize latency and support overlap
- Demo scenarios for collaborative tasks in shared spatial or AR settings
Programming Language
C
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/seamless-communication.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
