This is the Linux app named Seamless Communication whose latest release can be downloaded as seamless_communicationsourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Seamless Communication with OnWorks for free.
Siga estas instrucciones para ejecutar esta aplicación:
- 1. Descargue esta aplicación en su PC.
- 2. Ingrese en nuestro administrador de archivos https://www.onworks.net/myfiles.php?username=XXXXX con el nombre de usuario que desee.
- 3. Cargue esta aplicación en dicho administrador de archivos.
- 4. Inicie el emulador en línea OnWorks Linux o Windows en línea o el emulador en línea MACOS desde este sitio web.
- 5. Desde el SO OnWorks Linux que acaba de iniciar, vaya a nuestro administrador de archivos https://www.onworks.net/myfiles.php?username=XXXXX con el nombre de usuario que desee.
- 6. Descarga la aplicación, instálala y ejecútala.
SCREENSHOTS
Ad
Comunicación fluida
DESCRIPCIÓN
Seamless Communication is a research project focused on building more integrated, low-latency multimodal communication between humans and AI agents. The motivation is to move beyond “text in, text out” and enable direct, live, multi-turn exchange involving language, gesture, gaze, vision, and modality switching without user friction. The system architecture includes a real-time multimodal signal pipeline for audio, video, and sensor data, a dialog manager that can decide when to act (speak, gesture, point) or query, and a cross-modal reasoning layer that fuses perception with semantic context. The research prototype includes components for visual grounding (understanding when a user references something in view), gesture recognition and synthesis, and turn-taking mechanisms that mirror human conversational timing. Because latency and synchronization are critical, the codebase invests in asynchronous scheduling, overlap of perception and reasoning, and fast fallback responses.
Caracteristicas
- Real-time pipeline for audio, video, sensor fusion and synchronization
- Dialogue manager coordinating actions, queries, gestures, and speech
- Visual grounding to resolve references to objects in view
- Gesture recognition and synthesis to complement verbal output
- Asynchronous scheduling to minimize latency and support overlap
- Demo scenarios for collaborative tasks in shared spatial or AR settings
Lenguaje de programación
C
Categorías
This is an application that can also be fetched from https://sourceforge.net/projects/seamless-communication.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
