This is the Linux app named Perception Models whose latest release can be downloaded as perception_modelssourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Perception Models with OnWorks for free.
Suivez ces instructions pour exécuter cette application :
- 1. Téléchargé cette application sur votre PC.
- 2. Entrez dans notre gestionnaire de fichiers https://www.onworks.net/myfiles.php?username=XXXXX avec le nom d'utilisateur que vous voulez.
- 3. Téléchargez cette application dans ce gestionnaire de fichiers.
- 4. Démarrez l'émulateur en ligne OnWorks Linux ou Windows en ligne ou l'émulateur en ligne MACOS à partir de ce site Web.
- 5. Depuis le système d'exploitation OnWorks Linux que vous venez de démarrer, accédez à notre gestionnaire de fichiers https://www.onworks.net/myfiles.php?username=XXXXX avec le nom d'utilisateur que vous souhaitez.
- 6. Téléchargez l'application, installez-la et exécutez-la.
CAPTURES D'ÉCRAN:
Modèles de perception
DESCRIPTION:
Perception Models is a state-of-the-art framework developed by Facebook Research for advanced image and video perception tasks. It introduces two primary components: the Perception Encoder (PE) for visual feature extraction and the Perception Language Model (PLM) for multimodal decoding and reasoning. The PE module is a family of vision encoders designed to excel in image and video understanding, surpassing models like SigLIP2, InternVideo2, and DINOv2 across multiple benchmarks. Meanwhile, PLM integrates with PE to power vision-language modeling, achieving results competitive with leading multimodal systems such as QwenVL2.5 and InternVL3, all while being fully reproducible with open data. The project supports a wide range of research applications, from visual recognition and dense prediction to fine-grained multimodal understanding. Additionally, it includes several large-scale open datasets for both image and video perception.
Comment ça marche
- Combines Perception Encoder (PE) for vision encoding and Perception Language Model (PLM) for multimodal decoding
- State-of-the-art performance in image, video, and vision-language benchmarks
- Open, reproducible models using freely available datasets for transparency
- Multiple PE variants specialized for core, language-aligned, and spatial tasks
- PLM available in 1B, 3B, and 8B parameter sizes for flexible research needs
- Integrated with popular tools such as Hugging Face Transformers, timm, and lmms-eval
Langage de programmation
Python
Catégories
This is an application that can also be fetched from https://sourceforge.net/projects/perception-models.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.