This is the Linux app named ML Ferret whose latest release can be downloaded as ml-ferretsourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named ML Ferret with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
ML Ferret
DESCRIPTION:
Ferret is Apple’s end-to-end multimodal large language model designed specifically for flexible referring and grounding: it can understand references of any granularity (boxes, points, free-form regions) and then ground open-vocabulary descriptions back onto the image. The core idea is a hybrid region representation that mixes discrete coordinates with continuous visual features, so the model can fluidly handle “any-form” referring while maintaining precise spatial localization. The repo presents the vision-language pipeline, model assets, and paper resources that show how Ferret answers questions, follows instructions, and returns grounded outputs rather than just text. In practice, this enables tasks like “find that small red icon next to the chart and describe it” where both the linguistic reference and the visual region are ambiguous without fine spatial reasoning.
Features
- Any-form referring and precise visual grounding
- Hybrid region representation combining coordinates and features
- Open-vocabulary recognition with grounded outputs
- Instruction following for multimodal QA and editing prompts
- Assets and training scripts aligned to the research paper
- Research baseline for fine-grained spatial reasoning in MLLMs
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/ml-ferret.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.