This is the Linux app named Summarize from Feedback whose latest release can be downloaded as summarize-from-feedbacksourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Summarize from Feedback with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
Summarize from Feedback
DESCRIPTION
The summarize-from-feedback repository implements the methods from the paper “Learning to Summarize from Human Feedback”. Its purpose is to train a summarization model that better aligns with human preferences by first collecting human feedback (comparisons between summaries) to train a reward model, and then fine-tuning a policy (summarizer) to maximize that learned reward. The code includes different stages: a supervised baseline (i.e. standard summarization training), the reward modeling component, and the reinforcement learning (or preference-based fine-tuning) phase. The repo also includes utilities for dataset handling, modeling architectures, inference, and evaluation. Because the codebase is experimental, parts of it may not run out-of-box depending on dependencies or environment, but it remains a canonical reference for how to implement summarization via human feedback.
Features
- Supervised baseline summarization model to initialize performance
- Reward model trained from human comparisons of summary pairs
- Preference-based fine-tuning / RL stage to optimize summarizer toward human judgments
- Dataset handling modules (loading, comparisons, splits)
- Inference and evaluation scripts to generate and score summaries
- Architecture layout files (e.g. model_layout.py) supporting modular model definitions
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/summarize-from-feedback.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
