This is the Linux app named PRM800K whose latest release can be downloaded as prm800ksourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named PRM800K with OnWorks for free.
Befolgen Sie diese Anweisungen, um diese App auszuführen:
- 1. Diese Anwendung auf Ihren PC heruntergeladen.
- 2. Geben Sie in unserem Dateimanager https://www.onworks.net/myfiles.php?username=XXXXX den gewünschten Benutzernamen ein.
- 3. Laden Sie diese Anwendung in einem solchen Dateimanager hoch.
- 4. Starten Sie den OnWorks Linux-Online- oder Windows-Online-Emulator oder den MACOS-Online-Emulator von dieser Website.
- 5. Rufen Sie vom gerade gestarteten OnWorks Linux-Betriebssystem aus unseren Dateimanager https://www.onworks.net/myfiles.php?username=XXXXX mit dem gewünschten Benutzernamen auf.
- 6. Laden Sie die Anwendung herunter, installieren Sie sie und führen Sie sie aus.
SCREENSHOTS
Ad
PRM800K
BESCHREIBUNG
PRM800K is a process supervision dataset accompanying the paper Let’s Verify Step by Step, providing 800,000 step-level correctness labels on model-generated solutions to problems from the MATH dataset. The repository releases the raw labels and the labeler instructions used in two project phases, enabling researchers to study how human raters graded intermediate reasoning. Data are stored as newline-delimited JSONL files tracked with Git LFS, where each line is a full solution sample that can contain many step-level labels and rich metadata such as labeler UUIDs, timestamps, generation identifiers, and quality-control flags. Each labeled step can include multiple candidate completions with ratings of -1, 0, or +1, optional human-written corrections (phase 1), and a chosen completion index, along with a final finish reason such as found_error, solution, bad_problem, or give_up.
Eigenschaften
- 800,000 step-level correctness labels for MATH problems via JSONL
- Detailed schema with labeler IDs, timestamps, generations, QC flags, and finish reasons
- Multi-candidate step ratings of -1, 0, +1 with optional human-completion entries
- Labeler instruction docs for both phase 1 and phase 2
- Python grading logic using math normalization and sympy equivalence checks
- Nonstandard MATH train/test split and large-scale scored samples with PRM/ORM eval scripts
Programmiersprache
Python
Kategorien
This is an application that can also be fetched from https://sourceforge.net/projects/prm800k.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
