AI/Microsoft-fara
1
0
Fork 0
mirror of https://github.com/microsoft/fara.git synced 2026-06-10 02:54:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update WebTailBench results and success rate definition

Browse Source 
Added revised WebTailBench numbers and clarified process success definition.
This commit is contained in:
Corby Rosset
2026-04-20 18:13:41 -04:00
committed by GitHub
parent 3e07b2be83
commit 273614e6f4
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -152,6 +152,8 @@ We are releasing **[WebTailBench](https://huggingface.co/datasets/microsoft/WebT
#### WebTailBench Results (Process / Outcome)
UPDATE: we release revised WebTailBench numbers from the new Universal Verifier below, reporting both process- and outcome-based success rate. Process sucess is defined by whether the assessed rubric score is at least 80%.
| Task Segment | Tasks | SoM GPT-5 | SoM o3 | SoM 4o | GLM-4.1V-9B | OAI Comp-Use | UI-TARS-1.5 | **Fara-7B** |
|----------------|-------|-----------------|-----------------|-----------------|-----------------|-----------------|-----------------|-----------------|
| **Single-Site Tasks** |