Dom/rpa_vision_v3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: replay E2E fonctionnel — 25/25 actions, 0 retries, SomEngine via serveur

Browse Source 
Validé sur PC Windows (DESKTOP-58D5CAC, 2560x1600) :
- 8 clics résolus visuellement (1 anchor_template, 1 som_text_match, 6 som_vlm)
- Score moyen 0.75, temps moyen 1.6s
- Texte tapé correctement (bonjour, test word, date, email)
- 0 retries, 2 actions non vérifiées (OK)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Dom
2026-03-31 14:04:41 +02:00
parent 5e0b53cfd1
commit a7de6a488b
79542 changed files with 6091757 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
data/training/live_sessions/sess_20260312T160723_697ef4/live_events.jsonl Normal file
View File

@@ -0,0 +1,4 @@
{"session_id": "sess_20260312T160723_697ef4", "timestamp": 1773328049.1478407, "event": {"type": "heartbeat", "image": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T160723_697ef4\\shots\\context_1773328044_heartbeat.png", "timestamp": 1773328044.0968888}}
{"session_id": "sess_20260312T160723_697ef4", "timestamp": 1773328051.168717, "event": {"type": "window_focus_change", "from": null, "to": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "timestamp": 1773328044.1431766, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_context": ""}}
{"session_id": "sess_20260312T160723_697ef4", "timestamp": 1773328064.835903, "event": {"type": "mouse_click", "button": "left", "pos": [2137, 1560], "timestamp": 1773328050.5235949, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_id": "shot_0001", "vision_info": {"full": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T160723_697ef4\\shots\\shot_0001_full.png", "crop": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T160723_697ef4\\shots\\shot_0001_crop.png"}}}
{"session_id": "sess_20260312T160723_697ef4", "timestamp": 1773328071.9270766, "event": {"type": "window_focus_change", "from": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "to": {"title": "Fen\u00eatre de d\u00e9passement de capacit\u00e9 de la barre d\u2019\u00e9tat syst\u00e8me.", "app_name": "explorer.exe"}, "timestamp": 1773328050.7093427, "window": {"title": "Fen\u00eatre de d\u00e9passement de capacit\u00e9 de la barre d\u2019\u00e9tat syst\u00e8me.", "app_name": "explorer.exe"}, "screenshot_context": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T160723_697ef4\\shots\\context_1773328050_focus_change.png"}}