Dom/rpa_vision_v3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: replay E2E fonctionnel — 25/25 actions, 0 retries, SomEngine via serveur

Browse Source 
Validé sur PC Windows (DESKTOP-58D5CAC, 2560x1600) :
- 8 clics résolus visuellement (1 anchor_template, 1 som_text_match, 6 som_vlm)
- Score moyen 0.75, temps moyen 1.6s
- Texte tapé correctement (bonjour, test word, date, email)
- 0 retries, 2 actions non vérifiées (OK)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Dom
2026-03-31 14:04:41 +02:00
parent 5e0b53cfd1
commit a7de6a488b
79542 changed files with 6091757 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
data/training/live_sessions/sess_20260312T105742_a108e6/live_events.jsonl Normal file
View File

@@ -0,0 +1,5 @@
{"session_id": "sess_20260312T105742_a108e6", "timestamp": 1773309462.4654844, "event": {"type": "window_focus_change", "from": null, "to": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "timestamp": 1773309462.3281152, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_context": ""}}
{"session_id": "sess_20260312T105742_a108e6", "timestamp": 1773309465.4122849, "event": {"type": "heartbeat", "image": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T105742_a108e6\\shots\\context_1773309462_heartbeat.png", "timestamp": 1773309462.4682775}}
{"session_id": "sess_20260312T105742_a108e6", "timestamp": 1773309497.9602792, "event": {"type": "heartbeat", "image": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T105742_a108e6\\shots\\context_1773309492_heartbeat.png", "timestamp": 1773309492.919285}}
{"session_id": "sess_20260312T105742_a108e6", "timestamp": 1773309542.9974213, "event": {"type": "mouse_click", "button": "left", "pos": [2124, 1538], "timestamp": 1773309532.8196232, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_id": "shot_0001", "vision_info": {"full": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T105742_a108e6\\shots\\shot_0001_full.png", "crop": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T105742_a108e6\\shots\\shot_0001_crop.png"}}}
{"session_id": "sess_20260312T105742_a108e6", "timestamp": 1773309550.071422, "event": {"type": "window_focus_change", "from": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "to": {"title": "Fen\u00eatre de d\u00e9passement de capacit\u00e9 de la barre d\u2019\u00e9tat syst\u00e8me.", "app_name": "explorer.exe"}, "timestamp": 1773309533.0573182, "window": {"title": "Fen\u00eatre de d\u00e9passement de capacit\u00e9 de la barre d\u2019\u00e9tat syst\u00e8me.", "app_name": "explorer.exe"}, "screenshot_context": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260312T105742_a108e6\\shots\\context_1773309533_focus_change.png"}}