Dom/rpa_vision_v3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: replay E2E fonctionnel — 25/25 actions, 0 retries, SomEngine via serveur

Browse Source 
Validé sur PC Windows (DESKTOP-58D5CAC, 2560x1600) :
- 8 clics résolus visuellement (1 anchor_template, 1 som_text_match, 6 som_vlm)
- Score moyen 0.75, temps moyen 1.6s
- Texte tapé correctement (bonjour, test word, date, email)
- 0 retries, 2 actions non vérifiées (OK)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Dom
2026-03-31 14:04:41 +02:00
parent 5e0b53cfd1
commit a7de6a488b
79542 changed files with 6091757 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
data/training/live_sessions/sess_20260314T105319_e719ba/live_events.jsonl Normal file
View File

@@ -0,0 +1,4 @@
{"session_id": "sess_20260314T105319_e719ba", "timestamp": 1773482004.542332, "event": {"type": "window_focus_change", "from": null, "to": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "timestamp": 1773481999.3195462, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_context": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T105319_e719ba\\shots\\context_1773481999_focus_change.png"}}
{"session_id": "sess_20260314T105319_e719ba", "timestamp": 1773482011.5853794, "event": {"type": "heartbeat", "image": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T105319_e719ba\\shots\\context_1773481999_heartbeat.png", "timestamp": 1773481999.5515091}}
{"session_id": "sess_20260314T105319_e719ba", "timestamp": 1773482023.6719303, "event": {"type": "mouse_click", "button": "left", "pos": [1965, 1359], "timestamp": 1773482002.1097453, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_id": "shot_0001", "vision_info": {"full": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T105319_e719ba\\shots\\shot_0001_full.png", "crop": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T105319_e719ba\\shots\\shot_0001_crop.png"}}}
{"session_id": "sess_20260314T105319_e719ba", "timestamp": 1773482030.7138844, "event": {"type": "window_focus_change", "from": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "to": {"title": "(2237) L\u2019IRAN A-T-IL UN COUP D'AVANCE ? \u265f\ufe0f\ud83c\uddee\ud83c\uddf7 - YouTube - Google Chrome", "app_name": "chrome.exe"}, "timestamp": 1773482002.5132833, "window": {"title": "(2237) L\u2019IRAN A-T-IL UN COUP D'AVANCE ? \u265f\ufe0f\ud83c\uddee\ud83c\uddf7 - YouTube - Google Chrome", "app_name": "chrome.exe"}, "screenshot_context": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T105319_e719ba\\shots\\context_1773482002_focus_change.png"}}