Dom/rpa_vision_v3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: replay E2E fonctionnel — 25/25 actions, 0 retries, SomEngine via serveur

Browse Source 
Validé sur PC Windows (DESKTOP-58D5CAC, 2560x1600) :
- 8 clics résolus visuellement (1 anchor_template, 1 som_text_match, 6 som_vlm)
- Score moyen 0.75, temps moyen 1.6s
- Texte tapé correctement (bonjour, test word, date, email)
- 0 retries, 2 actions non vérifiées (OK)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Dom
2026-03-31 14:04:41 +02:00
parent 5e0b53cfd1
commit a7de6a488b
79542 changed files with 6091757 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
data/training/live_sessions/sess_20260314T102557_dada53/live_events.jsonl Normal file
View File

@@ -0,0 +1,4 @@
{"session_id": "sess_20260314T102557_dada53", "timestamp": 1773480363.5277069, "event": {"type": "heartbeat", "image": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T102557_dada53\\shots\\context_1773480358_heartbeat.png", "timestamp": 1773480358.4841778}}
{"session_id": "sess_20260314T102557_dada53", "timestamp": 1773480371.2984886, "event": {"type": "window_focus_change", "from": null, "to": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "timestamp": 1773480358.4643087, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_context": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T102557_dada53\\shots\\context_1773480358_focus_change.png"}}
{"session_id": "sess_20260314T102557_dada53", "timestamp": 1773480383.704044, "event": {"type": "mouse_click", "button": "left", "pos": [856, 1585], "timestamp": 1773480360.6086056, "window": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "screenshot_id": "shot_0001", "vision_info": {"full": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T102557_dada53\\shots\\shot_0001_full.png", "crop": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T102557_dada53\\shots\\shot_0001_crop.png"}}}
{"session_id": "sess_20260314T102557_dada53", "timestamp": 1773480391.4149888, "event": {"type": "window_focus_change", "from": {"title": "RPA Vision V3 - Agent V1", "app_name": "WindowsTerminal.exe"}, "to": {"title": "Rechercher", "app_name": "SearchHost.exe"}, "timestamp": 1773480361.5952103, "window": {"title": "Rechercher", "app_name": "SearchHost.exe"}, "screenshot_context": "C:\\rpa_vision\\agent_v1\\sessions\\sess_20260314T102557_dada53\\shots\\context_1773480361_focus_change.png"}}