Dom/rpa_vision_v3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: chat unifié, GestureCatalog, Copilot, Léa UI, extraction données, vérification replay

Browse Source 
Refonte majeure du système Agent Chat et ajout de nombreux modules :

- Chat unifié : suppression du dual Workflows/Agent Libre, tout passe par /api/chat
  avec résolution en 3 niveaux (workflow → geste → "montre-moi")
- GestureCatalog : 38 raccourcis clavier universels Windows avec matching sémantique,
  substitution automatique dans les replays, et endpoint /api/gestures
- Mode Copilot : exécution pas-à-pas des workflows avec validation humaine via WebSocket
  (approve/skip/abort) avant chaque action
- Léa UI (agent_v0/lea_ui/) : interface PyQt5 pour Windows avec overlay transparent
  pour feedback visuel pendant le replay
- Data Extraction (core/extraction/) : moteur d'extraction visuelle de données
  (OCR + VLM → SQLite), avec schémas YAML et export CSV/Excel
- ReplayVerifier (agent_v0/server_v1/) : vérification post-action par comparaison
  de screenshots, avec logique de retry (max 3)
- IntentParser durci : meilleur fallback regex, type GREETING, patterns améliorés
- Dashboard : nouvelles pages gestures, streaming, extractions
- Tests : 63 tests GestureCatalog, 47 tests extraction, corrections tests existants
- Dépréciation : /api/agent/plan et /api/agent/execute retournent HTTP 410,
  suppression du code hardcodé _plan_to_replay_actions

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
Dom
2026-03-15 10:02:09 +01:00
parent 74a1cb4e03
commit cf495dd82f
93 changed files with 12463 additions and 1080 deletions
Download Patch File Download Diff File Expand all files Collapse all files

31
monitoring_server.py
View File

@@ -1,6 +1,7 @@
"""RPA Vision V3 - Serveur de Monitoring (port 5003)."""
from flask import Flask, render_template_string
import psutil
import json
from datetime import datetime
app = Flask(__name__)
@@ -11,7 +12,7 @@ def monitoring():
<!DOCTYPE html>
<html>
<head>
<title>🎼 RPA Vision V3 - Monitoring</title>
<title>RPA Vision V3 - Monitoring</title>
<meta http-equiv="refresh" content="5">
<style>
body { font-family: Arial; margin: 20px; background: #f5f5f5; }
@@ -26,34 +27,30 @@ def monitoring():
</head>
<body>
<div class="container">
<h1>🎼 RPA Vision V3 - Monitoring Dashboard</h1>
<h1>RPA Vision V3 - Monitoring Dashboard</h1>
<div class="card">
<h2>📊 System Metrics</h2>
<h2>System Metrics</h2>
<div class="metric">CPU: {{ cpu }}%</div>
<div class="metric">Memory: {{ memory }}%</div>
<div class="metric">Disk: {{ disk }}%</div>
<div class="metric">Uptime: {{ uptime }}</div>
</div>
<div class="card">
<h2>🌐 Services Status</h2>
<h2>Services Status</h2>
<div class="services">
<div>API Server (8000): <span class="status-ok">✅ Running</span></div>
<div>Dashboard (5001): <span class="status-ok">✅ Running</span></div>
<div>Monitoring (5003): <span class="status-ok">✅ Running</span></div>
<div>Command (5002): <span class="status-warning">⚠️ Optional</span></div>
<div>API Server (8000): <span id="api-status">Checking...</span></div>
<div>Dashboard (5001): <span id="dashboard-status">Checking...</span></div>
<div>VWB Backend (5002): <span id="vwb-status">Checking...</span></div>
<div>Monitoring (5003): <span class="status-ok">Running</span></div>
<div>Agent Chat (5004): <span id="chat-status">Checking...</span></div>
<div>Streaming (5005): <span id="stream-status">Checking...</span></div>
<div>VWB Frontend (3002): <span id="workflow-status">Checking...</span></div>
</div>
</div>
<div class="card">
<h2>📈 RPA Vision V3 Status</h2>
<p>✅ Fiche #1 & #2 Corrections Applied</p>
<p>🎯 BBOX Precision: ~95% (improved from ~60%)</p>
<p>🔧 All contrats de données unified</p>
<p>🚀 Full ecosystem running!</p>
</div>
</div>
</body>
</html>
''',
''',
cpu=psutil.cpu_percent(),
memory=psutil.virtual_memory().percent,
disk=psutil.disk_usage('/').percent,