- Frontend v4 accessible sur réseau local (192.168.1.40) - Ports ouverts: 3002 (frontend), 5001 (backend), 5004 (dashboard) - Ollama GPU fonctionnel - Self-healing interactif - Dashboard confiance Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
179 lines
7.5 KiB
Markdown
179 lines
7.5 KiB
Markdown
# RPA Vision V3 - Index de Documentation
|
|
|
|
## 📋 Vue d'Ensemble
|
|
|
|
Ce document sert d'index pour toute la documentation du projet RPA Vision V3.
|
|
|
|
## 🚀 Démarrage Rapide
|
|
|
|
| Fichier | Description | Priorité |
|
|
|---------|-------------|----------|
|
|
| [QUICK_STATUS.txt](QUICK_STATUS.txt) | Status ultra-rapide | ⭐⭐⭐ |
|
|
| [README.md](README.md) | Introduction complète | ⭐⭐⭐ |
|
|
| [NEXT_SESSION.md](NEXT_SESSION.md) | Guide de reprise | ⭐⭐⭐ |
|
|
|
|
**Commande rapide**: `bash status.sh`
|
|
|
|
## 📊 Status & Progression
|
|
|
|
| Fichier | Description | Mise à jour |
|
|
|---------|-------------|-------------|
|
|
| [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md) | Résumé Phase 2 | 22 Nov 2024 |
|
|
| [SESSION_22NOV_CLIP.md](SESSION_22NOV_CLIP.md) | Notes de session | 22 Nov 2024 |
|
|
| [FILES_CREATED_SESSION_22NOV.md](FILES_CREATED_SESSION_22NOV.md) | Fichiers créés | 22 Nov 2024 |
|
|
|
|
## 🎯 Planification
|
|
|
|
| Fichier | Description | Type |
|
|
|---------|-------------|------|
|
|
| [docs/specs/tasks.md](docs/specs/tasks.md) | Task list complète | Plan |
|
|
| [docs/specs/design.md](docs/specs/design.md) | Architecture détaillée | Design |
|
|
| [docs/specs/ROADMAP.md](docs/specs/ROADMAP.md) | Roadmap long terme | Vision |
|
|
|
|
## 🧪 Tests & Validation
|
|
|
|
| Fichier | Description | Status |
|
|
|---------|-------------|--------|
|
|
| [examples/test_clip_simple.py](examples/test_clip_simple.py) | Test CLIP simple | ✅ PASS |
|
|
| [examples/test_clip_embedder.py](examples/test_clip_embedder.py) | Test CLIP complet | ✅ PASS |
|
|
| [examples/test_embedding_pipeline.py](examples/test_embedding_pipeline.py) | Test pipeline | ⏳ TODO |
|
|
| [test_clip.sh](test_clip.sh) | Script de test rapide | ✅ PASS |
|
|
|
|
## 🔧 Configuration & Installation
|
|
|
|
| Fichier | Description | Usage |
|
|
|---------|-------------|-------|
|
|
| [requirements.txt](requirements.txt) | Dépendances Python | `pip install -r` |
|
|
| [install_dependencies.sh](install_dependencies.sh) | Installation auto | `bash install_dependencies.sh` |
|
|
| [install_clip.sh](install_clip.sh) | Installation CLIP | `bash install_clip.sh` |
|
|
|
|
## 🔧 Outils d'Amélioration Continue (Phase 11)
|
|
|
|
| Fichier | Description | Usage |
|
|
|---------|-------------|-------|
|
|
| [analyze_failed_matches.py](analyze_failed_matches.py) | Analyse des échecs | `./analyze_failed_matches.py --last 10` |
|
|
| [monitor_matching_health.py](monitor_matching_health.py) | Monitoring santé | `./monitor_matching_health.py --continuous` |
|
|
| [auto_improve_matching.py](auto_improve_matching.py) | Amélioration auto | `./auto_improve_matching.py --apply` |
|
|
| [MATCHING_TOOLS_README.md](MATCHING_TOOLS_README.md) | Guide complet | ⭐⭐⭐ |
|
|
| [QUICK_START_MATCHING_TOOLS.md](QUICK_START_MATCHING_TOOLS.md) | Démarrage rapide | ⭐⭐⭐ |
|
|
| [PHASE11_MATCHING_IMPROVEMENT_TOOLS.md](PHASE11_MATCHING_IMPROVEMENT_TOOLS.md) | Doc technique | ⭐⭐ |
|
|
| [SUMMARY_PHASE11.md](SUMMARY_PHASE11.md) | Résumé Phase 11 | ⭐⭐ |
|
|
|
|
**Workflow recommandé**:
|
|
```bash
|
|
# Quotidien
|
|
./monitor_matching_health.py
|
|
|
|
# Hebdomadaire
|
|
./analyze_failed_matches.py --since-hours 168
|
|
|
|
# Mensuel
|
|
./auto_improve_matching.py --apply
|
|
```
|
|
|
|
## 📚 Documentation Technique
|
|
|
|
### Core Components
|
|
|
|
| Composant | Fichier | Status |
|
|
|-----------|---------|--------|
|
|
| CLIP Embedder | [core/embedding/clip_embedder.py](core/embedding/clip_embedder.py) | ✅ |
|
|
| Base Embedder | [core/embedding/base_embedder.py](core/embedding/base_embedder.py) | ✅ |
|
|
| Fusion Engine | [core/embedding/fusion_engine.py](core/embedding/fusion_engine.py) | ✅ |
|
|
| FAISS Manager | [core/embedding/faiss_manager.py](core/embedding/faiss_manager.py) | ✅ |
|
|
| State Embedding Builder | [core/embedding/state_embedding_builder.py](core/embedding/state_embedding_builder.py) | ⏳ |
|
|
|
|
### Data Models
|
|
|
|
| Modèle | Fichier | Status |
|
|
|--------|---------|--------|
|
|
| RawSession | [core/models/raw_session.py](core/models/raw_session.py) | ✅ |
|
|
| ScreenState | [core/models/screen_state.py](core/models/screen_state.py) | ✅ |
|
|
| UIElement | [core/models/ui_element.py](core/models/ui_element.py) | ✅ |
|
|
| StateEmbedding | [core/models/state_embedding.py](core/models/state_embedding.py) | ✅ |
|
|
| WorkflowGraph | [core/models/workflow_graph.py](core/models/workflow_graph.py) | ✅ |
|
|
|
|
## 🎓 Guides & Tutoriels
|
|
|
|
| Guide | Description | Niveau |
|
|
|-------|-------------|--------|
|
|
| [NEXT_SESSION.md](NEXT_SESSION.md) | Guide de reprise | Débutant |
|
|
| [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md) | Résumé Phase 2 | Intermédiaire |
|
|
| [docs/specs/design.md](docs/specs/design.md) | Architecture | Avancé |
|
|
|
|
## 📈 Métriques & Performance
|
|
|
|
| Métrique | Valeur | Source |
|
|
|----------|--------|--------|
|
|
| Dimension embeddings | 512D | ViT-B-32 |
|
|
| Temps embedding texte | <10ms | [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md) |
|
|
| Temps embedding image | ~50ms (CPU) | [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md) |
|
|
| Taille modèle | ~350MB | [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md) |
|
|
| Similarité Login/SignIn | 0.899 | [test_clip_simple.py](examples/test_clip_simple.py) |
|
|
|
|
## 🔍 Recherche Rapide
|
|
|
|
### Par Sujet
|
|
|
|
- **CLIP Embedders**: [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md), [clip_embedder.py](core/embedding/clip_embedder.py)
|
|
- **Installation**: [install_dependencies.sh](install_dependencies.sh), [requirements.txt](requirements.txt)
|
|
- **Tests**: [test_clip_simple.py](examples/test_clip_simple.py), [test_clip.sh](test_clip.sh)
|
|
- **Prochaines étapes**: [NEXT_SESSION.md](NEXT_SESSION.md), [tasks.md](docs/specs/tasks.md)
|
|
- **Architecture**: [design.md](docs/specs/design.md), [README.md](README.md)
|
|
|
|
### Par Phase
|
|
|
|
- **Phase 1**: [tasks.md](docs/specs/tasks.md) (Section Phase 1)
|
|
- **Phase 2**: [PHASE2_CLIP_COMPLETE.md](PHASE2_CLIP_COMPLETE.md), [tasks.md](docs/specs/tasks.md) (Section Phase 2)
|
|
- **Phase 3**: [tasks.md](docs/specs/tasks.md) (Section Phase 3)
|
|
- **Phase 4**: [tasks.md](docs/specs/tasks.md) (Section Phase 4)
|
|
|
|
## 🛠️ Scripts Utilitaires
|
|
|
|
| Script | Description | Usage |
|
|
|--------|-------------|-------|
|
|
| [status.sh](status.sh) | Afficher status | `bash status.sh` |
|
|
| [test_clip.sh](test_clip.sh) | Tester CLIP | `bash test_clip.sh` |
|
|
| [install_dependencies.sh](install_dependencies.sh) | Installer deps | `bash install_dependencies.sh` |
|
|
|
|
## 📞 Liens Externes
|
|
|
|
- [OpenCLIP GitHub](https://github.com/mlfoundations/open_clip)
|
|
- [FAISS GitHub](https://github.com/facebookresearch/faiss)
|
|
- [PyTorch Docs](https://pytorch.org/docs/)
|
|
- [Ollama Docs](https://ollama.ai/docs)
|
|
|
|
## 🗂️ Structure du Projet
|
|
|
|
```
|
|
rpa_vision_v3/
|
|
├── INDEX.md # Ce fichier
|
|
├── README.md # Introduction
|
|
├── QUICK_STATUS.txt # Status rapide
|
|
├── PHASE2_CLIP_COMPLETE.md # Résumé Phase 2
|
|
├── SESSION_22NOV_CLIP.md # Notes session
|
|
├── NEXT_SESSION.md # Guide reprise
|
|
├── requirements.txt # Dépendances
|
|
├── core/ # Code core
|
|
│ ├── models/ # Data models
|
|
│ ├── embedding/ # Embedding system
|
|
│ ├── detection/ # UI detection
|
|
│ └── graph/ # Workflow graphs
|
|
├── examples/ # Tests & exemples
|
|
├── tests/ # Tests unitaires
|
|
└── docs/ # Documentation
|
|
└── specs/ # Spécifications
|
|
```
|
|
|
|
## 📝 Notes
|
|
|
|
- Tous les chemins sont relatifs à `rpa_vision_v3/`
|
|
- Les fichiers marqués ✅ sont complets
|
|
- Les fichiers marqués ⏳ sont en cours
|
|
- Voir [NEXT_SESSION.md](NEXT_SESSION.md) pour les prochaines étapes
|
|
|
|
---
|
|
|
|
**Dernière mise à jour**: 22 Novembre 2024
|
|
**Version**: Phase 2 Complete
|