Dom/OmniParser
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

bind to default qemu address

Browse Source
This commit is contained in:
Alexey Taymano
2025-09-09 20:10:39 +00:00
parent a19bed9d75
commit 8e0f0ecb0f
3 changed files with 3 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
omnitool/omnibox/compose.yml
View File

@@ -13,8 +13,7 @@ services:
cap_add: cap_add:
- NET_ADMIN - NET_ADMIN
ports: ports:
- 8006:8006 # Web Viewer access - 8006:8006 # Web Viewer access
- 5000:5000 # Computer control server
volumes: volumes:
- ./vm/win11iso/custom.iso:/custom.iso - ./vm/win11iso/custom.iso:/custom.iso
- ./vm/win11setup/firstboot:/oem - ./vm/win11setup/firstboot:/oem

3
omnitool/omnibox/vm/win11setup/setupscripts/server/main.py
View File

@@ -70,7 +70,6 @@ def capture_screen_with_cursor():
cursor = cursor.resize((int(cursor.width / 1.5), int(cursor.height / 1.5))) cursor = cursor.resize((int(cursor.width / 1.5), int(cursor.height / 1.5)))
screenshot.paste(cursor, (cursor_x, cursor_y), cursor) screenshot.paste(cursor, (cursor_x, cursor_y), cursor)
# Convert PIL Image to bytes and send # Convert PIL Image to bytes and send
img_io = BytesIO() img_io = BytesIO()
screenshot.save(img_io, 'PNG') screenshot.save(img_io, 'PNG')
@@ -78,4 +77,4 @@ def capture_screen_with_cursor():
return send_file(img_io, mimetype='image/png') return send_file(img_io, mimetype='image/png')
if __name__ == '__main__': if __name__ == '__main__':
app.run(host="127.0.0.1", port=args.port) app.run(host="10.0.2.15", port=args.port)

2
omnitool/readme.md
View File

@@ -103,7 +103,7 @@ There are three components:
If your internet speed is slow and you want a minimal VM with less preinstalled apps comment out lines 57 to 350 in this [file](https://github.com/microsoft/OmniParser/blob/master/omnitool/omnibox/vm/win11setup/setupscripts/setup.ps1) that defines all the apps to install when you first create the container + VM. Ensure that you follow factory reset instructions from the next section when creating your VM to wipe any previous omnibox setup. If your internet speed is slow and you want a minimal VM with less preinstalled apps comment out lines 57 to 350 in this [file](https://github.com/microsoft/OmniParser/blob/master/omnitool/omnibox/vm/win11setup/setupscripts/setup.ps1) that defines all the apps to install when you first create the container + VM. Ensure that you follow factory reset instructions from the next section when creating your VM to wipe any previous omnibox setup.
### Validation errors: Windows Host is not responding ### Validation errors: Windows Host is not responding
If you get this error in Gradio after clicking the submit button, this indicates that the server running in the VM that accepts commands from Gradio and then moves the mouse/ keyboard isn't available. You can verify this by running `curl http://localhost:5000/probe`. Ensure your `omnibox` is fully finished setting up (should no longer have a terminal window). Refer to the omnibox section for timing on that. If you have set up your omnibox, it may be a matter of waiting a little. If you get this error in Gradio after clicking the submit button, this indicates that the server running in the VM that accepts commands from Gradio and then moves the mouse/ keyboard isn't available. You can verify this by running `docker exec -it omni-windows bash -c "curl http://localhost:5000/probe"`. Ensure your `omnibox` is fully finished setting up (should no longer have a terminal window). Refer to the omnibox section for timing on that. If you have set up your omnibox, it may be a matter of waiting a little.
If waiting 10 mins doesn't help. Try stopping (`./manage_vm.sh stop`) and starting (`./manage_vm.sh start`) your omnibox VM with the script commands. If waiting 10 mins doesn't help. Try stopping (`./manage_vm.sh stop`) and starting (`./manage_vm.sh start`) your omnibox VM with the script commands.