Ubuntu 37bb8bfe72 feat(cua): add 'send' action with UI auto-locate, fix coordinate accuracy, both scenarios pass ...

- Added 'send' action type that uses uiautomator XML to find the rightmost
  clickable element in the bottom input bar (the send button)
- Added screen resolution (1080x2400) to LLM context for better coordinate estimation
- Updated system prompt to instruct model to use 'send' action instead of manual tap
- Updated scenarios with clearer step-by-step instructions
- Both send_message and multi_turn scenarios pass reliably

2026-05-19 08:26:48 +00:00

15 KiB

Executable File

Raw Blame History

View Raw