Commit Graph

310 Commits

Author SHA1 Message Date
Ubuntu
5071c445ac docs: add HANDOFF.md with project status and memory notes 2026-05-19 09:06:32 +00:00
Ubuntu
37bb8bfe72 feat(cua): add 'send' action with UI auto-locate, fix coordinate accuracy, both scenarios pass
- Added 'send' action type that uses uiautomator XML to find the rightmost
  clickable element in the bottom input bar (the send button)
- Added screen resolution (1080x2400) to LLM context for better coordinate estimation
- Updated system prompt to instruct model to use 'send' action instead of manual tap
- Updated scenarios with clearer step-by-step instructions
- Both send_message and multi_turn scenarios pass reliably
2026-05-19 08:26:48 +00:00
Ubuntu
5473a488fc feat(ci): add CUA smoke test workflow, improve screenshot reliability, add multi-turn scenario 2026-05-19 07:47:04 +00:00
Ubuntu
7804b7a3b9 fix(cua): add Azure OpenAI support, fix max_tokens → max_completion_tokens, increase screencap timeout 2026-05-19 06:24:29 +00:00
Ubuntu
e08a4a7a36 Fix screenshot capture and add multi-provider support
- Fix adb exec-out binary pipe for screenshot capture
- Add XAI, Azure, and any OpenAI-compatible endpoint support
- Add rate limit retry logic
- Document all supported provider configurations
2026-05-19 02:17:23 +00:00
Ubuntu
4f39967606 Add LLM-powered Android CUA smoke test script
Implements a computer-use agent loop for E2E testing:
screenshot → vision LLM → action → repeat

Supports OpenAI, Gemini, xAI via OpenAI-compatible endpoints.
Inspired by openai/openai-cua-sample-app, MobileAgent, AppAgent.
2026-05-19 01:08:03 +00:00
Ubuntu
10b4ca2ced fix: enable cleartext HTTP traffic on Android (required for Tailscale/LAN connections) 2026-05-18 05:44:53 +00:00
Ubuntu
4ad09eae82 feat: add Play Store publish workflow and signing config 2026-05-17 21:11:43 +00:00
Ubuntu
ca345556e3 fix: generate debug keystore in CI for release signing 2026-05-17 20:09:16 +00:00
Ubuntu
1843a7c37e Initial commit: OpenCode mobile app (extracted from opencode monorepo) 2026-05-17 19:52:54 +00:00