luna/claw-ideas
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add new mobile integration ideas: Visual Task Assistant, Mobile Security & Location Sentinel, Notification Bridge & Filter, Personal Safety & Environment Monitor, Screen-Aware Context Assistant, and Mobile Document & Receipt Scanner

Browse Source
This commit is contained in:
Space-Banane
2026-04-03 13:05:33 +02:00
parent bdddf602be
commit ac48ac713b
7 changed files with 74 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
ideas/mobile-integration/screen-context-assistant.md Normal file
View File

@@ -0,0 +1,11 @@
# Screen-Aware Context Assistant
Provide the agent with context from what you're doing on your phone.
## Overview
Uses screen recordings to help the agent understand your mobile workflow and provide assistance.
## Features
- **Workflow Troubleshooting**: Record a bug or a confusing UI with `screen_record` for the agent to analyze.
- **Mobile Tutorial Generator**: Agent watches your `screen_record` and generates a step-by-step guide.
- **Contextual Q&A**: Ask questions about an app or website currently on your screen.
- **Data Extraction**: Extracts text or data from mobile apps that don't have APIs.