Big demo update: screen vision + language persistence

major update

Sidekick AI · build 23042552 · published

On SteamNotes only · this build shipped before we watched the app

Screen understanding

The avatar uses a vision-language model to actually look at your screen. Coaching is grounded in what's happening on-screen, not generic descriptions. Free tier: 3 captures/day.

This was the most-requested feature in the entire demo. We shipped it because you asked.

Language persistence

Pick your language and we will say your languages. 12 languages: English, French, German, Spanish (ES + LATAM), Japanese, Korean, Portuguese (BR + PT), Russian, Simplified Chinese, Traditional Chinese.

[]

— The Sidekick AI team