Case study · Android voice assistant

Tecno AI Assistant

Say “Hey Tecno” and ask. A Kotlin voice assistant that answers aloud, reads the screen when allowed, and acts on the phone, with confirmation before anything sensitive.

Open sourceUpdated 2026-11-21

Tecno AI banner: the red T logo with the tagline “Your voice assistant for Android”

Overview

Tecno AI is an Android assistant powered by Google Gemini. A wake word starts it hands-free, a floating panel opens over any app, and it can answer questions about what is on screen and carry out actions such as opening apps, calling, messaging, setting alarms and toggling the flashlight.

The problem

I wanted an assistant that does things on the phone rather than only chatting, that answers common commands instantly even offline, and that never sends a message or places a call without asking first.

My role

I designed and built the app on my own, from the voice pipeline to the interface and the release builds.

How it is built

  1. Wake word

    WakeWordDetector runs Android’s SpeechRecognizer in a continuous listening loop and listens for the wake phrase. Its RMS level drives the on-screen voice visualiser, and listening pauses while the assistant is speaking so it does not hear itself.

  2. Fast path before the model

    IntentRouter recognises common commands with patterns first (open an app, search YouTube or Spotify, send a WhatsApp, Discord or Messenger message, navigate, set volume). Those run immediately, and OfflineProcessingEngine handles the ones that need no network.

  3. Gemini with tools and failover

    GeminiClient sends tool declarations so the model can call device functions. It accepts up to five API keys and moves to the next key or model when one is rejected or rate-limited, and falls back to local answers when all of them fail.

  4. Confirmation before sensitive actions

    ToolDispatcher asks the user to confirm before calling a contact or sending any message, showing exactly who and what will be sent.

  5. Local data and releases

    Conversations and learned preferences are stored on the device with Room; settings use DataStore. A GitHub Actions workflow builds a signed release APK on every push.

Key features

Assistant

  • Hands-free “Hey Tecno” wake word that can be turned off
  • Speech in, spoken replies out, plus a dark chat screen with formatted answers
  • Floating “Hey Tecno” panel over other apps, or set as the default assist app
  • Screen sharing (Android 11+): answers questions about the current app

Device control

  • Open apps, call, message, set alarms and timers, toggle the flashlight, open settings
  • On-screen actions through the accessibility service
  • Common commands work offline

Engineering decisions

Never act silently

An assistant that can message people must not do it by mistake. Every call and message goes through an explicit confirmation step.

Resilient on free API tiers

Free Gemini keys hit limits quickly. Rotating across the user’s own keys, with clear error messages for invalid keys, limits and lost connection, keeps the assistant usable.

Sources

Want something built?

I build custom Minecraft plugins, advanced server systems and interactive software experiences. My focus is creating functional, reliable and well-engineered solutions.

Request a custom plugin Discuss a project

Tecnolegend
Hire Tecnolegend