Recent advancements in large language models (LLMs) have enabled reasoning-like behavior and sophisticated AI agents, but their deployment usually depends on cloud infrastructure or high-performance hardware. Existing local implementations rarely target energy-efficient edge scenarios. This work presents a conversational AI thermostat assistant running fully on a Raspberry Pi 5, a low-cost and moderately constrained device. The system combines Moonshine for speech-to-text, Granite 3.3 (8B) for natural language reasoning, and Piper for speech synthesis, enabling cloud-free voice interaction. Experiments show low latency for speech modules, while LLM inference remains the main bottleneck. The results highlight both the feasibility and current limitations of agentic AI on constrained hardware, stressing the need for further research to achieve practical real-time edge deployment.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Turning a Thermostat into an Agent at the Edge

  • Pietro Firpo,
  • Riccardo Berta,
  • Francesco Bellotti,
  • Danilo Pau

摘要

Recent advancements in large language models (LLMs) have enabled reasoning-like behavior and sophisticated AI agents, but their deployment usually depends on cloud infrastructure or high-performance hardware. Existing local implementations rarely target energy-efficient edge scenarios. This work presents a conversational AI thermostat assistant running fully on a Raspberry Pi 5, a low-cost and moderately constrained device. The system combines Moonshine for speech-to-text, Granite 3.3 (8B) for natural language reasoning, and Piper for speech synthesis, enabling cloud-free voice interaction. Experiments show low latency for speech modules, while LLM inference remains the main bottleneck. The results highlight both the feasibility and current limitations of agentic AI on constrained hardware, stressing the need for further research to achieve practical real-time edge deployment.