In this work, the authors propose a theoretical hybrid microservices architecture with on-device processing and cloud-based computation for real-time assistance in smart visually impaired glasses. The architecture integrates various functionalities, each containerized and deployed either locally or in the cloud, according to their computational requirements. Specifically, the pipeline includes a transformer-based Large Language Model (LLM) service, a barcode-scanning module, an expiration-date detection microservice, and an advanced performance optimization layer. The design references our previous four works, which explored domain-specific LLM architectures in the cloud, LLM integration in barcode scanning, LLM integration in expiration-date scanning, and performance trade-offs for LLMs on different hardware systems. By unifying these components into a hybrid model, our approach aims to deliver low-latency responses for core tasks on the smart glasses and robust, large-scale computations in the cloud. We highlight container orchestration, service-level optimizations, and security concerns, proposing an architecture adaptable to future IoT developments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Hybrid Microservices Architecture for Smart Glasses: Integrating Cloud-Based LLMs, Containerized Services, and On-Device Functionalities

  • Theodor-Radu Grumeza,
  • Thomas-Andrei Lazăr,
  • Alexandra-Emilia Fortiş

摘要

In this work, the authors propose a theoretical hybrid microservices architecture with on-device processing and cloud-based computation for real-time assistance in smart visually impaired glasses. The architecture integrates various functionalities, each containerized and deployed either locally or in the cloud, according to their computational requirements. Specifically, the pipeline includes a transformer-based Large Language Model (LLM) service, a barcode-scanning module, an expiration-date detection microservice, and an advanced performance optimization layer. The design references our previous four works, which explored domain-specific LLM architectures in the cloud, LLM integration in barcode scanning, LLM integration in expiration-date scanning, and performance trade-offs for LLMs on different hardware systems. By unifying these components into a hybrid model, our approach aims to deliver low-latency responses for core tasks on the smart glasses and robust, large-scale computations in the cloud. We highlight container orchestration, service-level optimizations, and security concerns, proposing an architecture adaptable to future IoT developments.