Scholarlink

<p>Lightweight convolutional and transformer-based networks are increasingly used for real-time image classification on resource-constrained hardware, yet their practical performance is highly sensitive to training hyperparameters. This work systematically quantifies how controlled hyperparameter choices affect both accuracy and deployability for seven modern lightweight backbones–ConvNeXt-Tiny, EfficientNetV2-S, MobileNetV3-L, MobileViT v2 (S/XS), RepVGG–A2, and TinyViT-21M trained from scratch on a class-balanced 90K/10K subset of ImageNet-1K under a standardized 300-epoch protocol. We isolate the effects of learning-rate magnitude and cosine scheduling, optimizer selection (SGD vs. AdamW where appropriate), and progressively stronger regularization via RandAugment, Mixup, CutMix, and label smoothing, complemented by constrained automated searches (Optuna and population-based training). Beyond training-time analysis, we add a deployment-focused evaluation: inference latency and throughput are benchmarked on an NVIDIA L40s GPU across batch sizes 1–512, and edge feasibility is examined via Edge CPU Platform under sustained workloads. Results show that hyperparameter tuning without architectural modification yields consistent accuracy gains (<InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\approx 1.5\text {--}3.5\%\)</EquationSource> </InlineEquation> Top-1 over baseline) and reveals architecture-dependent stability regions. Several models deliver strong real-time operating points: MobileNetV3–L and RepVGG–A2 achieve very low latency with high throughput on GPU, while edge tests highlight the limited benefit of batching on low-power CPUs and the importance of latency-centric model choice. The code and logs may be seen at:&#xa0;<a href="https://github.com/VineetKumarRakesh/lcnn-opt">https://github.com/VineetKumarRakesh/lcnn-opt</a>.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Analysis of hyperparameter optimization effects on lightweight deep models for real-time image classification

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年4月13日

查看全文
  • Vineet Kumar Rakesh,
  • Soumya Mazumdar,
  • Tapas Samanta,
  • Hemendra Kumar Pandey,
  • Amitabha Das,
  • Sarbajit Pal

摘要

Lightweight convolutional and transformer-based networks are increasingly used for real-time image classification on resource-constrained hardware, yet their practical performance is highly sensitive to training hyperparameters. This work systematically quantifies how controlled hyperparameter choices affect both accuracy and deployability for seven modern lightweight backbones–ConvNeXt-Tiny, EfficientNetV2-S, MobileNetV3-L, MobileViT v2 (S/XS), RepVGG–A2, and TinyViT-21M trained from scratch on a class-balanced 90K/10K subset of ImageNet-1K under a standardized 300-epoch protocol. We isolate the effects of learning-rate magnitude and cosine scheduling, optimizer selection (SGD vs. AdamW where appropriate), and progressively stronger regularization via RandAugment, Mixup, CutMix, and label smoothing, complemented by constrained automated searches (Optuna and population-based training). Beyond training-time analysis, we add a deployment-focused evaluation: inference latency and throughput are benchmarked on an NVIDIA L40s GPU across batch sizes 1–512, and edge feasibility is examined via Edge CPU Platform under sustained workloads. Results show that hyperparameter tuning without architectural modification yields consistent accuracy gains ( \(\approx 1.5\text {--}3.5\%\) Top-1 over baseline) and reveals architecture-dependent stability regions. Several models deliver strong real-time operating points: MobileNetV3–L and RepVGG–A2 achieve very low latency with high throughput on GPU, while edge tests highlight the limited benefit of batching on low-power CPUs and the importance of latency-centric model choice. The code and logs may be seen at: https://github.com/VineetKumarRakesh/lcnn-opt.