The explosion of artificial intelligence (AI) in recent years, powered by neural networks, has led to the development of numerous new number formats. This chapter explores the most common formats to understand why they exist and how they are used in AI. Experiments aid the discussion to illustrate the effects of model quantization, the process by which full-precision model weights and biases are mapped to reduced-precision formats for storage.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

AI Number Formats

  • Ronald T. Kneusel

摘要

The explosion of artificial intelligence (AI) in recent years, powered by neural networks, has led to the development of numerous new number formats. This chapter explores the most common formats to understand why they exist and how they are used in AI. Experiments aid the discussion to illustrate the effects of model quantization, the process by which full-precision model weights and biases are mapped to reduced-precision formats for storage.