This chapter develops a general Vision Metrics Taxonomy for feature description, so as to collect summary descriptor attributes for high-level analysis. The taxonomy includes a set of general robustness criteria for feature description and ground truth datasets. The material presented and discussed in this book follows and reflects this taxonomy. By developing a standard vocabulary in the taxonomy, terms and techniques are intended to be consistently communicated and better understood. The taxonomy is used in the survey of feature descriptor methods in Chap. 6 to record “what” practitioners are doing.