Algorithmic Governance and Social Vulnerability: A Value Analysis of Equality and Trust
摘要
This chapter presents a value analysis of equality and trust using cautionary examples of algorithmic governance that threaten these public values. The chapter uses experimentation as a conceptual lens to address the antecedents and consequences of the premature implementation of algorithmic governance targeting disproportionally socially vulnerable individuals and communities. The use of algorithmic governance before enough is known about the potential ill effects is tantamount to experimentation, and the potential harms from being targeted for testing such systems are disproportionately consequential for vulnerable populations, in economic and public value terms alike. The chapter concludes with a policy recommendation that strongly advises against the experimentation with algorithmic governance on vulnerable populations, because this deteriorates equality and trust—values that are already comparatively deprived among the socially vulnerable members of society. Therefore, as a moral obligation, social vulnerability should be considered a counterindication for the nascent use of algorithmic governance, particularly in the shape it tends to take currently—that of surveillance and control.