This chapter argues that the existence of the past fits in well with our overall picture of responsibility and the demands of our conscience. First, it is argued that it is morally right to take responsibility for past misdeeds. Then, quoting David Bowie, it is claimed that the idea that only the present exists can sometimes make it a little easier to escape this demand of morality, because then “what happened in the past only happened in your mind”. By contrast, the existence of the past can be seen as affirming the whole idea of moral responsibility, because every action that is taken in the present remains in existence forever, thus increasing either the good or the bad aspects of the world. Finally, this idea is linked with French artist Christian Boltanski’s idea of “small memory”, where the lives of ordinary people, who will not be remembered by history, are just as important and equally preserved as those of historical figures—an idea that Nietzsche found especially repulsive.