Reproducibility and replication of research results
摘要
While a reproducible research result can be independently confirmed by third parties using artifacts provided by the original authors, replicating a research result means to independently obtain it using new measurements, data, or implementations. Various initiatives like artifact evaluations and tool competitions support reproducibility, and replication studies are slowly gaining recognition. The RRRR workshop on reproducibility and replication of research results seeks to improve the knowledge transfer between the many reproducibility initiatives, and to provide a venue to formally publish replication studies, recognising their immense benefit to the scientific community and the hard work involved. This special issue of the International Journal on Software Tools for Technology Transfer gathers four articles originating from the 2022 edition of RRRR, on topics ranging from the concept of replicable theory to tools for scalable software benchmarking.