Web3Bench: A Web3 Based HTAP Benchmark
摘要
Hybrid Transaction/Analytical Processing (HTAP) databases are gaining popularity in the database community. The growing prominence of HTAP databases necessitates the development of suitable benchmarks tailored to evaluate these systems effectively. We believe existing HTAP benchmarks are not representative, as most of them merged the existing benchmarks for transactional and analytical workloads. Our research also found that the latest proposals did not take into account the online aspect of an HTAP database. Most of the existing proposals re-used previous benchmark data models that are not truly representative of HTAP workloads. This paper introduces Web3Bench, an HTAP benchmark that addresses the limitations mentioned above in the existing HTAP benchmarks. The benchmark we propose in this paper is based on a realistic workload in the Web3 domain, considered a predominant use case for an HTAP database. Our data model is a simplified version of the decentralized blockchain Ethereum dataset. In this benchmark, we leverage a sample data set from Ethereum to build a scale factor-based data generator. The workload in Web3Bench focuses on simple queries representing online processing with a high number of queries per second. In this paper, we also present the outcomes of our proof of concept conducted with this benchmark on the TiDB cluster, a distributed SQL database with HTAP features.