Realistic synthetic dataset generation for cyber-physical systems: a performance evaluation
摘要
Cyber-physical systems (CPS) represent the seamless integration of physical and digital systems connected through network of sensors, actuators, and controllers. Research in the field of CPS is crucial given its application in healthcare, smart cities, transportation, energy management and autonomous vehicles. The development and validation of models, algorithms, and control systems for CPS heavily relies on the availability of quality CPS datasets. However, conducting data collection experiments on complex CPS are constrained by considerable cost, lack of expertise and time involved. Consequently, the availability of genuine CPS dataset is limited. In response to this challenge, this paper leverages DoppelGANger, a Generative Adversarial Network (GAN) based model to generate synthetic CPS data using real four different CPS datasets across various domains: Water Distribution Testbed (WDT), Hardware in the Loop Industrial Control System (HAI), Gas pipeline, and Power system datasets. Furthermore, the synthetic datasets are compared to the real-world data through in-depth statistical analyses, visualization methods, and anomaly detection approaches. The difference in Silhouette scores across all CPS datasets is under 0.53, with the smallest difference of 0.071 in the HAI dataset and the largest difference of 0.525 in the Power System dataset. The Power system dataset exhibited the smallest difference in validation Mean Absolute Error (MAE), with values of 0.0184 for the real data and 0.0196 for the synthetic data. However, the correlation analysis revealed differences in feature relationships between real and synthetic datasets. Furthermore, the t-SNE visualizations for WDT demonstrated improved structural alignment between synthetic and real data as training epochs increased. Nevertheless, the alignment remained inconsistent for the HAI, Gas pipeline, and Power system datasets with increasing number of epochs. These observations highlight the need for more advanced synthetic data generation models within the realm of CPS to improve the fidelity and reliability of synthetic datasets.