One of the practical methods for general 3D shape reconstruction is active stereo, which involves capturing images of scenes illuminated by structured light and reconstructing the scenes from the images. Active stereo has the advantage of being able to achieve high-density reconstructions even for texture-less scenes. However, it requires finding dense correspondences between the captured image and the projected pattern, making it difficult to capture the scene using multiple systems simultaneously where patterns are overlapped each other. A simple solution is to switch the patterns on-and-off synchronously; however, this naturally decreases exposure time in inverse proportion to the number of systems, resulting in a lower signal-to-noise ratio (SNR). In addition, retrieving relative poses between a projector and a camera of active stereo systems as well as relative poses between multiple systems is another challenge. To address these challenges, we propose a technique based on neural signed distance field (Neural-SDF) using Direct Sequence Spread Spectrum (DSSS). DSSS is the latest technique widely used in the field of communications for multiplexing multiple signals and separating them. We propose a novel method to utilize DSSS to project multiple structured light patterns onto the object, where the overlapped patterns are efficiently separated. To calibrate the relative poses between projectors and cameras in multiple sets of active stereo systems, a differential renderer based method using Neural-SDF is proposed. Such an approach has not yet been explored yet for active stereo systems. In the experiments, it was proved that our technique worked successfully by both qualitative and quantitative evaluations using real sensors and objects.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multiple Active Stereo Systems Calibration Method Based on Neural SDF Using DSSS for Wide Area 3D Reconstruction

  • Kota Nishihara,
  • Ryo Furukawa,
  • Ryusuke Sagawa,
  • Hiroshi Kawasaki

摘要

One of the practical methods for general 3D shape reconstruction is active stereo, which involves capturing images of scenes illuminated by structured light and reconstructing the scenes from the images. Active stereo has the advantage of being able to achieve high-density reconstructions even for texture-less scenes. However, it requires finding dense correspondences between the captured image and the projected pattern, making it difficult to capture the scene using multiple systems simultaneously where patterns are overlapped each other. A simple solution is to switch the patterns on-and-off synchronously; however, this naturally decreases exposure time in inverse proportion to the number of systems, resulting in a lower signal-to-noise ratio (SNR). In addition, retrieving relative poses between a projector and a camera of active stereo systems as well as relative poses between multiple systems is another challenge. To address these challenges, we propose a technique based on neural signed distance field (Neural-SDF) using Direct Sequence Spread Spectrum (DSSS). DSSS is the latest technique widely used in the field of communications for multiplexing multiple signals and separating them. We propose a novel method to utilize DSSS to project multiple structured light patterns onto the object, where the overlapped patterns are efficiently separated. To calibrate the relative poses between projectors and cameras in multiple sets of active stereo systems, a differential renderer based method using Neural-SDF is proposed. Such an approach has not yet been explored yet for active stereo systems. In the experiments, it was proved that our technique worked successfully by both qualitative and quantitative evaluations using real sensors and objects.