Human exploration, a cornerstone of our ability to solve novel problems, is a complex process, posing significant research challenges. Most previous studies simplify tasks to isolate specific variables, creating artificial problems that do not align with those humans have evolved to solve, thus limiting the generalizability of findings. To address this gap, we introduce the Lockbox paradigm: a novel, ecologically valid, and challenging task that promotes active exploration and physical interaction. Data from 91 participants interacting with the Lockbox reveal a remarkable human ability to adapt and solve problems efficiently in complex scenarios. By comparing different interaction methods, we demonstrate the critical role of cost variations, such as physical and cognitive costs, in driving attentiveness and shaping exploration strategies. These findings provide valuable insights into human exploration strategies, with potential applications in fields such as robotics and artificial intelligence.