Internet of Things (IoT) devices are often vulnerable to various threats, such as botnets, lateral movement, and remote exploitation, due to their diverse transmission technologies, existing vulnerabilities, and lack of awareness regarding security from both device manufacturers and users. These vulnerabilities can be exploited to launch large-scale attacks, steal sensitive information or cause physical damage. Hence it is imperative to ensure proper vulnerability detection for IoT devices. This paper aims to build an IoT setup and create a fuzzing framework to detect vulnerabilities in IoT devices without access to their firmware. The proposed framework, called ChipFuzzer, targets IoT devices specifically developed as part of the Matter ecosystem. ChipFuzzer uses fuzzing techniques to detect known vulnerabilities in Matter-based IoT devices. Performed experiments demonstrate that Matter-based IoT devices exhibit greater resilience against known vulnerabilities compared to IoT devices utilizing other standards like Zigbee and Z-Wave.