Testing websites for accessibility with certified agencies is often time-consuming, complex, and costly. The Easy-Web-Check (EWC) is a simplified and open method for testing website accessibility with free tools, but it is not yet validated. This paper examines the correct use of the EWC by non-experts. To this end, a user study is conducted in which participants review the test criteria of the EWC on 2–3 websites each. In total, 24 participants have taken part, 10 completing the entire test. On average, 67% of the tasks were completed correctly, with automated testing methods demonstrating a higher number of correct assessments. The preliminary results suggest that the EWC is suitable for identifying accessibility barriers and has the potential to help non-experts improve website accessibility. However, some test criteria require more detailed explanation and examples to reduce testing errors.