<p>Agricultural heritage systems have the characteristics of ecological fragility and cultural sensitivity. For a long time, the conservation and sustainable development of agricultural heritage systems have received attention from all sectors. However, there are few measurements of tourism disturbance (TD) and community resilience (CR) in agricultural heritage sites, and research on the relationship between the two is even more lacking. This study selects six villages in the Honghe Hani Rice Terraced System (HHRTS) as examples and constructs an evaluation system for TD and CR. Through questionnaires and in-depth interviews, it explores the response relationship between TD and CR of heritage site, and compares the response relationship of villages in different stages of tourism development. The results indicate that the heritage site’s current response relationship between TD and CR shows a positive response type, and the development of tourism has brought positive responses and effects. There are differences in the interactive relationship between TD and CR among communities with different levels of tourism development. In communities with poor tourism development, CR is more susceptible to the impact of TD than other communities. The stability of the relationship between TD and CR response gradually tends to stabilize from poor, good, and moderate tourism development.</p>