Cement-based materials with added materials such as carbon nanotubes or graphene are piezoresistive, with resistance varying with stress level, referred to as smart concrete. In this paper, sensors made of such cementitious materials are embedded in concrete columns and beams to form smart concrete structures with self-monitoring properties that can monitor strain changes in critical parts of the structure and detect the occurrence of damage. By detecting the electrical resistance change rate of cementitious sensors in smart concrete columns and four-point bending beams under cyclic loading, the relationship between the electrical resistance change rate and the structural strain is collected to evaluate the self-monitoring performance of smart concrete structures. The experimental results show that the resistivity of the sensor can stably decrease with the increase of stress, which indicates the structures can realize self-monitoring. As the same time, the smart concrete structure exhibits the potential for detecting damages such as structural cracks. The findings of this work would not only deepen the understanding of internal concrete status under external loading, but also provide a durable, compatible and long-life material solution for structure monitoring.