An in-house finite element model is developed for investigating the dynamic response of composite concrete sandwich panels. Among the various types of sandwich panels, this study focuses on panels that uses shear connectors made from diagonal-bar fiber-reinforced polymers (FRPs). The vibrations frequencies and dynamic response under harmonic and impulse loading are investigated. The effect of the shear connectors is smeared and modelled through an effective shear stiffness of the insulation layer. Despite various studies that investigated the structural response of concrete sandwich panels under monotonic loading, their dynamic characteristics and response have not been investigated yet. The results show that due to the partial shear interaction between the concrete layers, the dynamic response of concrete sandwich panels is characterized by unique phenomena that cannot be captured using simplified approaches that are based on the full or zero composite action between the layers.