Constructing a smart concrete by an embedded piezoelectric ceramic (PZT) is feasible and effective. In this paper, a novel composite structure of embedded PZT-backing element is proposed to improve the performance of the embedded PZT. By properly setting the thickness of the mental backing lamination and selecting the corresponding vibration mode and frequency of the embedded PZT, the enhanced acoustic wave energy is obtained. The mass-spring lattice model (MSLM) is used to analyze the acoustic wave interaction with partially bonded interfaces of the PZT-backing element and the concrete. On the interface of the PZT and the metal backing, the rubber and the concrete, and the PZT and the rubber, the transmission and reflection factors is discussed using a simple layer model. The experiment proves the efficiency of the MSLM and finds the optimal setup of the PZT-backing structure.