Broadband down-conversion spectral modification attracts our attention followed by narrowband down-conversion due to its applicability for solar cells. This article reviews on the recent research development on broadband down-conversion spectral modification based on energy transfer: (1) f–d transition rare earth ions including Eu 2+ , Ce 3+ and Yb 2+ to Yb 3+ ; (2) other sensitizer including heavy metal ions and host lattice absorption to Yb 3+ . The mechanisms of energy transfer and the possibilities of efficient near-infrared emission are analyzed. We also point out some problems need further development on broadband down-conversion spectral modification.