Six new coordination polymers, namely, [Zn(L)](NO3)2·3H2O (1), [Zn2(L)0.5(HPO3)2]·H2O (2), [Zn2(L)(L1)2]·3H2O (3), [Zn2(L)(L2)2]·4.75H2O (4), [Zn2(L)(L3)2]·3H2O (5), and [Zn2(L)(L4)]·3H2O (6), where L = tetrakis(imidazol‐1‐ylmethyl)methane, H2L1 = oxalic acid, H2L2 = 1,3‐benzenedicarboxylic acid, H2L3 = 5‐OH‐1,3‐benzenedicarboxylic acid, and H4L4 = 4,4′‐oxydiphthalic acid, were successfully synthesized under hydrothermal conditions. In compound 1, the L ligands connect the ZnII ions to yield a 3D 4‐connected 4·65 net with the free NO3– filling the channels. In compound 2, HPO32– anions and L ligands link the ZnII centers to generate a pentanodal (3,4)‐connected (4·6·8)(62·8)(62·84)(4·6·83·10)(84·102)2 net. In compound 3, the Zn2L12 units are linked by the L ligands to form a 2D 63 network. In compound 4, the L and L2 ligands connect the ZnII ions to form a 3D framework with (4·62·83)(62·72·82)(4·6·73·8) topology. In compound 5, L ligands coordinate with the ZnII centers to give a 2D binodal 4‐connected layer with the Schläfli symbol of (55·8)2(54·62), which are further consolidated by L3 ligands. In compound 6, the ZnII centers are connected by the L and L4 ligands to form a 2D 4‐connected 43·63 network. The structural differences in 1–6 suggest the importance of the anions in the construction of the coordination polymers. The compounds underwent thermogravimetric analysis, and the luminescent properties of the compounds were also investigated.