We study the dynamics of quantum-memory-assisted entropic uncertainty relation for an open quantum system of two qubits, which interact independently with their own multiple bosonic reservoirs at zero temperature. It is shown that the entropic uncertainty can be reduced with the increase in the number of reservoirs in both the weak and strong coupling regimes. This indicates a fact that the non-Markovianity may play a positive role in reducing entropic uncertainty. Furthermore, an unusual relation is found between the entropic uncertainty and mixedness of the quantum states. We finally reveal an effective manipulation of entropic uncertainty and mixedness by means of the local filtering operation.