Label noise-tolerant machine learning techniques address datasets which are affected by mislabelling of the instances. Since labelling quality is a severe issue in particular for large or streaming data sets, this setting becomes more and more relevant in the context of life-long learning, big data and crowd sourcing. In this contribution, we extend a powerful online learning method, soft robust learning vector quantisation, by a probabilistic model for noise tolerance, which is applicable for streaming data, including label-noise drift. The superiority of the technique is demonstrated in several benchmark problems.