This paper aims to address the ability of self-organizing neural network models to manage real-time applications. Specifically, we introduce a Graphics Processing Unit (GPU) implementation with Compute Unified Device Architecture (CUDA) of the Growing Neural Gas (GNG) network. The Growing Neural Gas network with its attributes of growth, flexibility, rapid adaptation, and excellent quality representation of the input space makes it a suitable model for real time applications. In contrast to existing algorithms the proposed GPU implementation allow the acceleration keeping good quality of representation. Comparative experiments using iterative, parallel and hybrid implementation are carried out to demonstrate the effectiveness of CUDA implementation in representing linear and non-linear input spaces under time restrictions.