The increased usage of the phase shifting transformers in various fields within power systems has introduced new challenges in performing on-site maintenance testing. These special transformers were used as converter transformers, rectifier transformers, harmonic mitigating transformers, zigzag transformers and quadrature boosters with unconventional vector groups, having an additional phase shift such as +/-7.5º, +/-15º combined with normal ‘Delta and Star’ configurations. The challenges now faced by the increased use of these transformers are testing them for accuracy on the voltage ratio and phase shift at site during commissioning and maintenance. Different test methods were performed / studied and were compared. A prototype of a three-phase converter transformer with variable ratio taps and vector groups was constructed and tested. The prototype transformer is constructed to have variable parameters for test trials on different vector groups and ratios. The three phase converter transformer prototype will have options to regulate the output voltage on varying input voltage using the tap changer and also can vary the phase shift by varying the vector group combinations. On-site testing of ratio and phase shift will be done on different types of traction rectifier transformers. The approach for factory testing and onsite testing of the special transformers will be different. The effect on the phase shift values when the ratio taps are changed will be the focus and the results compared. The study on the importance of phase shift on these special transformers is presented. The test results of different test methods using modern portable test equipment and conventional classical methods were compared and presented. The results of the ratio testing and the phase shift measurement variation during vector group variation and tap change were presented.