The problem of designing the linear transmitters and receiver jointly in a non-regenerative MIMO relay system is considered, where linear processing is applied at the source, relay and destination node, using the minimum mean square error criterion. Under average power constraint at both the source and the relay node, the transmitters and receiver could be realised through a joint iterative algorithm. Simulation results are also provided to demonstrate the performance of this new method.