This paper presents a set of infrared perception techniques for automatic detection of heat losses in windows by using autonomous and teleoperated helicopters. The paper focuses on the processing of infrared images paying special attention to the segmentation, estimation of temperature and classification of thermal heat losses in infrared images. It also presents briefly the main characteristics of the UAV platform used in the experiments. The paper includes results of experiments of infrared building inspection carried out in December 2005.