Commonly, HoG/SVM classifier uses rectangular images for HoG feature descriptor extraction and training. This means that significant additional work has to be done to process irrelevant pixels belonging to the background surrounding the object of interest. Moreover, some areas of the foreground also can be eliminated from the processing to improve the algorithm speed and memory wise. In Boundary-Bitmap HoG approach proposed in this paper, the boundary of irregular shape of the object is represented by a bitmap to avoid processing of extra background and (partially) foreground pixels. Bitmap, derived from the training dataset, encodes those portions of an image to be used to train a classifier. Experimental results show that not only the proposed algorithm decreases the workload associated with HoG/SVM classifiers by 92.5% compared to the state-of-the-art, but also it shows an average increase about 6% in recall and a decrease about 3% in precision in comparison with standard HoG.