The present paper investigated the relationship between low-temperature embrittlement and microstructure of lath martensite in a low-carbon steel from both microstructural and crystallographic points of view. The fracture surface of the specimen after the miniaturized Charpy impact test at 98 K (−175 °C) mainly consisted of cleavage fracture facets parallel to crystallographic {001} planes of martensite. Through the crystallographic orientation analysis of micro-crack propagation, we found that the boundaries which separated different martensite variants having large misorientation angles of {001} cleavage planes could inhibit crack propagation. It was then concluded that the size of the aggregations of martensite variants belonging to the same Bain deformation group could control the low-temperature embrittlement of martensitic steels.