The multiscale study of asphalt concrete using fine aggregate matrix (FAM) has become widespread in recent years. Different laboratory fabrication procedures have been proposed, and since FAM’s sensitivity to compositional effects is unknown this literature cannot be coherently interpreted. In this paper, the mechanical responses of FAM at different volumetric compositions are systematically studied. The viscoelastic and tensile properties are found to be sensitive to volumetric composition. It is concluded that the use of FAM for modeling purposes requires accurate replication of FAM as it exists in the mixture. However, such strict requirements are not necessary for simpler, comparative evaluations.