Different contents of bonded cellulose were dispersed in a matrix of castor-oil-based polyurethane to produce composites with high susceptibility to fungal attack. We chose to bond the cellulose filler with free diisocyanate, to increase the crosslinking density. Measurements indicated physical and chemical interactions between the polyurethane matrix and cellulose filler. The cellulose network significantly enhanced the interfacial adhesion and thus improved the thermal stability and Young’s modulus of the composites. The influences of the amount of cellulose on the surface chemical structure, surface morphology, and mechanical properties after fungal attack were also investigated. The tensile strength and elongation at break of these composites substantially decreased after exposure to fungus. These composites with high content of renewable raw materials present an optimal balance of physical properties and biodegradability, with potential applications as ecofriendly biomaterials.