Heterogeneous networks are a key solution to serving the exponential surge in data volume and higher quality expectations. Nonetheless, such networks require the ubiquitous presence of fiber-to-the-cell to address the performance demands of 5G and fast-spreading small cells. To this end, innovative ways of optimizing the usage of realistic backhaul links are being investigated. In this work, we propose a fuzzy Q-learning-based user-centric backhaul-aware user cell association scheme. The proposed scheme aims at optimizing the user-cell association process in a context-aware and backhaul-aware manner. Complementing the scheme with fuzzy-logic requires 33.3% additional storage memory. On the other hand, it increases the computational efficiency by 60% and improves the users' performance by 12%.