Device-to-device (D2D) communication can improve coverage, spectrum efficiency, and energy efficiency based on the current cellular network architecture. The fair scheduling for D2D communication in the orthogonal frequency division multiple access-based cellular network is studied in this paper. Based on the proportional fairness criteria, the optimization objective is formulated to maximize the sum of the relative achievable rate of both cellular users (CUs) and D2D pairs. It is a hybrid optimization problem since it involves in both the resource reuse and the transmit power control. A practical proportional fairness scheduling (PFS) algorithm is proposed. Firstly, the admissible area is decided according to the transmit power limitation of terminals and the quality of service (QoS) requirement. Next, we seek the optimal transmit power combination for the CU and D2D pair in the admissible area and it is demonstrated that the optimal value can be selected from several points on the border of the admissible area. Lastly, when multiple subchannels can be employed for scheduling, based on the generated bipartite graph, Hungarian algorithm is adopted to realize maximum matching, i.e., select reusable CUs and D2D pairs to maximize the sum of the relative achievable rates. The simulation results show that PFS algorithm can guarantee the excellent performance of both throughput and fairness.