Osteoporosis is characterized by low bone mineral density (BMD) and fragility fracture and affects over 200 million people worldwide. Bone quality describes the material properties that contribute to strength independently of BMD, and its quantitative analysis is a major priority in osteoporosis research. Tissue mineralization is a fundamental process requiring calcium and phosphate transporters. Here we identify impaired bone quality and strength in Slc20a2–/– mice lacking the phosphate transporter SLC20A2. Juveniles had abnormal endochondral and intramembranous ossification, decreased mineral accrual, and short stature. Adults exhibited only small reductions in bone mass and mineralization but a profound impairment of bone strength. Bone quality was severely impaired in Slc20a2–/– mice: yield load (–2.3 SD), maximum load (–1.7 SD), and stiffness (–2.7 SD) were all below values predicted from their bone mineral content as determined in a cohort of 320 wild‐type controls. These studies identify Slc20a2 as a physiological regulator of tissue mineralization and highlight its critical role in the determination of bone quality and strength.