Craniometaphyseal dysplasia (CMD), a rare genetic bone disorder, is characterized by lifelong progressive thickening of craniofacial bones and metaphyseal flaring of long bones. The autosomal dominant form of CMD is caused by mutations in the progressive ankylosis gene ANKH (mouse ortholog Ank), encoding a pyrophosphate (PPi) transporter. We previously reported reduced formation and function of osteoblasts and osteoclasts in a knockin (KI) mouse model for CMD (Ank^KI/KI) and in CMD patients. We also showed rapid protein degradation of mutant ANK/ANKH. Mutant ANK protein displays reduced PPi transport, which may alter the inorganic phosphate (Pi) and PPi ratio, an important regulatory mechanism for bone mineralization. Here we investigate whether reducing dietary Pi intake can ameliorate the CMD‐like skeletal phenotype by comparing male and female Ank^+/+ and Ank^KI/KI mice exposed to a low (0.3%) and normal (0.7%) Pi diet for 13 weeks from birth. Serum Pi and calcium (Ca) levels were not significantly changed by diet, whereas PTH and 25‐hydroxy vitamin D (25‐OHD) were decreased by low Pi diet but only in male Ank^+/+ mice. Importantly, the 0.3% Pi diet significantly ameliorated mandibular hyperostosis in both sexes of Ank^KI/KI mice. A tendency of decreased femoral trabeculation was observed in male and female Ank^+/+ mice as well as in male Ank^KI/KI mice fed with the 0.3% Pi diet. In contrast, in female Ank^KI/KI mice the 0.3% Pi diet resulted in increased metaphyseal trabeculation. This was also the only group that showed increased bone formation rate. Low Pi diet led to increased osteoclast numbers and increased bone resorption in all mice. We conclude that lowering but not depleting dietary Pi delays the development of craniofacial hyperostosis in CMD mice without severely compromising serum levels of Pi, Ca, PTH, and 25‐OHD. These findings may have implications for better clinical care of patients with CMD.