Bone mineral density alone cannot reliably predict fracture risk in humans and laboratory animals. Therefore, other factors including the quality of organic bone matrix components and their interactions may be of crucial importance to understanding of fragility fractures. Emerging research evidence shows, that in addition to collagen, certain noncollagenous proteins (NCPs) play a significant role in the structural organization of bone and influence its mechanical properties. However, their contribution to bone strength still remains largely undefined. Collagen and NCPs undergo different post-translational modifications, which alter the quality of the extracellular matrix and the response of bone to mechanical load. The primary focus of this overview is on NCPs that, together with collagen, contribute to structural and mechanical properties of bone. Current information on several mechanisms through which some NCPs influence bone’s resistance to fracture, including the role of nonenzymatic glycation, is also presented.