Bone's remarkable mechanical properties are a result of its hierarchical structure. The mineralized collagen fibrils, made up of collagen fibrils and crystal platelets, are bone's building blocks at an ultrastructural level. The organization of bone's ultrastructure with respect to the orientation and arrangement of mineralized collagen fibrils has been the matter of numerous studies based on a variety of imaging techniques in the past decades. These techniques either exploit physical principles, such as polarization, diffraction or scattering to examine bone ultrastructure orientation and arrangement, or directly image the fibrils at the sub-micrometre scale. They make use of diverse probes such as visible light, X-rays and electrons at different scales, from centimetres down to nanometres. They allow imaging of bone sections or surfaces in two dimensions or investigating bone tissue truly in three dimensions, in vivo or ex vivo, and sometimes in combination with in situ mechanical experiments. The purpose of this review is to summarize and discuss this broad range of imaging techniques and the different modalities of their use, in order to discuss their advantages and limitations for the assessment of bone ultrastructure organization with respect to the orientation and arrangement of mineralized collagen fibrils.