Raman spectroscopy is increasingly commonly used to understand how changes in bone composition and structure influence tissue-level bone mechanical properties. The spectroscopic technique provides information on bone mineral and matrix collagen components and on the effects of various matrix proteins on bone material properties as well. The Raman spectrum of bone not only contains information on bone mineral crystallinity that is related to bone hardness but also provides information on the orientation of mineral crystallites with respect to the collagen fibril axis. Indirect information on collagen cross-links is also available and will be discussed. After a short introduction to bone Raman spectroscopic parameters and collection methodologies, advances in in vivo Raman spectroscopic measurements for animal and human subject studies will be reviewed. A discussion on the effects of aging, osteogenesis imperfecta, osteoporosis and therapeutic agents on bone composition and mechanical properties will be highlighted, including genetic mouse models in which structure–function and exercise effects are explored. Similarly, extracellular matrix proteins, proteases and transcriptional proteins implicated in the regulation of bone material properties will be reviewed.