Musculoskeletal disease is the leading cause of disability worldwide, with the 2019 Global Burden of Disease study reporting global disease prevalence of approximately 1.714 billion¹. Xray and magnetic resonance imaging (MRI) are routinely used for clinical diagnosis and monitoring of musculoskeletal disease, however, due to an increasing volume of acquired images and limited time, image assessments are mainly qualitative. This thesis aims to elevate the role of imaging in the assessment of musculoskeletal disease by developing fully automatic image analysis tools to improve image analysis sensitivity, speed, and/or precision. We target the two conditions with the highest prevalence and healthcare expenditure in the United States: knee osteoarthritis (OA) and back pain. We use deep learning to develop fully automatic tools for image analysis and demonstrate their utility in the assessment and analysis of research and clinical datasets. I will be presenting four main projects: