The skeleton shows greatest plasticity to physical activity-related mechanical loads during youth but is more at risk for failure during aging. Do the skeletal benefits of physical activity during youth persist with aging? To address this question, we used a uniquely controlled cross-sectional study design in which we compared the throwing-to-nonthrowing arm differences in humeral diaphysis bone properties in professional baseball players at different stages of their careers (n = 103) with dominant-to-nondominant arm differences in controls (n = 94). Throwing-related physical activity introduced extreme loading to the humeral diaphysis and nearly doubled its strength. Once throwing activities ceased, the cortical bone mass, area, and thickness benefits of physical activity during youth were gradually lost because of greater medullary expansion and cortical trabecularization. However, half of the bone size (total cross-sectional area) and one-third of the bone strength (polar moment of inertia) benefits of throwing-related physical activity during youth were maintained lifelong. In players who continued throwing during aging, some cortical bone mass and more strength benefits of the physical activity during youth were maintained as a result of less medullary expansion and cortical trabecularization. These data indicate that the old adage of “use it or lose it” is not entirely applicable to the skeleton and that physical activity during youth should be encouraged for lifelong bone health, with the focus being optimization of bone size and strength rather than the current paradigm of increasing mass. The data also indicate that physical activity should be encouraged during aging to reduce skeletal structural decay.