Osteoporosis (OP) is a multi-factorial bone disease influenced by genetic factors, age, and lifestyles. The aim of this study is to evaluate the genetic correlations between OP and multiple lifestyle-related factors, and explore the genes underlying the detected genetic correlations. Linkage disequilibrium score regression (LDSC) analysis was applied to evaluate the genetic correlations of total body bone mineral density (TB-BMD) of different ages (including 15^–30 years, 30–45 years, 45–60 years, and over 60 years) with four common lifestyle/environment-related factors (including serum 25-hydroxyvitamin D, cigarette smoking, alcohol dependence, and caffeine metabolites). Transcriptome-wide association studies (TWAS) of TB-BMD (30–45 years) and smoking were conducted in peripheral blood (PB), whole blood (WB), and adipose tissues. The identified candidate genes were also subjected to gene set enrichment analysis (GSEA). Genetic correlation was only observed between TB-BMD (30–45 years) and cigarette smoking status (P = 0.01, LD score = 0.11 ± 0.04). No significant genetic correlation was detected for other lifestyle/environmental factors, including serum 25-hydroxyvitamin D, alcohol dependence, and caffeine metabolites for TB-BMD within all of the four age groups. TWAS identified 85 genes in PB and 163 genes in WB for TB-BMD, as well as 123 genes in PB and 257 genes in WB for smoking. Multiple common candidate genes shared by both TB-BMD and smoking were detected, such as MAP1LC3B (PTB-BMD-PB = 1.00 × 10^–3, Psmoking-PB = 9.62 × 10^–3, PTB-BMD-WB = 2.99 × 10^–2) and SLC23A3 (PTB-BMD-WB = 1.48 × 10^–2, Psmoking-WB = 8.76 × 10^–3). GSEA detected one GO terms for TB-BMD (cytosol) in WB, one GO term for smoking (mitochondrion) in PB, and one pathway (oocyte meiosis) for smoking in WB.