The key parameters determining the elastic properties of an unidirectional mineralized bone fibril-array decomposed in two further hierarchical levels are investigated using mean field methods. Modeling of the elastic properties of mineralized micro- and nanostructures requires accurate information about the underlying topology and the constituents’ material properties. These input data are still afflicted by great uncertainties and their influence on computed elastic constants of a bone fibril-array remains unclear. In this work, mean field methods are applied to model mineralized fibrils, the extra-fibrillar matrix and the resulting fibril-array. The isotropic or transverse isotropic elastic constants of these constituents are computed as a function of degree of mineralization, mineral distribution between fibrils and extra-fibrillar matrix, collagen stiffness and fibril volume fraction. The linear sensitivity of the elastic constants was assessed at a default set of the above parameters. The strain ratios between the constituents as well as the axial and transverse indentation moduli of the fibril-array were calculated for comparison with experiments. Results indicate that the degree of mineralization and the collagen stiffness dominate fibril-array elasticity. Interestingly, the stiffness of the extra-fibrillar matrix has a strong influence on transverse and shear moduli of the fibril-array. The axial strain of the intra-fibrillar mineral platelets is 30–90% of the applied fibril strain, depending on mineralization and collagen stiffness. The fibril-to-fibril-array strain ratio is essentially ~1. This study provides an improved insight in the parameters, which govern the fibril-array stiffness of mineralized tissues such as bone.