Extracellular matrix (ECM) determines the physiological function of all tissues, including musculoskeletal tissues. In tendon, ECM provides overall tissue architecture, which is tailored to match the biomechanical requirements of their physiological function, that is, force transmission from muscle to bone. Tendon ECM also constitutes the microenvironment that allows tendon‐resident cells to maintain their phenotype and that transmits biomechanical forces from the macro‐level to the micro‐level. The structure and function of adult tendons is largely determined by the hierarchical organization of collagen type I fibrils. However, non‐collagenous ECM proteins such as small leucine‐rich proteoglycans (SLRPs), ADAMTS proteases, and cross‐linking enzymes play critical roles in collagen fibrillogenesis and guide the hierarchical bundling of collagen fibrils into tendon fascicles. Other non‐collagenous ECM proteins such as the less abundant collagens, fibrillins, or elastin, contribute to tendon formation or determine some of their biomechanical properties. The interfascicular matrix or endotenon and the outer layer of tendons, the epi‐ and paratenon, includes collagens and non‐collagenous ECM proteins, but their function is less well understood. The ECM proteins in the epi‐ and paratenon may provide the appropriate microenvironment to maintain the identity of distinct tendon cell populations that are thought to play a role during repair processes after injury. The aim of this review is to provide an overview of the role of non‐collagenous ECM proteins and less abundant collagens in tendon development and homeostasis.