The effects of biodiversity on ecosystem functioning generally increase over time, but the underlying processes remain unclear. Using 26 long-term grassland and forest experimental ecosystems, we demonstrate that biodiversity-ecosystem functioning relationships strengthen mainly by greater increases in functioning in high-diversity communities in grasslands and forests. In grasslands, biodiversity effects also strengthen due to decreases in functioning in low-diversity communities. Contrasting trends across grasslands are associated with differences in soil characteristics.