In many European mountain regions, natural forest regrowth on abandoned agricultural land and the related consequences for the environment are issues of increasing concern. We developed a spatial statistical model based on multiple geophysical and socio-economic variables to investigate the pattern of natural forest regrowth in the Swiss mountain area between the 1980s and 1990s. Results show that forest regrowth occurred primarily in areas with low temperature sum, intermediate steepness and soil stoniness as well as close to forest edges and relatively close to roads. Model results suggest that regions with weak labor markets are favored in terms of land abandonment and forest regrowth. We could not find an effect of population change on land abandonment and forest regrowth. Therefore, we conclude that decision makers should consider non-linearities in the pattern of forest regrowth and the fact that labor markets have an effect on land abandonment and forest regrowth when designing measures to prevent agricultural land abandonment and natural forest regrowth in the Swiss mountains.