How can urban nature contribute to the reduction of chronic stress? We twice measured the concentration of the “stress hormone” cortisol in the hair of 85 volunteer gardeners (six months apart), relating cortisol level change to (self-reported) characteristics of their recreational activities. Both time spent in nature and physical activity led to decreases in cortisol, while time spent being idle led to an increase. At high levels of present stressors, however, the relationship for time spent in nature and for idleness was reversed. Time spent with social interaction had no effect on cortisol levels. Our results indicate that physical activity is an effective means of mitigating the negative effects of chronic stress. The results regarding the time spent in nature and time spent being idle are less conclusive, suggesting the need for more research. We conclude that if chronic stress cannot be abolished by eradicating its sources, public health may take to measures to reduce it—providing urban nature being one effective possibility.