Urban green spaces are vital for cities to achieve sustainability. Optimal design and management of green space is necessary to counter pressure from increased use due to urban densification and therefore needs to account for the preferences of its potential users. However, preference is inherently subjective and difficult to measure. This study tested a crowdsourcing method using a mobile app for on-site data collection to study the use of, perception of, and preferences for different green configurations in the Rembrandtpark, a large urban park in Amsterdam. Responses obtained through the mobile app were compared to those obtained through more traditional on-site and postal surveys to identify differences in sampled population and results. We found clear differences in respondent samples and in stated preferences when comparing the mobile app and the traditional survey methods. Mobile app respondents (n = 154) were younger and more willing to become more involved with park management. They were also less satisfied with most aspects of locations and found them more noisy. On-site survey respondents (n = 146) appeared more susceptible to response bias in their answers to certain questions. Employing different recruitment methods is important to engage different park user types and account for multiple perceptions.