The uptake of water by atmospheric aerosols has a pronounced effect on particle light scattering properties, which in turn are strongly dependent on the ambient relative humidity (RH). Earth system models need to account for the aerosol water uptake and its influence on light scattering in order to properly capture the overall radiative effects of aerosols. Here we present a comprehensive model measurement evaluation of the particle light scattering enhancement factor f (RH), defined as the particle light scattering coefficient at elevated RH (here set to 85 %) divided by its dry value. The comparison uses simulations from 10 Earth system models and a global dataset of surface-based in situ measurements. In general, we find a large diversity in the magnitude of predicted f (RH) amongst the different models, which can not be explained by the site types. Based on our evaluation of sea salt scattering enhancement and simulated organic mass fraction, there is a strong indication that differences in the model parameterizations of hygroscopicity and model chemistry are driving at least some of the observed diversity in simulated f (RH). Additionally, a key point is that defining dry conditions is difficult from an observational point of view and, depending on the aerosol, may influence the measured f (RH). The definition of dry also impacts our model evaluation, because several models exhibit significant water uptake between RH D0% and 40 %. The multisite average ratio between model outputs and measurements is 1.64 when RHD0% is assumed as the model dry RH and 1.16 when RHD40% is the model dry RH value. The overestimation by the models is believed to originate from the hygroscopicity parameterizations at the lower RH range which may not implement all phenomena taking place (i.e., not fully dried particles and hysteresis effects). This will be particularly relevant when a location is dominated by a deliquescent aerosol such as sea salt. Our results emphasize the need to consider the measurement conditions in such comparisons and recognize that measurements referred to as dry may not be dry in model terms. Recommendations for future model measurement evaluation and model improvements are provided.