Hydroclimate, the interplay of moisture supply and evaporative demand, is essential for ecological and agricultural systems. The understanding of long-term hydroclimate changes is, however, limited because instrumental measurements are inadequate in length to capture the full range of precipitation and temperature variability and by the uneven distribution of high-resolution proxy records in space and time. Here, we present a tree-ring-based reconstruction of interannual to centennial-scale groundwater level (GWL) fluctuations for south-western Germany and north-eastern France. Continuously covering the period of 265–2017 CE, our new record from the Upper Rhine Valley shows that the warm periods during late Roman, medieval and recent times were characterized by higher GWLs. Lower GWLs were found during the cold periods of the Late Antique Little Ice Age (LALIA; 536 to ~ 660 CE) and the Little Ice Age (LIA; between medieval and recent warming). The reconstructed GWL fluctuations are in agreement with multidecadal North Atlantic climate variability derived from independent proxies. Warm and wet hydroclimate conditions are found during warm states of the Atlantic Ocean and positive phases of the North Atlantic Oscillation on decadal scales.