Vibrationally-resolved resonant inelastic X-ray scattering (VR-RIXS) at the O K-edge is emerging as a powerful tool for identifying embedded molecules in lithium-ion battery cathodes. Here, we investigate two known oxygen redox-active cathode materials: the commercial Li_xNi_0.90Co_0.05Al_0.05O₂ (NCA) used in electric vehicles and the high-capacity cathode material Li_1.2Ni_0.13Co_0.13Mn_0.54O₂ (LRNMC) for next-generation Li-ion batteries. We report the detection of a novel vibrational RIXS signature for Li-ion battery cathodes appearing in the O K pre-peak above 533 eV that we attribute to OH-groups. We discuss likely locations and pathways for OH-group formation and accumulation throughout the active cathode material. Initial-cycle behaviour for LRNMC shows that OH-signal strength correlates with the cathodes state of charge, though reversibility is incomplete. The OH-group RIXS signal strength in long-term cycled NCA is retained. Thus, VR-RIXS offers a path for gaining new insights to oxygen reactions in battery materials.