We present a versatile optical setup for high-resolution neutron imaging with an adaptable field of view and magnification that can resolve individual neutron absorption events with an image intensifier and a CMOS camera. Its imaging performance is characterized by evaluating the resolution limits of the individual optical components and resulting design aspects are discussed. Neutron radiography measurements of a Siemens star pattern were performed in event mode acquisition comparing two common high-resolution neutron scintillators, crystalline Gadolinium Gallium Garnet (GGG) and powdered Gadolinium Oxysulfide (GOS). An analysis of the light signature caused by neutron absorption events is performed and some resulting issues for both GGG and GOS regarding optical system design are addressed. Both scintillators reach similar resolution (4–5 μm) in event mode acquisition despite different light emission characteristics. The findings suggest that, in the case of GOS, the resolution is limited by the size of the light clusters which in turn originate from the photon scattering at the boundaries of the powder particles comprising it, while with GGG the lower light conversion efficiency makes it challenging to collect enough photons to trigger sufficient signal amplification in the image intensifier. Overall, the proposed event-based evaluation of scintillators allows for quantifying and optimizing various design parameters, which is much more complex than adopting conventional methods based on integrated images.