Novel emitters of muonium (Mu = μ⁺ + e^-) with high conversion efficiencies can enhance the precision of muonium spectroscopy experiments and enable next-generation searches for new physics. At the Paul Scherrer Institute (PSI), we investigate muonium production at room-temperature as well as in cryogenic environment using a superfluid helium converter. In this paper, we describe the development of compact detection schemes which resulted in the background-suppressed observation of atomic muonium in vacuum, and can be adapted for cryogenic measurements. Using these setups, we compared the emission characteristics of various muonium production targets at room temperature using low momentum (p_μ = 11-13 MeV/c) muons, and observed muonium emission from zeolite targets into vacuum. For a specific laser-ablated aerogel target, we determined a muon-to-vacuum-muonium conversion efficiency of 7.23 ± 0.05(stat)_-0.76^+1.06(sys)%, assuming thermal emission of muonium. Moreover, we investigated muonium-helium collisions and from it we determined an upper temperature limit of 0.3 K for the superfluid helium converter.