Despite the critical role of microorganisms in plant and fungal residue decomposition, our understanding of their full diversity remains limited. This is due largely to the rapid microbial succession during decomposition, a scarcity of studies including multiple sampling times, and the omission of a species richness index encompassing all decay stages. To address these gaps, we conducted a meta-analysis of 12 studies, each examining bacterial and fungal communities at multiple time points during decomposition. We aimed to determine the overall microbial diversity involved in decomposition processes by aggregating microbial richness at different time points. By comparing cumulative microbial OTU (operational taxonomic unit) richness with single time point microbial richness, we show that the cumulative richness was 2–5 times greater, indicating that a high yet frequently overlooked diversity of microorganisms is involved in the decomposition process. This pattern was consistent across different organic matter types (plant and fungal residues) for both major microbial domains (bacteria and fungi). Moreover, the appearance rate of novel OTUs generally decreased over time for most organic matter types, except for dead wood, which accumulated new fungal OTUs at a notable pace. Our results collectively emphasize the importance of considering various microbial domains, organic matter types, and time points to successfully characterize the diversity of microorganisms involved in decomposition. Further, given the hidden cumulative number of bacterial and fungal species held within plant and fungal residues across decay stages, we propose that these substrates are crucial microbial reservoirs to include to accurately assess global terrestrial microbial diversity.