The growth of crystalline Li-based oxide thin films on silicon substrates is essential for the integration of next-generation solid-state lithionic and electronic devices including on-chip microbatteries, memristors, and sensors. However, growing crystalline oxides directly on silicon typically requires high temperatures and oxygen partial pressures, which leads to the formation of undesired chemical species at the interface compromising the crystal quality of the films. In this work, we employ a 2 nm gamma-alumina (γ-Al₂O₃) buffer layer on Si substrates in order to grow crystalline thin films of Li₄Ti₅O₁₂ (LTO), a well-known active material for lithium-ion batteries. The ultrathin γ-Al₂O₃ layer enables the formation of a stable heterostructure with sharp interfaces and drastically improves the LTO crystallographic and electrochemical properties. Long-term galvanostatic cycling of 50 nm LTO films in liquid-based half-cells demonstrates a high capacity retention of 91% after 5000 cycles at 100 C. Rate capability tests showcase a specific charge of 56 mA h g^-1 at an exceptional C-rate of 5000 C (15 mA cm^-2). Moreover, with sub-millisecond current pulse tests, the reported thin-film heterostructure exhibits rapid Li-ion (de)intercalation, which could lead to fast switching timescales in resistive memory devices and electrochemical transistors.