Classical feed-forward inhibition involves an excitation-inhibition sequence that enhances the temporal precision of neuronal responses by narrowing the window for synaptic integration. In the input layer of the cerebellum, feed-forward inhibition is thought to preserve the temporal fidelity of granule cell spikes during mossy fiber stimulation. Although this classical feed-forward inhibitory circuit has been demonstrated in vitro, the extent to which inhibition shapes granule cell sensory responses in vivo remains unresolved. Here we combined whole-cell patch-clamp recordings in vivo and dynamic clamp recordings in vitro to directly assess the impact of Golgi cell inhibition on sensory information transmission in the granule cell layer of the cerebellum. We show that the majority of granule cells in Crus II of the cerebrocerebellum receive sensory-evoked phasic and spillover inhibition prior to mossy fiber excitation. This preceding inhibition reduces granule cell excitability and sensory-evoked spike precision, but enhances sensory response reproducibility across the granule cell population. Our findings suggest that neighboring granule cells and Golgi cells can receive segregated and functionally distinct mossy fiber inputs, enabling Golgi cells to regulate the size and reproducibility of sensory responses.