Cell competition is emerging as a quality control mechanism that eliminates unfit cells in a wide range of settings from development to the adult. However, the nature of the cells normally eliminated by cell competition and what triggers their elimination remains poorly understood. In mice, 35% of epiblast cells are eliminated prior to gastrulation. Here we show that cells with mitochondrial defects are eliminated by cell competition during early mouse development. Using single cell transcriptional profiling of eliminated mouse epiblast cells we identify hallmarks of cell competition and mitochondrial defects. We go on to demonstrate that mitochondrial defects are common to a range of different loser cell types and that manipulating mitochondrial function triggers cell competition. In the mouse embryo, cell competition eliminates cells with sequence changes in mt-Rnr1 and mt-Rnr2, and that even non-pathological changes in mitochondrial DNA sequence can induce cell competition. Our results suggest that cell competition is a purifying selection that optimises mitochondrial performance prior to gastrulation.