The bacterial type VI secretion system (T6SS) delivers effectors into eukaryotic host cells or toxins into bacterial competitor for survival and fitness. The T6SS is positively regulated by the threonine phosphorylation pathway (TPP) and negatively by the T6SS-accessory protein TagF. Here, we studied the mechanisms underlying TagF-mediated T6SS repression in two distinct bacterial pathogens, Agrobacterium tumefaciens and Pseudomonas aeruginosa. We found that in A. tumefaciens, T6SS toxin secretion and T6SS-dependent antibacterial activity are suppressed by a two-domain chimeric protein consisting of TagF and PppA, a putative phosphatase. Remarkably, this TagF domain is sufficient to post-translationally repress the T6SS, and this inhibition is independent of TPP. This repression requires interaction with a cytoplasmic protein, Fha, critical for activating T6SS assembly. In P. aeruginosa, PppA and TagF are two distinct proteins that repress T6SS in a TPP-dependent and -independent pathways, respectively. P. aeruginosa TagF interacts with Fha1, suggesting that formation of this complex represents a conserved TagF-mediated regulatory mechanism. Using TagF variants with substitutions of conserved amino acid residues at predicted protein-protein interaction interfaces, we uncovered evidence that the TagF-Fha interaction is critical for TagF-mediated T6SS repression in both bacteria. TagF inhibits T6SS without affecting T6SS protein abundance in A. tumefaciens, but TagF overexpression reduces the protein levels of all analyzed T6SS components in P. aeruginosa. Our results indicate that TagF interacts with Fha, which in turn could impact different stages of T6SS assembly in different bacteria, possibly reflecting an evolutionary divergence in T6SS control.