Let Z be a subvariety of the moduli space of principally polarised abelian varieties of dimension g over the complex numbers. Suppose that Z contains a Zariski dense set of points which correspond to abelian varieties from a single isogeny class. A generalisation of a conjecture of André and Pink predicts that Z is a weakly special subvariety. We prove this when dimZ=1 using the Pila–Zannier method and the Masser–Wüstholz isogeny theorem. This generalises results of Edixhoven and Yafaev when the Hecke orbit consists of CM points and of Pink when it consists of Galois generic points.