We investigate eigenvalue problems for the planar Helmholtz equation in open systems with a high order of rotational symmetry. The resulting solutions have similarities with the whispering gallery modes exploited in photonic micro-resonators and elsewhere, but unlike these do not necessarily require a surrounding material boundary, with confinement instead resulting from the geometry of a series of inclusions arranged in a ring. The corresponding fields exhibit angular quasi-periodicity reminiscent of Bloch waves, and hence we refer to them as whispering Bloch modes (WBMs). We show that if the geometry of the system is slightly perturbed such that the rotational symmetry is broken, modes with asymmetric field patterns can be observed, resulting in field enhancement and other potentially desirable effects. We investigate the WBMs of two specific geometries first using expansion methods and then by applying a two-scale asymptotic scheme.