As first demonstrated by Hanbury Brown and Twiss, it is possible to observe interference between independent light sources by measuring correlations in their intensities rather than their amplitudes. In this work, we apply this concept of intensity interferometry to holography. We combine a signal beam with a reference and measure their intensity cross-correlations using a time-tagging single-photon camera. These correlations reveal an interference pattern from which we reconstruct the signal wavefront in both intensity and phase. We demonstrate the principle with classical and quantum light, including a single photon. Since the signal and reference do not need to be phase-stable nor from the same light source, this technique can be used to generate holograms of self-luminous or remote objects using a local reference, thus opening the door to new holography applications.