Understanding the correlation between chemical and microstructural properties is critical for unraveling the fundamental relationship between materials chemistry and physical structures that can benefit materials science and engineering. Here, we demonstrate novel in situ correlative imaging of the X-ray Compton scattering computed tomography (XCS-CT) technique for studying this fundamental relationship. XCS-CT can image light elements that do not usually exhibit strong signals using other X-ray characterization techniques. This paper describes the XCS-CT setup and data analysis method for calculating the valence electron momentum density and lithium-ion concentration, and provides two examples of spatially and temporally resolved chemical properties inside batteries in 3D. XCS-CT was applied to study two types of rechargeable lithium batteries in standard coin cell casings: (1) a lithium-ion battery containing a cathode of bespoke microstructure and liquid electrolyte, and (2) a solid-state battery containing a solid-polymer electrolyte. The XCS-CT technique is beneficial to a wide variety of materials and systems to map chemical composition changes in 3D structures.