Carbon-based fibrous scaffolds are highly attractive for all biomaterial applications that require electrical conductivity. It is additionally advantageous if such materials resembled the structural and biochemical features of the natural extracellular environment. Here, we show a novel modular design strategy to engineer biomimetic carbon fiber-based scaffolds. Highly porous ceramic zinc oxide (ZnO) microstructures serve as three-dimensional (3D) sacrificial templates and are infiltrated with carbon nanotubes (CNTs) or graphene dispersions. Once the CNTs and graphene coat the ZnO template, the ZnO is either removed by hydrolysis or converted into carbon by chemical vapor deposition. The resulting 3D carbon scaffolds are both hierarchically ordered and free-standing. The properties of the microfibrous scaffolds were tailored with a high porosity (up to 93%), a high Young's modulus (ca. 0.027-22 MPa), and an electrical conductivity of ca. 0.1-330 S/m, as well as different surface compositions. Cell viability, fibroblast proliferation rate and protein adsorption rate assays have shown that the generated scaffolds are biocompatible and have a high protein adsorption capacity (up to 77.32 ± 6.95 mg/cm3) so that they are able to resemble the extracellular matrix not only structurally but also biochemically. The scaffolds also allow for the successful growth and adhesion of fibroblast cells, showing that we provide a novel, highly scalable modular design strategy to generate biocompatible carbon fiber systems that mimic the extracellular matrix with the additional feature of conductivity.