This paper gives an assessment on the electrical conductivity of different additive fillers (graphite, multi-walled carbon nanotubes) into carbon fiber-cement based composites (CFRC). Results show that cement matrix containing 0.4% carbon fiber (CF) and 0.5% multi-walled carbon nanotubes (MWCNTs) exhibits an excellent electrical conductivity of 33.65Ω·cm. When the content of CF is below the percolation threshold (0.4% CF), adding graphite is beneficial to the electrical conduction of CFRC, which has a tremendous drift from 3991.44Ω·cm to 524.33Ω·cm as the content of graphite varies from 0% to 30%. However, when the content of CF is above the percolation threshold, adding graphite makes no advantages in the electrical conductivity of CFRC because of leading to a porosity rising. MWCNTs are useful conductive constituents for CFRC and can increase electrical conductivity by two orders of magnitude. However, excessive adding MWCNTs into CFRC will have a rapid increase of electrical resistivity on the contrary.