The immunogenicity of adenovirus serotype 5 (Ad5) vectors has been shown to be suppressed by neutralizing antibodies (NAbs) directed primarily against the hexon hypervariable regions (HVRs). However, the role of NAbs directed against other capsid components, particularly the adenovirus fiber, remains unclear. Here we show that Ad5 NAbs target both hexon and fiber following vaccination and natural infection. Utilizing neutralization assays with capsid chimeric vectors, we observed that NAb responses to hexon appeared dominant and NAb responses against fiber were subdominant in sera from vaccinated mice, vaccinated humans, and naturally exposed humans. A novel chimeric Ad5 vector in which both the hexon HVRs and the fiber knob were exchanged nearly completely evaded Ad5-specific NAbs both in vitro and in vivo.