Numerous host components are encountered by viruses during the infection process. While some of these host structures are left unchanged, others may go through dramatic remodeling processes. In this review, we summarize these host changes that occur during small DNA virus infections, with a focus on host nuclear components and pathways. Although these viruses differ significantly in their genome structures and infectious pathways, there are common nuclear targets that are altered by various viral factors. Accumulating evidence suggests that these nuclear remodeling processes are often essential for productive viral infections and/or viral-induced transformation. Understanding the complex interactions between viruses and these host structures and pathways will help to build a more integrated network of how the virus completes its life cycle and point toward the design of novel therapeutic regimens that either prevent harmful viral infections or employ viruses as nontraditional treatment options or molecular tools.