Histone deacetylases (HDACs) are involved in tumor progression, and some have been successfully targeted for cancer therapy. The expression of histone deacetylase 4 (HDAC4), a class IIa HDAC, was upregulated in our previous microarray screen. However, the role of HDAC4 dysregulation and mechanisms underlying tumor growth and metastasis in nasopharyngeal carcinoma (NPC) remain elusive. Here, we first confirmed that the HDAC4 levels in primary and metastatic NPC tissues were significantly increased compared with those in normal nasopharyngeal epithelial tissues and found that high HDAC4 expression predicted a poor overall survival (OS) and progression-free survival (PFS). Functionally, HDAC4 accelerated cell cycle G1/S transition and induced the epithelial-to-mesenchymal transition to promote NPC cell proliferation, migration, and invasion in vitro, as well as tumor growth and lung metastasis in vivo. Intriguingly, knockdown of N-CoR abolished the effects of HDAC4 on the invasion and migration abilities of NPC cells. Mechanistically, HDAC3/4 binds to the E-cadherin promoter to repress E-cadherin transcription. We also showed that the HDAC4 inhibitor tasquinimod suppresses tumor growth in NPC. Thus, HDAC4 may be a potential diagnostic marker and therapeutic target in patients with NPC.