The molecular mechanisms underlying the targeting of Huntingtin (Htt) to endosomes and its multifaceted role in endocytosis are poorly understood. In this study, we have identified Htt-associated protein 40 (HAP40) as a novel effector of the small guanosine triphosphatase Rab5, a key regulator of endocytosis. HAP40 mediates the recruitment of Htt by Rab5 onto early endosomes. HAP40 overexpression caused a drastic reduction of early endosomal motility through their displacement from microtubules and preferential association with actin filaments. Remarkably, endogenous HAP40 was up-regulated in fibroblasts and brain tissue from human patients affected by Huntington's disease (HD) as well as in STHdhQ(111) striatal cells established from a HD mouse model. These cells consistently displayed altered endosome motility and endocytic activity, which was restored by the ablation of HAP40. In revealing an unexpected link between Rab5, HAP40, and Htt, we uncovered a new mechanism regulating cytoskeleton-dependent endosome dynamics and its dysfunction under pathological conditions.