Protein dynamics are essential for protein function, and yet it has been challenging to access the underlying atomic motions in solution on nanosecond-to-microsecond time scales. We present a structural ensemble of ubiquitin, refined against residual dipolar couplings (RDCs), comprising solution dynamics up to microseconds. The ensemble covers the complete structural heterogeneity observed in 46 ubiquitin crystal structures, most of which are complexes with other proteins. Conformational selection, rather than induced-fit motion, thus suffices to explain the molecular recognition dynamics of ubiquitin. Marked correlations are seen between the flexibility of the ensemble and contacts formed in ubiquitin complexes. A large part of the solution dynamics is concentrated in one concerted mode, which accounts for most of ubiquitin's molecular recognition heterogeneity and ensures a low entropic complex formation cost.