In this paper, we demonstrate that metamaterials represent model systems for longitudinal and transverse magnetic coupling in the optical domain. In particular, such coupling can lead to fully parallel or antiparallel alignment of the magnetic dipoles at the lowest frequency resonance. Also, we present the design scheme for constructing three-dimensional metamaterials with solely magnetic interaction. Our concept could pave the way for achieving rather complicated magnetic materials with desired arrangements of magnetic dipoles at optical frequencies.