We report a simple implementation to acquire spectral domain polarization-sensitive optical coherence tomography (PSOCT) using a single camera. By combining a dual-delay assembly in the reference arm and offset B-scan in the sample arm, the orthogonal vertical- and horizontal-polarized images were acquired in parallel and spatially separated by a fixed distance in the full range image space. The two orthogonal polarization images were recombined to calculate the intensity, retardance and fast-axis images. This system was easy to implement and capable of acquiring high-speed in vivo 3D polarization-sensitive OCT images.