We present a fiber based multifunctional Jones matrix swept source optical coherence tomography (SS-OCT) system for Doppler and polarization imaging. Jones matrix measurement without using active components such as electro-optic modulators is realized by incident polarization multiplexing based on independent delay of two orthogonal polarization states and polarization diversity detection. In addition to polarization sensitivity, this system measures Doppler flow without extra hardware for phase stabilized SS-OCT detection. An eighth-wave plate was measured to demonstrate the polarization detection accuracy. The optic nerve head of a retina was measured in vivo. Detailed vasculature and birefringent structures were investigated simultaneously.