The brain processes images at different spatial scales, but it is unclear how far into the visual stream different scales remain segregated. Using functional magnetic resonance imaging, we found evidence that BOLD activity in the fusiform face area (FFA) reflects computations based on separate spatial frequency inputs. When subjects perform different tasks (attend location vs. identity; attend whole vs. parts) or the same task with different stimuli (upright or inverted) with high- and low-pass images of cars and faces, individual differences in the FFA in one condition are correlated with those in the other condition. However, FFA activity in response to low-pass stimuli is independent of its response to high-pass stimuli. These results suggest that spatial scales are not integrated before the FFA and that processing in this area could support the flexible use of different sources of information present in broad-pass images.