Autism spectrum disorder (ASD) is a neurodevelopmental disorder found to have widespread alterations in the function and synchrony of brain regions. These differences may underlie alterations in microstructural organization, such as in white matter pathways. To investigate the diffusion of major white matter tracts, the current study examined multiple indices of white matter diffusion in 42 children and adults with ASD and 44 typically developing (TD) age- and IQ-matched peers using diffusion tensor imaging. Diffusivity measures were compared between groups for the following tracts: bilateral cingulum bundle, corpus callosum, inferior longitudinal fasciculus, superior longitudinal fasciculus, and uncinate fasciculus. Results indicate a significant reduction in fractional anisotropy (FA) for the left superior longitudinal fasciculus (LSLF) in ASD children and adults compared with TD peers. A significant increase in radial diffusivity for ASD participants was also found in the same cluster along the LSLF. In addition, a significant positive correlation emerged for all subjects between FA for the LSLF and age, with FA increasing with age. These findings point to a significant alteration in long-distance white matter connectivity in children and adults with ASD, potentially underscoring the relationship between alterations in white matter diffusion and the ASD phenotype. These results also suggest that the white matter alterations in autism may be subtle and related to the developmental trajectory.