Background. This study aimed to determine whether it is possible to predict driving safety of individuals with homonymous hemianopia or quadrantanopia based upon a clinical review of neuroimages that are routinely available in clinical practice. Methods. Two experienced neuroophthalmologists viewed a summary report of the CT/MRI scans of 16 participants with homonymous hemianopic or quadrantanopic field defects which indicated the site and extent of the lesion and they made predictions regarding whether participants would be safe/unsafe to drive. Driving safety was independently defined at the time of the study using state-recorded motor vehicle crashes (all crashes and at-fault) for the previous 5 years and ratings of driving safety determined through a standardized on-road driving assessment by a certified driving rehabilitation specialist. Results. The ability to predict driving safety was highly variable regardless of the driving safety measure, ranging from 31% to 63% (kappa levels ranged from -0.29 to 0.04). The level of agreement between the neuroophthalmologists was only fair (kappa = 0.28). Conclusions. Clinical evaluation of summary reports of currently available neuroimages by neuroophthalmologists is not predictive of driving safety. Future research should be directed at identifying and/or developing alternative tests or strategies to better enable clinicians to make these predictions.