Although a number of studies examined recollection and familiarity memory in schizophrenia, most of studies have focused on nonsocial episodic memory. Little is known about how schizophrenia patients remember social information in everyday life and whether social episodic memory changes over the course of illness. This study aims to examine episodic memory for dynamic social interaction with multi-modal social stimuli in schizophrenia across phase of illness. Within each phase of illness, probands and demographically matched controls participated: 51 probands at clinical high risk (CHR) for psychosis and 36 controls, 80 first-episode schizophrenia patients and 49 controls, and 50 chronic schizophrenia patients and 39 controls. The participants completed the Social Remember-Know Paradigm that assessed overall social episodic memory, social recollection and familiarity memory, and social context memory, in addition to social cognitive measures and measures on community functioning. Probands showed impairment for recollection but not in familiarity memory and this pattern was similar across phase of illness. In contrast, impaired social context memory was observed in the first-episode and chronic schizophrenia samples, but not in CHR samples. Social context memory was associated with community functioning only in the chronic sample. These findings suggest that an impaired recollection could be a vulnerability marker for schizophrenia whereas impaired social context memory could be a disease-related marker. Further, a pattern of impaired recollection with intact familiarity memory for social stimuli suggests that schizophrenia patients may have a different pattern of impaired episodic memory for social vs nonsocial stimuli.