Estrogenic and androgenic neurosteroids can rapidly modulate synaptic plasticity in the brain through interaction with membrane receptors for estrogens (ERs) and androgens (ARs). We used electrophysiological recordings in slices of young and adolescent male rats to explore the influence of sex neurosteroids on synaptic plasticity in the CA1 hippocampal region, by blocking ARs or ERs during induction of long-term depression (LTD) and depotentiation (DP) by low-frequency stimulation (LFS) and long-term potentiation (LTP) by high-frequency stimulation (HFS). We found that LTD and DP depend on ARs, while LTP on ERs in both age groups. Accordingly, the AR blocker flutamide affected induction of LTD reverting it into LTP, and prevented DP, while having no effect on HFS-dependent LTP. Conversely, ER blockade with ICI 182,780 (ICI) markedly reduced LTP, but did not influence LTD and DP. However, the receptor blockade did not affect the maintenance of either LTD or LTP. Moreover, we found that similar to LTP and LTD induced in control condition, the LTP unveiled by flutamide during LFS and residual LTP induced by HFS under ICI depended on N-methyl-D aspartate receptor (NMDAR) activation. Furthermore, as the synaptic paired-pulse facilitation (PPF) was not affected by either AR or ER blockade, we suggest that sex neurosteroids act primarily at a postsynaptic level. This study demonstrates for the first time the crucial role of estrogenic and androgenic neurosteroids in determining the sign of hippocampal synaptic plasticity in male rat and the activity-dependent recruitment of androgenic and estrogenic pathways leading to LTD and LTP, respectively.