Recent evidence indicates that the establishment of the haploid phase of the plant life cycle requires epigenetic mechanisms that control reproductive cell fate. We previously showed that in Arabidopsis thaliana (Arabidopsis) mutations in ARGONAUTE9 (AGO9) result in defective cell specification during megasporogenesis. AGO9 preferentially interacts with 24 nucleotide (nt) small RNAs (sRNAs) derived from transposable elements (TEs), and its sporophytic activity is required to silence TEs in the female gametophyte. Here we show that AGO9 can bind in vitro to 24 nt sRNAs corresponding to Athila retrotransposons expressed in the ovule prior to pollination. We also show that AGO9 is necessary to inactivate a significant proportion of long terminal repeat retrotransposons (LTRs) in the ovule, and that its predominant TE targets are located in the pericentromeric regions of all 5 chromosomes, suggesting a link between the AGO9-dependent sRNA pathway and heterochromatin formation. Our extended results point towards the existence of a tissue-specific mechanism of sRNA-dependent TE silencing in the ovule.