Dynamic control of gene expression is essential for the development of a totipotent zygote into an embryo with defined cell lineages. The accessibility of genes responsible for cell specification to transcriptional machinery is dependent on chromatin remodelling complexes such as the SWI\SNF (BAF) complex. However, the role of the BAF complex in early mouse development has remained unclear. Here, we demonstrate that BAF155, a major BAF complex subunit, regulates the assembly of the BAF complex in vivo and regulates lineage specification of the mouse blastocyst. We find that associations of BAF155 with other BAF complex subunits become enriched in extra-embryonic lineages just prior to implantation. This enrichment is attributed to decreased mobility of BAF155 in extra-embryonic compared with embryonic lineages. Downregulation of BAF155 leads to increased expression of the pluripotency marker Nanog and its ectopic expression in extra-embryonic lineages, whereas upregulation of BAF155 leads to the upregulation of differentiation markers. Finally, we show that the arginine methyltransferase CARM1 methylates BAF155, which differentially influences assembly of the BAF complex between the lineages and the expression of pluripotency markers. Together, our results indicate a novel role of BAF-dependent chromatin remodelling in mouse development via regulation of lineage specification.