Gpr125 is an orphan G-protein coupled receptor, with homology to cell adhesion and axonal guidance factors, that is implicated in planar polarity and control of cell movements. By lineage tracing we demonstrate that Gpr125 is a highly specific marker of bipotent mammary stem cells in the embryo and of multiple long-lived unipotent basal mammary progenitors in perinatal and postnatal glands. Nipple-proximal Gpr125+ cells express a transcriptomic profile indicative of chemo-repulsion and cell movement, whereas Gpr125+ cells concentrated at invasive ductal tips display a hybrid epithelial-mesenchymal phenotype and are equipped to bind chemokine and growth factors and secrete a promigratory matrix. Gpr125 progenitors acquire bipotency in the context of transplantation and cancer and are greatly expanded and massed at the pushing margins of short latency MMTV-Wnt1 tumors. High Gpr125 expression identifies patients with particularly poor outcome within the basal breast cancer subtype highlighting its potential utility as a factor to stratify risk.