A central question in the underdoped cuprates pertains to the nature of the pseudogap ground state. A conventional metallic ground state of the pseudogap region has been argued to host quantum oscillations upon destruction of the superconducting order parameter by modest magnetic fields. Here, we use low applied measurement currents and millikelvin temperatures on ultrapure single crystals of underdoped [Formula: see text] to unearth an unconventional quantum vortex matter ground state characterized by vanishing electrical resistivity, magnetic hysteresis, and nonohmic electrical transport characteristics beyond the highest laboratory-accessible static fields. A model of the pseudogap ground state is now required to explain quantum oscillations that are hosted by the bulk quantum vortex matter state without experiencing sizable additional damping in the presence of a large maximum superconducting gap; possibilities include a pair density wave.