Polarized optical dark-field spectroscopy is shown to be a versatile noninvasive probe of plasmonic structures that trap light to the nanoscale. Clear spectral polarization splittings are found to be directly related to the asymmetric morphology of nanocavities formed between faceted gold nanoparticles and an underlying gold substrate. Both experiment and simulation show the influence of geometry on the coupled system, with spectral shifts Δλ = 3 nm from single atoms. Analytical models allow us to identify the split resonances as transverse cavity modes, tightly confined to the nanogap. The direct correlation of resonance splitting with atomistic morphology allows mapping of subnanometre structures, which is crucial for progress in extreme nano-optics involving chemistry, nanophotonics, and quantum devices. Here are the dataset provided that contain all the information of the 4 figures of the article showing experimental as well as theoretical polarization dependent dark-field scattering of NPoM structures.