In this study, we connect concepts that have been recently developed in thermoacoustics, specifically, (i) high-order spectral perturbation theory, (ii) symmetry induced degenerate thermoacoustic modes, (iii) intrinsic thermoacoustic modes, and (iv) exceptional points. Their connection helps gain physical insight into the behaviour of the thermoacoustic spectrum when parameters of the system are varied. First, we extend high-order adjoint-based perturbation theory of thermoacoustic modes to the degenerate case. We provide explicit formulae for the calculation of the eigenvalue corrections to any order. These formulae are valid for self-adjoint, non-self-adjoint or even non-normal systems; therefore, they can be applied to a large range of problems, including fluid dynamics. Second, by analysing the expansion coefficients of the eigenvalue corrections as a function of a parameter of interest, we accurately estimate the radius of convergence of the power series. Third, we connect the existence of a finite radius of convergence to the existence of singularities in parameter space. We identify these singularities as exceptional points, which correspond to defective thermoacoustic eigenvalues, with infinite sensitivity to infinitesimal changes in the parameters. At an exceptional point, two eigenvalues and their associated eigenvectors coalesce. Close to an exceptional point, strong veering of the eigenvalue trajectories is observed. As demonstrated in recent work, exceptional points naturally arise in thermoacoustic systems due to the interaction between modes of acoustic and intrinsic origin. The role of exceptional points in thermoacoustic systems sheds new light on the physics and sensitivity of thermoacoustic stability, which can be leveraged for passive control by small design modifications.