Recent ancient DNA (aDNA) studies of human pathogens have provided invaluable insights into their evolutionary history and prevalence in space and time. Most of these studies were based on DNA extracted from teeth or postcranial bones. In contrast, no pathogen DNA has been reported from the petrous bone which has become the most desired skeletal element in ancient DNA research due to its high endogenous DNA content. To compare the potential for pathogenic aDNA retrieval from teeth and petrous bones, we sampled these elements from five ancient skeletons, previously shown to be carrying Yersinia pestis. Based on shotgun sequencing data, four of these five plague victims showed clearly detectable levels of Y. pestis DNA in the teeth, whereas all the petrous bones failed to produce Y. pestis DNA above baseline levels. A broader comparative metagenomic analysis of teeth and petrous bones from 10 historical skeletons corroborated these results, showing a much higher microbial diversity in teeth than petrous bones, including pathogenic and oral microbial taxa. Our results imply that although petrous bones are highly valuable for ancient genomic analyses as an excellent source of endogenous DNA, the metagenomic potential of these dense skeletal elements is highly limited. This trade-off must be considered when designing the sampling strategy for an aDNA project.