Mycobacterium abscessus (Mab) is a rapidly growing species of multidrug-resistant nontuberculous mycobacteria that has emerged as a growing threat to individuals with cystic fibrosis and other pre-existing chronic lung diseases. Mab pulmonary infections are difficult, or sometimes impossible, to treat and result in accelerated lung function decline and premature death. There is therefore an urgent need to develop novel antibiotics with improved efficacy. tRNA (m1G37) methyltransferase (TrmD) is a promising target for novel antibiotics. It is essential in Mab and other mycobacteria, improving reading frame maintenance on the ribosome to prevent frameshift errors. In this work, a fragment-based approach was employed with the merging of two fragments bound to the active site, followed by structure-guided elaboration to design potent nanomolar inhibitors against Mab TrmD. Several of these compounds exhibit promising activity against mycobacterial species, including Mycobacterium tuberculosis and Mycobacterium leprae in addition to Mab, supporting the use of TrmD as a target for the development of antimycobacterial compounds.