We study random walks on the groups $Fpd⋊$ SL($Fp$). We estimate the spectral gap in terms of the spectral gap of the projection to the linear part SL($Fp$). This problem is motivated by an analogue in the group $Rd⋊$ SO($d$), which have application to smoothness of self-similar measures.