We investigate time-dependent inorganic ligand exchanging effect and photovoltaic performance of lead sulfide (PbS) nanocrystal films. With optimal processing time, volume shrinkage induced by residual oleic acid of the PbS colloidal quantum dot (CQD) was minimized and a crack-free film was obtained with improved flatness. Furthermore, sufficient surface passivation significantly increased the packing density by replacing from long oleic acid to a short iodide molecule. It thus facilities exciton dissociation via enhanced charge carrier transport in PbS CQD films, resulting in the improved power conversion efficiency from 3.39% to 6.62%. We also found that excess iodine ions on the PbS surface rather hinder high photovoltaic performance of the CQD solar cell.