In recent years, there has been an increased focus on studying light-battery interactions in the context of operando optical studies and integrated photoelectrochemical energy harvesting. However, there has been little insight into identifying suitable "light-accepting" current collectors for this class of batteries. In this study, fluorine-doped tin oxide, indium-tin oxide, and silver nanowire-graphene films are analyzed along with carbon paper, carbon nanotube paper, and stainless-steel mesh as current collectors for optical batteries. They are categorized into two classes - transmissive and non-transmissive, based on the orientation of the light-electrode interaction. Various methods to prepare the electrode are highlighted, including drop casting and the fabrication of free-standing electrodes. The optical and electrical properties of these current collectors as well as their electrochemical stability are measured using linear sweep voltammetry against zinc and lithium anodes. Finally, the rate performance and long-term cycling stability of lithium manganese oxide (LiMn2O4) cathodes are measured against lithium anodes with these current collectors and their performance is compared. These results show which current collector to choose depends on the application and cell chemistry. These guidelines will assist in the design of future optical cells for in-situ measurements and photoelectrochemical energy storage.