Visual inspection is the most commonly employed way of condition inspection for road networks. The process is quite labor intensive, leading to a substantive cost of inspection per lane mile and causing long inspection cycles and substantive inspection outcomes variability. Automating the process can tackle these issues. The first step to achieve automation is to understand what the assets are, what their visible condition symptoms are, what they cause and what causes them, and how to fix both their outcomes and their causes. This is the objective of this paper. Inspired by the symptoms tracker of WebMD, we conducted exploratory research that combined several guidelines into a comprehensive definition of road assets, their defects and possible maintenance techniques from the road inspector’s point of view. We propose a different classification system of the road assets according to their defects and maintenance techniques driven by the computer visual monitoring approach. The result is a large map containing all the aforementioned elements.