The relativistically-broadened reflection spectrum, observed in both AGN and X-ray binaries, has proven to be a powerful probe of the properties of black holes and the environments in which they reside. Being emitted from the inner-most regions of the accretion disk, this X-ray spectral component carries with it information not only about the plasma that resides in these extreme conditions, but also the black hole spin, a marker of the formation and accretion history of these objects. The models currently used to interpret the reflection spectrum are often simplistic, however, approximating the disk as an infinitely thin, optically thick plane of material orbiting in circular Keplerian orbits around the central object. Using a new relativistic ray tracing suite (Fenrir) that allows for more complex disk approximations, we examine the effects that disk thickness may have on the reflection spectrum. Assuming a lamp post corona, we find that finite disk thickness can have a variety of effects on the reflection spectrum, including a truncation of the blue wing (from self-shadowing of the accretion disk) and an enhancement of the red wing (from the irradiation of the central 'eye wall' of the inner disk). We make a first estimate on the systematic errors on black hole spin and height that may result from neglecting these effects.