An alternative approach is to consider each pixel in the frame buffer and determine what object should determine the color at that pixel.
Once the point on the correct object has been identified, us the reflectance model to calculate the proper pixel color.
This approach seems much more reasonable, but requires an inverse map from image space back to object space.