Yes, just like blunt trauma to the eye, a black eye needs to be properly evaluated to rule out things like a corneal abrasion, inflammation inside of the eye, and possible internal bleeding or damage to the back part of your eye, the retina.  An eye exam is strongly recommended.