Semen is normally white. Some change in the color of a guy’s semen can happen with changes in his diet, however, most of the time these changes aren’t easily noticed. A brown color in the semen that doesn’t go away may mean a low level of bleeding (most likely from the prostate) or possibly an infection, and is certainly a medical concern that you should discuss health care provider.