Does this sweater fit well on me?

How does the size and color of this sweater work for me? I got it from J Crew and ordered medium, which is my usual size from there. I think it is slightly big/loose, but not too bad. It is cotton so I don't expect it to shrink much. I'm 5'7" and 155 lbs. I have broad shoulders/chest which make small a tough fit most of the time.