Personally, I do not see what is the issue with a woman breast-feeding her infant in public. To me, I cannot think of anything that is more natural and maternal than a mother providing for her child in the most elemental way possible. I do not believe there is any shame whatsoever for the woman, and frankly, seeing it in public does not bother me at all.
As for it being arousing, seeing any attractive woman can be arousing, whether she is breastfeeding or not, if you are in that frame of mind (I can only speak for myself, but I'm not always thinking about sex, nor am I necessarily aroused at all times when seeing attractive women).