I've had that problem (moobs) most my life. Pardon me...most my fat adult life. But looking back, they were almost gone when I was thin. Now that I am older, they are even more noticeable....so, thats one of the reasons I've started eating better. And after losing about 16 lbs, theres already a big difference. 225 > 209.
I am also concentrating a bit more on exercises that are geared to the pecs. And I think, while these exercises don't do anythng to the actual fat on the chest, they do make the pecs appear better if that makes sense.
As already mentioned, see a doctor if you are concerned about gynecomastia.