The only person that can change that is you, love.
People are always going to be judgmental, it is just how our brains operate. As long as YOU like that sweater, or that make-up, or how your hair looks that day, screw those other people. You need to do things that make you happy, because like is too short to do otherwise. And plus, I think being a bit self conscious sometimes is normal. It happens.
Gurl, if you like that sweater, you work that sweater. haha <3