ive never done it myself but i know people who have gone out in pj's with a coat on (so pj bottoms are on show). I think as long as theyre not revealing or whatnot then what does it matter?? why people worry about others they dont even know, gets me (unless of course someone is doing/wearing something offensive).
It's not socially acceptable, that's why. Wear some proper clothes.