The fact that you are an only child would not matter to someone untill they get to know u and your attitude makes them go "patutlah ... this fella only child, that's why the attitude like that".

My guess is that there is something in your behavior/look that makes ppl think like that or maybe u just had the bad luck of meeting a bunch of idiots on your journey to adulthood.