That's because people would think either you're a nerdy bookworm, an anti-social, show off, or just plain boring, and weirdly enough they would get somehow intimidated or uncomfortable being around you. Err.. Something along those lines. I wouldn't give them a second thought if I were you, I mean I'd rather just continue reading and lost myself in it than messing my head with possible reasons people would come up with when they were scrutinizing me. Lol just my two cents.