Going to gym or not does not matter, but everyone must at least do some exercise that make them sweat and pant.

and going to the gym does not necessarily makes you bigger size. You can lift for bulking up, but you can also lift for getting cut and slim.