It's PSVita, no apostrophe   

Well, first thing's first:

1) What games are you looking for? Are the games available on the PS Vita?
2) Are you okay with a handheld device with a smaller screen than a home console?

Most of the games are in Japanese, but we're seeing more English subtitles coming in like Senran Kagura Estival Versus, Digimon Sleuth, and Gundam Extreme Vs Force next year.

The Vita 1000 is the first Vita - it's thicker and has some metal parts I think, and it's got an OLED display, but no internal storage. Some people might say an OLED display is nicer, but it's subjective. It's basically more saturated, i.e. blacks are really black, red is really red - think Samsung's AMOLED displays. It also comes in a 3G + WiFi model, meaning you can use a 3G sim card inside for internet use.

The Vita 2000 - or known as the Vita Slim - is slimmer, slightly rounder, has better battery life, and uses an LCD screen PLUS 1GB of internal storage. The screen, once again, is very subjective. Go and check it out in stores if you can before you decide. The extra hour or so of battery life definitely helps if you're always on the go and gaming for long periods, not to mention the Vita is lighter as well.
You'll definitely need a Vita memory card regardless of which Vita you get, even if the Slim has the 1GB - it fills up quite fast if you play a few games at once. The proprietary memory card costs a lot as well, 16GB is RM130.
Besides the differences above, both Vita series is same everywhere else. You might want to check out the latest released Vita debut bundles with the new red and blue colors.

You're welcome, always happy to have more Vita players! 
You can check Heavy-Arms Gaming in SS15, or Impulse Gaming in Sunway - they're both reputable shops with ok-ok prices.

The Vita currently goes for about RM699-700+ depending.

Games got Playstation store or physical copies - entirely up to you, but sometimes digital copy cheaper.
You should also go and read up about the Region account. R1, R2, and R3 got different Playstation Stores with different content.