Dont buy cheap guitar. Buy the most expensive that you can afford. Why? Because expensive guitar give you more motivation to play it. But if you cant, then buy guitar with price range 1.5k-2k. With that price I think brands like Yamaha, Cort, Ibanez should be ok.
I'm not sure about amplifier but if you want to make some cool/weird guitar sounds perhaps you could get a guitar multi effect (price range 300-1k) and listen thru headphone or whatever.

And with that you should also learn a bit theory like circle of fifths, scales, chord progressions etc.