Feedback is cool, noise is not.

Just to note, some amps have internal grounding, so they don't need to be wired to the earth on the plugs. If it's done well, you can avoid the earth loop and headaches figuring out where the noise is coming from.