It could be picking up noise from your fluroscent lights or tv or PC monitor (CRT type) or even stray radio waves in the atmosphere. If you are playing near these, try to move away from them. Try pluggin your amplifier to another power socket (in case of a noisy power outlet), or chagne the power cable (grounding issues).