What happens if you press the 'Cue' button instead? In this case,, the turntable should start, the arm should cue over the record but remain raised above it until you press the Cue button again.
If this works, then your Play button is dodgy. If it doesn't, then you may have some kind of power supply issue or a bad mains connection.