Need to give those details for merchant to charge your card. So, if they want to charge you, have to give.. if they only want for confirmation on their own process without charging you, no reason to give. But still, even you walk in and give card to counter and swipe then you take back, that's not safe also. Very easy to duplicate your card once it is swiped..