It doesn't bother me, but I politely would tell them that I preferred to chat via email for a little while before talking on the phone.


I understand your concerns, but some guys just feel more comfortable talking on the phone. Personally I like instant message for online communication because it is more like a convo than emailing back and forth.