Some hispanic asked if I spoke Spanish.  I said no and they said F You!  
I asked who were they calling and they said F You again.  
After exchanging a couple more salutations, I hung up.

You should've told him you'll speak Spanish only if he grew balls and told you where he's calling you from. He must be a Card Service Turd or some other group trying to rip off Spanish speakers.