Call claiming to be from the IRS, needing me to call back or be arrested.

There is a widespread IRS (or CRA) or "tax scam" being  practiced by scammers on both USA and Canadian residents.

USA tax payers should read this:
http://www.irs.gov/uac/Newsroom/Phone-Scams-C ... 5-Filing-Season

Canadian tax payers should read this:
http://www.cra-arc.gc.ca/nwsrm/lrts/2013/l131210-eng.html

Short answer:
The IRS never initiates a contact via phone.
They always send a snailmail first.

Educational post:
This scam is also described as scam #11, here:
http://phonehelp.2truth.com/facts.html

If you were contacted by an IRS impostor, you may file a report, after clicking on this link:
http://www.treasury.gov/tigta/contact_report_scam.shtml

UPDATES:
Recent news story:
http://www.wltx.com/story/money/2015/03/12/fa ... -scam/70202814/

Congressional hearing:
http://www.nbcnews.com/business/taxes/tax-imp ... hearing-n341906

I received a voicemail  from 202-239-1323/Caller Name: Joey Wonder on Tues 6/16/2015 at 4:14pm PT claiming to be from the IRS and that I owed money. (I accidentally deleted the voicemail) but I've already paid my taxes for 2014 so I knew this was a "SCAM" call.