IRS telling me that there is a warrant for my arrest and our property is under surveillance...whatever

Same thing, telling me there were going to bgellegal matters if i didnt pay. Isnt there somewhere you can report these people?

Same thing saying they would start legal matters, etc

Report them:
https://www.treasury.gov/tigta/contact_report_scam.shtml

You understand there's no much anyone can really do at this point.   Callers are hard core Indian and Pakistani phone scammers who ignore all US laws.  The US can't do much and the local governments do little.

Being sued