the A Holes at Portfolio Recovery with another number

called my home phone at 5:44PM. I didn't answer because it was Portfolio Recovery calling again on a different number. I wish they would stop calling me.

Wishing won't do it.  A certified, return receipt cease and desist calling letter, a complaint to the following two agencies, and an FDCPA lawsuit will take care of that.  You might also want to use the links to learn what you should already know about how debt collection is supposed to work.
Read up on your rights here and also make a complaint at this government site:  http://www.consumerfinance.gov/

Also file a complaint with your State Attorney General's office.
List of State AG’s offices:   http://800notes.com/faq/attorney-general

3:35 AM?? Really?