No, you don't. DH and I just recently finished paying off a home equity loan. We shopped for the best interest rate. It wasn't with the bank that holds our mortgage. Your mortgage company will just need to provide some info to the bank issuing the loan.