When the numbers work in your favor. That usually means when you can get a meaningfully lower interest rate, when you need to change your loan terms, or when you want to access your home’s equity.