Batteries do need to be replaced, every year or two, depending on the way you use it. If I were you, I'd order another. I wouldn't keep using a battery that was acting up.

Your laptop shouldn't overheat if you battery isn't recharging, but, of course, you'll have to stay plugged in in order to use your computer if the battery won't charge at all.