The manual will tell you how to open the fob to replace the battery.
I have a Prius, so this may not work for you:
There's a little button on the side of the fob that you press to release the emergency key for the door (in case the battery dies and you need to get in). You can hold the fob up to the Start button to turn the car on if the battery is too weak to work from afar.
You can also take the emergency key and stick it in the narrow little hole on the fob and twist to pop the fob open. There's a round battery inside with numbers on it. You can go to CVS or Target and buy the same battery.