Where do you usually go to replace the car key battery?

Check the "user manual" that comes with the car for instructions on changing the remote control battery. It usually specifies the battery model, typically a CR2032 button battery. You can buy it yourself for cheaper, and there are replacement tutorial videos online. If you really can't figure it out, go to an auto parts market.

Do it yourself.