It's possible that the internal battery just doesn't want to hold a charge. It sounds like it from what you are describing, certainly.
With that said, you could certainly replace it if you liked its performance, or look for something newer, even a single battery removable mod, although that's going to be larger than what you have now, I'm guessing.
Best of luck,
Anna