I tried pulling and reinserting the battery but it didn't work.
I've never seen them lit. The only reason I even noticed it is because I saw that the other phones we bought had lit buttons and asked them if they had to turn that on. They told me they didn't and that the buttons lit up from the first time they were turned on.