Hi ChristopherSims, I had the same problem with my Macbook Air Mid 2011, but I've solved it by doing this:
Check 'Adjust keyboard brightness in low light'
Choose 'Never' for 'Turn off when computer is not used for:'
Uncheck 'Adjust keyboard brightness in low light'
Use F5 to turn the light to zero (no light)
Check 'Adjust keyboard brightness in low light' again.
If you cannot use the F5 and F6 keys for adjusting the light anymore, then it's done.
I don't have to reset or do anything else.
It works for me, hope it will for you.
It used to work properly: turned on when it's dark, turned off when it's light, even when I was in a room. After upgrading to my current OSX 10.9.4, it didn't do anything:
If I ticked the 'Adjust keyboard brightness in low light', I was still able to adjust the light with F5 and F6 keys. It was always on or it wasn't even when I sat in a dark room after using F5 key to turn the light off
Now, it works properly. It's not on when I sit in a bright room or outside during daytime, it's only on when I sit in a dark room.