Siri seems to be forgetting my location

How can Siri know my location one time and on the same day forget my location. Restarting them helps for a brief time but it will forget again later on the same day. “I don’t know where you are” How is this possible? Siri forgets my location on the same day. Why is this happening? And why is Siri slow to control any HomeKit devices?

I am using LIFX on wifi and mostly using Eve and Nanoleaf on thread.