Apple Home Leave / Arrive scene not triggering

I have my Apple Home set up to turn on some iDevices outlets and switches when I arrive home, and off when I leave home. The trigger and or scene does not work, but when I click test automation, the switches turn on/off. It seems the automation is not triggering, even though clicking "Test This Scene" works. I have an Apple TV gen 4 with HomeKit connected and Location Services on. Also my iPhone has Location Services on and under the HomeKit settings the apps are selected.

Am I missing something? Anybody has a solution?