Sleep tracking accuracy ios16

I have been using Autosleep (available on the App Store) to track my sleep for several years and I've learned to trust it. Now that iOS16 has more detailed sleep tracking, I compared the Autosleep results with the Apple sleep tracking and there are big differences.


Notably, in my case (and confirmed by one other user on another forum) the Apple sleep app registers zero or very little deep sleep on most nights whereas Autosleep registers between 45 minutes and 2 hours. The average adult gets 1-2 hours of deep sleep per night so I believe that the Apple algorithm may be at fault. It is not possible to test actual deep sleep without an EEG Device but the algorithm should be a decent approximation.


I'd appreciate it if other users/biohackers could share their experiences here.

Apple Watch Series 7, watchOS 9

Posted on Sep 15, 2022 12:33 AM

Reply
Question marked as Top-ranking reply

Posted on Nov 18, 2022 10:45 AM

Thanks JJ. Part of the reason for the post was the YouTube video by "The Quantified Scientist" where he analysed the Apple Watch algorithm when WatchOS 9 came out. He rated the Apple Watch as the best wearable for sleep tracking. I accept his results because he's very scientific but then I noticed that the Apple Watch was consistently reporting less deep sleep than other algorithms which on its own does not mean the algorithm is wrong. However the Apple Watch also consistently reports lower deep sleep scores than are considered normal for healthy adults and this means more investigation is needed. I belong to a biohacking group on whatsapp and I did a survey monkey survey on it - I got 15 responses. The most popular device was Oura ring followed by Whoop, Fitbit, and Garmin. All of the other devices consistently report higher deep sleep scores than the Apple Watch. In my own case when I used the Autosleep algorithm it was reporting 30-90 minutes of deep sleep. When I switched to the native Apple algorithm it is reporting as little as zero deep sleep and never more than 40 minutes (and this was after a long-haul flight when I slept for about 10 hours straight). I'm pretty healthy, I train every day, don't smoke, don't drink and have a relatively low stress life so I don't think the Apple algorithm is working for me.


34 replies
Question marked as Top-ranking reply

Nov 18, 2022 10:45 AM in response to jjdub1313

Thanks JJ. Part of the reason for the post was the YouTube video by "The Quantified Scientist" where he analysed the Apple Watch algorithm when WatchOS 9 came out. He rated the Apple Watch as the best wearable for sleep tracking. I accept his results because he's very scientific but then I noticed that the Apple Watch was consistently reporting less deep sleep than other algorithms which on its own does not mean the algorithm is wrong. However the Apple Watch also consistently reports lower deep sleep scores than are considered normal for healthy adults and this means more investigation is needed. I belong to a biohacking group on whatsapp and I did a survey monkey survey on it - I got 15 responses. The most popular device was Oura ring followed by Whoop, Fitbit, and Garmin. All of the other devices consistently report higher deep sleep scores than the Apple Watch. In my own case when I used the Autosleep algorithm it was reporting 30-90 minutes of deep sleep. When I switched to the native Apple algorithm it is reporting as little as zero deep sleep and never more than 40 minutes (and this was after a long-haul flight when I slept for about 10 hours straight). I'm pretty healthy, I train every day, don't smoke, don't drink and have a relatively low stress life so I don't think the Apple algorithm is working for me.


Nov 9, 2022 7:27 AM in response to john buck1

It seems fairly clear that the Fitbit, Xiaomi band and the Autosleep app on Apple Watch report significantly more deep sleep than the native Apple algorithm. There is no way to say definitively which algorithm is best but published YouTube tests suggest that the Apple algorithm is pretty good. If you google "deep sleep in healthy adults" or something similar the results will tell you that the Apple Watch algorithm tends to report less deep sleep than is "normal" for the average population. There is a way to address the problem with Autosleep but it doesn't really solve the problem it just forces Autosleep to use the Apple values. If you go into Autosleep settings you can configure "Sleep Stages" to "Show Sleep Stages" and "Use Awake Stage" - this appears to instruct the app to use the default Apple measurements in the Autosleep reporting. I did this and now Autosleep and the Apple algorithm agree but the deep sleep value is still way below what it was in the past.

Nov 17, 2022 11:48 AM in response to CapeTownMacaroni

Hey CapeTownMacaroni,


I am no sleep expert, but have experienced similar "scoring" issues comparing Withings Sleep Mat, Apple Watch and other random wearables since I became interested in health tracking.


I have no association, but if you are interested in digging deep on this I would take a look at The Quantified Scientist. Tons of science based information, comparisons and reviews.


Hope this helps.


All the best.

Nov 18, 2022 1:09 PM in response to CapeTownMacaroni

Interesting conversation Cape Town,


I cannot argue the merits of the Apple Watch Algorithm. If for no other reason than I do not have the knowledge or a large enough personal sample size to produce any data with significance.


TQS does a great job with what he does, but as you mention, his test is on himself which is a baseline of one and does not consider the cofactors associated with other individuals or groups.


Personally, I consider the Apple Watch in the top ten of consumer devices that can be purchased easily, over the counter, at an affordable price to monitor sleep or other health metrics. That being said, I do not consider it a medical device (as close as it may get at times).


Your sample size of 15 with your questionnaire affirms some of my assumptions that that Aura ring is probably better suited at sleep tracking. I would also make the assumption that the sample is a little bias as those usually associated with a biohacking group are more healthy, fit or aware of a health lifestyle than the general population, which may sway the results versus a larger, general population sample.


As a last ditch effort to assist I would do the following if you have not already:

https://www.myhealthyapple.com/apple-watch-not-tracking-sleep-or-sleep-stages-heres-what-you-can-do/


I am not sure if you have stumbled upon this conversation:

https://www.reddit.com/r/AppleWatch/comments/xrxkfw/am_i_the_only_one_whos_aw_records_very_little/


I enjoy the conversation, but I really have nothing else substantial to provide towards a solution as related to the Apple Watch (I am not sure an Genius is going to get you anywhere with this either). I would find it interesting if you were to track with a different device (Aura, FitBit, etc.) if your results would match your current conclusions or create another outlier?


If you find the time, post back any results or solutions you may find (or if you happen to find an ear at Apple to assist with this).


Good luck. All the best.

Nov 18, 2022 3:28 PM in response to jjdub1313

I wear a Fitbit Inspire 2 on the same arm next to my Apple watch 6 and I also get lower deep sleep on the watch vs Fitbit. The REM cycles dont match either. The values can be off 2x-3x. I dont buy into the studies showing apple watch is the most accurate wearable since my blood oxygen readings can go from 100% to 85% in the same day. My skin is fair with no tattoos. I tend to believe the fitbit more since deep sleep is a key factor to me and i know what 1+ hrs does to me vs how i would feel with the fewer minutes Apple watch shows.

Sep 26, 2022 9:07 AM in response to mjperry51

Some more data for you:


Apple Watch


9/21 12 Min Deep, 54 min REM

9/22 26 Min Deep, 1 hour 26 min REM

9/23 34 Min Deep, 34 min REM

9/24 15 Min Deep, 1 Hour 12 Min REM

9/25 31 Min Deep, 1 hour 143 Min REM

9/26 31 Min Deep, 58 Min REM


Applied IOS 16.02 Update on 9/24


FitBit Charge 2


9/21 7 Min Deep, 18 Min REM

9/22 1 Hour 6 Min Deep, 41 Min REM

9/23 36 Min Deep, 4 min REM (Only 5 Hours sleep that night)

9/24 No Sleep Stages reported

9/25 1 Hour 1 Min Deep, 22 Mon REM

9/26 12 Min Deep, 53 Min REM


FWIW


ETA: On further consideration I wonder if the Auto Sleep algorithm is different from both the FitBit/IOS algorithm. And which one(s) is (are) more accurate. Looking at my AutoSleep data for the periods involved the Deep Sleep totals are much higher than either the FitBit or IOS.


Fascinating



Dec 13, 2022 11:04 AM in response to CapeTownMacaroni

Come on, guys! What do you expect? Sleep studies attach wires to your head, your arms, your feet, and your chest! They measure actual eye movement, multiple aspects of heart signals, and alpha brain waves! The amazing thing is that an Apple Watch or a Fitbit or whatever can work at all!


You can't compare the Apple Watch data to the Fitbit data, and certainly not to real sleep study data. What you can do is monitor your sleep each day and be aware of drastic changes that might indicate something's going on. This ain't brain surgery, and you don't want your brain surgeon depending on either an Apple Watch or a Fitbit. Let's use it for what it's good for and not complain about what we have no right to expect.

Feb 2, 2023 4:12 AM in response to CapeTownMacaroni

I can support your concern with Deep Sleep recording . In 2020 using my wife's Fitbit I was clocking between 5 - 16% Deep Sleep . I bought Apple 8 series watch about 8 days ago and its recording Zero Deep Sleep most nights !! . My wife and swapped and she recorded 7 mins deep using my watch , but there were some inconsistencies from her watch that I wore . Ive had disturbed sleep patterns for some years , which match REM Sleep Behaviour Disorder symptoms which was my reason for buying the watch. Any research on quality of sleep details the importance of Deep Sleep both in quality and quantity and the rather scary implications should you fall short on this. We are going to try more swap tests and both of us using both watches to compare . It was something of a comfort to hear Im not alone with concerns about Deep Sleep accuracy on Apple Watches. Richnsoul

UK

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Sleep tracking accuracy ios16

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.