Sleep tracking accuracy ios16

I have been using Autosleep (available on the App Store) to track my sleep for several years and I've learned to trust it. Now that iOS16 has more detailed sleep tracking, I compared the Autosleep results with the Apple sleep tracking and there are big differences.


Notably, in my case (and confirmed by one other user on another forum) the Apple sleep app registers zero or very little deep sleep on most nights whereas Autosleep registers between 45 minutes and 2 hours. The average adult gets 1-2 hours of deep sleep per night so I believe that the Apple algorithm may be at fault. It is not possible to test actual deep sleep without an EEG Device but the algorithm should be a decent approximation.


I'd appreciate it if other users/biohackers could share their experiences here.

Apple Watch Series 7, watchOS 9

Posted on Sep 15, 2022 12:33 AM

Reply
Question marked as ⚠️ Top-ranking reply

Posted on Sep 21, 2022 6:27 AM

I had the SAME issue. my xiaomi Band 7 (the latest) has been recorded consistently 1 hour to latest 1 hour 40 minutes (and I can feel I slept well in the morning), BUT Apple Watch record I only have 7 min of deep sleep. that just doesn't make any sense.

34 replies
Sort By: 
Question marked as ⚠️ Top-ranking reply

Sep 21, 2022 6:27 AM in response to CapeTownMacaroni

I had the SAME issue. my xiaomi Band 7 (the latest) has been recorded consistently 1 hour to latest 1 hour 40 minutes (and I can feel I slept well in the morning), BUT Apple Watch record I only have 7 min of deep sleep. that just doesn't make any sense.

Reply

Nov 17, 2022 5:45 AM in response to edgargtryr54

If you look at the various data points/sources I and others have provided here your experience may be the outlier. I have never seen a report from any sources (AutoSleep from the Apple Watch or the native FitBit sleep app) anywhere near five hours of Deep Sleep (or REM for that matter). My investigations across three apps and two separate hardware platforms do not support your assertions.


For you to make such an absolute blanket statement (AutoSleep is wrong) is highly presumptive.


"how poorly I sleep"


This can be an indication of other hidden health issues. I had poor Detailed Sleep reporting from my FitBit for several years; very frustrating. Subsequently learned I have some significant cardiac issues; sleep stage detection is based (among other things) on monitoring HRV which my conditions impacted. Once those issues were resolved though medication the FitBit began to return regular Detailed Sleep reports.


I'm not a doctor -- all I'm saying is your problems sleeping (and the seemingly exaggerated Deep Sleep reports you get) could be an indication of other health matters.


For what it's worth.

Reply

Nov 18, 2022 10:45 AM in response to jjdub1313

Thanks JJ. Part of the reason for the post was the YouTube video by "The Quantified Scientist" where he analysed the Apple Watch algorithm when WatchOS 9 came out. He rated the Apple Watch as the best wearable for sleep tracking. I accept his results because he's very scientific but then I noticed that the Apple Watch was consistently reporting less deep sleep than other algorithms which on its own does not mean the algorithm is wrong. However the Apple Watch also consistently reports lower deep sleep scores than are considered normal for healthy adults and this means more investigation is needed. I belong to a biohacking group on whatsapp and I did a survey monkey survey on it - I got 15 responses. The most popular device was Oura ring followed by Whoop, Fitbit, and Garmin. All of the other devices consistently report higher deep sleep scores than the Apple Watch. In my own case when I used the Autosleep algorithm it was reporting 30-90 minutes of deep sleep. When I switched to the native Apple algorithm it is reporting as little as zero deep sleep and never more than 40 minutes (and this was after a long-haul flight when I slept for about 10 hours straight). I'm pretty healthy, I train every day, don't smoke, don't drink and have a relatively low stress life so I don't think the Apple algorithm is working for me.


Reply

Nov 9, 2022 7:27 AM in response to john buck1

It seems fairly clear that the Fitbit, Xiaomi band and the Autosleep app on Apple Watch report significantly more deep sleep than the native Apple algorithm. There is no way to say definitively which algorithm is best but published YouTube tests suggest that the Apple algorithm is pretty good. If you google "deep sleep in healthy adults" or something similar the results will tell you that the Apple Watch algorithm tends to report less deep sleep than is "normal" for the average population. There is a way to address the problem with Autosleep but it doesn't really solve the problem it just forces Autosleep to use the Apple values. If you go into Autosleep settings you can configure "Sleep Stages" to "Show Sleep Stages" and "Use Awake Stage" - this appears to instruct the app to use the default Apple measurements in the Autosleep reporting. I did this and now Autosleep and the Apple algorithm agree but the deep sleep value is still way below what it was in the past.

Reply

Sep 20, 2022 9:06 AM in response to mjperry51

That's super helpful. Very similar to my experience with Autosleep vs the Apple Health app. This strongly suggests that the Apple algorithm is at fault because the average adult should get between 1 to 2 hrs of deep sleep and we can't all be outliers.


Hopefully some more people will do testing and we can compare notes.


I have also asked the various biohacking groups I'm part of if someone will lend me an EEG device so that I can test using proper brainwave measurement. That will give the most accurate answer.


[Edited by Moderator]

Reply

Sep 20, 2022 7:52 AM in response to CapeTownMacaroni

Same issue.


Comparing results with a FitBit Charge 2 IOS 16/Watch OS9 Apple Watch 4 Last night recorded 12 minutes of Deep Sleep, 1 hour 30 minutes of REM; FitBit recorded 1 hour 33 minutes of Deep Sleep, 52 minutes of REM.


There may be differences in the algorithms used. That said the differences shouldn't be that pronounced.

Reply

Nov 17, 2022 11:48 AM in response to CapeTownMacaroni

Hey CapeTownMacaroni,


I am no sleep expert, but have experienced similar "scoring" issues comparing Withings Sleep Mat, Apple Watch and other random wearables since I became interested in health tracking.


I have no association, but if you are interested in digging deep on this I would take a look at The Quantified Scientist. Tons of science based information, comparisons and reviews.


Hope this helps.


All the best.

Reply

Nov 18, 2022 1:09 PM in response to CapeTownMacaroni

Interesting conversation Cape Town,


I cannot argue the merits of the Apple Watch Algorithm. If for no other reason than I do not have the knowledge or a large enough personal sample size to produce any data with significance.


TQS does a great job with what he does, but as you mention, his test is on himself which is a baseline of one and does not consider the cofactors associated with other individuals or groups.


Personally, I consider the Apple Watch in the top ten of consumer devices that can be purchased easily, over the counter, at an affordable price to monitor sleep or other health metrics. That being said, I do not consider it a medical device (as close as it may get at times).


Your sample size of 15 with your questionnaire affirms some of my assumptions that that Aura ring is probably better suited at sleep tracking. I would also make the assumption that the sample is a little bias as those usually associated with a biohacking group are more healthy, fit or aware of a health lifestyle than the general population, which may sway the results versus a larger, general population sample.


As a last ditch effort to assist I would do the following if you have not already:

https://www.myhealthyapple.com/apple-watch-not-tracking-sleep-or-sleep-stages-heres-what-you-can-do/


I am not sure if you have stumbled upon this conversation:

https://www.reddit.com/r/AppleWatch/comments/xrxkfw/am_i_the_only_one_whos_aw_records_very_little/


I enjoy the conversation, but I really have nothing else substantial to provide towards a solution as related to the Apple Watch (I am not sure an Genius is going to get you anywhere with this either). I would find it interesting if you were to track with a different device (Aura, FitBit, etc.) if your results would match your current conclusions or create another outlier?


If you find the time, post back any results or solutions you may find (or if you happen to find an ear at Apple to assist with this).


Good luck. All the best.

Reply

Dec 14, 2022 1:15 PM in response to Richard.Taylor

I think you are missing the point. I am not expecting exact wires to head data. Those of us that have used FB for a long time have gained a correlation confidence from what we feel from sleep and the data. The data from the Apple watch many times just doesnt match how we have experienced that sleep for whatever reason. My expectation is that the two should be somewhat in the ballpark but not dramatically different.


Maybe if we can get the algorithms of each that determine what the states are, we can understand where/why they diverge at times.

Reply

Feb 23, 2023 6:55 AM in response to bucc208

bucc208 wrote:

iOS 16 Apple Watch series 8 does not accurately measure deep sleep when compared with Garmin and Polar devices. Data is clearly incorrect and the issue needs to be fixed. This is a healthcare aspect of the watch and should not be providing misleading information.

You can let Apple know your thoughts here:


Product Feedback - Apple

Reply

Nov 30, 2022 7:53 AM in response to CapeTownMacaroni

I always wear Fitbit and Apple Watch to bed. I have the Pillow app which uses the Apple Watch 16 facts. Apple 16 as well as Pillow in the past have my deep sleep almost 2 hours higher each night. Fitbit has to be right. I am an extremely light sleeper. Above is Fitbit’s last night results.Above are Apple’s and Pillow’s night night’s results. I have been in contact with Pillow about the differences. I have used Pillow for 4 years. Most of the comments on this forum state Apple shows less deep sleep. For me, it shows much greater deep sleep. Also, Apple and Pillow stop recording when I get up in the middle of the night to use the restroom. I am able to adjust the wake up times in Pillow. Fitbit shows I had 50 minutes of deep sleep last night. Apple and Pillow show I had 2 hours and 34 minutes of deep sleep last night.

Reply

Jan 25, 2023 7:46 AM in response to CapeTownMacaroni

Hello,


I was searching for this exact situation, glad I stumble on this thread. I have the same conclusion.


For example last night, in Apple sleep tracker it indicates 46 min of deep sleep.


I also use the Autosleep app and the deep sleep indicates 2h 34min.


I had a Garmin watch for a year, and the sleep analysis was more inline with the Autosleep app.


Like it was mentioned, I guess the Apple algorithm for sleep analysis is different?


Reply

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Sleep tracking accuracy ios16

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.