Sleep tracking accuracy ios16

I have been using Autosleep (available on the App Store) to track my sleep for several years and I've learned to trust it. Now that iOS16 has more detailed sleep tracking, I compared the Autosleep results with the Apple sleep tracking and there are big differences.


Notably, in my case (and confirmed by one other user on another forum) the Apple sleep app registers zero or very little deep sleep on most nights whereas Autosleep registers between 45 minutes and 2 hours. The average adult gets 1-2 hours of deep sleep per night so I believe that the Apple algorithm may be at fault. It is not possible to test actual deep sleep without an EEG Device but the algorithm should be a decent approximation.


I'd appreciate it if other users/biohackers could share their experiences here.

Apple Watch Series 7, watchOS 9

Posted on Sep 15, 2022 12:33 AM

Reply
Question marked as Top-ranking reply

Posted on Nov 18, 2022 10:45 AM

Thanks JJ. Part of the reason for the post was the YouTube video by "The Quantified Scientist" where he analysed the Apple Watch algorithm when WatchOS 9 came out. He rated the Apple Watch as the best wearable for sleep tracking. I accept his results because he's very scientific but then I noticed that the Apple Watch was consistently reporting less deep sleep than other algorithms which on its own does not mean the algorithm is wrong. However the Apple Watch also consistently reports lower deep sleep scores than are considered normal for healthy adults and this means more investigation is needed. I belong to a biohacking group on whatsapp and I did a survey monkey survey on it - I got 15 responses. The most popular device was Oura ring followed by Whoop, Fitbit, and Garmin. All of the other devices consistently report higher deep sleep scores than the Apple Watch. In my own case when I used the Autosleep algorithm it was reporting 30-90 minutes of deep sleep. When I switched to the native Apple algorithm it is reporting as little as zero deep sleep and never more than 40 minutes (and this was after a long-haul flight when I slept for about 10 hours straight). I'm pretty healthy, I train every day, don't smoke, don't drink and have a relatively low stress life so I don't think the Apple algorithm is working for me.


34 replies

Sep 20, 2022 9:06 AM in response to mjperry51

That's super helpful. Very similar to my experience with Autosleep vs the Apple Health app. This strongly suggests that the Apple algorithm is at fault because the average adult should get between 1 to 2 hrs of deep sleep and we can't all be outliers.


Hopefully some more people will do testing and we can compare notes.


I have also asked the various biohacking groups I'm part of if someone will lend me an EEG device so that I can test using proper brainwave measurement. That will give the most accurate answer.


[Edited by Moderator]

Nov 30, 2022 7:53 AM in response to CapeTownMacaroni

I always wear Fitbit and Apple Watch to bed. I have the Pillow app which uses the Apple Watch 16 facts. Apple 16 as well as Pillow in the past have my deep sleep almost 2 hours higher each night. Fitbit has to be right. I am an extremely light sleeper. Above is Fitbit’s last night results.Above are Apple’s and Pillow’s night night’s results. I have been in contact with Pillow about the differences. I have used Pillow for 4 years. Most of the comments on this forum state Apple shows less deep sleep. For me, it shows much greater deep sleep. Also, Apple and Pillow stop recording when I get up in the middle of the night to use the restroom. I am able to adjust the wake up times in Pillow. Fitbit shows I had 50 minutes of deep sleep last night. Apple and Pillow show I had 2 hours and 34 minutes of deep sleep last night.

Dec 22, 2022 12:58 AM in response to CapeTownMacaroni

Hi all,


is this not all down to the simple fact that AutoSleep’s Deep Sleep metric is in fact just the Deep and REM stages from Apple Sleep added together?


And doesn’t that mean that AutoSleep is misleading in its reporting of ‘Deep Sleep’ in the clinical sense of the term?


EDIT: On second look, this appears to be the case for some of my results but not all of them. What I don’t understand, though, is what AS Deep Sleep actually represents. Is it the actual deep sleep stage, or some proprietary metric that they’ve come up with that doesn’t really compare to anything else?

Jan 25, 2023 7:46 AM in response to CapeTownMacaroni

Hello,


I was searching for this exact situation, glad I stumble on this thread. I have the same conclusion.


For example last night, in Apple sleep tracker it indicates 46 min of deep sleep.


I also use the Autosleep app and the deep sleep indicates 2h 34min.


I had a Garmin watch for a year, and the sleep analysis was more inline with the Autosleep app.


Like it was mentioned, I guess the Apple algorithm for sleep analysis is different?


Nov 16, 2022 12:50 AM in response to Crisnl88

I have decided not to use mybapoke watch ultra to keep track of my deep sleep and continue to use fitbit and other sleep tracking devices to track, because indeed for bizarre reasons my apple watch shows extremely little deep sleep consistently (in terms of number of minutes only) vs my other sleep tracking devices which shows consistently over 60minutes or more.

Nov 17, 2022 5:45 AM in response to edgargtryr54

If you look at the various data points/sources I and others have provided here your experience may be the outlier. I have never seen a report from any sources (AutoSleep from the Apple Watch or the native FitBit sleep app) anywhere near five hours of Deep Sleep (or REM for that matter). My investigations across three apps and two separate hardware platforms do not support your assertions.


For you to make such an absolute blanket statement (AutoSleep is wrong) is highly presumptive.


"how poorly I sleep"


This can be an indication of other hidden health issues. I had poor Detailed Sleep reporting from my FitBit for several years; very frustrating. Subsequently learned I have some significant cardiac issues; sleep stage detection is based (among other things) on monitoring HRV which my conditions impacted. Once those issues were resolved though medication the FitBit began to return regular Detailed Sleep reports.


I'm not a doctor -- all I'm saying is your problems sleeping (and the seemingly exaggerated Deep Sleep reports you get) could be an indication of other health matters.


For what it's worth.

Jan 17, 2023 10:19 AM in response to Myamya57

Clearly there is a disconnect between the criteria defining "deep sleep" of the various entities (AutoSleep, FitBIt, Apple, et al).


The best way to eliminate the confusion for end users is for the different groups to publish the criteria they are using (based on agreed parameters). This would also include the measurements made by the various devices, the expected accuracy of the device measurements, etc.


Face it -- rubber rulers don't work. Standards are needed. . .

Jan 17, 2023 7:37 PM in response to CapeTownMacaroni

I’m observing the same thing with my Apple Watch 7. It concerned me enough that I did a search to see if others like yourself have had the same experience. I have been logging 30 min on average for deep sleep. This is well below the recommended.


Before my Apple Watch, I had a Fitbit Ionic for years. It consistently recorded that I was getting the normal level deep sleep minutes.


I’d like to think the Apple Watch algorithm is off. That said, I don’t often wake up well rested even on a solid 8 hrs. And so it has me thinking that maybe the Apple Watch is picking something up on my sleep patterns that the Ionic did not?

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Sleep tracking accuracy ios16

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.