Appleâ€™s recent Worldwide Developers Conference (WWDC) keynote was packed with new features for iPhones, Macs and iPads â€” and like it has done pretty consistently since the debut of its original Health app in 2014, those included updates focused on personal health and wellness. Often, itâ€™s impossible to assess the impact of the work Apple is doing in these areas in the moment, and health-related feature announcements arenâ€™t generally as splashy as user interface overhauls for Appleâ€™s device software, for instance. But viewed as a whole, Apple has built probably the most powerful and accessible suite of personal health tools available to an individual, and it shows no signs of slowing down.
I spoke with Apple Vice President of Technology Kevin Lynch, who actually demonstrated the Apple Watch for the first time on the world stage during Appleâ€™s September 2014 keynote event. Lynch has seen Apple Watch grow considerably during his time at the company, but heâ€™s also been integral to the evolution of its health initiatives. He explained how it became what it is today and provided some hints as to where it might go in the future.
â€œItâ€™s been amazing how much itâ€™s evolved over time,â€ Lynch said, referring to the original Health app. â€œIt actually started from Apple Watch, where we were capturing heart rate data for calorimetry activity, and [Activity] ring closure, and we needed a place to put the heart rate data. So we created the Health app as a place to store the data.â€
From there, Lynch says Apple realized that once you had this centralized location, they could develop a system that could store other data types, as well, and create an API and architecture that allowed developers to store related data there, as well, in a privacy-respecting way. In the early days, the Health app was still essentially a passive storehouse, providing users one touchpoint for various health-related information, but the company soon began thinking more about what else it could offer, and inspiration came from users.
A key turning point for Appleâ€™s approach to health came when the company saw that users were doing more with features available via the Apple Watch than the company ever intended, Lynch said.
â€œWe were showing people their heart rate, and you could look at it â€” we were using it for calorimetry,â€ he told me. â€œBut some users actually were looking at their heart rate when they werenâ€™t working out, and noticed it was high. [â€¦]They would go talk to their doctor, and the doctor would find a heart issue, and we would start getting letters about this. We still get letters today about our work in the space, which is amazing. But some of those early letters were clueing us into â€˜Wait, we could actually look for that ourselves in the backgroundâ€™.â€
Apple then developed its high heart rate alert notifications, which can tell users when Apple Watch detects an unusually high heart rate that occurs when they arenâ€™t moving around very much. High resting heart rates are good indicators of potential issues, and Apple also later added notifications for unusually low heart rates. This was all data that was already available to the user, but Apple saw that it could proactively provide it to users, providing the benefits already enjoyed by the most vigilant of all Apple Watch owners.
From there, Apple started investing more heavily in thinking about more areas where it could glean similar insights. Rather than waiting for user behavior to identify new areas to explore (though Lynch says thatâ€™s still important to the team), the company started hiring more clinicians and medical researchers to chart the path forward for Health.
One example of where that led was announced at WWDC: Walking steadiness, a new metric that provides a simple score of how stable a Watch wearerâ€™s average gait is.
â€œWalking steadiness [â€¦] actually came from fall detection,â€ Lynch said. We were working on fall detection, and thatâ€™s been really awesome, but as weâ€™re working on it, weâ€™re brainstorming about how we can actually help people not fall, rather than just detecting that they fell. Itâ€™s pretty tricky to do that in the moment â€” thereâ€™s not much you could do once thatâ€™s actually happening.â€
Lynch is referring to the fall detection feature that Apple introduced in 2018, which could use motion sensor data to detect what was likely a sudden and severe fall, and provide emergency alerts to hopefully render aid to the wearer who had fallen. Apple was able to look at fall detection data for users in its 100,000-participant strong Heart and Movement study and combine that with data gathered from the iPhone in the same study about walking metrics.
â€œ[The Heart and Movement study data] has been super helpful in some of the work here on machine learning,â€ Lynch said. â€œAnd then we did a focus study particularly around falls with walking steadiness, where we used [as] the source of truth a set of traditional measurements of walking steadiness; so questionnaires, clinical observation, people meeting with doctors and theyâ€™re observing the person walking. And then as over the period of a year or two, as people in that study happened to fall, we were able to look at all their metrics ahead of that and understand, â€˜What are the real predictors here of potential fall?â€™ Then we were able to build a model around that.â€
Apple actually accomplished something with its Walking Steadiness feature that is very rare in the health and fitness industry: It created a clinically validated, meaningful new metric around individual health. The Health app assigns a score from Very Low to Low or OK, based on motion-sensing data passively gathered through Appleâ€™s iPhone sensors (the phone is better able to detect these metrics since itâ€™s positioned on your hip, Lynch says). Perhaps best of all, according to Lynch, the data is actually something people can use to make real improvements.
â€œThe other compelling thing is that itâ€™s actionable,â€ he said. â€œSome of these things can be harder to change. But with walking steadiness, there are exercises you can do to improve your walking steadiness. And so we built those into the Health app. You can watch the videos and do the exercises and work to improve your steadiness ahead of falling.â€
Walking steadiness is perhaps the best expression yet of an area of increased focus for Apple when it comes to health: Turning the devices you carry with you into an ambient protector of sorts.
â€˜The Intelligent Guardianâ€™
Appleâ€™s Health app provides a good overview of the metrics that you might want to keep track of, and the company has steadily built out a library of vetted contextual information to make it easier to understand what youâ€™re seeing (including through new updated lab displays that translate results into plain language in iOS 15). But one of the areas where itâ€™s in a unique position to innovate is in proactive or preventative health. Lynch pointed out that the walking steadiness feature is a progression of those efforts.
â€œThe walking steadiness work is in this category that we think of as â€˜Intelligent Guardianâ€™; itâ€™s â€˜How can we help watch out for people with data that they may not otherwise be even looking at or aware of, and let them know of potential changes,â€ he said.
Lynch admits that the â€˜Intelligent Guardianâ€™ category wasnâ€™t something that was initially really part of the plan for Apple Watch and health.
â€œIn the early days, we werenâ€™t as onto this line of thinking about â€˜Intelligent Guardianâ€™, as we are now,â€ he said. â€œThose early letters were really inspiring in terms of [pointing out] we could actually let people know these things that are really meaningful.â€
Those letters still inspire the team working on health features and help motivate the team and validate their work. Lynch cites one Apple received where a person had purchased an Apple Watch for their father, and while his father was out biking he got thrown off the bike and fell into a gully. Apple Watch detected the fall, and also that he was unconscious, and the Watch was luckily set up to notify emergency contacts and 911, and did both. It provided the son with a location on a map, so his son rushed to the spot, but found paramedics on scene already loading his father (who ended up being okay) into an ambulance.
â€œNow, thereâ€™s a lot of thought that we put into â€˜What are the other things that we could maybe sense about someone and let them know about?â€™ â€ he said. â€œOur work on health very much involves this ongoing discussion of, from a clinical perspective, what is really interesting to know about somebody? Then from a science perspective, what do we think that we can sense about somebody? Itâ€™s this intersection of what might we be able to know and extract from the data that we gather, or are their new sensors that we might be able to build to get some data that could answer the questions that, clinically, we think would be really valid.â€
A community approach to individual health
Another big change coming in iOS 15 for Apple Health is sharing. Apple will allow private, secure sharing of health data from users to loved ones and caregivers, including doctors. Users can choose exactly which health data to share, and can revoke access at any time. Apple itself never sees that data, and itâ€™s encrypted locally on your device and then decrypted in local memory on the receiving device.
Health sharing is a natural extension of Appleâ€™s work with the Intelligent Guardian since it elevates personal health care into what it always has been â€” something managed by a network of connected individuals â€” but augmented by modern technology and sensing capabilities.
â€œThe other person youâ€™re watching out for can see that information, and be notified of changes, and you can see a little dashboard of the data,â€ Lynch said. â€œThatâ€™s going to be super helpful, we hope, for people, especially as youâ€™re caring for an older adult, or caring for a partner of yours â€” thatâ€™s going to basically enable people to do that kind of mutual support on their health journey.â€
Lynch points out that itâ€™s not just about surfacing data that people might not otherwise find, but itâ€™s actually about opening the door for more communication around health between families and personal networks that typically might never happen.
â€œIt enables conversations, where maybe people wouldnâ€™t maybe naturally talk about how much theyâ€™ve been walking lately or how their sleepâ€™s been going,â€ he said. â€œIf youâ€™re up for sharing that, then it can be a conversation that maybe you otherwise wouldnâ€™t have had. And then itâ€™s the same with doctor interactions; when youâ€™re interacting with a doctor, they may not have a great view of your daily health. They have these little silo views of blood pressure at the time and stuff like that, so how can we help you tell your whole story when youâ€™re talking with your doctor and make that conversation even richer than it would have been otherwise, in a very quick period of time?â€
Sharing with a doctor relies on integrating with a healthcare providerâ€™s electronic healthcare records (EHR) system, but Lynch notes that itâ€™s using all interoperable standards to make this work, and they have a range of providers with large footprints in the U.S. already lined up to participate at launch. Healthcare professionals using this feature will be able to see data users share with them in a web view in their EHR system, and while that data is only shared ephemerally, they can easily annotate and store specific readings in their permanent EHR for a patient should they require it to back up a diagnosis or course of treatment.
I asked Lynch about the state of EHR, which has had a tricky history in terms of adoption and interoperability, and he said that itâ€™s true that this is something they initially started working on years ago, at a time when making it work would have required a much more massive technical undertaking on Appleâ€™s side to make it actually work. Luckily, the industry in general has been trending toward adopting more open standards.
â€œThere really has been a change in how you can connect to the EHRs in a more standardized way,â€ he said. â€œAnd certainly, weâ€™ve been working with and across all of them to help get this mature.â€
Benefits of a long-term user relationship
One of the biggest potential benefits for both users and their doctors of Apple Health is just how much data they can gain access to over time. Apple users who have stuck with the platform and used Health have now been tracking at least heart rate data for around seven years. Thatâ€™s why another iOS 15 feature, Health Trends, has even more potential future impact.
â€œTrends is looking at the longer term changes, and starting to identify what may be statistically significant changes in those areas,â€ Lynch explained. â€œThere are about 20 areas that weâ€™re starting with to do this, and if we start seeing those notable trends, then we can highlight those to you and show you how, for instance, your resting heart rates change now, you know, versus a year ago.â€
This is once again the result of the Apple Heart and Movement study and the insights that the company continues to derive from that work. During the study, Apple focused a lot on how to fine-tune insight delivery, so as to ensure that it was providing users with information they could use, but at the same time avoiding any kind of overload or generating more confusion.
â€œWhen you work on something like trends, we donâ€™t want to overwhelm people with insights, if you will, but we also donâ€™t want to like not have, you know, if thereâ€™s something relevant to show, we donâ€™t want to suppress that. How do we tune that in? So we did a lot of that tuning with the data that we have in the Heart and Movement study, and weâ€™re excited to see how it goes with the with public launch, and weâ€™ll keep iterating on it. We think this is going to be a really powerful way for people to understand long-term changes.â€
The future is fusion
Appleâ€™s health story to date is largely one made up of realizations that the sensors the iPhone and Apple Watch carry, originally for other purposes, can provide tremendous insights into our health on a continuous basis â€” something that previously just hasnâ€™t been possible or practical. That evolved into an intentional strategy of seeking out new sensor technologies to integrate into Watch and other Apple devices to address even more daily health concerns, and Apple continues to figure out new ways to use the sensors that are there already â€” the addition of respiratory rate measurement during sleep in iOS 15 is a prime example â€” while working on what new hardware comes next to do even more.
Perhaps one place to look for even more potential in terms of future health capabilities lies in sensor fusion, however. Walking steadiness is the result of not just the iPhone or the Apple Watch acting independently, but of whatâ€™s possible when the company can use them in combination. Itâ€™s another place where Appleâ€™s tight integration of software and hardware give it an edge, and it multiplies as Appleâ€™s ecosystem of devices, and the sensors they carry, continues to grow.
I ended our interview by asking Lynch about what kind of possibilities might open up when you consider that AirPods, too, contain their own sensors and gather different data that could complement that monitored by the iPhone and Apple Watch in terms of health.
â€œWe already do sensor fusion across some devices today, and I think thereâ€™s all kinds of potential here,â€ he said.