How Reliable is Reliable in Connected Health?

Monday, January 21, 2008  | Doug McClure


About the author - Doug McClure is the Corporate Manager for Technology and Operations at the Center for Connected Health.

Connected health is still in its infancy, but one thing is clear - it has moved beyond the realm of "just research".  Programs are scaling to levels of patients served far beyond what was done during research phases.  This is leading organizations, including our own Center, to struggle with how scalable is scalable and how reliable is reliable when it comes to these services.

When we do research projects (and fully 1/3 of the activities of our Center can truly be considered research and development) we tend to throw inordinate amounts of resources at projects and be relatively forgiving of the technology and processes involved.  We need to do this in order to push the envelope of what is currently available while also setting up experiments that will allow us to measure which activities have the opportunity to have clinical and economic impact.  Let me provide a few examples.  When we rolled out Heart Failure Monitoring as a research project nearly 5 years ago, we staffed it in such as way that was economically unsupportable over time but did allow us to guarantee success of the service.  We were careful to measure our costs and our impact, but in order to effect change we needed to put more resources (eg technology support) in than would be sustainable over time.  Another example of how we look at research differently is our orb project in which we took the SIMPill medication adherence device and connected it to Ambient’s executive desktop device/toy to see if using novel feedback mechanisms would effect adherence rates.  In this case we had to reset our expectations about how reliable the technology would be.  Try as we might, we never truly got beyond 85% reliability for the message getting from the pill bottle to the orb (this is not really a fault of either technology, it was more a challenge of integrating devices that were never meant to work together and using them in ways they were not necessarily designed to work).  When it worked it was a very cool physical world mash-up, when it didn't it was frustrating to everyone – our technologists, researchers and most importantly our patients.

Which brings us back to our current efforts at scaling programs.  Our current Diabetes program is designed for much higher technology reliability than the orb project.  Our expanding Heart Failure programs have moved squarely into the realms of scaling and very careful cost control to make sure the program can sustain itself.  With Heart Failure, if the readings don’t flow, the patients are so fragile that we reach out to them and make sure we get those readings.  With Diabetes, if a glucose reading doesn't get "loaded" into the system where a clinician and patient can see and act on it, there is probably not a critical failure of care.  In either case, the greater worry is there can certainly be a critical failure of patient and clinician belief in the system.

I love my blackberry because it works.  I have steadfastly refused to come off that platform for years, losing out on cooler functionality elsewhere because the reliability of the platform is the most important feature to me (I think I am on my 5th device).  As we scale our programs, technologies and services, one of the constant questions for our team is how we can create similar levels of patient and provider belief in our offerings.

While 95%+ reliability of the system is achievable for us with our current tools, is it enough when it comes to health?  Given the number of moving parts and integration points we need to create (see our work in and support of the Continua Health Alliance), if we cannot get easily and cost-effectively beyond the 95% mark, what else can we do?  We have begun to design service processes that provide a safety net for folks to fall into and be serviced by when they have questions and challenges.  We are asking ourselves what the top-tier service organizations outside of Health do to help us all feel welcome and supported in using their services.  But how expensive will that end up being?

Will the combination of better systems and support be reliable enough for people to believe in the system? My blackberry from the year 2000 was a far sight less reliable than my device and service now.  Will people be ready to grow with us as the scale and reliability grow?  How many "bumps" can we have? How reliable is reliable in Connected Health?

 

Member Comments


Yes! For the first time this topic didn't include the words "secure" or "security"! Why do I say this? Because it is now a given that connectivity cannot take place until it is at least HIPAA secured, and probably more so. Now, the question is about reliability. That's interesting because generally reliability is an issue brought up much later in the technology cycle...when adoption has been demonstrated and when methods are being evaluated and scrutinized. But that's simply not the case in the healthcare market. We're still dealing with clipboards in physician offices, photo copies of insurance cards, fedex of records/charts, and less than 1% consumer/patient adoption of personal health records application...even when a payer GIVES them the PHR free! So, at some point reliability of devices will be an issue. Today, my PC works just fine and is pretty reliable. Only problem is my cable modem drops out too often which drops both the PC and the phone (VOIP). Soon, my mobile phone will be asked to do more than make calls, retrieve emails and access favorite internet sites. PHR applications, perhaps as part of a broader life-management application running on a mobile device (RIM, Windows Mobile, Java, etc.) will one day be the norm, and at that point we should discuss reliability of devices. For now, we should focus on reliability of the data and the willingness of the various healthcare constituents (payers, patients, providers) to become engaged in using the currently available information in a way to improve wellness and healthcare outcomes. In my opinion, we haven't even broken the surface of that larger issue.

Jim O'Reilly

Indepenent Healthcare Executive
Upwind Capital Partners

 

Posted by: Jim O'Reilly
1/23/2008

 

Reliability is an odd concept in our society. It is often given a number (50%, 95%, 100%, even 110%!), so it takes on the pseudo-attribute of being measurable. But, one can only measure reliability in the past. In order to measure reliability in the future, one requires a crystal ball. Furthermore, the demands for reliability are skewed depending upon who is demanding it. In our culture of lawsuits and self-centeredness, we all to often hear people demanding 100% in nearly everything. The more accurate (and therefore less reasonable) statement would be, "I demand 100% reliability in everything. Except me, of course." As Doug alluded, the cost in resources increases with the increase of reliability. The cost is not linear, but it is asymptotic. In simplified terms, it takes x resources to achieve 50% reliability. But it takes another x resources to achieve the next 50%. So, it takes 2x resources to achieve 75% reliability. Following this progression, even if one were to apply an infinite level of resource, one would still never achieve 100% reliability. That hardly matters, though. The resource drain has long since surpassed availability. I have often seen that in the health care industry, we seem to think that our lofty goals of reducing suffering, illness and death will somehow exempt us from these truths. In my life, I have observed quite the opposite. In our drive to achieve extremes in reliability, technology, and knowledge the resource drain has been so high that now many in this country (and world, for that matter) cannot afford any health care at all. I would choose 80% reliability for all over 90% reliability for the select few that can afford it.

Richard Evans

Senior Software Engineer
Utah Telehealth Network

 

Posted by: Richard Evans
1/23/2008

 

I think a lot of connected health research seems to rely on the "remote patient and central server" paradigm. With something like your orb project it might be a lot more reliable if most of the communication was local.

Let's say a pill bottle on a small (usb-connected) weight sensor talks to a simple local programme on the PC. This relates prescribed dosage over time to the weight of pills left in the bottle then it lights up the orb appropriately. It's all local and would be as reliable as the consumers own personal kit.

Maybe it could then report periodically back to the centre. This would separate the local reliability elements from the network reliability elements.

Telcos need traffic on their networks and will be happy to drive applications like this, but maybe patients don't really need to use it.

Paul McGhee

Research Communications Manager
Cambridge University Hospitals NHS Foundation Trust

 

Posted by: Paul McGhee
1/23/2008

 

How reliable is reliable in Connected Health? Well that depends on what your trying to accomplish.
Given my entry level exposure to the Connected Health world, I have yet to see an area where technology can't raise the bar. As Doug suggests, there are many areas of need with different tolerances for reliability. As I see it, the user interface has an impact on acceptance and therefore plays an important part in reliability. If you really like something, you strive to make it more reliable. Frankly, I don't like or use a blackberry so it is not reliable for me. Sorry Doug; the screen is to small and I find the keyboard difficult to use! I like the idea of interfacing (via USB) to home PCs as a stepping stone whereas many people have PCs as a standard part of the household. Also, I have high expectations for wireless RFID devices in the home for Connected Healthcare.

You would have to define what 100% reliability means. If my home PC or wellness control center (I made that up) is transporting information about my well being and loses the connection, after a retry or two, it should sound alarms to inform me. If it loses power, an intelligent UPS (battery) should sound an alarm or call someone.
As far as connectivity from the home is concerned, we should not ignore computers such as your TV. After all, TVs are extremely powerful computers in the home with network connections. When I think of connected health, I envision people in need and then try to devise technology solutions to help them. The reliability aspect will depend of the criticality of the service being provided. Also, the technology architecture plays an important role here as well.

Paul Dattoli

Technologist
Partners

 

Posted by: Paul Dattoli
1/23/2008

 

Very interesting commentary as always, Doug. The work you all are doing with the Diabetes Monitoring program is incredible. We remain committed to telling your story in Washington!

Geoffrey Basye

Moderator
NextGenWeb.org

 

Posted by: Geoffrey Basye
1/24/2008

 

The consumer products industries have become proficient at making high volume products very reliably, even using new technology. Those companies who didn't learn how to do this have long since gone out of business - in high volume manufacturing you cannot afford to make unreliable products.

Making 50 of something is quite a different matter. If 85% reliability was achieved then it was a good result.

The pharmaceutical packaging suppliers who believe in smart compliancy packaging are investing tens of millions to make their concepts manufacturable in high volume - before a single product has been shipped. It is not only a question of money, it starts with design for volume manufacture and is followed by a commitment to process and quality.

If the real issue with the Orb project was to test whether reminders actually help people be more compliant and thus lead to improved outcomes then it might have been smarter to do it with proven products. In Holland, for example, a lot of trials are being run with sms reminders. The patients are given mobile phones - which is a lot cheaper than building a small batch of prototypes - and the infrastructure for handling sms is widely available. Doubtless when the trial owners are convinced that reminders help patients, then they will think about scaleable solutions which may well look quite different and have a lot more functionality.

Chris Johnson

VP Business Development
Cypak

 

Posted by: Chris Johnson
1/24/2008

 

I judge your handling of reliability in your own programs, Doug, to be very appropriate. Certainly ultimate reliability of products/systems always comes from a learning-curve affect: for instance, the more pill packages a pharma company makes, the greater its chance to "learn" and so improve reliability. However, in the early stage of a system's life, it is more important to prove the benefit that will sustain the system's use than fretting about it's ultimate reliability. In the early stage of a connected-health system's life, we can simply match the reliability of the human system it replaces - even if that means adding costly humans to make-up any shortfall.

When we get to that elusive point that the value of a new connected health system is proven, then we can indeed learn from the ultra-reliability of the Blackberry system. I believe two features therein are worth transferring to our connected-health system at that point: (1) bringing the END-TO-END system under the tight control & scrutiny of a single organization (did you know that every single email passing to or from a Blackberry worldwide goes through a control center owned and staffed by Blackberry's maker?): this gives that organization the chance to understand failures and correct them, and (2) using the intelligence of the remote device to detect, log AND report errors, even through system crashes: this the failure data from a tiny part of the rolled-out system (failure of one device in a million, say) to be captured, effectively running a closed loop continuous trial using every single actually-placed device (not just during specifically-run forensic reliability trials); paying for the design and implementation of such a reliability overlay, of course, only makes sense once the basic system benefit is proven and its ability to generate revenues to cover the reliability costs is beyond doubt.

Great that you are thinking about scaleability by fretting over reliability. I hope it means that some of your programs are moving past the elusive financial benefit proof-point that can so effectively hides from us in connected-health.

Malcolm Burwell

Founder
Vivigor Health (in early-stage stealth mode)

 

Posted by: Malcolm Burwell
1/25/2008

 

In reaction to Paul's comment.

I fully agree with your premise. All of us who have taken a course of medication are familiar with the "did I take it, didn't I" moment.

As far as I am aware, the majority of medication adherence issues are to do with memory. In this respect, any local system which can record usage and give reminders is going to be better than the current situation in which nothing is recorded and no there are no reminders. Why the healthcare industry is in a continuous loop of wanting to prove the obvious here is beyond me.

Communicating data to a central point has more to do with the possibilities for intervention by a professional or call-center. In marketing terms this is the "worried well" segment as the moment, but I expect this will expand in future

Chris Johnson

VP Business Development
Cypak

 

Posted by: Chris Johnson
1/29/2008

 

Recognizing the need for agility in an environment of adaptive healthcare solutions.
It is essentially tries to conform human networks, with the support
of the ICT that motivate and harness, in dynamic and systematic
form, the interaction between the people, who fortify the
generation, dissemination and exchange of information and
knowledge based on the professional objectives, institutional and
social in each context of an individual

LADY MURRUGARRA

HEAD COMPUTER CENTER
INSTITUTO DE MEDICINA TROPICAL ALEXANDER VON HUMBOLDT - UPCH

 

Posted by: LADY MURRUGARRA
2/9/2008

 

Your Comments


This feature is available for Connected Health members only. Please login now or register to continue.

Login

Discussion

Solving the Puzzle of Poor Adherence – Can Connected Health Tools Provide the Missing Pieces?
Thursday, July 24, 2008 | Shanta Griffin, PhD and Alice Watson, MD, MPH
Can Connected Health survive the political economy of health care?
Tuesday, June 24, 2008 | Matthew Holt  | 2 Comments
Connected Health and the Medical Home: Savior or Distraction?
Tuesday, May 27, 2008 | Joseph Kvedar, MD  | 6 Comments
Connected Health in the Developing World
Monday, March 24, 2008 | Paul Heinzelmann  | 15 Comments
Can Second Life serve as a virtual training ground for individuals with poor social skills?
Monday, February 25, 2008 | Dr. Jerome Schultz  | 7 Comments
How Reliable is Reliable in Connected Health?
Monday, January 21, 2008 | Doug McClure  | 9 Comments
Self-Insured Companies: Low-Hanging Fruit for Consumer-Driven Telehealth?
Monday, November 26, 2007 | Malcolm Burwell  | 3 Comments
What Will Microsoft's HealthVault Mean to the Telehealth Community?
Thursday, October 18, 2007 | Vince Kuraitis and Tim Gee  | 5 Comments
Causing What Isn’t
Monday, August 20, 2007 | Joseph Kvedar  | 2 Comments
Revolutionizing Healthcare
Tuesday, June 19, 2007 | Jeff Gruen  | 6 Comments
Personal Health Management
Monday, May 21, 2007 | Joseph Ternullo  | 3 Comments
Medical Education of the Future?
Friday, April 27, 2007 | Ramesh Ramloll  | 2 Comments
Using Telemedicine to Create Intimacy
Monday, April 9, 2007 | Jon Darsee  | 12 Comments
Can we use Web 2.0 in Health Care?
Friday, December 8, 2006 | Sally Lakeman  | 10 Comments
The Changing Care Provider
Wednesday, October 11, 2006 | Ateret Haselkorn  | 4 Comments
A Metric for Connected Health Success?
Friday, October 6, 2006 | Joseph Kvedar  | 9 Comments
Impediments to Technology Adoption
Monday, September 25, 2006 | Neil Wasserman  | 3 Comments
Behavioral Telehealth
Wednesday, July 26, 2006 | Steven Locke  | 5 Comments
Will MediPare Come to Pass?
Wednesday, June 14, 2006 | Ashok Boghani  | 14 Comments
A Home Care Perspective
Friday, May 5, 2006 | Kathy Duckett  | 4 Comments
The True Burden of Connected Health?
Wednesday, March 22, 2006 | Ravi Nemana  | 7 Comments
The Future of the Hospital
Friday, March 17, 2006 | Joseph Coughlin  | 6 Comments
The Role of Consumer Grade Techologies
Sunday, January 8, 2006 | Joseph Kvedar  | 7 Comments
 
 

Newsletter Signup

Go