« Previous Post | Main | Next Post »

June 09, 2008

Stories and Statistics— Why We Need Both

Lately, I’ve been thinking about the difference between stories and stats- those hard and fast numbers that give us “objective” information about everything from  the body politic to the human body.

Social scientists like data, perhaps because it makes social science seem more “scientific.”  They like to square things off and measure them. They like to count:  How many? How much? What do the polls say?  Percentages are impressive.

Try to tell a story, and a purist will remind you that “the plural of data is not anecdote.”

But what some social scientists—and some physicians—forget is that statistics measure only what can be counted. Many of the things that are most important, in medicine as in life, are immeasurable.   Stories are valuable because they can capture some of the messiness of reality, including the ambiguities and contradictions that make both human experience and the human mind/body just beyond comprehension. (Since we have only the mind with which understand the mind, ultimately investigation must end in a stand-off.)

I began thinking about the difference between stories and statistics this week end, while reading Dr. Chris Johnson’s blog. A pediatrician and former head of pediatric critical care at the Mayo Clinic, Johnson confides that he sees medicine as “complicated mish-mash of science, near-science, intuition, guesswork, and blind luck.”

And that, he explains, is why he has been thinking about “the enduring power of the anecdote in how we humans understand things. . .

“These days physicians are exhorted to use only the hardest of hard evidence to make decision,” Johnson observes, and he has no objection to this—when there is sufficient data to lead to a clear diagnosis. But often there isn’t.  And this is why physicians “also use anecdotes — stories we have heard or things we have seen,” Johnson writes. Those stories feed a doctor’s intuition. “We should always use the best science we can,” he concludes, “but somewhere in the mix there is a place for the anecdote, the story.”

Johnson then goes on to provide a link to what Rafael Campo, the award-winning physician and poet, had to say on the subject in a 2006 essay titled “Anecdotal Evidence: Why Narratives Matter to Medical Practice.”

Campo begins simply: “I want to tell you a story.

“After a lecture I gave recently at a well-known medical school on the possible utility of narrative to clinical practice, from the back of the auditorium came the first question of the traditional question and answer portion of the program: ‘Don't you feel, Dr. Campo, that what you seem to regard as the arrogant biomedical science model of medicine is already sufficiently under attack these days?’

“As the lights came up, I could make out a tall, bearded man in a long white coat, standing as if at attention near the end of one of the aisles. ‘We have creationists trying to teach “intelligent design” in our children's science classes, [he declared], and even closer to home, nurses and optometrists being given the right to prescribe medications.’ Their applause having ceased, my audience now grew hushed as he went on, his voice steadily rising.

“‘Do you really expect physicians to accept the notion that what any ignorant patient tells us about his disease should carry a weight equal to what our years of training and expertise reveals to us about complex pathophysiology?’ Then came what was clearly meant to be his coup de grace, delivered in an almost derisive tone. ‘Really, sir, do you have anything more than the anecdotal evidence you shared to support your thesis?’

“Of course, like any physician trained in the past several decades, I too had learned to view the anecdote with the greatest amount of skepticism, if not outright disdain,” Camp acknowledges. “The anecdote, though beguiling in its familiar engagement of our human sensibilities, is, we are all taught, the enemy of objective, dispassionate observation.

“The anecdote is rife with such difficulties as openness to interpretation, and the biases of faulty memory and foolish optimism; it is just as likely to be explained by fickle chance as by anything truly under the clinician's control. It is colored by the inflections in our voices and shaped by our gestures and facial expressions. The case report counts not for academic promotion, while the randomized controlled trial of thousands of anonymous subjects has become the lingua franca of our profession, and for good reason, as rigorous epidemiologic studies have replaced mere conjecture with sound, evidence-based understanding of the causes of countless diseases and effective treatments for them. Yet to offer an anecdote these days is almost to admit the insufficiency of one's knowledge, and so we do so, at least to our fellow physicians, very apologetically.”

Nevertheless, Campo insists: “Whether we choose to admit it or not, the anecdote continues to be an important engine of novel ideas in medicine...

“The inscrutably enduring power of the anecdote itself is what incites all our most fearsome defenses,” Campo continues. “So furious are we in our rejection of the merely anecdotal one cannot help but begin to wonder at it.”

Why are so we defensive? Because stories are potent. Rick Diamond and Mishra Moezzif, scientists at the Berkeley National Laboratory, elaborate on Campo’s point:

“Whether we formally recognize it or not anecdotes can have powerful effects in challenging assumptions, although they may  be ignored when they confront popular preconceptions of what is true,” Diamond and Moezzif observe, citing Thomas Kuhn’s classic The Structure of Scientific Revolutions. Yet “anecdotes are told because they illustrate or crystallize important concepts. Accordingly, anecdotes can provide extremely valuable information, if their significance is actually understood.”

In the same vein, Campo writes: “Whether we choose to admit it or not, the anecdote continues to be an important engine of novel ideas in medicine. No matter how wide the perceived rift between science and the humanities, and no matter what new technologies may deliver unto us in terms of more precise tests and life-prolonging therapies, the work of doctors will always necessarily take place at the intersection of science and language. [my emphasis] How many of us have first felt inspired to dig deeper into a question that first took shape in the form of ‘a couple of interesting cases’—the beginnings of a case series, in epidemiological parlance—shared by a colleague over a cup of bad doctors' lounge coffee?”

The Patient’s History

In many instances the most important story in medicine—and the one that is most difficult to grasp—is the patient’s history. Yet rather than listening carefully, today’s rushed clinicians often rely on a battery of tests to tell them what they need to know about the patient. Meanwhile, the clue to the diagnosis remains hidden in a half-heard anecdote.

“Our patients' stories too, if only we could listen to them less critically and cynically, might similarly inspire us to the more practically important discoveries of what truly ails them,” Campo acknowledges. “Yes, we must always be wary of the ways in which the interlocutor may lead us astray; the possibility of violation of the narrative contract, that implicit agreement between us that the story being told is truthful and offered in the service of best care, is a real one. A patient in distress may speak to us across a chasm so vast that what we can hear is terribly distorted—by our professional distance, by our own most unprofessional fears and misapprehensions, and by society's attitudes which inescapably contextualize our every action.

“One common clinical scenario has become so familiar as to be regarded as paradigmatic of our distaste for the subjective. The patient, we frequently suspect, is exaggerating her pain to obtain more narcotics, so we check to see if she is tachycardic, or whether she perspires or writhes in her sheets, ever on the lookout for more reliable objective signs of what her suspiciously anecdotal description fails to convey. Yet even in the face of language's shortcomings and betrayals, understanding narrative ultimately helps us. If we can recognize a breakdown in our communication with a suffering patient, we can begin the crucial process of repair—usually by explicitly re-establishing the ground rules of empathetic mutual trust upon which any exchange of language must be based.

“Perhaps,” he adds, “it is our own mistrust of the anecdotal that has engendered the backlash against science to which my interrogator at that recent lecture alluded. We seem to be of two minds when it comes to science as it relates to our ever defiantly human bodies. While we look to medicine to offer us the fruits of its inquiry into our innermost life-giving processes, at the same time we refuse to be entirely explicated. We want answers, but not all the answers. We want Tamiflu [a bird flu drug] as well as talismans to protect us from avian influenza.”

Uncertainties, Doubts, and Mysteries

There remain many medical miracles that we cannot fully explicate. For example, how do we explain the “placebo effect?” Are depressed patients who take medication really helped, or are the drugs, as some have recently suggested, simply placebos? How could we possibly know?  Our only evidence consists of the stories that the patient tells himself about himself and how he feels—the stories that, taken together, create his reality.

Campo considers the problem: “A daughter of a patient of mine wrote a poem about a flamingo,” Campo tells us,  “so the birds won't get mad and make us sick.’ At the bottom of the page blazed a hot pink stick figure of a bird, as if she had drawn fever itself. Might her fervent belief in the power of her own words somehow stimulate her immune system to fend off an unlucky exposure to a bird-borne virus?”

“In all the millions of epidemiologic studies we have published in thousands of medical journals,” Campo observes, “we have yet to prove the mechanism behind a phenomenon evident in nearly all of them: the placebo effect. Perhaps there remain ideas about ourselves and our bodies that can never be summarily studied?

“ ‘I want to tell you a story,’ another patient of mine said to me a few weeks later, back home in Boston, in the quieter theater of daily life. She was dying of multiple myeloma that afternoon. No more melphalan and prednisone, which had caused diabetes, nor more thalidomide, which had given her neuropathy; instead, she received only morphine now, because all that was left to treat was her pain. Rain fell relentlessly outside, streaking the windows in a way that made me think inanimate objects might somehow feel sadness.

“One of her daughters clutched my hand. I looked into her mother's watery, deep brown eyes, which at that moment seemed a well of stories so absorbing and so numerous that they might unspool forever. ‘I want to tell you a story,’ she said again. Perhaps she was going to God, a notion that consoled us all; perhaps nothing was left of her but the fading impulse generated by the brain's physiology, whose final expression would be these last words. But before she could go on, her breathing stopped—leaving it all at once plainly obvious, and yet utterly incomprehensible.” [my emphasis]

Indeed, a test might provide the data needed to confirm the obvious fact that she had died, but even the most precise tests couldn’t “comprehend,” in the sense of fully grasping the mystery of her death. Only Campo’s story could begin to do that.

TrackBack

TrackBack URL for this entry:
http://www.typepad.com/t/trackback/856730/29979812

Listed below are links to weblogs that reference Stories and Statistics— Why We Need Both :

Comments

(Since we have only the mind with which understand the mind, ultimately investigation must end in a stand-off.)

We use our mind to understand everything else, seems to work out fine, for the most part at least.

Chris-- a wise aphorism.

Gregory-- LOL

While reading this post, I am reminded again of the theoretical Parachute clinical trial.

The parachute is used in recreational, voluntary sector, and military settings to reduce the risk of orthopaedic, head, and soft tissue injury after gravitational challenge, typically in the context of jumping from an aircraft.

The perception that parachutes are a successful intervention is based largely on anecdotal evidence. Observational data have shown that their use is associated with morbidity and mortality, due to both failure of the interventional and iatrogenic complications.

In addition, natural history studies of free fall indicate that failure to take or deploy a parachute does not inevitably result in an adverse outcome. We therefore undertook a systematic review of randomised controlled trials of parachutes.

The conclusion was, as with many interventions intended to prevent ill health, although the effectiveness of parachutes has not been subjected to rigorous evaluation by using randomized controlled trials, everyone might benefit by its use.

I should have included one of Osler's more familiar aphorisms: "Listen to the patient -- he is telling you the diagnosis."

Great Maggie- Narrative in medicine is making a long overdue comeback.Dr.Rita Charon is also a leader in this area.

If it were up to me every patient would write his or her mini-autobiography to be placed in the formal medical record.

Science looks for common phenomena which obviously helps us. But narrative is always individual which cannot be denied and eludes exact quantification.

By the way I have personally said that while the deconstruction of the human genome is the map to human biology so to the patient's story is the map to the patient's heart and the patient's soul not to trivialized in total patient care.

I have spoken at the World Future Society (WFS)twice on what I call a Bio-Psycho-Social-Spiritual (BPSS) model of health care.(longhand for "holistic")

Thanks again,

Dr. Rick Lippin
Southampton,Pa

Frank--

With all due respect, there are no new ideas under the sun--just revisionings of old ones
You'll find virtually everything in Shakespeare, Plato, Aristotle, a handful of others. . .

But your comment illustrates what I'm trying to get at in this post.

"Mixed Methods" as described by social scientists over the past decade is quite different from the intersection of language and medicine as
described by Campo.

The difference is in the telling--in the "story." I could read a book about "mixed methods" and come away with information about different ways of collecting data--but probably not the knowledge and wisdom Campo imparts with his stories.

Thomas Kuhn's "Structure of Scientific Revolutions" was talking about what is now called "mixed methods" in 1970 . . .To his credit, Kuhn avoids such terrible jargon. That's the one problem with social science--not enough great writers.

Though Paul Starr's Social Transformation of American Medicine (1982, won a Pulitizer) inspired me to write about health care--and he's a sociologist.

News-flash -- the "mixed-methods" approach has been described. Been around for nearly a decade -- maybe longer.

Post a comment

If you have a TypeKey or TypePad account, please Sign In