TrendWatcher
When Good Storytelling Goes Bad
By Lorrie Lykins from i4cp | April 11, 2012, Issue 547
Most of us love a good story -
especially those inspiring tales delivered from the dais of a
conference our employer spent a serious chunk of money sending us to.
Those stories light a fire under us and we return to our jobs energized
and rededicated to giving our jobs our all. I say "most of
us" because researchers tend to be a little outside that norm.I like to think that most
researchers never stop questioning and that they (we) approach
information with fairly equal parts of curiosity, tenacity,
open-mindedness and skepticism. I'm always curious about the
origins of information, and in the case of a survey, I want to know who
was surveyed, when they were surveyed and how the questions were asked.
I can't sit through a presentation of any sort that relies on
research - from a PTA budget report at my kid's school to a
presentation of newly crunched data by one of my colleagues -
without pondering those very questions. And during presentations I find
myself squinting to read the footnoted sources inserted in impossibly
tiny font in the corner of PowerPoint slides. This is because at some
point in the presentation, my internal narrator interjects something
along the lines of: "Oh yeah? Says who?"
The interjections of inner
narrators are often the source of some of
the more challenging questions we receive from i4cp member
organizations - ones that require us as researchers to really dig
deep
to find the answers. Sometimes those questions or topics run in cycles.
Case in point: i4cp's research team is occasionally asked by
various
members to track down the same bit of research within a relatively
short span of time. This phenomenon causes my inner narrator to wonder
about the chatter that may be going on in certain functions that cross
organization lines, time zones and continents. It's as if
something is
in the air; there's been a sudden shift in the conversation, one
that
seemingly prompts nearly every practitioner in a field to talk about
the same thing and spurs the same requests for information around that
topic from all sides.
One such cluster of requests
involves a celebrated Yale study that
validates the effects of goal-setting. The usual description provided
to us is a variation of: "We heard about a study that was
conducted in
the 1950s that found a correlation between setting goals and future
financial success. Can you send it to us?" The details are that
soon-to-be-graduating Yale seniors were asked to ponder their future
goals, with one group committing the goals to paper while the other
group did not. A follow-up survey conducted a decade later found that
the group members who had committed their goals to paper were much more
financially successful than their classmates who had not written down
their goals.
We've also been asked to
locate a Harvard study that purportedly
validates the effects of goal-setting. This study was conducted in the
1970s and the particulars run parallel to the Yale study: graduating
seniors were asked to contemplate their future goals, some committed
the goals to paper, others did not. A follow-up survey found that those
with written goals far exceeded the financial success in the long-term
of their classmates who had not written down their goals.
What we discovered was that neither
the Yale nor the Harvard study
actually exists. There is no evidence that the studies took place and
no papers were ever published. Yet the "goal-setting
to-money" study is
a particularly imperishable business myth that has circulated for
several decades. It persists despite sound debunking efforts on the
part of entities such as Fast Company, which conducted an
in-depth
investigation of the myth in 1996. The origin of the fable has been
traced to the late Mark McCormack, who authored several books,
including the bestselling What They
Don't Teach You at Harvard Business
School in 1979. McCormack went on to become a lawyer, sports
agent and
manager who published widely on the topic of golf.
McCormack's book referenced a
Harvard study in which he claimed that
the 3% of Harvard graduates who had clear, written goals earned ten
times as much as their classmates, 97% of whom didn't have clear,
written goals. Motivational speakers and business pundits seized on the
anecdote, and the legend took off in earnest. Clearly, plenty of folks
have been bamboozled by the story of the Yale/Harvard study, including
corporate leaders, authors and sought-after speakers such as Zig Ziglar
and Tony Robbins, who both referenced the fictional study -
Ziglar in a
best-selling video and Robbins in one of his books.
What's ironic is that Harvard
Business School published a paper in
2009, Goals Gone Wild: The Systematic Side
Effects of Over-Prescribing
Goal Setting, asserting that corporate goal-setting may
actually erode
performance because it can encourage dishonest behavior on the part of
employees.
Of course, the point here is not
that we're all just hopelessly
gullible; I think it's human nature and perfectly reasonable in
most
professional milieus to accept what we're told as factual -
especially
when the information comes from a person of great respect or authority.
I mean, who stands up during a keynote address at the annual
shareholder's conferences or at their kid's commencement
and asks that
the speaker (usually an illustrious individual of note for one reason
or another) provide attribution for the deeply profound anecdote they
just referenced?
We embrace inspiring stories of
success and we repeat them to move
and motivate others. This particular mythical survey continues to be
referenced because the aforementioned bamboozled are credible people
who, for whatever reasons, didn't do their homework and have
unwittingly contributed to the propagation of what, on the surface, is
a great tale of persistence and achievement but is in fact not true.
The lesson here is simply that
research is everyone's job. Just
because you read it or hear it doesn't necessarily mean
it's totally
accurate, and if you intend to make something part of your own story
-
personally or professionally - it's a good idea to check it
out.
By the way, i4cp research found
that, to its credit, Yale
has posted
a comment on its website regarding the "goals study of the Class of
1953": In recent years, we
have received a number of requests for
information on a reported study based on a survey administered to the
Class of 1953 in their senior year and a follow-up study conducted ten
years later. This study has been described as how one's goals at
graduation related to success and annual incomes achieved during the
period. The secretary of the Class of 1953, who had served in that
capacity for many years, did not know of the study, nor did any of the
fellow class members he questioned. In addition, a number of Yale
administrators were consulted and the records of various offices were
examined in an effort to document the reported study. There was no
relevant record, nor did anyone recall the purported study of the Class
of 1953, or any other class.
Lorrie Lykins is i4cp's
managing editor and director of research services and she occasionally
writes down her goals.




This ia an excellent reminder and great article. As an author/speaker I am tempted to look/add/believe stories that help get across my point. I have a responsibility to my audience to keep them informed as you have with us.
The reminder to be vigilant with data is two ways isn't it? As the hearer I need to be discerning and as the speaker I need to be responsible.
As a side-note I've heard the goal setting studies quoted in more talks than I can count. I believed every word since it "rang true."
I was feeling guilty that I haven't set my goals for this year yet. Poof no more guilt. Thanks Lorrie!
Really enjoyed your article.