TrendWatcher

When Good Storytelling Goes Bad

Printer
| More
Most of us love a good story - especially those inspiring tales delivered from the dais of a conference our employer spent a serious chunk of money sending us to. Those stories light a fire under us and we return to our jobs energized and rededicated to giving our jobs our all. I say "most of us" because researchers tend to be a little outside that norm.

I like to think that most researchers never stop questioning and that they (we) approach information with fairly equal parts of curiosity, tenacity, open-mindedness and skepticism. I'm always curious about the origins of information, and in the case of a survey, I want to know who was surveyed, when they were surveyed and how the questions were asked. I can't sit through a presentation of any sort that relies on research - from a PTA budget report at my kid's school to a presentation of newly crunched data by one of my colleagues - without pondering those very questions. And during presentations I find myself squinting to read the footnoted sources inserted in impossibly tiny font in the corner of PowerPoint slides. This is because at some point in the presentation, my internal narrator interjects something along the lines of: "Oh yeah? Says who?"

The interjections of inner narrators are often the source of some of the more challenging questions we receive from i4cp member organizations - ones that require us as researchers to really dig deep to find the answers. Sometimes those questions or topics run in cycles. Case in point: i4cp's research team is occasionally asked by various members to track down the same bit of research within a relatively short span of time. This phenomenon causes my inner narrator to wonder about the chatter that may be going on in certain functions that cross organization lines, time zones and continents. It's as if something is in the air; there's been a sudden shift in the conversation, one that seemingly prompts nearly every practitioner in a field to talk about the same thing and spurs the same requests for information around that topic from all sides.

One such cluster of requests involves a celebrated Yale study that validates the effects of goal-setting. The usual description provided to us is a variation of: "We heard about a study that was conducted in the 1950s that found a correlation between setting goals and future financial success. Can you send it to us?" The details are that soon-to-be-graduating Yale seniors were asked to ponder their future goals, with one group committing the goals to paper while the other group did not. A follow-up survey conducted a decade later found that the group members who had committed their goals to paper were much more financially successful than their classmates who had not written down their goals.

We've also been asked to locate a Harvard study that purportedly validates the effects of goal-setting. This study was conducted in the 1970s and the particulars run parallel to the Yale study: graduating seniors were asked to contemplate their future goals, some committed the goals to paper, others did not. A follow-up survey found that those with written goals far exceeded the financial success in the long-term of their classmates who had not written down their goals.

What we discovered was that neither the Yale nor the Harvard study actually exists. There is no evidence that the studies took place and no papers were ever published. Yet the "goal-setting to-money" study is a particularly imperishable business myth that has circulated for several decades. It persists despite sound debunking efforts on the part of entities such as Fast Company, which conducted an in-depth investigation of the myth in 1996. The origin of the fable has been traced to the late Mark McCormack, who authored several books, including the bestselling What They Don't Teach You at Harvard Business School in 1979. McCormack went on to become a lawyer, sports agent and manager who published widely on the topic of golf.

McCormack's book referenced a Harvard study in which he claimed that the 3% of Harvard graduates who had clear, written goals earned ten times as much as their classmates, 97% of whom didn't have clear, written goals. Motivational speakers and business pundits seized on the anecdote, and the legend took off in earnest. Clearly, plenty of folks have been bamboozled by the story of the Yale/Harvard study, including corporate leaders, authors and sought-after speakers such as Zig Ziglar and Tony Robbins, who both referenced the fictional study - Ziglar in a best-selling video and Robbins in one of his books.

What's ironic is that Harvard Business School published a paper in 2009, Goals Gone Wild: The Systematic Side Effects of Over-Prescribing Goal Setting, asserting that corporate goal-setting may actually erode performance because it can encourage dishonest behavior on the part of employees.

Of course, the point here is not that we're all just hopelessly gullible; I think it's human nature and perfectly reasonable in most professional milieus to accept what we're told as factual - especially when the information comes from a person of great respect or authority. I mean, who stands up during a keynote address at the annual shareholder's conferences or at their kid's commencement and asks that the speaker (usually an illustrious individual of note for one reason or another) provide attribution for the deeply profound anecdote they just referenced?

We embrace inspiring stories of success and we repeat them to move and motivate others. This particular mythical survey continues to be referenced because the aforementioned bamboozled are credible people who, for whatever reasons, didn't do their homework and have unwittingly contributed to the propagation of what, on the surface, is a great tale of persistence and achievement but is in fact not true.

The lesson here is simply that research is everyone's job. Just because you read it or hear it doesn't necessarily mean it's totally accurate, and if you intend to make something part of your own story - personally or professionally - it's a good idea to check it out.

By the way, i4cp research found that, to its credit, Yale has posted a comment on its website regarding the "goals study of the Class of 1953": In recent years, we have received a number of requests for information on a reported study based on a survey administered to the Class of 1953 in their senior year and a follow-up study conducted ten years later. This study has been described as how one's goals at graduation related to success and annual incomes achieved during the period. The secretary of the Class of 1953, who had served in that capacity for many years, did not know of the study, nor did any of the fellow class members he questioned. In addition, a number of Yale administrators were consulted and the records of various offices were examined in an effort to document the reported study. There was no relevant record, nor did anyone recall the purported study of the Class of 1953, or any other class.

Lorrie Lykins is i4cp's managing editor and director of research services and she occasionally writes down her goals.

Comments

Interesting!!
Are there any studies that actually corrolate goal setting to financial success or other "success" factors?
Hi, Joe, great question!
The good news is that yes, there is such a study that actually came to fruition because of the non-existent study.
Psychology professor Dr. Gail Matthews of the Dominican University of California conducted her study after reading the Fast Company debunking article.
Here's a link to read more (short answer: yes, she found connections between goal-setting and success)
University of Toronto's Dr. Gary Latham has done quite a bit of work in this area, which I used in my masters thesis on 'execution' 10 years ago! (where does the time go??) One example:
Latham, Gary P. (2001) The Reciprocal Effects of Science on Practice. Insights from the Practice and Science of Goal Setting. Canadian Psychology, 42, No. 1, 1-11.
Everything I researched pointed to goal management as differentiating re effective execution but like anything, it's only as good as all the integrated elements that make goal management work (e.g. in organizations culture / leadership matters) and it can be an over or under-used skill individually or in groups.
Thanks for sharing. Even if a good thanks thanks for sharing this. It is amazing how stories can become 'true' just by telling it around.
An interesting article and I had heard both of the Harvard study and the later clarification. BUT ... there are many, many other anecdotal stories based on fact that can convey very powerful and, at the same time, simple messages. Take the example of WD 40. Origin of the name? WD = water dispersal, but why 40? Well, that's how many attempts it took to arrive at the eventual formulation. What a great metaphor for sheer persistence!
Lorrie,

This ia an excellent reminder and great article. As an author/speaker I am tempted to look/add/believe stories that help get across my point. I have a responsibility to my audience to keep them informed as you have with us.

The reminder to be vigilant with data is two ways isn't it? As the hearer I need to be discerning and as the speaker I need to be responsible.

As a side-note I've heard the goal setting studies quoted in more talks than I can count. I believed every word since it "rang true."

I was feeling guilty that I haven't set my goals for this year yet. Poof no more guilt. Thanks Lorrie!

Really enjoyed your article.
I both love and hate stories of myths debunked. While I don't want my head filled with bunk, I'm left with this feeling of not knowing what or who to believe! I thought it was great that Professor Matthews at Dominican University took the initiative to conduct a study into the question. That's a positive step. Maybe the many famous authors and pundits who have been citing the results should start mentioning her work, or at least send her a little of their royalties!
Add a comment

 Name (required)
 Email (will not be published) (required)
Commenting on this article requires human verification. Please enter the two words in the textbox below before clicking the post button
By posting, you agree to i4cp's Terms and Conditions.