Here’s an op-ed I wrote that was published today in the L.A. Times:
Sloppy science bears substantial blame for Americans’ bad eating habits
by, Nina Teicholz
A spectacular case of sloppy science came crashing to a close last month. Cornell University’s Brian Wansink, a world-renowned scientist who seized headlines with his research on American eating habits, had many of his papers retracted and resigned from his professorship. Wansink’s fall is not just the tale of a single scientist gone astray. It is, instead, an indictment of an entire type of nutrition science that has led to mistaken dietary advice dispensed to Americans for decades.
Wansink’s misdeeds played out in Cornell classrooms and nutrition journals and, as crucially, around American dinner tables. He had a central role in all our diets. From 2007 to 2010, he served as executive director of the U.S. government’s Dietary Guidelines, which set the standard for healthy eating for the nation. Under Wansink, the guidelines shifted to be ever-more based on the same type of easily manipulated, weak observational data he produced in his lab. A new iteration of the guidelines, under a different director, was issued in 2015, yet the reliance on weak data has remained the same.
Wansink’s research depended on observational studies, which can yield only associations, such as “coffee is associated with cancer.” These are at best suggestions of hypotheses, and they nearly always fall far short of demonstrating cause and effect. To show causation — that coffee causes cancer, for example — a real experiment, or clinical trial, is needed. For nutrition policy, however, we have rarely required that caliber of research.
Worse, the associational data in nutrition studies are particularly unreliable because the studies depend upon self-reported answers on dietary questionnaires with such queries as: How many cups of pasta did you consume weekly for the last six months? Or, how much did you enjoy that last slice of pizza? Studies have long shown that people misrepresent what they eat — or they simply can’t remember.
John Ioannidis, a Stanford University professor and evidence-based medicine expert, recently wrote that, given all of the problems with this kind of nutrition research, “Reform has long been due.” The claims of this weak science, when tested properly by rigorous clinical trials, have been shown in two analyses to be correct only 0% to 20% of the time. This means that 80% to100% of the time, they’re wrong.
These kinds of odds may be relatively harmless when it comes to studying our intake and enjoyment of pizza, as Wansink did. Yet for the Dietary Guidelines, much more is at stake.
Mistakes of the past, such as the now-jettisoned caps on dietary cholesterol and total fat, show the harm of rushing to create policy based on weak science.
The guidelines are surprisingly powerful: They drive choices for school lunches, feeding programs for the elderly, hospital food and military rations, as well as influencing the advice dispensed by doctors, nurses, dieticians and nutritionists. If the guidelines are off or downright wrong, the potential impact on our epidemics of obesity, diabetes and neurological diseases is devastating.
Critics have argued that the guidelines, launched in 1980, were based on shaky science before Wansink got involved, but his guidance arguably drove them off the rails. His 2010 guidelines turned the recommendations away from a focus on food groups and toward dietary patterns. This sounds reasonable enough, yet the fundamental flaw lies in the evidence base for the patterns.
I examined each study cited by the guidelines’ advisory committee to support the recommendations, and the results, published in a science journal in 2015, were astonishing. The government’s three recommended Food Patterns — “U.S.-Style,” “Mediterranean” and “Healthy Vegetarian”— were supported by fewer than a handful of truly rigorous trials. Even the government’s expert panel noted the deficiencies.
A single Mediterranean-diet trial, on only 180 people, was cited to demonstrate that any of these patterns could produce significant weight loss. The advisory committee deemed there was “limited” or “insufficient” evidence to show that the diets could combat diabetes. And the support for claims that the diets could prevent heart disease was ambiguous at best (blood pressure was the only risk factor that improved in quite a few studies, and in others, both “bad” and “good” cholesterol dropped, implying mixed outcomes overall).
The key, large clinical trial cited to claim cardiovascular benefits for the Mediterranean diet was recently retracted and reissued, raising serious doubts about its basic reliability. Meanwhile, the government’s review of the Healthy Vegetarian diet concluded that the evidence for any disease-fighting powers of this diet was “limited”— the lowest rank given for available data.
The lack of rigorous experimentation is matched by the data’s lack of transparency. In retracting Wansink’s papers, the editors of the Journal of the American Medical Assn. said their primary reason was that the data could not be confirmed because the original dietary surveys had been thrown out. Much the same problem dogs the country’s largest observational nutrition study, funded by the National Institutes of Health and run by Harvard’s T.H. Chan School of Public Health. Its findings are among the most highly cited in the Dietary Guidelines’ evidence base, yet Harvard does not publicly disclose its data, making those findings also impossible to confirm.
Defenders of the current guidelines’ argue that the urgency of our obesity and diabetes epidemics virtually demands that we march forward with recommendations based even on imperfect data. Yet mistakes of the past, such as the now-jettisoned caps on dietary cholesterol and total fat, show the real harm of rushing to create policy based on weak science. Most people still don’t even know about these reversals in our dietary guidelines — that the weight of evidence has now shifted to sugars and refined carbohydrates as the more likely dietary culprits. However, un-learning diet rules once they have been learned proves to be extremely difficult.
Wansink’s downfall reveals the corrosive powers perpetually undermining good science in nutrition. Observational studies are supposed to be exploratory work, hardly ready for prime time. Yet the pressure to publish, the reality that media coverage drives grant making, and that these both drive the professional trajectory of researchers, push scientists like Wansink and others to oversell their results.
When imperfect data shape headlines, and the entire Dietary Guidelines, the losers are science itself and, quite clearly, the public health.
Nina Teicholz is a science journalist and the executive director of the Nutrition Coalition, which is dedicated to evidence-based nutrition policy.
For the rest, read here:
http://www.latimes.com/opinion/op-ed/la-oe-teicholz-wansink-dietary-guidelines-20181009-story.html
It’s a tiny thing, but it would be better if you could make your links clickable rather than cut-and-pasteable. Thanks.
Hopefully we did that now. Good point.
I thought my links were clickable!
I’ve been reading a lot about nutrition lately–books, YouTube lectures and interviews, academic papers, and lay articles. I’m doing it out of concern for my health. My A1C has been creeping upward in recent years and weight management becoming more difficult, even though I’m active. I’m not pre-diabetic yet, but it is concerning me more than my doctor (which bothers me too).
I’ve learned about the work of Dr. Robert Lustig, Dr. Mark Hyman, Gary Taubes, Dr. Dwight Lundell, and now yours. I’ve changed my diet by virtually eliminating sugar, cutting refined carbs, and not worrying about healthy fats like pastured meat, eggs and butter, extra virgin olive and coconut oil, avocados, nuts, and seeds. I’m feeling the best I have in my entire life in many ways, and my weight is decreasing. I get my annual check-up next month, and I’m looking forward to seeing my bloodwork results.
Anyway, what I think I’ve learned is pretty simple, and it’s similar to what Michael Pollan says, but here’s my take: Eat food the way nature intended it: with all of the fiber is comes with, grown in a healthy manner (i.e. minimal chemical interference), from animals that have eaten what they are supposed to eat, and with minimal processing. And maybe one way to sum that up is a “Pre-Industrial Diet”.
If this is the case, how much science do we really need beyond fine tuning the details of “eating food as nature intended with minimal processing”? As a scientist by education (B.S. and M.S.), I don’t feel uncomfortable tossing that question out there for discission.
Hi there, It really depends if you are healthy vs. unwell. Unhealthy people who have damaged their metabolism cannot eat as broad a range of foods as others. They must restrict carbohydrates–which may seem “unnatural.” But that is what the science shows. Also, Pollan advises against eating meat, based on environmental reasons, so that is another area of dispute. It should be simple, but it’s not quite…
That is all you need to know: Eat food from natural sources, mainly from animal sources, and not too many carbs. That’s really it. If you get stuck, with your health or weight, then you can look deeper.
Hi again… I guess I thought I was suggesting the widest possible range of foods for people to choose from for their individual situations with what I said– animals that we’ve been eating for centuries but have been allowed to eat their natural diets (i.e. not CAFO) and anything we already grow, just in environmentally sustainable and not heavily processed forms.
I realize Pollan’s view on meat (although his advice is: Eat food, not to much, mostly plants– which leaves room for some animal products). Even you discussed in your interview with Dr. Mark Hyman that meat can be raised in ways that sequester carbon, for example. Animals raised by proper grazing techniques can restore some ecosystems. Alan Savory, for example, says that one of the causes of desertification is the loss of native populations of grazing animals, so proper grazing can address this problem too: https://www.youtube.com/watch?v=vpTHi7O66pI To be clear, I am not suggesting we increase our meat consumption levels to that of the Massai.
Anyway, I was just taking a big picture view (something I’m prone to do for better or for worse) because it seems to me that things went sideways with our health when agriculture got too industrialized and our food system got inundated with over-processed, industrialized foods. Fast-paced modern life and the host of new chemicals we were never exposed to prior to the Industrial Revolution have their impact too, but I think it really all begins with food. In my case, simply getting my diet resulted in a lot of positive changes for me. I can’t believe how much better I feel. ~Peace
Hi Nina,
I would love to read your op-ed but just get a message that it is not available in Europe. Is there any other way of reading it? Thanks in advance, from someone with a damaged metabolism who is learning she cannot eat carbs but the flavours of foods she can eat are amazing!
See complete post, now available.
Thanks Nina!
I have binged on YouTube and and have listened to hours of your findings.
This is the most shocking conspiracy in American history. I have been involved in Politics and often spend too much time debunking political conspiracies so I am predisposed to any conspiracy theories. Well, here is one which is true!
You have to be careful, because it sounds too fantastic, but this conspiracy has killed millions of people and ruined the lives of millions more who have suffered from obesity and Diabetes. Yet, they go on. I hope you do not underestimate the influence of animal rights purists and vegan/vegetarians who will do and say anything to advance their political position and “moral” declaration concerning raising animals for protein. Facts be damned, they have an ideology to promote. (Leftist politics always comes with true believers, willing to sacrifice anything, usually others, to advance their certainty of the position. It should be obvious, the vegetarian/vegans are nearly 100% on the Left.)
Keep up the good work. So interesting and revealing and helping so many who are essentially sick.
Best,
Steve