This blog is written by Canadian journalist Donna Laframboise. Posts appear Monday & Wednesday.
We read a lot of magazines in our house. Occasionally, an issue arrives in which nearly every article is engaging and (in the case of cooking magazines) every recipe sounds amazing. In short, the issue is a keeper.
The Intergovernmental Panel on Climate Change (IPCC) had an experience like that. It was so impressed by one edition of the academic journal Climatic Change that it cited 16 of the 21 papers published that month. The journal editors should take a bow. When three-quarters of a single issue of your publication is relied on by a Nobel-winning report, you’re doing something right.
Except for one small problem. The issue in question – May 2007 – didn’t exist yet when the IPCC wrote its report. Moreover, none of the research papers eventually published in that issue had been finalized prior to the IPCC’s cutoff date.
As the IPCC chairman recently reminded us, that organization’s 2007 report:
…was based on scientific studies completed before January 2006, and did not include later studies…
That’s what the rules say. And that’s what was supposed to have happened. But according to the online abstracts for each of the 16 papers cited by the IPCC and published in the May 2007 issue of Climatic Change (see my working notes here):
The first date is highly significant. As the second box on this page makes clear, the IPCC expert review period ended on June 2, 2006 for Working Group 1 and on July 21, 2006 for Working Group 2. This means the expert reviewers had offered their comments on the second draft and had already exited the stage. It means the IPCC had reached the utmost end of a process that represented years of collective labour. UPDATE Dec 20, 2012. The link in this paragraph is now dead. Please see the first three rows under the heading 2006 review periods for IPCC reports here.
So how could 16 papers, accounting for 39 new citations across fours chapters and two working groups, have made it into this twice vetted, next-to-finalized IPCC report? Those citations don’t reference research papers the wider scientific community had already digested. They don’t even reference papers that were hot off the press. Instead, in 15 of 16 cases, no expert reviewer could possibly have evaluated these papers since they hadn’t yet been accepted for publication by the journal itself.
Where do these 39 citations of the May 2007 issue of Climatic Change turn up in the IPCC report? [working notes here]
Among the 10 papers cited in Chapter 11 three were co-authored by Jens Hesselbjerg Christensen. I’m sure it’s sheer coincidence that this gentleman served as one of two coordinating lead authors for that chapter.
I’m equally certain there’s no connection whatsoever between the fact that Jørgen E. Olesen was a lead author for the IPCC’s Chapter 12 and that a paper he co-authored in the May 2007 issue of Climatic Change got cited four times in that chapter. (That abstract is here. Cited as Olesen et al., 2007 four times on this page.)
Welcome to the strange world of the IPCC. Whenever one turns over a new rock there’s something shady beneath.