"The Scientific Method" is both a deceptively simple and deceptively complex concept. On the complex end you have the
philosophy of science, which gets into some quite deep questions of epistemology, and you also have the mundane day-to-day (but often very complex) techniques that have been found to be the most reliable ways to perform different sorts of investigations, tests, measurements, trials, and so on. Then, on the opposite side, you have this: the "scientific method" (or, perhaps more accurately,
science) is simply humankind's accumulated wisdom about the best way to go about learning new things of practical value. Period. Nothing more than that. No hard and fast rules that are always applicable, no universal litmus tests, no comprehensive guidelines. Exceptions are possible (and not all that uncommon) even to such Science 101 concepts as reproducibility, Occam's Razor, full disclosure and peer review.
humankind's accumulated wisdom about the best way to go about learning new things of practical valueAnd thus one of the root problems we have talking about climate change, both in this forum and the worldwide one: there is very little in the way of accumulated wisdom about how to go about learning new things of practical value about climate change. For one thing, there are different "scientific methods" for oceanological chemistry versus solar astrophysics, atmospheric fluid dynamics versus economic resource geography, and the subject at hand encompasses a greater variety of disparate sciences than any previous one of comparable practical importance. Each little field has its accumulated wisdom, but we are not well-rehearsed in ways to integrate so many findings, facts, and numbers from different fields - from different "scientific methods". Special difficulties arise when so many different historical sciences get mixed in with so many different experimental ones. Another broad area of difficulty arises from the fact that we lack broad and widely-accepted theories of climate change out of which we can draw useful hypotheses. Our tendency is toward fragmentation of subjects, not integration of them; even in the field of climatology you have many sub-specialties, each with its own way of looking at climate generally, and each with its own set of guiding theories.
There's an odd and ironic fact about science that's rarely noted: whereas data accumulates at a fantastic pace, technology changes so quickly we can't keep up, and our
need for new knowledge grows and changes in a dizzying fashion, the
profession of science changes only at glacial rates - at least compared to all that other stuff.
HERE is an interesting page entitled "Climatology as a Profession"; it's much less a career guide than it is a history of climate research, and includes some surprising facts about how far the discipline has evolved relative to the need for integrated expertise.
By the end of the century... There was still no specific professional organization or other institutional framework to support "climate science" as an independent discipline...
When you look at the history of science in recent decades from the standpoint of phenomena like global warming, which entails a very high degree of dynamism, interconnected feedback mechanisms, and a huge array of inputs, the most significant advance has been the development of Chaos Theory. There's no question that climate behaves chaotically. This is a great insight, but it certainly doesn't help efforts to turn "Climate Science" into something like a recognizable field that can attract top students.
Back off one page from the above to
HERE and you'll find something interesting: under "Contents/Site Map" is a fairly good breakdown of what's important about climate change, and under "Theory" what do we find? What is the
theory of global warming? What
rubric guides this field of research? What
explains (at least tentatively) what we know? What
collection of concepts have we found to be useful? Sorry. All that's listed there are models, and models are not theories. "Climate Change" is not a mature science and does not yet have any real comprehensive theories.
That doesn't mean it's not a science, or that work being done isn't scientific. It does, however, mean that even unsophisticated critics of Al Gore can come up with reasonable ways to pick at "what the science says". And it makes it difficult for those who understand science on a deeper level to rebut by describing just how "scientific" the work has been.
The weaknesses of climate science and what passes as AGW theory have been recognized and addressed (to some degree and with mixed success) in a way that recognizes the simple definition I started with, that science is
humankind's accumulated wisdom about the best way to go about learning new things of practical value. We simply don't have a lot of accumulated wisdom about the best way to go about learning what we should do about the possibility of global warming. This is the part of science that moves slowly. Recognizing this, a new sort of mechanism emerged from a variety threads being drawn together. The history to which I linked describes how integrated thinking about climate science benefited from email, online journals, and blogs, but goes on to say:
Still, the most important mechanism was the one that had sustained scientific communities for centuries—you went to meetings and talked with people. As one scientist described the system, "Most successful scientists develop networks of 'trusted' sources—people you know and get along with, but who are specialists in different areas... and who you can just call up and ask for the bottom line. They can point you directly to the key papers related to your question or give you the unofficial 'buzz' about some new high profile paper."
For climate scientists, the process of meetings and discussion went a long step farther when the world’s governments demanded a formal advisory procedure. The resulting Intergovernmental Panel on Climate Change (IPCC) was not really a single panel, but a nexus of uncounted international workshops, exchanges of draft reports, and arguments among individuals, all devoted to producing a single authoritative assessment every half dozen years. From the 1990s on, the process engaged every significant climate scientist in the world (and many of the insignificant ones). At the time of its 2007 assessment, the IPCC process had grown to include 157 authors plus some 600 reviewers, giving a rough measure of the size of the scientific community on which the world's policy-makers now depended for crucial advice.
In some fields the IPCC process became the central locus for arguments and conclusions. This went farthest among computer modelers, whose efforts increasingly focused on cooperative projects to produce results for the IPCC assessments. When climate modelers studied the details of each factor that went into their calculations, and when they sought large sets of data to check the validity of their results, they had to interact with every specialty that had anything to say about climate change. Every group felt an intense pressure to come up with answers, as demanded by the world's governments and by their own rising anxieties about the future. In countless grueling exchanges of ideas and data, the experts in each field hammered out agreements on precisely what they could, or could not, say with confidence about each scientific question. Their projections of future climate, and the IPCC reports in general, were thus the output of a great engine of interdisciplinary research. In the world of science this was a social mechanism altogether unprecedented in its size, scope, complexity and efficiency—as well as in its importance for future policy.
In other words, the accumulated wisdom about the best way to go about learning new things of practical value about climate
is the IPCC. It is the state of the art. And thus the difficulties: it's easy to criticize and hard to defend. And IMHO models without theories are very weak methodologically when the systems being modeled are chaotic and have emergent properties. BUT... the IPCC is the best we have. That means that according to the way science works its conclusions have to be considered "true". That's a fact that even people sophisticated about science and inclined to accept the truth of AGW will have great difficulty explaining to anyone inclined to scoff.
