Showing posts with label exploitation. Show all posts
Showing posts with label exploitation. Show all posts

Sunday, June 22, 2014

Hokum's Razor (Scientific R&D, Part 2.1.2)

"Nature ... is not always noted for its parsimony." - Donald A. Dewsbury

In this post, I want to follow up on my previous comments regarding simplicity and the dubious role it plays in the unificationist agenda for science.  At no point in that discussion did I refer to Occam's razor (or the Law of Parsimony, as it is sometimes called), and this was a peculiar oversight on my part given its central place in the unificationist playbook.  In fact, while few unificationists would ever explicitly identify themselves as such (the label being more of a shorthand used by philosophers of science),  the majority will almost certainly invoke Occam's razor at some point in their career, so much so that it has become a standard fixture in the dramatic depiction of science-types (or their adversaries) in popular drama, due in large part to the success of the film adaptation of Carl Sagan's Contact.  Noteworthy mentions since then include The X-Files (Season 8, Episode 4, "Patience"), Scrubs (Season 7, Episode 1, "My Own Worst Enemy"), House M.D. (Season 1, Episode 3, "Occam's Razor"), and The Big Bang Theory (Season 1, Episode 9, "The Cooper-Hofstadter Polarization").

Okay, so what is this rule?  This is a deceptively simple question, as I intend to demonstrate, but in a nutshell, it is the application of the principle of economy ("never do for more what you can do for less") to explanatory matters: "Plurality [in explanation] should never be posited unnecessarily."  The rule takes its name from the 12th Century philosopher William of Ockham, though he was hardly the first to suggest it; it can be traced back to influential Hellenistic philosophers like Aristotle and Ptolemy, and variants of the rule were in wide circulation during Ockham's time, as well.

Since then, several well-known figures in science have given expression to the rule, or at least to rules that resemble it.  This includes Isaac Newton's "we are to admit no more causes of natural things than such as are both true and sufficient to explain their appearances," Ernst Mach's "scientists must use the simplest means of arriving at their results and exclude everything not perceived by the senses," and of course the Einsteinian pseudepigrapha that "everything should be made as simple as possible, but not simpler."  It also includes various expressions of the tenet that "extraordinary claims require extraordinary evidence," made popular (once again) by Carl Sagan (Cosmos, Episode 12, "Encyclopedia Galactica").

At face value, the proliferation of paraphrases of the rule in both academic and popular media might be taken as an indicator of the rule's power and centrality in scientific practice.  Careful consideration of their wording, however, betrays a considerable degree of conceptual disparity between them, worthy of further consideration:
  • While some versions of the rule focus on the number of "moving parts" included in the causal account, others focus instead on the plausibility or credibility of these parts regardless of number (Newton's "admission of causes that are true"; Mach's "exclusion of everything not perceived by the senses").  Some articulations of the rule dodge such considerations simply by insisting on the "simplest" explanation.
  • Among the versions of the rule that focus on the plausibility or credibility of the cause, these vary between expressions that treat "credibility" as if sharply divided between known and unknown (e.g., Newton's "admission of causes that are true") and those that are relatively more liberal in their allowance for a range of confidences in the truth of various claims.  The fictional and ever-entertaining Dr. House ascribes to the latter: "Why is one simpler than two?  It's lower, it's lonelier, but is it simpler?  Each one of these conditions is about a thousand to one shot.  That means that any two of them happening at the same time is a million to one shot.  [Dr.] Chase says the cardiac infection is a ten million to one shot, which makes my idea ten times better than yours."  In other words, any explanation involving a joint probability of two relatively uncommon conditions is still vastly superior to one involving a single probability of an incredibly rare condition, or in the words of Dr. Cox, "if you hear hoof beats, you just go ahead and think 'horseys'" (unless, of course, you happen to live in zebra country):




  • The tenet that "extraordinary claims require extraordinary evidence" is also an extension of this perspective, because our sense of a claim's plausibility is subject to change as new information comes in, though not by much unless the information is strongly in the opposite direction of prior belief.
  • While some versions of the rule assert that adherence is more likely to yield correct explanations, or even that contrary explanations cannot be true, others simply assert that such adherence is "better" without saying why, and yet others dispense entirely with the effort to justify adherence.
  • Only a few versions suggest that the process of simplification can be taken too far.  For example, Okham's "do not posit unnecessarily" suggests that some degree of plurality in explanation is desirable.  Similarly, the pseudo-Einsteinian "but not simpler" suggests that oversimplification is just as grave a mistake as is needless complexity.
  • A careful reading of Newton's version of the rule reveals that it is not concerned with efficiency at all but instead with the plausibility and sufficiency of the causal account on offer; if the posited causes are unlikely to produce the effect in question, or if their truth is in doubt, then the account fails no matter how many or few are suggested.

Deeper into the quagmire of Occam's ambiguous rule

In scientific practice, alleged adherence to the rule likewise masks multiple, qualitatively distinct practices.  To illustrate what I mean, I introduce to you one of the tools that logicians use to evaluate the validity of certain kinds of arguments.  The tool of which I speak is known as 'predicate logic,' and it belongs to a larger logician's toolkit, 'symbolic logic,' which is similar to symbolic algebra in that both describe relationships between variables of unspecified value by combining letters (representing the variable under investigation) and operators (representing their relationships), according to specific rules constraining their possible combinations.

Predicate logic is made up of elements that take the form 'Px', where x stands for the subject of a proposition and P stands for the predicate of the proposition (i.e., the part of the sentence describing the subject; essentially Px means "x is P").  When it comes to formulating expressions in predicate logic that adequately capture the conceptual structure of explanations, we need to combine statements about some earlier, causal condition - something like Cx - with statements about some later, outcome condition or effect - something like Ex.  Specifically, we can combine such statements in one of three possible conditional statements.  (Conditional statements relate two statements in an "if, then" manner).  However, choosing the right combination to accurately convey our causal concept takes some careful consideration.  These are the three candidates:
  1. Cx → Ex:  "if situation x exhibits condition C, then it will exhibit condition E."
  2. Ex → Cx:  "if situation x exhibits condition E, then it will exhibit condition C" (or in other words, "only if situation x exhibits condition C will it exhibit condition E").
  3. Cx ↔ Ex:  "if and only if situation x exhibits condition C will it exhibit condition E" (or vice versa).
The first statement establishes a characteristic outcome-state for situation x, E, given that it previously exhibited condition C.  In this formulation, Cx is identified as a 'sufficient condition' for Ex to be true, and this is very different from an alternative and rather vacuous statement
  • Cx → (Ex ˅ ~Ex):  "if situation x exhibits condition C, then it will either exhibit condition E, or it won't."
The second statement, on the other hand, gives condition C exclusive access to condition E: if we see that condition E characterizes situation x, then situation x must formerly have been characterized by condition C.  In this formulation, Cx is identified as a necessary condition for Ex to be true (if Cx is not true, then neither is Ex).  Finally, the third statement, known as a biconditional statement, establishes a doubly exclusive relationship between C and E, such that Cx is both a necessary and sufficient condition for Ex.

The first inferential activity masquerading as Occam's razor involves favoring Cx as both a necessary and sufficient condition for Ex, in other words favoring the biconditional formulation above.  If we attach an index to C in order to distinguish between alternative, mutually exclusive causal accounts, Cix, where 'i' is a placeholder for a specific C, then the statement "C1x ↔ Ex" precludes alternative conditional statements linking C2x to Ex.  In other words, if it is true that situation x will exhibit condition E if and only if it had previously exhibited condition C1, then it is false that situation x had previously exhibited some alternative condition C2.

All of the above formulations, however, apply only to a single subject, the situation symbolized x.  If a researcher wishes to expand the scope of their explanation using predicate logic to cover a set rather than a single subject, one of two additional statements is added:
  • (x)( ... ):  "for every x, ...," where the ellipsis within the second set of parentheses is a placeholder for a logical statement (for example any of the three formulated above).
  • x)( ... ):  "for some x, ..."
Each of these formalities, known as the 'universal quantifier' and 'existential quantifier,' respectively, is used to extend the coverage of the statement within the second set of parentheses to a whole set of subjects, either the more inclusive "every x" when using the universal quantifier, or the more exclusive "some x" when using the existential quantifier.

Applying the universal quantifier to the third, biconditional, formulation above is the second practice masquerading as Occam's razor: "(x)(C1xEx)", in other words "It is true of every situation that, if and only if it exhibits condition C1, it will exhibit condition E."  In doing so, the researcher relieves him or herself of the need to consider novel causes for each newly described instance of Ex, since C1x is both necessary and sufficient in every situation.  In effect, this formulation globalizes the relationship between E and C1, making a general principle or law of it and transforming subsequent explanations of C1x into a highly redundant operation.

The next two practices subsumed under the heading of Occam's razor involve (1) the expansion of condition E to include multiple, qualitatively distinct effects, and (2) the suppression of condition C to include as few separate causal terms as possible:
  • (x)(C1x ↔ (E1x ∙ E2x)):  "it is true of every situation that, if and only if it exhibits condition C1, it will exhibit both condition E1 and E2 (and E3 and ...)."
  • (x)(C1x ∙ C2x) ↔ Ex):  "it is true of every situation that, if and only if it exhibits conditions C1 and C2, it will exhibit condition E.
The first of these practices exhibits the same sort of economy as does killing two birds with one stone; it reduces the need to engage in novel explanatory efforts for every new phenomenon encountered.  The second of these practices, on the other hand, is a formalization of the "minimal moving parts" imperative discussed above.

Abstraction, the fifth and final Ockhamian practice, involves expressing C and E in such a way that some degree of variation around an ideal is tolerated: "situation x exhibits something like condition C" or "situation x exhibits a condition similar to E."  Inclusive expressions like these allow researchers to capture a significantly wider range of individual cases under their explanatory account than can a more rigid expression that demands an exact resemblance between them.  Abstraction, in other words, allows researchers to pigeonhole nonidentical cases into lawful conformity, further reducing the need to produce novel explanations for every new case.

Some examples of Occam's ambiguous razor in the historical sciences

While Occam's razor is frequently treated as if axiomatically true and invoked to legitimate one or two of these practices at a time, it is rare to encounter a researcher ambitious enough to attempt all five at once.  One exceptional example comes from archaeology (my home discipline): British archaeologist Colin Renfrew's explanation of the language geography of our modern world.

In several regions across the globe, clusters of languages bearing close affinities to one another enjoy wide geographic distribution.  For example, the Indo-European languages (e.g., Hindi, Farsi, the Baltic, Slavic, Germanic, Celtic, Hellenic, and Romance languages) dominate the European linguistic landscape, as well as significant areas of Iran, Pakistan, Afghanistan, and India.  Historical linguists have long argued that the shared traits characterizing many of these language clusters exist as a dwindling legacy of a shared linguistic ancestry, for example "Proto-Indo-European" (or PIE for short) in the case of the Indo-European languages.  However, historical linguists also argue that the gradual disappearance of shared traits between related languages will eventually progress to such a degree that their family resemblance entirely fades away, after a threshold of perhaps no more than 8,000 years.  Conversely, the family resemblance existing between the Indo-European languages is still discernible, suggesting that populations speaking different Indo-European languages have not been separated from one another for more than a few thousand years.  Even so, Europe and Southcentral Asia have been occupied continuously for tens of thousands of years, implying that the Indo-European languages now spoken in these regions could not have descended from the languages originally spoken there by the populations living their tens of thousands of years prior.  Instead, Renfrew argues, the establishment of the Indo-European-speaking communities currently occupying these regions must have involved replacement of older populations by an influx of PIE speakers within the last few thousand years.  In Renfrew's account, this PIE population, practicing an agricultural economy and driven by the explosive population growth that such an economy supports, expanded out of its original homeland (perhaps in Anatolia, perhaps ~8000 years ago) to overwhelm the much more sparsely distributed hunter-gatherer populations previously inhabiting Europe and Southcentral Asia.

As Alison Wylie has argued, a central component of Renfrew's support for his account is an appeal to its parsimony, and he has certainly succeeded on this point, quite well.  First, he has suggested that his account might take on global relevance if applied to the explanation of the geographic distribution of the world's other major language families (Occam's razor as universal quantification), dismissing alternative accounts in the process (Occam's razor as advocacy of necessary and sufficient causal relationships).  Second, he has formulated his account in such a way that it explains not only the language geography of Europe and parts of Asia but also the emergence of agricultural economies in Europe, and tentatively the geographic distribution of genetic variabilty there, as well (Occam's razor as the explanation of many effects by a single cause).  Third, by attributing these economic, linguistic, and genetic changes to a single process of population expansion and replacement, Renfrew has disfavored more eclectic causal accounts, for example involving a mixed process that includes the sharing of ideas and languages between neighboring groups in addition to population expansion and replacement (Occam's razor as suppression of causal terms; this book on contact-induced language change is an engaging read on contact-induced language change and may well be my favorite book ever).  Fourth and finally, Renfrew's account explicitly concedes that the ongoing process of population expansion may have varied in detail as it unfolded (e.g., regarding the rate of population expansion, the degree to which expanding agriculturalists outnumbered hunter-gatherers, and so on; Occam's razor as abstraction).

Yet, despite the simplifying ambition of Renfrew's account, few archaeologists have actually been impressed by it.  Wylie summarizes the numerous critiques that have accrued since the model was first advanced, these variously focusing on the empirical implausibility and the lack of "causal efficacy" (in other words, sufficiency) of Renfrew's account. In short, many archaeologists contend that his model runs slipshod over archaeological data and are quick to point out that these data necessitate an eclectic account.  The virtue of simplification in this case is far from obvious.

Other examples of Occam's razor in scientific practice come from the contentious debate over the cause(s) of the Late Quaternary megafaunal extinctions.  Between approximately 50,000 and 10,000 years ago, a number of large-bodied animal species in Eurasia, Australia, and the Americas went extinct, including mammoths and mastodons, woolly rhinos, giant marsupials, giant ground sloths, and a number of other large-bodied ungulates and predators.  For decades, paleontologists and archaeologists have debated what might have led to this series of extinctions, with climate change and human impacts (including over-predation, habitat alteration, and the introduction of deadly, inter-specifically contagious diseases or "hyper-diseases") being the two main contenders.  For some participants in the debate, causal accounts that suggest a combination of these various elements, or that the demise of some species owes to one factor while the demise of other species owes to the other, are regarded as "a relatively weak approach epistemologically; ... an admission of defeat rather than a breakthrough in understanding" (MacPhee and Marx 1997:209; Occam's razor as disfavoring multi-term causes).  It is worth mentioning that MacPhee and Marx instead endorsed the hyper-disease hypothesis, which has been widely dismissed for its implausibility and insufficiency.  Instead, at least some researchers are confident in their multi-cause stance.

Perhaps one of the most controversial accounts of the North American extinctions was Richard Firestone and coauthors' recent suggestion that one or more extraterrestrial (ET) bodies impacted the Laurentide ice sheet covering southeastern Canada during the last ice age, approximately 12,900 years ago, triggering the breaking up of the ice sheet, the climatic cooling episode known as the Younger Dryas (YD), megafaunal extinctions in the Americas (but not elsewhere), extensive biomass burning across North America, significant population depression and economic reorganization of the Paleoindians inhabiting North America, and the formation of a variety of distinctive geological deposits.  In the primary article advancing this account, the authors offer the synchroneity of these phenomena as evidence congruent with the ET impact event.

Once again, however, few have found Firestone and coauthors' argument compelling, in large part because ET impact events in general have not been convincingly linked to any of the various lines of evidence cited by them and in part because few if any of their critics are impressed by the unifying power of this account alone.  Instead, archaeologists, geologists, and paleoclimatologists have seen the article as a transparent play at grabbing attention and prestige for its authors.  In an intellectual climate already strained by limited research funding, researchers dedicated to understanding Late Quaternary extinctions are instead vexed by Firestone and coauthors' sensationalism for its threat at diverting funding away from the pursuit of explanations based on more credible premises.

Occam's baby and Occam's bathwater

Simplification is not the epistemological virtue that unificationists claim it to be, as I argued in my previous post.  It should by now be apparent that Occam's razor should do little to change our minds on this point, and many researchers have little patience for it (e.g., the quote with which I began this essay).  To begin with, any impression of solidarity that the frequent invocation of the rule may give is spurious, given the multiple disparate intellectual practices that are lumped together under this single, equivocal heading.  "The" law of parsimony, as it turns out, is an epistemological Mr. Potato Head, able to be remade into whichever visage best serves the researcher's argument.

As spurious as the rule may be as a mask, however, there is nothing obviously defective with any of the various practices that it lumps together.  Rather, each one deserves careful scrutiny on its own.  In so doing, we have no reason to expect that all will remain standing, but nor do we have reason to think that all will fall.  What we want to ask of each one is, "will this practice point me toward more realistic and accurate understandings of nature/the universe?  Why or why not?"

Biconditionality

Binding a particular cause to a particular effect together in a necessary and sufficient relationship certainly simplifies the labor of a researcher: the statement (x)(Cx ↔ Ex) means that, if he or she has encountered Ex, then he or she already knows what caused that state of xEx stands as a proxy for Cx, and explanatory accounts that are structured in this way are tremendously helpful in applied sciences, for example clinical diagnosis.  When knowing the cause is critical to successful policy-making, medical treatment, or similar, possession of explanatory accounts like this are time-saving (and stress-, life-, and grief-saving) devices.

Be that as it may, such accounts are incredibly hard to come by.  I don't mean that it is particularly difficult to formulate such accounts.  In the internet age, where hypochondria meets WebMD, it is all too easy to find hypochondriacs thinking "all patients will develop a fever if and only if they have the bubonic plague."  The ease of formulating such statements, however, is hardly virtuous, because establishing the empirical plausibility of necessary and sufficient relationships between cause and effect is a profoundly elusive enterprise.

The easy part, as it turns out, is establishing empirical support for statements with the following structure: (x)(Cx → Ex) ("every situation that exhibits condition C will exhibit condition E").  Causal accounts exhibiting this sort of structure are easy to demonstrate experimentally, a dime a dozen, really.  The hard part is getting the arrow to point in both directions, because on the contrary, it is much easier to make paired observations like
  • (x)(C1x → Ex) ∙ (x)(C2x → Ex):  "every situation that exhibits condition C1 will exhibit condition E, but every situation that exhibits condition C2 will also exhibit condition E."
In other words, we are all too aware that many phenomena of interest may be explained by either of two (or more) equally plausible, mutually exclusive causes.  In archaeology, we refer to such unhappy circumstances as cases of 'equifinality' (a term borrowed from general systems theory), while geologists prefer the term 'polygeneity'.  Equifinality is what makes drawing straightforward equivalences like "fever = bubonic plague" so misinformed and medically disastrous, instead warranting the much more complicated (and expensive) enterprise of differential diagnosis.

The solution is a lot of research, not Ockhamian flag-waving and offhanded dismissal of alternative explanations, even if it means sacrificing explanatory (and financial) efficiency.  In differential diagnosis, this requires the prior establishment of symptom complexes or syndromes, combinations of signs and symptoms that are indicative of particular medical conditions:
  • (x)(C1x ↔ (E1x ∙ E2x)) ∙ (x)(C2x ↔ (E1x ∙ ~E2x)):  "Every situation will exhibit conditions E1 and E2 if and only if it exhibits condition C1, while every situation will exhibit condition E1 but not Eif and only if it exhibits condition C2.
The research efforts involved in establishing these relationships fall under the heading of symptomatology, whereas the application of such knowledge falls under the general heading of diagnosis, including its differential variety.  Note that the observation of a single symptom, in this case annotated E1, cannot be explained unambiguously, even if both conditions C1 and C2 are sufficient to cause it.  Instead, a successful diagnosis may require further evaluations of a patient (though this should be balanced with other considerations).  As has been argued elsewhere, the invocation of Occam's razor to rule out explanations that do not make the same predictions is illicit, even if a part of their respective predictions is identical.

Archaeologists engage in a similar sort of reasoning: when confronted with situations of equifinality, when we really want to know which human activity led to the formation of an archaeological deposit, or if it was human activity at all, we need to draw on a body of knowledge that ties particular patterns of cultural debris to particular behavioral or natural processes.  We call this body of knowledge 'middle range theory' or 'formation theory,' which is built from 'actualistic research' (including experimental archaeology, ethnoarchaeology, and computer simulation).  Often, the archaeological reconstruction of  past human activities and natural processes requires us to draw on multiple lines of archaeological evidence when single lines prove to be equivocal.

Universal quantification

While biconditionality is hard to come by in scientific research but still worth pursuing, formulating explanatory accounts that assume universal quantification is an essential requirement.  Consider the alternative case of existential quantification:
  • x)(Cx ↔ Ex): "There are some situations which will exhibit condition E if and only if they exhibit condition C."
This formulation is capricious and unreliable; it leaves us wondering which situations are covered by the explanation and which ones are not.  In fact, on this point a logician would be quick to point out that the existential quantifier does not even rule out the possibility of universal quantification, but nor does it necessitate it; a universally quantified rule implies that the rule is also existentially quantified ("if all x are P, then some x are P, necessarily"), but an existentially quantified rule does not necessarily imply its universal quantification ("if we know that at least some x are P, then we cannot say for sure whether all x are P or not.").  Statements involving existential quantification are useful tools for description, but when applied to the task of explanation, such statements leave us in the dark as to why certain situations should exhibit well-specified cause-effect relationships while others may or may not.  Worse still, we might imagine a disingenuous researcher variously invoking and dismissing the applicability of an existentially quantified explanation to particular situations, conditional on self-serving motives rather than any honest concern for improving our understanding of nature.

Even worse would be the case of an unquantified rule:
  • Cx ↔ Ex: "The individual situation x will exhibit condition E if and only if it exhibits condition C."
The rationale in making such statements is entirely obscure: why is Cx necessary and sufficient for Ex in this one situation but potentially not in others?  Such statements are entirely unsatisfying, and fortunately few researchers actually make such locally specific statements.

If we rule out these two alternatives for their indecisiveness and vulnerability to deceitful manipulation, we are left with universal quantification, with explanatory accounts that are meant to apply to every situation.  It also makes the identification of empirically inaccurate explanations easy: if the rule "breaks down" in light of empirical data, for example if its applicability seems to be conditional on some other condition that is not included in its specification, then it is insufficient and needs to be reformulated accordingly.

Abstraction

In evaluating the epistemological merit of abstraction, we should be aware of the fact that this practice exists in essential tension with universal quantification and biconditionality.  When the latter two practices are combined, in other words when our formulation of an explanatory account takes the form (x)(Cx  Ex), we transform Ex into a decisive, diagnostic outcome of Cx, dodging the pitfall of making noncommittal statements like:
  • (x)(Cx ↔ (Ex ˅ ~Ex)):  "If and only if any given situation exhibits condition C, it will either exhibit condition E or it won't"; or
  • (Ǝx)(Cx ↔ Ex) ∙ (Ǝx)(Cx ↔ ~Ex):  "There are some situations that exhibit condition E if and only if they exhibit condition C, and there are some other situations that don't exhibit condition E if and only if they exhibit condition C."
However, when we deliberate insert an imprecise expression of E into the formulation (x)(Cx  Ex), we sacrifice a degree of the decisiveness we originally gained by combining universal quantification and biconditionality.  In theory, we might even accomodate for such a large degree of imprecision in the formulation of E that the noncommittal statement (x)(Cx ↔ (Ex ˅ ~Ex)) is the better fit, if we are being honest.

However, our willingness to engage in abstraction need not be seen as entailing a slippery-slope descent into explanatory impotence.  In practice, this is rarely the case, because our allowance for imprecision is usually tempered by statistical constraint: "every situation that exhibits condition C will exhibit something like condition E, even if not condition E exactly, and not a condition very different from it."  Imagine an experiment in which a group of lab mice are exposed to a performance-altering substance (the 'treatment group') while a second group remains unexposed (the 'control group').  When a mouse from one of these two groups is then placed in a maze, no individual from the treatment group completes the maze more quickly than any mouse from the control group.  However, the time to completion does vary between individuals within each group.  The results of the experiment are then formalized in terms of the following two causal accounts:
  • (m)(~Sm ↔ Om):  "Any mouse will complete the maze in approximately one minute if and only if they have been exposed to the performance-altering substance."
  • (m)(Sm ↔ Tm):  "Any mouse will complete the maze in approximately two minutes if and only if they have been exposed to the performance-altering substance."
While this example is hypothetical, real experiments often exhibit similar distinctions between groups, with limited or no overlap in the outcome.  Such cases illustrate the fact that constrained imprecision in the expression of E does not necessarily weaken the explanatory power of an explanatory account; we still understand the world a little better when we understand that mice that are exposed to the substance in question suffer a disadvantage of time in navigating a maze relative to those who are unexposed.  At the same time, we are being honest with the influence of a given causal condition on an outcome condition when we acknowledge the imprecision that characterizes its influence on time to completion.  The realism that such statements permit, not their parsimony, is what should convince us to accept abstraction as a good practice in formulating explanatory accounts.

Diverse effects

Unlike universal quantification, biconditionality, and abstraction, the practice of subsuming explanations of multiple, qualitatively distinct phenomena under a single account has no merit.  Renfrew sought to do so by linking the spread of agriculture and linguistic and genomic geographies to a single process of population expansion and replacement.  Similarly, Firestone and coauthors sought to do so by linking American megafaunal extinctions, economic reorganization, climate change, and the formation of a handful of poorly understood geologic deposits to a single extraterrestrial impact.  But why should we be impressed by such syntheses?  On the contrary, we observe coincidences all the time in the course of our daily lives, and this ought to be reason enough not to be taken in by such grand syntheses.  Instead, the burden is on the researcher to provide a convincing argument for why qualitatively distinct phenomena ought to be linked to a common cause.

Suppression of causal terms

There is also little reason to think that the number of premises involved in a causal account should be few in number.  The question is not "how many working parts are invoked?" but rather "how plausible is the particular combination of working parts that has been invoked? (what is their joint probability?)."

My own work in archaeological demography focuses on identifying factors that influenced patterns of stability and change in the population growth rates of high-latitude hunter-gatherer populations of the past.  The population growth rate is a net balance of the 'four flows' of demography - fertility, mortality, in-migration, and out-migration - and therefore any explanation for patterns of stability or change in a population's growth rate record must refer to a change in one or more of these flows.  It would be convenient for me if I could pursue my explanatory efforts under the assumption that any observed change in my study population's growth rate was caused by a change in a single flow, but such singular changes are rare.  Whatever factors have led to change in one flow have the stubborn habit of driving change in one or more of the others, as well.  Changes in per capita subsistence productivity, for example, can influence fertility (with nutritional income bearing on reproductive health and/or decision-making), mortality (through deficiency diseases, compromised immune systems, and/or violence fueled by subsistence shortfalls), and/or migration ("stick around if food is bountiful; consider moving on to more productive lands if it is not").  Ironically, explanations for growth rate change that focus on changes in individual flows are frequently less plausible than those that focus on changes in multiple flows.

This example also illustrates another reason that most realistic (= plausible) explanations involve multiple terms.  In thinking about the factors that influence population growth, the four flows are proximate determinants: any factor other than fertility, mortality, in-, or out-migration that has an influence on population growth must act through one or more of these four flows.  Environmental change, predation, infectious disease, subsistence productivity, education, contraception, violence, genetic disorders, and other factors that might bear on population growth are thus most accurately conceived as distal determinants, and any explanatory effort focusing on such indirect influences must therefore include as many causal terms as it takes to adequately describe the chain of influences linking the indirect determinant of interest to population growth.  This, I think, is exactly the sort of necessary plurality that Ockham had in mind when he warned against unnecessary plurality.

Newton's razor

In the end, there is no reason to pay such deference to Occam's razor as unificationists do.  When it is invoked, the effect (at least for those who buy it) is to prevent a more thorough scrutiny of the plausibility and sufficiency of an explanatory account; instead, the target is a low cause-to-effect ratio, with lower ratios facilitating more redundancy in explanation.  In the process, all manner of intellectual activities are offered as examples of good Ockhamian behavior, conjuring the impression of epistemological solidarity among those who invoke it, despite the demonstrable qualitative differences standing between these practices.

Newton's razor, on the other hand, has considerable appeal to it: "we are to admit no more causes of natural things than such as are both true and sufficient to explain their appearances."  Whereas Occam's razor is primarily a numbers game, Newton's makes no particular demand for economy but instead requires sufficient and plausible causes.

On the matter of sufficiency, it is important to distinguish between formal sufficiency and causal efficacy.  From a strictly grammatical standpoint, it is easy to construct causal accounts that follow the form

  • (x)(Cx → Ex)

for example "pre-menopausal women who continue to live in close proximity to each other for extended periods of time will exhibit increasingly synchronized menstrual cycles over time."  On the other hand, not all such constructions are equaling compelling.  Many researches call this often-repeated account into question for its lack of causal mechanisms.

Establishing plausibility is a separate issue.  We might conceive of causal accounts that make a lot of sense hypothetically but whose causal terms are unlikely to be true (= implausible).  For example, it does not take any great act of imagination to envision a scenario in which the terrestrial impact or air burst from a large extraterrestrial object leads to a cataclysmic extinction event.  This is the favored account for the extinction of the dinosaurs approximately 65 million years ago, and if popular entertainment is any measure of the credibility of mechanism in a causal account, the back-to-back release of Deep Impact and Armageddon in 1998 is a further indication of this scenario's general credibility.  (On the other hand, the idea of menstrual synchrony is frequently enough repeated that popularity should not be treated as the final arbiter of sufficiency).  Instead, what makes Firestone and colleagues' explanation of American megafaunal extinctions and economic and climatic change so unconvincing is that, despite centuries of geological, paleontological, and archaeological research in North America, none of the tell-tale symptoms of an ET impact at aprroximately 12,900 years ago have made themselves known.  Instead, Firestone and colleagues make their case based on a round-up of nonspecific lines of geological, paleontological, and archaeological evidence.  The medical analogue would be a clinician who diagnosis an unconscious patient with Hantavirus Pulmonary Syndrome based on the observation of a mild cough, split ends, and a swollen thumb.  Such malpractice borders on gross negligence, and one would hope that censure, if not revocation of the clinician's medical license, would follow.  Or, if you favor a less socially charged example, a healthy lawn may require watering, and lawns in rainy areas may do well on that count, but if I have a healthy lawn in a drought-stricken area, it's not because of the rain.

In short, what Newton's razor demands of any explanation, and what we should demand of it as well, is not that it is efficient but instead that it makes sense, not only in an abstract way (sufficiency) but also when it is applied to a particular case (plausibility).  If Newton's razor saves us any effort, it is only as a side-effect: in shaving off the incredible from consideration, we don't have to waste the time, or limited research funding, investigating it.

Sunday, September 15, 2013

The most important thing about science

The world of ideas in which we live

Consider the following statements:
  • If anything bad can happen, it will.  For example, the GPS will always tell me that my destination will be on the left (i.e., across traffic; in England, Australia, or Malta, this would instead be on the right).
  • Nice guys finish last.
  • Good things happen to good people.
  • Everything that has happened to me in my life  everything good, everything bad  has happened for a reason.  It is part of a divine plan.
  • My car won’t start because the alternator has failed.
  • Heavier objects fall faster than lighter objects.
  • The universe was created in six days.  Living organisms were created on the fifth and sixth days and belong to a limited number of immutable species.
  • The world is flat and exists on the back of a turtle.
  • The Sun and all of the rest of the celestial bodies revolve around the Earth.
  • The universe is almost 14 billion years old, the Earth orbits the Sun and is approximately 4.5 billion years old, life on earth began sometime before approximately 3.5 billion years, and organic species have been evolving and going extinct ever since.
  • The evolution of life on Earth is explainable in terms of natural selection and only natural selection.
  • Natural selection happens when an organism changes its traits to be better adapted to its environment, then passes these traits on to its offspring.
  • Those individuals that survive longer are more evolutionarily successful.
  • Those individuals that have the most offspring are more evolutionarily successful.
  • The evolution of intelligent lifeforms is the end goal of evolution.
  • Natural selection is the process by which species become better adapted to their environments; when confronted with environmental change, all species must change to adapt to new conditions.
  • If I pour the coconut milk slowly into the blender, I will get more out of the carton than if I pour it quickly.
  • If I play the Powerball numbers that have been drawn most frequently in the past, I will increase my odds of winning.
  • Denali is 20,320 ft./6194 m tall.
  • The distance between a lightning strike and its observer is approximately s/7 miles, where s is the number of seconds between the observation of the lightning and of its thunder peal.


To be human is to live in a world of ideas like these, ideas that assert something about the way the world looks and works, and why it works in one particular way rather than some other.  I say "ideas like these" because I do not intend this list to be exhaustive, nor to imply that every individual who has ever been born has shared all of the same beliefs.  The staggering plurality of beliefs held by the world's current population (>7 billion and growing), which underlie many of the bitter conflicts that are all too familiar to us, are proof enough that one could never realistically hope to inventory them all.  If we expand our scope to include every belief ever held in the 200,000 years since the dawn of the human mind as we know it, with its insatiable thirst for knowledge, then we have to add more than 75 billion human minds (though admittedly, many of these people did not survive infancy).  That's a lot of minds to change, and a lot of time to change our minds.

And change them we have.  I change my mind on a daily basis, though about some things more than others.  I inherited some of my current ideas from my parents, some from my teachers, some from my peers, some from strangers (books, magazines, radio, television, blogs), and many directly from my own experience of the world.  I have been accumulating beliefs for decades, but I also have not hesitated to abandon some of them whenever I have seen fit, sometimes in favor of better beliefs, but sometimes just because some have seemed so bad upon further examination.  I still have plenty of beliefs left, though.  I have so many of them, in fact, that I don't always recognize when I am holding contradictory ones. 

I hold my beliefs at every level of consciousness, from the "important" ideas that I rehearse with regularity, to the intuitions that go unspoken most of the time and that I am only vaguely aware of even when I try to think about them, to the matters that my body knows at such a basic level (motor intuitions) that I am not even consciously aware of them, nor could I ever be.

The ideas I have are about everything.  I have ideas about how old our universe, our planet, and life on our planet are; ideas about the general processes that led up to their present state and the specific changes that they have undergone along the way (quite vague when it comes to our universe and our solar system, admittedly); and ideas about how they work in the present.  I have ideas about the daily mechanics of life – about gravity, resistance, speed, inertia, temperature, etc. I have lots of ideas about human nature and about the way that human nature affects the ways that our social, economic, and political lives play out.  I have all kinds of ideas about health, disease, birth, and death.  I have ideas, and I have ideas, and I have ideas.  My cup runneth over with ideas.

Some of my ideas are quite important to me, though not all for the same reason: some are ideas that I take for granted when I make my practical daily decisions, some are the ones I have dedicated my life as a scientist to, some don’t affect me but I can’t imagine them being untrue, and some even bring me considerable displeasure, yet I believe them just the same.  Some I believe despite the fact they are demonstrably absurd (early in the morning, that thing about pouring coconut milk slowly from a finite cartonful is far more true for me than I care to admit), while others are so basic to my grasp on reality that I might have called them “self-evident” were I living in the 18th century (though it’s just not cool to describe ideas that way anymore).  The ideas that I have abandoned along the way have also varied in their importance to me.  With little more than a raised or furrowed eyebrow, I have cleared up misunderstandings about tax code, postal policy, and why the fridge has been making that funny sound (the condensor coil on the back of the fridge had been too close to the wall behind it, nothing more serious).  But others have shaken my sense of order and direction to their foundations.

If we assume that the thirst for understanding is a pervasive feature of human nature (and I do), this makes the business of abandoning beliefs puzzling, all the more when we further observe that we hold on to some longer than others.  Why can't or shouldn't we just keep the ones we already have and be done with it?  I assume that it is not for no reason, and this brings me to my main point.  It is such an important point that, if you take nothing else away from this blog, if this post is the first and last time you'll ever read it, I will be satisfied that at least it was this one.

The single most important thing about science

The single most important thing about science, the thing that sets it apart from all other ways of knowing, is that it focuses on scrutinizing beliefs, using observation of the world that these beliefs purport to understand to do so.  When I say that science is about building better beliefs, such scrutiny is at the very center of this enterprise.  Granted, building better beliefs must involve more than just scrutinizing them, particularly because scrutiny often leads to their abandonment.  To think otherwise is to be comfortable with the idea of eventually living a belief-free life, and that quite simply won’t do.  So obviously, there also has to be something additive to science, to offset the part of it that is subtractive.

Speaking metaphorically, we might think of the labor of science as being divided up into two complementary divisions: quality control, and research and development (R&D for short).  The people in quality control are charged with the task of inspecting the product, whether this be newly manufactured beliefs (i.e., the guesses or hunches that I mentioned previously) or the ones that have been on the market for a while.  On the other hand, the people in R&D are charged with coming up with new products (again, guesses), whether these be invented to explain newly discovered phenomena, or long-standing mysteries, or even to replace older, widely accepted explanations.

While it is true that these two metaphorical divisions complement each other, the quality control aspect is far more important to science.  I do not mean that scrutinizing ideas is somehow more important than coming up with new ideas, nor that coming up with new ideas is better than keeping old ones around.  I simply mean that, if we are trying to determine what sets science apart from other activities, it is the premium that science puts on scrutiny, and scrutiny based on observation of the world in particular.  Science insists that our understandings of the world be constrained by our observation of it, and this insistence is so central to it that no enterprise can rightly call itself ‘science’ if it does not take observational scrutiny seriously, if its practitioners are not sincerely open to endangering and potentially defeating ideas.  On the other hand, the activities of the R&D division are hardly unique to science.  On the contrary, there are many ways of coming into possession of beliefs, whether these be the time-honored beliefs that are passed down from generation to generation or those that have been newly invented by the revolutionaries of the avante-garde.  So, if science is to be set apart on the basis of its deeds, these will be the work of the folks over in quality control.

When I say "observation of the world that these beliefs purport to understand," what I mean by 'observation'  is "descriptions of the world, gained either through direct sensory perception or through the use of various measurement instruments (scales, measuring tapes, satellite arrays, mass spectrometers, etc.)."  Why?  Because if our understandings about the world are successful, if they actually help us to explain the phenomena we perceive, then what we actually perceive, including what we have perceived in the past and what we can perceive in the future, ought to be consistent with such understandings.  It is this risk of poor fit that makes observation so dangerous for ideas, that makes ideas so vulnerable to the risk of defeat:



In this framework, we give a new name to the idea – ‘hypothesis’ – but only if we are able to identify one or more kinds of observation that would allow us to test it.  Many scientists would also insist that we actually be able to make such observation, and I suppose that effectively, this is true; if we were never able to make one or another of the dangerous observations that we have identified, then the moment of peril would remain out of our reach.  Yet even so, it is a big step simply to be able to admit that one’s ideas are potentially vulnerable to observational scrutiny, and I consider any individual who is willing to hold their beliefs up to observational scrutiny, or who is at least dedicated to understanding the work of professionally trained scientists who do, to be a participant in the scientific enterprise.  This openness is very different from the person who is so committed to their understandings that, as a matter of principle, they refuse to let the world say otherwise.  It is also very different from the person who contends that his or her beliefs are informed by observational evidence but who chooses to emphasize only the evidence that is consistent with those beliefs.

Vexingly, it is also very different from some of the particularly smug scientists over in R&D, who are so enamored by the elegance of the ideas they have brainstormed that they find the world, not their ideas, to be in contempt when the fit between the two proves to be poor:
"On occasion, Einstein not only ignored the observational and experimental facts, but he even denied them.  Asked what would be his reaction to observation evidence against the bending of light predicted by his theory of general relativity, he answered, 'Then I would feel sorry for the good Lord.  The theory is correct anyway'"  (Hans C. Ohanian, Einstein’s Mistakes: The Human Failings of Genius, p. 5).
The tension that exists between the quality-control scientists and their colleagues in R&D is well-captured (albeit exaggerated for comedic effect) in the antagonism between The Big Bang Theory’s Dr. Sheldon Cooper (a theoretical physicist, i.e., an R&D guy) and Dr. Leonard Hofstadter (the experimental physicist, i.e., a quality control guy).  More realistically, theoretical and experimental physics are complementary operations, no less than any other scientific discipline's quality control and R&D divisions (see here for a real theoretical physicist's perspective on the matter).  I will have much more to say about the operations of the R&D division in my next post.

What is the outcome of such scrutiny?  Possibly, the failure of the idea under investigation.  The quality control operation, as I mentioned, is a subtractive one, though to be more accurate, it is a non-additive one: at the end of the operation, no new idea has been added; one has either been retained or eliminated.  Not that we should think that the dismissal of ideas is a bad thing; if we have rid ourselves of an idea, it is only that we have gotten rid of a demonstrably bad one, "vanquished the impossible" as Carl Sagan has said (though "vanquished the improbable" is a better way of putting it).  And the virtue of this elimination is amplified by the fact that it also clears up space for better beliefs.

But what if the scrutiny "fails" to defeat the idea?  On the one hand, ideas that don't fall to scrutiny start to look pretty good, all the more so the longer they stand up to scrutiny.  This is how scientists transform a practice focused on scrutiny to one capable of lending support.  On the other hand, such success should not be confused with proof.  "The hypothesis is consist with the evidence" is too weak a support to constitute an incontestable proof, so our uncertainty about the idea necessarily lingers.  Most scientists will be the first to admit that they are not in the business of proving anything, and those who do choose to use the word 'proof' either mean something different by it than 'incontestable proof' or they misunderstand the limits of their own methodology, or worse still, they are con men charading as scientists.  Most scientists would instead say that any hypothesis that has withstood scrutiny up to the present should be provisionally included as an item of standing knowledge (referring back to my earlier assertion that current definitions of knowledge are more inclusive than the stringently high standards imposed by Platonic epistemology), ever vulnerable to future scrutiny and to the risk of defeat that such entails.  By implication, we can say that it is possible to know something that is wrong, and by extension that we can know something today because it has been well-supported up to the present that we might know no longer tomorrow, once its support has been pulled out from under it.

Scrutiny based on observation is an imperfect mode of evaluation for another reason, and scientists have never claimed otherwise, but it bears repeating because it is not well enough recognized by the public at large: while remaining open to the possibility of scrutinizing our beliefs makes us all scientists of a sort, we cannot all be great or even good scientists, because not all kinds of observation are equally reliable (accurate or precise); the best ones, I am sorry to say, are technically demanding and expensive to operate.  Indeed, many of the intuitions we live by are informed by our five or so senses, yet these are considerably less reliable than we sometimes like to believe, or else we have subjected our intuitions to only the most casual of scrutiny using them.  As a wearer of glasses since age 8, I am keenly aware of the limitations of my own sense of vision, and even if I trusted it, I doubt that I ever would have come to the conclusion on my own that heavier and lighter objects fall at the same speed, all else being equal.  So, in order to improve the quality of the observations we use, we also have to scrutinize the quality of the observational methods we use to generate them.  To this end, some scientists dedicate their entire careers to identifying better and worse modes of observation.  Unfortunately, due caution regarding the limitations of science's observational methods is not always clearly conveyed to the public in the popular media.  For example, while media coverage of a recent re-measurement of the height of Denali suggests that it has shrunk by 83 ft. (25 m) over the last six decades (see also here), little attention has been paid to the possibility that this change is the result of imprecision inherent in the various methods used to estimate the mountain’s height.

In thinking in such great detail about the quality dimension of science, there are two mistakes that we should avoid making at all costs.  The first is lumping together untested ideas and bad ones.  Again, what makes an idea bad is its poor fit with the world it is supposed to explain, and this quite simply cannot be known until the idea has actually been tested.  Granted, untested ideas are a liability because they may be wrong, but this liability is counterbalanced to the degree that some of them will also eventually turn out to be good guesses.  In fact, if untested ideas were automatically deemed bad by virtue of their untestedness, this would disallow the possibility of ever having a good idea, because all of the good ideas that we have ever held, that we now hold, or that we might ever hold in the future began their lives as untested ideas, too.

The second mistake that we should avoid is the “Gee whiz, Mr. Science!” reflex, by which I mean the inclination to offhandedly dismiss any research that seems to do little more than support ideas that we already think we know.  At first site, such research does seem wasteful; if we knew it already, why not use the time, effort, and funding to explore new horizons instead?  Yet, the appearance of wastefulness is an illusion, one that persists right up until somebody's research reveals the falsehood of some confidently held, previously unexamined belief.  A more appropriate response to research that has demonstrated the "obvious" truths would be one of appreciation, because we no longer have to accept them with such blind faith.

But why abandon old beliefs, especially in favor of new guesses?

Okay, so science is in the business of snooping out ideas that seem to fit poorly with the world they are supposed to illuminate and of recommending these ones for termination, but again, the question is not so much whether we can scrutinize or refute beliefs but why we would ever want to do so.  Granted, for many the answer is no more complicated than a desire to possess only the highest-quality beliefs available; their appetite for belief is conditional on the quality, not about the quantity.  For others, however, the stakes in giving up beliefs are high enough  the sense of order that their beliefs afford them is salient enough  that the gamble entailed by scientific scrutiny is just too dangerous to accept.

The beliefs that afford a sense of purpose and/or hope for the future are an especially sore subject, and yet science's most outspoken advocates have not been particularly bothered by this matter.  Carl Sagan is well-known for his insistence that there are no ideas important enough to elude its scrutiny.  On the contrary, he said, science is intent on the pursuit of truth no matter where it leads, in other words no matter how psychologically disconcerting its revelations might be.  Likewise, Richard Feynman declared that he is less afraid of doubt than of the prospect of accepting beliefs that might be wrong.  In "vanquishing the impossible" (Sagan again), science is no less likely to scrutinize the hope-filled beliefs, nor to leave them in its wake if found wanting, than any other.

The scientific refusal to compromise on what beliefs we are willing to subject to scrutiny is an understandably unsettling prospect for many, but a few words should be said in rejection of the occasional claim that we are disporportionately invested, therefore persecutoral, in challenging the sacred.  I won't deny that this is a possibility on a small scale; scientists are humans, and this means that individual scientists are capable of dedicating their life's work to the assault on the sacred.  But we are not talking about potential, and for the most part scientists are no more mean-spirited than anyone else.  On the contrary, many of us care a great deal for the well-being of our fellow human beings, and on occasion scientists distress even ourselves by undermining our own sacred beliefs.  Even conceding that a good many sacred beliefs concern cosmic, planetary, and biological origins and that a good many scientists are dedicated to the study of such topics, it cannot be stressed enough that the overwhelming majority of such scientists do so out of sincere curiosity regarding such matters, not because they are spitefully compelled to inflict life-altering emotional trauma upon others, even if it does happen as a side effect.

It would also be wrong to limit our understanding of "important beliefs" to the sacred tenets of religious faith.  If the importance of a belief is measured by the trauma we experience upon its defeat, then it is easy to demonstrate that a good many of them have nothing at all to do with what we would consider sacred, for example this amusing anecdote from "The West Wing" (a fictional one, but one that probably feels familiar to many):


(In fact, no cartographic projection is a perfectly accurate representation of the Earth's or any other celestial body's surface, because all of them are equally guilty of the crime of representing spheroid surfaces as flat ones.  My favorite mind-blowing projections are the azimuthal equidistant projections, like this one centered on Hana, Hawai'i, in which Africa is wrapped around the entire perimeter of the map.)


I am probably not alone in the fact that, as an 8th grader, I was baffled to learn that heavier and lighter objects fall at the same speed as each other, all else being equal.  (Conversely, I am amused by the general indifference of pretty much everyone, mountaineers included, to the demotion of Denali's stature.)

Alternatively, if the importance of a belief is measured by its relevance to our daily lives and decisions, then once again we find many more examples that fall outside the realm of the sacred.  Not surprisingly, the scientific scrutiny of these beliefs is frequently met with much the same zealous fervor and vehement defense as when scientists challenge the sacred  the recent food safety firestorm set off by an NPR story discouraging people from washing their chickens as a matter of good hygiene is an excellent example, with similar revolts lurking just below the surface regarding male circumcision, the safe cooking of pork, and the mixing of hot water and bleach – and yet accusations of persecution are peculiarly absent in such cases (or I have missed them).  Similar revolts are waiting in the wings.

However disinclined we may be to seeing our cherished beliefs defeated, the stakes in continuing to hold onto them may be high, as well.  As a consequence, we often find ourselves confronted by a dilemma of conflicting urgencies: to risk the psychological trauma of being left without previous hope or direction, or to accept the high physical, emotional, or financial tolls resulting from our continued acceptance of the false ones.  As we might expect, we encounter a mixed response among religious communities when it comes to the scrutiny of sacred dogmas: some certainly experience the scrutiny as persecution, as previously suggested, while others will be too attuned to the perils of embracing untrue beliefs to continue to indulge them with unremittingly blind faith:

(See the Dalai Lama's op-ed piece in the New York Times for the original quote.)

Similarly, while the sense of persecution is considerably diminished when scientists challenge the unreligious beliefs we live by (for example, the belief that washing a raw chicken is "a safer thing to do" than not to), the reception has nonetheless been quite mixed.  I don't wash chicken when I cook it, but apparently some people are really quite bothered that people like me exist.

In any case, it is probably fair to say that we are drawn to the pursuit of better beliefs not because of the intrinsic value of having good ideas but because of the practical value of good ideas.  The folly of embracing a bad idea is perhaps never more clear than when you turn the key to your car and it fails to start.  Is something wrong with the ignition system, or is it a dead battery?  If it is a dead battery, is something wrong with the alternator, is the battery old, or did you just leave the car door ajar overnight?  You begin to panic because you are going to be late to work, and you start considering what to do next to solve your predicament.  Jumping to any conclusion at such an early juncture would be folly; you certainly wouldn't refuse to consider the possibility that it is an ignition problem just because that would be more serious than a dead battery, but you also wouldn't run out and buy a new alternator out of blind faith that it must be an alternator problem.  When it comes to automotive problems, there is no room for sacred truths.

What would you do instead?  If you are inclined to automotive mechanics, you might attempt to diagnose the problem yourself.  Conversely, if you are like me, you would be better served to defer to people with such inclination.  In either case, the most beneficial approach to identifying the problem  not just coming up with any idea about what is wrong with your car, but coming up with a good one  will involve much the same sort of observational scrutiny as scientists advocate:
The "scientific method" is familiar enough so that it can be used intuitively.  In fact, all people, not just scientists, use it regularly.  Just listen to Click and Clack, the mechanics on Car Talk on National Public Radio, as they try to figure out what is causing a 1987 Volvo station wagon to stall unexpectedly as its driver, Bill from Beford, Massachusetts, motors down the highway.  (John Alcock, Animal Behavior 6th ed., p. 11)

Nor are the practical matters that we might address in such a manner limited to the personal ones.  The way that we approach our local, national, and global energy, health and safety, transportation, shelter, and food needs are influenced to a significant degree by our beliefs about them, so we have good reason to employ the best methods of critical thought available to size up our beliefs, including observational scrutiny.

Finally, the blind acceptance of many beliefs provides a potential for our disempowerment, to be exploited by con artists and tyrants.  The textbook example of belief-based exploitation is the 'divine right of kings,' which asserts the divinity or at least divine election of rulers and which has consequently been used to legitimate such rule at least since the dawn of written language (and probably well before it), to the detriment of hundreds of generations of loyal subjects.  In Enlightenment political thought, this belief was eventually replaced by the competing 'self-evident truth' that "all men are created equal," but in the United States at least, the belief in such equality was not legally extended to former slaves or their offspring, to women, or to Native Americans for a century or more.  It has often been observed that knowledge (or, to be more accurate, belief) is power, and those who are able to control it often do so with self-promoting agendas in mind, almost always to the detriment of others.  As Neil Degrasse Tyson has pointed out, our ability to scrutinize such beliefs thus affords us a powerful means to guard against the disempowerment and exploitation that blind faith entails.