Friday, February 4, 2011

ecnomies Restrictive, unrealistic assumptions

 Pitfalls

I only varied one assumption -- the assumption concerning perfect information -- and in ways which seemed highly plausible. ... We succeeded in showing not only that the standard theory was not robust -- changing only one assumption in ways which were totally plausible had drastic consequences, but also that an alternative robust paradigm with great explanatory power could be constructed. There were other deficiencies in the theory, some of which were closely connected. The standard theory assumed that technology and preferences were fixed. But changes in technology, R & D, are at the heart of capitalism. ... I similarly became increasingly convinced of the inappropriateness of the assumption of fixed preferences. (Footnote: In addition, much of recent economic theory has assumed that beliefs are, in some sense, rational. As noted earlier, there are many aspects of economic behavior that seem hard to reconcile with this hypothesis.)"
Economic models can be such powerful tools in understanding some economic relationships, that it is easy to ignore their limitations. One tangible example where the limits of Economic Models collided with reality, but were nevertheless accepted as "evidence" in public policy debates, involved models to simulate the effects of NAFTA, the North American Free Trade Agreement. James Stanford published his examination of 10 of these models.
The fundamental issue is circularity: embedding one's assumptions as foundational "input" axioms in a model, then proceeding to "prove" that, indeed, the model's "output" supports the validity of those assumptions. Such a model is consistent with similar models that have adopted those same assumptions. But is it consistent with reality? As with any scientific theory, empirical validation is needed, if we are to have any confidence in its predictive ability.
If those assumptions are, in fact, fundamental aspects of empirical reality, then the model's output will correctly describe reality (if it is properly "tuned", and if it is not missing any crucial assumptions). But if those assumptions are not valid for the particular aspect of reality one attempts to simulate, then it becomes a case of "GIGO" -- Garbage In, Garbage Out".
James Stanford outlines this issue for the specific Computable General Equilibrium ("CGE") models that were introduced as evidence into the public policy debate, by advocates for NAFTA:
"..CGE models are circular: if trade theory holds that free trade is mutually beneficial, then a quantitative simulation model based on that theoretical structure will automatically show that free trade is mutually beneficial...if the economy actually behaves in the manner supposed by the modeler, and the model itself sheds no light on this question, then a properly calibrated model may provide a rough empirical estimate of the effects of a policy change. But the validity of the model hangs entirely on the prior, nontested specification of its structural relationships ... [Hence, the apparent consensus of pro-NAFTA modelers] reflects more a consensus of prior theoretical views than a consensus of quantitative evidence."
Commenting on Stanford's analysis, one computer scientist wrote,
"When simulating the impact of a trade agreement on labor, it seems absurd to assume a priori that capital is immobile, that full employment will prevail, that unit labor costs are identical in the U.S. and Mexico, that American consumers will prefer products made in America (even if they are more expensive), and that trade flows between the U.S. and Mexico will exactly balance. Yet a recent examination of ten prominent CGE models showed that nine of them include at least one of those unrealistic assumptions, and two of the CGE models included all the above assumptions.
This situation bears a disturbing resemblance to computer-assisted intellectual dishonesty. Human beings have always been masters of self-deception, and hiding the essential basis of one's deception by embedding it in a computer program surely helps reduce what might otherwise become an intolerable burden of cognitive dissonance."
In commenting on the general phenomenon of embedding unrealistic "GIGO" assumptions in neoclassical economic models, Nobel prizewinner Joseph Stiglitz is only slightly more diplomatic: (p. 507-8)
"But the ... model, by construction, ruled out the information asymmetries which are at the heart of macro-economic problems. Only if an individual has a severe case of schizophrenia is it possible for such problems to arise. If one begins with a model that assumes that markets clear, it is hard to see how one can get much insight into unemployment (the failure of the labor market to clear)."
Despite the prominence of Stiglitz' 2001 Nobel prize lecture, the use of (perhaps intentionally-) misleading neoclassical models persisted in 2007, according to these authors:
" ... projected welfare gains from trade liberalization are derived from global computable general equilibrium (CGE) models, which are based on highly unrealistic assumptions. CGE models have become the main tool for economic analysis of the benefits of multilateral trade liberalization; therefore, it is essential that these models be scrutinized for their realism and relevance. ... we analyze the foundation of CGE models and argue that their predictions are often misleading. ... We appeal for more honest simulation strategies that produce a variety of plausible outcomes."
The working paper, "Debunking the Myths of Computable General Equilibrium Models", provides both a history, and a readable theoretical analysis of what CGE models are, and are not. In particular, despite their name, CGE models use neither the Walrass general equilibrium, nor the Arrow-Debreus General Equilibrium frameworks. Thus, CGE models are highly-distorted simplifications of theoretical frameworks—collectively called "the neoclassical economic paradigm" -- which—themselves—were largely discredited by Joseph Stiglitz.
In the "Concluding Remarks" (p. 524) of his 2001 Nobel Prize lecture, Stiglitz examined why the neoclassical paradigm—and models based on it—persists, despite his publication, over a decade earlier, of some of his seminal results showing that Information Asymmetries invalidated core Assumptions of that paradigm and its models:
"One might ask, how can we explain the persistence of the paradigm for so long? Partly, it must be because, in spite of its deficiencies, it did provide insights into many economic phenomena. ... But one cannot ignore the possibility that the survival of the [neoclassical] paradigm was partly because the belief in that paradigm, and the policy prescriptions, has served certain interests."
In the aftermath of the 2007-2009 global economic meltdown, the profession's attachment to unrealistic models is increasingly being questioned and criticized. After a weeklong workshop, one group of economists released a paper highly critical of their own profession's unethical use of unrealistic models. Their Abstract offers an indictment of fundamental practices:
"The economics profession appears to have been unaware of the long build-up to the current worldwide financial crisis and to have significantly underestimated its dimensions once it started to unfold. In our view, this lack of understanding is due to a misallocation of research efforts in economics. We trace the deeper roots of this failure to the profession’s focus on models that, by design, disregard key elements driving outcomes in real-world markets. The economics profession has failed in communicating the limitations, weaknesses, and even dangers of its preferred models to the public. This state of affairs makes clear the need for a major reorientation of focus in the research economists undertake, as well as for the establishment of an ethical code that would ask economists to understand and communicate the limitations and potential misuses of their models."

No comments:

Post a Comment