Chen, Daniel L. and Schonger, Martin (2023) Invariance of Equilibrium to the Strategy Method II: Experimental Evidence. Journal of the Economic Science Association.

Abstract

The strategy method (SM) is, in practice, subject to a possibly severe economic-theoretical bias. Although many studies utilize SM to examine responses to rare or off-equilibrium behaviors unattainable through direct elicitation (DE), they ignore the fact that the strategic equivalence between SM and DE holds for the monetary payoff game but not the game participants actually play, which is in terms of utilities. We report three results. First, failing to account for estimation bias when decisions at one information set can influence utility at another may result in significant differences in decision-making. Second, the magnitude of this bias can be substantial, comparable to other measured treatment effects. Third, minor interventions targeting salience can amplify these differences similarly, causing treatment effects to differ significantly between SM and DE, even reversing in direction. These findings emphasize the need for reconsideration of the SM’s reliability for economic research.