OLS · Robustness

Specification Searching

Trying many unplanned models until one produces a preferred result weakens the evidential claim.

Page 1 of 7 · Big Picture

The big picture: Specification Searching

When does model comparison become specification searching?

Why a policy analyst should care

Trying many defensible-looking models until one gives a desired result converts uncertainty about analysis choices into overstated evidence.

Follow the idea from the opening question to a practical decision. These are the conceptual moves this module will develop:

1 Question When does model comparison become specification searching?
2 Explore See how silent choices multiply
3 Formalize Separate planned alternatives from searching
4 Transfer Audit a preferred result

Use the left and right arrow keys to move between pages.