Testing the validity of the Diff-in-Diff design when treatment timing varies (done rigorously)

Sharing a very interesting new paper on DiD methods when used with heterogeneous treatment effects:

Andrew Goodman-Bacon, 2018. Differences-in-Differences with Variation in Treatment Timing, Working Paper.

The paper shows how (and when) a DiD estimator can be decomposed as a weighted average of 4 simple and intuitive “2×2” average causal effects. Some of these effects may have negative “weights” which arise because already-treated units sometimes act as controls, leading to a biased DiD estimator. Hence, DiD estimates can be too small (or even wrong-signed!). The author notes that “this does not imply a failure of the underlying design, but it does caution against the use of a single-coefficient two-way fixed effects specification to summarize time-varying effects”. Several implications for the intuition, theory and practice of this well-known econometric method are discussed.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s