What is Goodhart’s law?
Goodhart’s law states that when a measure becomes a target, it stops being a good measure. As soon as an indicator is rewarded, behavior optimizes for the indicator rather than for what it was supposed to represent. It bears directly on our subject in two places. First in the attention economy: when engagement becomes the platforms’ objective, it stops measuring how interesting a piece of content is and starts measuring its capacity to provoke. Second for ourselves: if we turned the quality of a debate into a score to be maximized, we would quickly produce debates that optimize the score. It is one of the reasons we remain careful with ratings and rankings, and use them in a measured way.