There are still important disanalogies between our current empirical setup and the ultimate problem of aligning superhuman models. For example, it may be ...