by Owen Cotton-Barratt 12 days ago | link | parent I think the double decrease effect kicks in with uncertainty, but not with confident expectation of a smaller network.

 by Stuart Armstrong 9 days ago | link I think it does do the double decrease for the known smaller network. Take three agent $$A_1$$, $$A_2$$, and $$A_3$$, with utilities $$u_1$$, $$u_2$$, and $$u_3$$. Assume the indexes $$i$$, $$j$$, and $$k$$ are always distinct. For each $$A_i$$, they can boost $$u_j$$ at the cost described above in terms of $$u_i$$. What I haven’t really specified is the three-way synergy - can $$A_i$$ boost $$u_j+u_k$$ more efficiently that simply boosting $$u_j$$ and $$u_k$$ independently? In general yes (the two utilities $$u_j$$ and $$u_k$$ are synergistic with each other, after all), but let’s first assume there is zero three-way synergy. Then each agent $$A_i$$ will sacrifice $$1/2+1/2=1$$ in $$u_i$$ to boost $$u_j$$ and $$u_k$$ each by $$1$$. Overall, each utility function goes up by $$1+1-1=1$$. This scales linearly with the size of the trade network each agent sees (excluding themselves): if there were two agents total, each utility would go up by $$1/2$$, as in the top post example. And if there were $$n+1$$ agents, each utility would go up by $$n/2$$. However, if there are any three-way, four-way,…, or $$n$$-way synergies, then the trade network is more efficient than that. So there is a double decrease (or double increase, from the other perspective), as long as there are higher-order synergies between the utilities. reply

### NEW DISCUSSION POSTS

The "benign induction
 by David Krueger on Why I am not currently working on the AAMLS agenda | 0 likes

This comment is to explain
 by Alex Mennen on Formal Open Problem in Decision Theory | 0 likes

Thanks for writing this -- I
 by Daniel Dewey on AI safety: three human problems and one AI issue | 1 like

I think it does do the double
 by Stuart Armstrong on Acausal trade: double decrease | 0 likes

>but the agent incorrectly
 by Stuart Armstrong on CIRL Wireheading | 0 likes

I think the double decrease
 by Owen Cotton-Barratt on Acausal trade: double decrease | 0 likes

The problem is that our
 by Scott Garrabrant on Cooperative Oracles: Nonexploited Bargaining | 1 like

Yeah. The original generator
 by Scott Garrabrant on Cooperative Oracles: Nonexploited Bargaining | 0 likes

I don't see how it would. The
 by Scott Garrabrant on Cooperative Oracles: Nonexploited Bargaining | 1 like

Does this generalise to
 by Stuart Armstrong on Cooperative Oracles: Nonexploited Bargaining | 0 likes

>Every point in this set is a
 by Stuart Armstrong on Cooperative Oracles: Nonexploited Bargaining | 0 likes

This seems a proper version
 by Stuart Armstrong on Cooperative Oracles: Nonexploited Bargaining | 0 likes

This doesn't seem to me to
 by Stuart Armstrong on Change utility, reduce extortion | 0 likes

[_Regret Theory with General
 by Abram Demski on Generalizing Foundations of Decision Theory II | 0 likes

It's not clear whether we
 by Paul Christiano on Infinite ethics comparisons | 1 like