by Owen Cotton-Barratt 190 days ago | link | parent I think the double decrease effect kicks in with uncertainty, but not with confident expectation of a smaller network.

 by Stuart Armstrong 187 days ago | link I think it does do the double decrease for the known smaller network. Take three agent $$A_1$$, $$A_2$$, and $$A_3$$, with utilities $$u_1$$, $$u_2$$, and $$u_3$$. Assume the indexes $$i$$, $$j$$, and $$k$$ are always distinct. For each $$A_i$$, they can boost $$u_j$$ at the cost described above in terms of $$u_i$$. What I haven’t really specified is the three-way synergy - can $$A_i$$ boost $$u_j+u_k$$ more efficiently that simply boosting $$u_j$$ and $$u_k$$ independently? In general yes (the two utilities $$u_j$$ and $$u_k$$ are synergistic with each other, after all), but let’s first assume there is zero three-way synergy. Then each agent $$A_i$$ will sacrifice $$1/2+1/2=1$$ in $$u_i$$ to boost $$u_j$$ and $$u_k$$ each by $$1$$. Overall, each utility function goes up by $$1+1-1=1$$. This scales linearly with the size of the trade network each agent sees (excluding themselves): if there were two agents total, each utility would go up by $$1/2$$, as in the top post example. And if there were $$n+1$$ agents, each utility would go up by $$n/2$$. However, if there are any three-way, four-way,…, or $$n$$-way synergies, then the trade network is more efficient than that. So there is a double decrease (or double increase, from the other perspective), as long as there are higher-order synergies between the utilities. reply

### NEW DISCUSSION POSTS

Indeed there is some kind of
 by Vadim Kosoy on Catastrophe Mitigation Using DRL | 0 likes

Very nice. I wonder whether
 by Vadim Kosoy on Hyperreal Brouwer | 0 likes

Freezing the reward seems
 by Vadim Kosoy on Resolving human inconsistency in a simple model | 0 likes

Unfortunately, it's not just
 by Vadim Kosoy on Catastrophe Mitigation Using DRL | 0 likes

>We can solve the problem in
 by Wei Dai on The Happy Dance Problem | 1 like

Maybe it's just my browser,
 by Gordon Worley III on Catastrophe Mitigation Using DRL | 2 likes

At present, I think the main
 by Abram Demski on Looking for Recommendations RE UDT vs. bounded com... | 0 likes

In the first round I'm
 by Paul Christiano on Funding opportunity for AI alignment research | 0 likes

Fine with it being shared
 by Paul Christiano on Funding opportunity for AI alignment research | 0 likes

I think the point I was
 by Abram Demski on Predictable Exploration | 0 likes

(also x-posted from
 by Sören Mindermann on The Three Levels of Goodhart's Curse | 0 likes

(x-posted from Arbital ==>
 by Sören Mindermann on The Three Levels of Goodhart's Curse | 0 likes

>If the other players can see
 by Stuart Armstrong on Predictable Exploration | 0 likes