Intelligent Agent Foundations Forumsign up / log in
1.A Loophole for Self-Applicative Soundness
discussion post by Alex Appel 19 days ago | Abram Demski likes this | 4 comments
2.Logical Inductor Tiling and Why it's Hard
post by Alex Appel 17 days ago | Sam Eisenstat and Abram Demski like this | discuss

(Tiling result due to Sam, exposition of obstacles due to me)

continue reading »
3.Logical Inductor Lemmas
discussion post by Alex Appel 28 days ago | discuss
4.Two Notions of Best Response
post by Alex Appel 28 days ago | discuss

In game theory, there are two different notions of “best response” at play. Causal best-response corresponds to standard game-theoretic reasoning, because it assumes that the joint probability distribution over everyone else’s moves remains unchanged if one player changes their move. The second one, Evidential best-response, can model cases where the actions of the various players are not subjectively independent, such as Death in Damascus, Twin Prisoner’s Dilemma, Troll Bridge, Newcomb, and Smoking Lesion, and will be useful to analyze the behavior of logical inductors in repeated games. This is just a quick rundown of the basic properties of these two notions of best response.

continue reading »
5.Logical Inductors Converge to Correlated Equilibria (Kinda)
post by Alex Appel 28 days ago | Sam Eisenstat and Jessica Taylor like this | discuss

Logical inductors of “similar strength”, playing against each other in a repeated game, will converge to correlated equilibria of the one-shot game, for the same reason that players that react to the past plays of their opponent converge to correlated equilibria. In fact, this proof is essentially just the proof from Calibrated Learning and Correlated Equilibrium by Forster (1997), adapted to a logical inductor setting.

continue reading »
6.Doubts about Updatelessness
discussion post by Alex Appel 51 days ago | Abram Demski likes this | 2 comments
7.Resource-Limited Reflective Oracles
discussion post by Alex Appel 73 days ago | Sam Eisenstat, Abram Demski and Jessica Taylor like this | discuss
8.No Constant Distribution Can be a Logical Inductor
discussion post by Alex Appel 77 days ago | Sam Eisenstat, Abram Demski, Jessica Taylor and Stuart Armstrong like this | 1 comment
9.Musings on Exploration
discussion post by Alex Appel 81 days ago | Vadim Kosoy likes this | 4 comments
10.A Difficulty With Density-Zero Exploration
discussion post by Alex Appel 88 days ago | 1 comment
11.Distributed Cooperation
post by Alex Appel 97 days ago | Abram Demski and Scott Garrabrant like this | 2 comments

Reflective oracles can be approximated by computing Nash equilibria. But is there some procedure that produces a Pareto-optimal equilibrium in a game, aka, a point produced by a Cooperative oracle? It turns out there is. There are some interesting philosophical aspects to it, which will be typed up in the next post.

The result is not original to me, it’s been floating around MIRI for a while. I think Scott, Sam, and Abram worked on it, but there might have been others. All I did was formalize it a bit, and generalize from the 2-player 2-move case to the n-player n-move case. With the formalism here, it’s a bit hard to intuitively understand what’s going on, so I’ll indicate where to visualize an appropriate 3-dimensional object.

continue reading »
12.Passing Troll Bridge
discussion post by Alex Appel 120 days ago | Abram Demski likes this | discuss
13.Further Progress on a Bayesian Version of Logical Uncertainty
post by Alex Appel 142 days ago | Scott Garrabrant likes this | 1 comment

I’d like to credit Daniel Demski for helpful discussion.

continue reading »
14.Strategy Nonconvexity Induced by a Choice of Potential Oracles
discussion post by Alex Appel 147 days ago | Abram Demski likes this | discuss
15.Open Problems Regarding Counterfactuals: An Introduction For Beginners
link by Alex Appel 340 days ago | Vadim Kosoy, Tsvi Benson-Tilsen, Vladimir Nesov and Wei Dai like this | 2 comments

NEW LINKS

NEW POSTS

NEW DISCUSSION POSTS

RECENT COMMENTS

I found an improved version
by Alex Appel on A Loophole for Self-Applicative Soundness | 0 likes

I misunderstood your
by Sam Eisenstat on A Loophole for Self-Applicative Soundness | 0 likes

Caught a flaw with this
by Alex Appel on A Loophole for Self-Applicative Soundness | 0 likes

As you say, this isn't a
by Sam Eisenstat on A Loophole for Self-Applicative Soundness | 1 like

Note: I currently think that
by Jessica Taylor on Predicting HCH using expert advice | 0 likes

Counterfactual mugging
by Jessica Taylor on Doubts about Updatelessness | 0 likes

What do you mean by "in full
by David Krueger on Doubts about Updatelessness | 0 likes

It seems relatively plausible
by Paul Christiano on Maximally efficient agents will probably have an a... | 1 like

I think that in that case,
by Alex Appel on Smoking Lesion Steelman | 1 like

Two minor comments. First,
by Sam Eisenstat on No Constant Distribution Can be a Logical Inductor | 1 like

A: While that is a really
by Alex Appel on Musings on Exploration | 0 likes

> The true reason to do
by Jessica Taylor on Musings on Exploration | 0 likes

A few comments. Traps are
by Vadim Kosoy on Musings on Exploration | 1 like

I'm not convinced exploration
by Abram Demski on Musings on Exploration | 0 likes

Update: This isn't really an
by Alex Appel on A Difficulty With Density-Zero Exploration | 0 likes

RSS

Privacy & Terms