Intelligent Agent Foundations Forumsign up / log in
by Abram Demski 200 days ago | link | parent

Regret Theory with General Choice Sets by John Quiggen is a generalization of DT of more the sort I was initially hoping to produce. It doesn’t try to justify probability theory (it assumes it). Like me, it considers sets of options rather than only binary choices. Unlike me, it requires that if the bookie makes sequential offers, the bookie must keep all previously-given offers in the set (where I only require the bookie to keep the option which the agent chooses). This blocks the money-pump argument for transitivity, but still allows significant constraints on preferences to be argued by money-pump.

The result of this modification to the setup is that the agent can have many different utility functions which are used for different choice-sets. The condition on this is that the utility function must stay the same whenever the “best achievable outcome” is the same. (Best see the paper for that notion.)



NEW LINKS

NEW POSTS

NEW DISCUSSION POSTS

RECENT COMMENTS

Indeed there is some kind of
by Vadim Kosoy on Catastrophe Mitigation Using DRL | 0 likes

Very nice. I wonder whether
by Vadim Kosoy on Hyperreal Brouwer | 0 likes

Freezing the reward seems
by Vadim Kosoy on Resolving human inconsistency in a simple model | 0 likes

Unfortunately, it's not just
by Vadim Kosoy on Catastrophe Mitigation Using DRL | 0 likes

>We can solve the problem in
by Wei Dai on The Happy Dance Problem | 1 like

Maybe it's just my browser,
by Gordon Worley III on Catastrophe Mitigation Using DRL | 2 likes

At present, I think the main
by Abram Demski on Looking for Recommendations RE UDT vs. bounded com... | 0 likes

In the first round I'm
by Paul Christiano on Funding opportunity for AI alignment research | 0 likes

Fine with it being shared
by Paul Christiano on Funding opportunity for AI alignment research | 0 likes

I think the point I was
by Abram Demski on Predictable Exploration | 0 likes

(also x-posted from
by Sören Mindermann on The Three Levels of Goodhart's Curse | 0 likes

(x-posted from Arbital ==>
by Sören Mindermann on The Three Levels of Goodhart's Curse | 0 likes

>If the other players can see
by Stuart Armstrong on Predictable Exploration | 0 likes

Thinking about this more, I
by Abram Demski on Predictable Exploration | 0 likes

> So I wound up with
by Abram Demski on Predictable Exploration | 0 likes

RSS

Privacy & Terms