Viewing a single comment thread. View all comments

MetaAI_Official OP t1_izfhgd0 wrote

Reply to comment by MetaAI_Official in [D] We're the Meta AI research team behind CICERO, the first AI agent to achieve human-level performance in the game Diplomacy. We’ll be answering your questions on December 8th starting at 10am PT. Ask us anything! by MetaAI_Official

As Andrew has said, Diplomacy is less about lying and more about trust-building than beginners typically think. Of course, there are times when some amount of lying may be the best strategy. One reason that CICERO did not use deception effectively - and why we abandoned it - is that it wasn't very good at reasoning about the long-term cost of lying, i.e. knowing exactly how much a particular lie would hurt its ability to cooperate with the other player in the future. We're not really interested in building lying AIs, but being able to understand the long-term consequences of one's actions on other people's behavior is an interesting research direction! -AL

6

Thorusss t1_izfsiut wrote

>We're not really interested in building lying AIs

Why? Child psychology sees lies as an important development step in the theory of mind - the insight that knowledge is not universal.

In real world applications, AI might encounter lies. Do you think these systems can be deal with that as good, when they are not themselves capable of it? E.g. for planning, you have the model the other side, how do you model lying successfully, when you cannot lie?

5