I know that some like Character.AI get trained a bit through conversation now. The AIs I’ve made seem to learn some behaviours after a long conversation that get pulled in to new chats. Like if I tell it to speak in a certain way and keep reinforcing that in one chat then when I start a new one it’ll keep it up despite having no memory of being explicitly told to act that way.