Viewing a single comment thread. View all comments

[deleted] t1_jak7jf3 wrote

42

qqYn7PIE57zkf6kn t1_japrx5u wrote

What does system message mean?

1

earslap t1_jb0qamw wrote

When you feed messages into the API, there are different "roles" to tag each message ("assistant", "user", "system"). So you provide content and tell it from which "role" the content comes from. The model continues from there using the role "assistant". There is a token limit (limited by the model) so if your context exceeds that (combined token size of all roles), you'll need to inject salient context from the conversation using the appropriate role.

2