Context Limit: First message
P
Philipp Stracker
Instead of only allowing "Last X messages", I want to set context to "First message". That way, the first message I enter can be used as a context for any follow-up query I send to the AI
Alternative: Add a new select list with options "First X messages" to keep the first and last part of the context. This could allow the AI to
- Forget the first part of a longer conversation (using only "Last X messages")
- Forget the last part of a longer conversation (using only "First X messages")
- Forget the middle part of a longer conversation (using both options)
a
yeah similarly, i was thinking "pinned" messages in the chat can be sent always since they can have context (like the first message)
N
Ngoc Nguyen
For First message, can you add it to system instruction, this will help remember the context too?
P
Philipp Stracker
Ngoc Nguyen thanks for the suggestion. That's what I'm doing right now, but it means that I regularly need to update the system message:
One agent where I'd like to implement this is a "classify and organize into one of the provided folders" type agent.
When I change or add a folder to the list, I need to update the system message, but I'd rather change this to something like "use the folders from the next message".
Then the system message would be constant a, and I can paste a folder list into the first message, then paste one file/document, let it classify that document, paste the next document, and so on. The agent would always see system message + first message + the last (document) and nothing else.
Additionally, I can scroll up to verify if the folder list is still current, or if I need to start a new chat.