Side-questions
planned
S
Steven Menke
I often want to ask clarification or dive deeper on part of a response. I would like to be able to create a quick side/sub-thread - without losing the main thread. I for sure don't want to send the whole context (which is often 100K+) just the response I'm asking a specific follow-up on.
damoon azarpazhooh
Why doesnt fork work for you ?
I think the only possibke way to do this if you dont want to use fork is through the assistant api which i think only openai supports.
From what i recall, /v1/chat/completion endpoint does not have the concept of memory so you cant start a new thread and expect it to remember , which means for every message you send that endpoint , you have to include the entire conversation history . Claude is the exception here as it has promot caching. I think Gemini on Vertex AI also has this feature
nazimansari
Yes wonderful feature.
Tony Dinh
planned
S
Steven Menke
After thinking about it some more. This is the UX flow I would like:
Initiate side question:
- Select text--> right-click --> side question with selected text --> in new side-chat: option to include whole previous message (as 'previous message' just like when responding to emails) OR just selected text
- Right-clickanywhere in the message --> new side-chat with this message
- Menu-optionin the 'extra (3 dots) menu' on bottom-right of message.
Side question chat:
Either simple or complex
- simpleoverlay of existing chat thread. Easy to dismiss. Exact same UX as regular chat with exact same options set as parent-thread. Just overlaid.
- complex: subthread UX like with Slack.
- Delete/KeepOption to 'keep side-chat as regular chat' --> add it to the chatlist on the left.
J
Jpsala
Sounds like I would use something like this often
S
Stef Becker
Very useful. I often experience the same need, leading to chats that blow out of proportion.