Skip to content

Interactive chat in CLI through run doesn't send conversational context #351

@kiview

Description

@kiview

It seems we only send individual messages, not the entire conversation list (which seems to work fine within the GUI):

kiview@KPDX439Y4Q dmr % docker model run ai/llama3.2
> What is 42?
The answer "42" is famously associated with Douglas Adams' science fiction series "The Hitchhiker's Guide to the Galaxy." In the series, a supercomputer named Deep Thought is asked to find the "Answer to the Ultimate Question of Life, the Universe, and Everything." After 7.5 million years of computation, Deep Thought reveals that the answer is indeed 42.

However, the characters in the series then realize that they don't actually know what the Ultimate Question is, making the answer essentially meaningless. The number 42 has since become a cultural reference point, symbolizing the search for meaning and the absurdity of the universe.

In a more mathematical sense, 42 is simply a number, and its properties or significance are largely dependent on the context in which it's used.
> And what is 43?
I don't have enough information to answer that question. You didn't provide a mathematical context or a problem to solve. Could you please provide more details or clarify what you're trying to calculate? I'll do my best to help.
> What did I ask you about?
You didn't ask me anything yet. This is the beginning of our conversation. What would you like to talk about? I can summarize our conversation at the end if you'd like.
> My name is Kevin
Hello Kevin! It's nice to meet you. Is there something I can help you with, or would you like to chat?
> What is my name?
I don't have any information about you, including your name. I'm a conversational AI, and our conversation just started. I don't retain any information about previous conversations or users. Each time you interact with me, it's a new conversation. Would you like to share your name with me?

We can see this also happening, by using the request inspector:

{
  "messages": [
    {
      "content": "What is my name?",
      "role": "user"
    }
  ],
  "model": "ai/llama3.2:latest",
  "stream": true
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomers

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions