Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Context doesn't work anymore #2613

Open
BlyZeDev opened this issue Jan 26, 2025 · 3 comments
Open

Context doesn't work anymore #2613

BlyZeDev opened this issue Jan 26, 2025 · 3 comments
Assignees
Labels
bug Something isn't working

Comments

@BlyZeDev
Copy link

Bug description
All AI's I tested don't work with context anymore.
I give the whole message context using the messages json property.

ex.

  1. Have a chat history
  2. Ask the first message ever send / continue after an unfinished message
  3. Doesn't know the first message / Explains me the continue keyword in Java and C

Environment

  • Python 3.11.2
  • Germany

Additional context
It worked some versions ago (can't recall which broke it)

@BlyZeDev BlyZeDev added the bug Something isn't working label Jan 26, 2025
@hlohaus
Copy link
Collaborator

hlohaus commented Jan 26, 2025

If you enable debug mode, do you see logs for strip messages?
Which provider and models are you using?
Have you disabled Conversation History in the UI settings?

@BlyZeDev

@BlyZeDev
Copy link
Author

BlyZeDev commented Jan 26, 2025

I don't know how to go into debug mode.
I tried with many some of them are DDG - gpt-4o-mini, PollinationsAI - gpt-4o-mini, Blackbox - gpt-4o-mini.
I use the API endpoint http://localhost:1337/v1/chat/completions with this json style:

var messages = new List<AIChatMessage>
{
    new AIChatMessage
    {
        Role = "system",
        Content = SystemMessage
    }
};

await foreach (var message in history)
{
    messages.Add(message);
}

messages.Add(new AIChatMessage
{
    Role = "user",
    Content = prompt
});

var postJson = JsonConvert.SerializeObject(new AIChatRequest
{
    Messages = messages,
    Model = model,
    Provider = provider,
    WebSearch = true,
    Temperature = 0.5f,
    HistoryDisabled = true,
    Stream = false,
    MaxTokens = 400,
    AutoContinue = true,
    Timeout = (int)(_http.Timeout.TotalSeconds * 0.75)
});

@BlyZeDev
Copy link
Author

Also tried using gemini-1.5-pro from AIChatFree. Doesn't work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants