Skip to content

[Feature]: Net: I deployed the Qwopus3.5-9B-Coder-MTP-Q8_0.gguf model using the Lllama server. How can I disable thinking in ChatClientAgent? #6102

@williamlzw

Description

@williamlzw

Description

I deployed the Qwopus3.5-9B-Coder-MTP-Q8_0.gguf model using the Lllama server. How can I disable thinking in ChatClientAgent?

Code Sample

var ExpansionUrl = new Uri("http://127.0.0.1:8080");
var openAIOptionsExpansion = new OpenAIClientOptions
{
    Endpoint = ExpansionUrl
};
var openAIClientExpansion = new OpenAIClient(
      credential: new ApiKeyCredential("123"),
      options: openAIOptionsExpansion
  );
_agentExpansion = openAIClientExpansion.GetChatClient("Qwopus3.5-9B-Coder-MTP-Q8_0").AsAIAgent(new ChatClientAgentOptions
{
    Name = "LeadAgent",
    ChatOptions = new ChatOptions
    {
        Instructions = AppConstants.SystemPromptExpansion,
        Reasoning = new() { Effort = ReasoningEffort.None }//Doesn't work
    },
});

Language/SDK

Both

Metadata

Metadata

Assignees

No one assigned

    Labels

    No fields configured for Feature.

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions