I deployed the Qwopus3.5-9B-Coder-MTP-Q8_0.gguf model using the Lllama server. How can I disable thinking in ChatClientAgent?
var ExpansionUrl = new Uri("http://127.0.0.1:8080");
var openAIOptionsExpansion = new OpenAIClientOptions
{
Endpoint = ExpansionUrl
};
var openAIClientExpansion = new OpenAIClient(
credential: new ApiKeyCredential("123"),
options: openAIOptionsExpansion
);
_agentExpansion = openAIClientExpansion.GetChatClient("Qwopus3.5-9B-Coder-MTP-Q8_0").AsAIAgent(new ChatClientAgentOptions
{
Name = "LeadAgent",
ChatOptions = new ChatOptions
{
Instructions = AppConstants.SystemPromptExpansion,
Reasoning = new() { Effort = ReasoningEffort.None }//Doesn't work
},
});
Description
I deployed the Qwopus3.5-9B-Coder-MTP-Q8_0.gguf model using the Lllama server. How can I disable thinking in ChatClientAgent?
Code Sample
var ExpansionUrl = new Uri("http://127.0.0.1:8080"); var openAIOptionsExpansion = new OpenAIClientOptions { Endpoint = ExpansionUrl }; var openAIClientExpansion = new OpenAIClient( credential: new ApiKeyCredential("123"), options: openAIOptionsExpansion ); _agentExpansion = openAIClientExpansion.GetChatClient("Qwopus3.5-9B-Coder-MTP-Q8_0").AsAIAgent(new ChatClientAgentOptions { Name = "LeadAgent", ChatOptions = new ChatOptions { Instructions = AppConstants.SystemPromptExpansion, Reasoning = new() { Effort = ReasoningEffort.None }//Doesn't work }, });Language/SDK
Both