Using agent API to call tools manually

[ghita]

I try to use the agent API to control calling of the tools like this:

// Made before: { FunctionChoiceBehavior = FunctionChoiceBehavior.Auto( autoInvoke: false) }
while (true)
{
    await foreach (var response in agent.InvokeAsync(message, thread))
    {
        WriteAgentChatMessage(response);
        // Get the function calls from the response
        var functionCalls = FunctionCallContent.GetFunctionCalls(response);
        if (!functionCalls.Any())
        {
            // No function calls, break out of the loop
            // TODO: Check if the response is complete
            return;
        }

        foreach (var functionCall in functionCalls)
        {
            // Invoking the function
            FunctionResultContent resultContent = await functionCall.InvokeAsync(agent.Kernel);
            Console.WriteLine($"Function result: {resultContent.Result}");
        }
    }
}

Something seems to be broken about this and not sure what. ( functionCall.InvokeAsync(agent.Kernel) is a little odd)

[ghita]

Just to give more details, in the existing API I use (see provided code) I am not sure if the way to call the FunctionResultContent is the right one. How can I make sure the function call result is added the the agent history/thread ? Is the provided code the right way to add to a conversation and be able to pick up what was the function invocation response at each step ?

[ghita]

Trying another approach using agent API with

Kernel CreateKernelWithFilters()
{
    IKernelBuilder builder = Kernel.CreateBuilder();
    builder.AddAzureOpenAIChatCompletion(deploymentName: "gpt-4o-mini",
                endpoint: endpoint!,
                apiKey: apiKey!);

    // Add the same chat completion service to the new kernel.
    builder.Services.AddSingleton<IAutoFunctionInvocationFilter>(new AutoFunctionInvocationFilter());

    return builder.Build();
}

But when I construct the agent with Kernel = CreateKernelWithFilters() I break all automatic function calling - nothing works anymore. I just want to have a filter so I can watch for the function calls

[markwallace-microsoft]

@crickman can you suggest the correct way to achieve this?

[crickman]

Hi @ghita, I'll need to explore the dynamics around this since we've updated the invocation pattern to use AgentThread. Will respond with more information over the next day.