include_in_function_choices but for plugin Output

[FlorianPydde]

Hi,
I am creating an Agentic Rag agent based on the chatcompletionagent in python. In short, I would like to be able to trace input/outputs in the ChatHistoryAgentThread while hiding/masking input AND outputs to the LLM.

Thanks to the include_in_function_choices I can leverage the KernelArguments object to send arguments to pluging functions without having the LLM to generate the values for these arguments. Additionalyl, I can review all the inputs to the functions since they are traced stored in ChatHistoryAgentThread which is fantastic for debugging.

Now here comes the challenge: when I am retrieving the information from my search engine, I want to remove most metadata (chunk_id, embedding value, etc) before sending it to the LLM. However I need to know the id of the chunks for evaluation purposes, i.e. did the search engine retrieve the correct chunks and in which order.

So when returning values from the functions, it would be great to mask/hide some values from the LLM while keeping it part of the thread history, like what we do with the KernelArguments for inputs.

Do you have any recommendation for achieving this ?

Thanks for your support.