Missing "patch_client" for bedrock-agent-runtime

[ChuckJonas]

There is currently no patch for the Bedrock Agent Runtime bota3 SDK.

This is where many of the higher level abstractions live that make it easy to build RAG and Agents. Right now it seems like we don't get any tracking on the model, tokens, etc.

from weave.integrations.bedrock.bedrock_sdk import patch_client

client = boto3.client("bedrock-agent-runtime", region_name="us-east-2")
patch_client(client)  // AttributeError: 'AgentsforBedrockRuntime' object has no attribute 'converse'

[scottire]

Hi Chuck, thanks for raising this issue. There's a WIP to support the Bedrock Agent Runtime via Open Telemetry. We will close this issue once that's complete and link the docs.

[tcapelle]

Hello @ChuckJonas ,

We are working on OTEL support for Bedrock Agents, it actually works already if you are willing to setup the instrumentation:
https://github.com/tcapelle/amazon-bedrock-agent-samples/tree/main/examples/agent_observability/OpenTelemetry-Agent-Instrumentation

We are working with the bedrock team to land an example in there.

[tcapelle]

Ok, managed to pull together something here: #3802

Can you give it a spin @ChuckJonas by installing from the bedrock-agents brach?

pip install git+https://github.com/wandb/weave.git@bedrock-agents

[ChuckJonas]

@tcapelle epic, thanks for the fast response.

Do I follow the OTEL setup instructions from your first message? Or is there a more straightforward setup now?

Update

Nvm, I peaked in the code and it seem like with this change, we should now just be able to use patch_client on the bedrock-agent-runtime:

from weave.integrations.bedrock.bedrock_sdk import patch_client

client = boto3.client("bedrock-agent-runtime", region_name="us-east-2")
patch_client(client)

Will test and let you know how it goes 👍

[ChuckJonas]

@tcapelle so the code is patch_client is working 💯

but...

It seems like the method I'm primarly using wasn't implemented. How hard would it be add in [retrieve_and_generate](https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/bedrock-agent-runtime/client/retrieve_and_generate.html)?

Ideally we would get tokens and cost, but I'm not sure there is usage information in the response.

[ChuckJonas]

@tcapelle any chance of merging this in (even without the full functionality)? I'm now getting errors I'm on a legacy version

weave version 0.51.53-dev0 has been retired! Please upgrade.