Custom Model + Copilot Metrics API

[monil-patel]

We setup a specific EMU organization with a custom model for this pilot before applying to our company wide one.

OrgA = standard model // this is where all employees get a seat from
OrgB = custom model // We selectively are adding people here to try out the model

If a given user has a copilot seat from OrgA and OrgB how does this impact the Copilot Metrics API?

• UserA was a part of OrgA and was using the standard model
• UserA is onboarded onto OrgB and now using the custom model
• Would the metrics API response for OrgA still continue to pick up UsersA telemetry? Or are they only represented in OrgB?

We are interested in comparing Metrics between OrgA and OrgB in order to see how much the model improves. Any suggestions for the team on this?