Currently, when end users submit feedback (thumbs up/down reactions, along with their comments) on responses from the out-of-the-box Dynamics 365 Sales Copilot agents — including the Sales Qualification Agent, Sales Opportunity Agent, Sales Close Agent, Sales Research Agent, and Recommended Actions Agent — this data is sent directly to Microsoft for internal engineering use only. It is not surfaced to tenant administrators or makers in any way.
This is in contrast to custom agents built in Copilot Studio, where Reaction Analytics are available and show the full picture: the reaction, the question asked, the answer given, and the user's comment.
This creates a significant gap for organizations rolling out these OOB agents. As administrators, we're responsible for tracking usage, user adoption, and overall effectiveness of Copilot within our environment — but without visibility into what users are actually reacting to (positively or negatively), it's very difficult to:
- Measure real adoption and satisfaction beyond raw usage counts
- Identify specific failure patterns or gaps in agent responses
- Prioritize enhancement work (e.g. Phase 2 tuning/extension of these agents) based on actual user pain points
- Justify continued investment or expansion of Copilot to stakeholders
Requested capability:
Expose reaction/feedback analytics (reaction type, question, response, and user comment) for the out-of-the-box Dynamics 365 Sales Copilot agents to tenant admins/makers — either through the existing Copilot Studio Analytics experience or an equivalent reporting surface — consistent with what's already available for custom agents.
Without this, admins are effectively "flying blind" on how OOB Copilot agents are actually performing for their users, despite being accountable for driving and measuring adoption.
