|
| 1 | +--- |
| 2 | +title: Employee Self-Service agent deployment overview |
| 3 | +f1.keywords: NOCSH |
| 4 | +ms.author: daisyfeller |
| 5 | +author: daisyfell |
| 6 | +manager: triciagill |
| 7 | +ms.date: 7/3/2025 |
| 8 | +audience: Admin |
| 9 | +ms.topic: article |
| 10 | +ms.service: microsoft-365-copilot |
| 11 | +ms.custom: ess-agent |
| 12 | +robots: NOINDEX, NOFOLLOW |
| 13 | +ms.localizationpriority: medium |
| 14 | +ms.collection: m365copilot |
| 15 | +description: Learn about the deployment process and application lifecycle management for the Employee Self-Service agent |
| 16 | +appliesto: |
| 17 | + - ✅ Microsoft 365 Copilot |
| 18 | +--- |
| 19 | + |
| 20 | +# Employee Self-Service agent deployment overview |
| 21 | + |
| 22 | +>[!NOTE] |
| 23 | +>The Employee Self-Service agent is currently in limited public preview. Deployment processes are subject to change before this product becomes generally available. |
| 24 | +
|
| 25 | +There are several steps necessary to deploy the Employee Self-Service (ESS) Agent. Refer to the table for an overview of the deployment process. |
| 26 | + |
| 27 | +|Role |Development environment |Production environment | |
| 28 | +|-----|------------------------|-----------------------| |
| 29 | +|Power Platform administrator |- Create environment for development and testing.</br> - Create a preferred custom solution. |Create an environment for production rollout. | |
| 30 | +|Copilot Studio maker |- Install the ESS agent.</br> - Install ISV extension packs and set up connectors.</br> - Customize and test.</br> - Export as a managed solution. |-Install the ESS agent.</br> - Import customization solution.</br> - Test.</br> - Publish. | |
| 31 | + |
| 32 | +## Deployment stages |
| 33 | + |
| 34 | +There are four stages in deploying the ESS agent. |
| 35 | + |
| 36 | +1. Prepare: |
| 37 | + 1. Set up roles. |
| 38 | + 1. Set up your environment. |
| 39 | + 1. Infra, set up for third-party ISV integration. |
| 40 | +2. Install: |
| 41 | + 1. Install the ESS agent. |
| 42 | + 1. Install third-party ISV packages. |
| 43 | +3. Customize: |
| 44 | + 1. Configure core ESS agent. |
| 45 | + 1. Provide third-party ISV configurations. |
| 46 | + 1. Identify knowledge sources. |
| 47 | + 1. Provide frequent queries. |
| 48 | + 1. Identify sensitive queries. |
| 49 | +4. Publish: |
| 50 | + 1. Publish ESS agent. |
| 51 | + 1. Approve ESS agent. |
| 52 | + 1. Identify test users. |
| 53 | + |
| 54 | +## Determine your application lifecycle management process |
| 55 | + |
| 56 | +Application lifecycle management (ALM) includes governance, development, and maintenance. The key areas of ALM are as follows: |
| 57 | + |
| 58 | +**Governance** includes managing requirements, managing resources, nurturing and system administration such as data security, user access, change tracking, reviewing, auditing, deployment control, and rollback. |
| 59 | + |
| 60 | +**Application development** includes identifying current issues, planning, design, building and testing the application, and making continuous improvements. This area includes traditional developer and app maker roles. |
| 61 | + |
| 62 | +**Maintenance** includes deploying the app and maintaining optional and dependent technologies. |
| 63 | + |
| 64 | +The application lifecycle is the cyclical software development process that involves these areas: plan and track, develop, build and test, deploy, operate, monitor, and learn from discovery. |
| 65 | +ALM for Microsoft Copilot Studio uses Dataverse in Microsoft Power Platform to securely store and manage the data and processes that business applications use. To use the Power Platform features and tools available to manage ALM, all environments that participate in ALM must include a Dataverse database. |
| 66 | + |
| 67 | +The following concepts are important for understanding ALM using Microsoft Power Platform: |
| 68 | + |
| 69 | +**Solutions** are the mechanisms for implementing ALM. You use solutions to distribute components across environments through export and import. A component represents an artifact used in your application that you can potentially customize. Anything that can be included in a solution is a component, such as tables, columns, canvas and model-driven apps, Power Automate flows, agents, charts, and plugins. |
| 70 | + |
| 71 | +**Dataverse** stores all the artifacts, including solutions and [in-product deployment pipelines](/power-platform/alm/pipelines). |
| 72 | + |
| 73 | +**Source control** is your source of truth for storing and collaborating on your components. [Learn more about source control](/power-platform/alm/git-integration/overview). |
| 74 | + |
| 75 | +**Continuous integration and continuous delivery platforms** such as [Azure DevOps](/azure/devops/user-guide/what-is-azure-devops?view=azure-devops&preserve-view=true) allows you to automate your build, test, and deployment pipeline. These platforms can also be used with in-product pipelines. |
| 76 | + |
| 77 | +Every organization has their own ALM process to deploy and test enterprise applications. The ESS Agent is published using Microsoft Copilot Studio, which brings Power Platform ALM directly into the Copilot Studio app. |
| 78 | +Makers and developers work in development environments using unmanaged solutions, then import them to other downstream environments, such as tests, as managed solutions. |
| 79 | +You need to work with your organization’s Power Platform administrator to establish your ALM process. It’s recommended to have at least two separate environments to author, update, and test the agent. |
| 80 | + |
| 81 | +The ESS Agent has three distinct persona experiences: |
| 82 | + |
| 83 | +1. Administrator: Prepare the tenant to deploy, configure, and operate the ESS agent with the correct roles assigned to identified service owners. |
| 84 | + |
| 85 | +2. Environment maker: Install, configure, and publish the agent, including third-party ISV packages. |
| 86 | + |
| 87 | +3. User: Consume the ESS Agent within Microsoft Teams or Microsoft 365 Copilot chat. Users’ data is harnessed from Microsoft 365 Graph. |
| 88 | + |
| 89 | +These experiences are within the boundary of a single tenant, whereas the environment maker’s experience installing and publishing the agent can vary among different environments within Power Platform. It’s therefore recommended to establish ALM environments such as Developer, Test, and Production for publishing and testing the ESS Agent. Each of the third-party ISV applications can also be connected to the respective environments if each application has their own ALM instances (such as Developer, Test, and Production). |
| 90 | +It's recommended to have end users using a live production tenant to make use of recent and meaningful user-object interactions in Microsoft Graph. |
| 91 | + |
| 92 | +## Quality Assurance Strategy (QA) |
| 93 | + |
| 94 | +Deploying Copilot agents is a transformative initiative, but without rigorous testing, even the most promising agent can fall short of expectations. Here’s why testing is essential: |
| 95 | + |
| 96 | +- Ensures accuracy, relevance, and trust |
| 97 | + - *simulate real-world scenarios, including edge cases, to uncover blind spots early.* |
| 98 | +- Supports security, compliance, and governance |
| 99 | + - *Involve compliance, security, governance, and corporate communications teams early in the testing phase.* |
| 100 | +- Refines user experience and tone |
| 101 | + - *Using Copilot Studio’s instruction field to define tone, language, and behavior explicitly* |
| 102 | +- Enables performance benchmarking and continuous improvement |
| 103 | + - *Define success metrics (e.g., resolution rate, user satisfaction) and track them from pilot to production.* |
| 104 | +- Validates technical integration and readiness |
| 105 | + - *A phased rollout – starting in dev/test environments before scaling to production* |
| 106 | +- Aligns with Microsoft's deployment framework |
| 107 | + - Scenario-based testing |
| 108 | + - CI/CD pipelines for version control |
| 109 | + - Final DLP and RBAC validations |
| 110 | + - Simulated test data for controlled evaluations |
| 111 | + - *Adopt a proven, enterprise-grade approach.* |
| 112 | + |
| 113 | +### Golden prompt testing framework |
| 114 | + |
| 115 | +This framework is one of the most common testing frameworks for quality testing the agent that serves as the final gate before production deployment. This is shared here ONLY for guidance and please align with the standard QA process that’s established for your enterprise. |
| 116 | + |
| 117 | +**What are golden prompts?** |
| 118 | + |
| 119 | +Golden prompts are a curated set of test scenarios that: |
| 120 | + |
| 121 | +- Represent critical user workflows and edge cases |
| 122 | +- Have known, expected responses (golden responses) |
| 123 | +- Cover core functionality that must never break |
| 124 | +- Serve as regression detection mechanisms |
| 125 | + |
| 126 | +The following **Process flow** can help you understand testing and golden prompts. Think of this flow as circular rather than linear, as testing is iterative and continuous. |
| 127 | + |
| 128 | +1. Scenarios |
| 129 | +1. Golden prompt testing |
| 130 | +1. Go or No go |
| 131 | +1. Production release |
| 132 | +1. Feedback |
| 133 | +1. Repeat |
| 134 | + |
| 135 | +### Implementation guidelines |
| 136 | + |
| 137 | +#### Golden prompt maintenance |
| 138 | + |
| 139 | +|Responsibility |QA Team | |
| 140 | +|---------------|--------| |
| 141 | +|Activities |- Maintain comprehensive library of golden prompts</br> - Regularly review and update prompts based on:</br> --New feature additions</br> --Historical failure patterns</br> -- Customer feedback</br> --Usage analytics | |
| 142 | +|Prompt categories |- **Core functionality:** Basic system operations</br> - **Integration points:** API calls, database operations</br> - **Edge cases:** Boundary conditions, error scenarios</br> - **Performance:** Response time and resource usage</br> **Security:** Authentication, authorization, data validation | |
| 143 | + |
| 144 | +#### Pre-release testing protocol |
| 145 | + |
| 146 | +|Trigger |Quality gate for production deployment | |
| 147 | +|--------|---------------------------------------| |
| 148 | +|Process |1. **Testing strategy** Begin by testing the updated package in the Copilot Studio test window as an initial validation step. Additionally, consider using a ring deployment strategy to progressively test the package across lower environments before promoting it to production.</br> 2. **Automated execution** Run all golden prompts against the modified package.</br> 3. **Response verification** Compare actual responses with expected golden responses.</br> 4. **Tolerance checking** Apply acceptable variance thresholds where applicable.</br> **Failure analysis** Investigate any mismatches or failures. | |
| 149 | +|Success criteria |- All golden prompts must pass</br> - Response times within acceptable ranges</br> - No security vulnerabilites introduced</br> - Memory/resource usage within limits | |
| 150 | + |
| 151 | +#### Go/ No go decision framework |
| 152 | + |
| 153 | +|Decision authority |Release management qualifying QA team approval | |
| 154 | +|-------------------|-----------------------------------------------| |
| 155 | +|Go criteria |- 100% golden prompt pass rate</br> - All critical functionality verified</br> - Performance benchmarks met</br> - Security checks passed | |
| 156 | +|No go triggers |- Any golden prompt failure</br> - Performance degradation beyond threshold</br> - Security vulnerability detected</br> - Resource usage exceeds limits | |
0 commit comments