In short
Microsoft Copilot can help you draft internal messages in minutes, but it cannot measure how employees actually engage with them. To avoid flying blind, internal communication leaders must look beyond native dashboards to build a robust, cross-channel analytics strategy.
Key takeaways
- Microsoft Copilot speeds up writing, with 85% of early users reporting that it helps them reach a first draft faster.
- While Copilot solves drafting bottleneck issues, it does not track employee readership or engagement metrics.
- To compare human and AI content performance, IC teams must establish clear, tag-based cross-channel tracking.
- Power BI and Microsoft native SharePoint metrics often show conflicting KPI values due to unreliable Graph API connections.
Accelerate your drafting: What Copilot solves for content production
We understand the daily challenges you face as an internal communications leader. Blank-page syndrome, tight deadlines, and constant content demands from different departments can slow your publishing cycle to a crawl. The arrival of Microsoft 365 Copilot represents a major shift in how we approach these content bottlenecks. By automating the heavy lifting of drafting and brainstorming, Copilot helps internal communicators move from a blank screen to a solid first draft in seconds, freeing up valuable time to focus on strategic alignment and delivery.
Overcome creative roadblocks and shorten draft cycles
For many internal communication teams, the hardest part of the job is simply getting started. Research shows that 87% of Copilot users say the tool makes it easier to start a first draft, while 85% agree it helps them reach a finished draft much faster[1]. Whether you are translating a complex corporate policy into an engaging intranet post or summarising a long leadership meeting into a quick update, generative AI serves as a powerful starting point. It helps you generate ideas during the writing process and jump-start your creative flow, allowing you to bypass creative roadblocks and shorten your overall content development cycles.
Deploy messages effortlessly across Teams and SharePoint
Internal communications are rarely confined to a single channel. To keep employees informed, you must distribute your messaging across SharePoint, Microsoft Teams, Viva Engage, and dedicated newsletters. Copilot can take a single source document and instantly rewrite it in multiple formats, tailoring the tone for an informal Microsoft Teams post or formatting it as an official announcement for SharePoint. This multi-channel speed allows your team to maintain an active presence everywhere without doubling your writing workload.
- Brainstorming core campaign angles to quickly generate creative hook ideas
- Summarising long executive transcripts into digestible team updates
- Adapting a single announcement into varied tones for SharePoint, Microsoft Teams, and Viva Engage
- Refining messy notes into clean, structured paragraphs in seconds
Track the actual impact of your AI-assisted content
While Copilot is excellent at accelerating content production, it is crucial to remember that drafting is only half the battle. Producing more content faster does not automatically translate to better employee engagement. To understand if your AI-assisted posts are actually hitting the mark, you need a robust, cross-channel analytics strategy. Many communication teams rely on basic SharePoint native analytics to measure success, but these tools fail to show cross-channel performance or segment your audience. To truly see the impact of your efforts, you need to monitor key internal communication KPIs in a centralised dashboard. With our Communication Insights platform, you can bring all your channels together to compare the performance of human-authored messages versus Copilot-assisted content and make data-driven decisions.
Avoid the black box: What Copilot does not solve for measurement
As organisations pilot Microsoft 365 Copilot, internal communication leaders are discovering its remarkable ability to draft and summarise messages in seconds. It solves the content production bottleneck by helping you author communication posts, refine emails, and outline newsletters[2]. However, writing a message quickly is only half the battle. Generative AI does not solve the challenge of measuring employee engagement once your content is published. This disconnect is creating a major visibility gap, leaving many internal communicators feeling like they are sending their AI-assisted messages directly into a black box.
Bridge the gap between content volume and reader attention
When you use generative AI to scale up your communications, you risk contributing to the growing noise in the digital workplace[3]. If you cannot verify which employees read or engage with your posts, simply creating more content will not help you improve your impact. This is why you must move beyond basic vanity metrics, like simple page views or broad impressions, and focus on strategic internal communication KPIs that reveal true engagement.
| What Microsoft 365 Copilot Solves | What Microsoft 365 Copilot Does Not Measure |
|---|---|
| Drafts and refines internal news posts in seconds | Whether employees actually read the news posts you publish |
| Summarises long threads and updates for employees | Which specific employee segments are reading the summaries |
| Speeds up the writing process across multiple channels | Cross-channel engagement trends across your digital workplace |
Understand the limitations of native reporting
Some teams look to native Microsoft features to measure the reach of their content, but these tools fall short of strategic communications needs. For example, SharePoint native analytics suffer from severe limits, including a lack of audience segmentation and a standard six-month cap on data history. Custom dashboards built on Power BI also introduce significant friction. The Microsoft Graph reporting API is not always reliable, leading to occasional odd KPI values or missing days of data. Consequently, communication teams running Power BI over SharePoint frequently see different KPI values in Power BI than in native SharePoint on the exact same data.
To stop wasting time and start making data-driven decisions, you need an all-in-one, cross-channel view of your employee engagement. Our analytics platform, Communication Insights, solves this by providing a single view across SharePoint, Viva Engage, Microsoft Teams, and email newsletters. We empower you with unlimited history, robust audience segmentation via Active Directory, and executive-ready templates. It is secure by design, being SOC 2 Type 2 certified, GDPR compliant, and EU-hosted by default with US data residency available on demand. The platform deploys in a couple of hours to help you optimise your internal communication strategy.
Set a baseline: How to track Copilot-assisted vs human-authored content
While Microsoft 365 Copilot speeds up content writing by solving bottlenecks in drafting and summarising, it cannot measure employee engagement on the final product. To see if your AI-generated updates are actually landing, we must establish a separate, cross-channel analytics foundation. Without this, you cannot determine if your newfound efficiency is coming at the expense of genuine connection. We must use a specialised platform like Communication Insights to create an all-in-one view and track these two content streams side by side.
Implement tag-based tracking
To compare human and AI content fairly, you need a systematic categorisation system. We recommend establishing a simple tag-based taxonomy in your intranet or content management system. By tagging published pieces as either “Human-Drafted,” “Copilot-Assisted,” or “Copilot-Generated,” you can easily segment your performance metrics. This categorisation allows you to track key indicators across SharePoint, Viva Engage, and internal newsletters in a single dashboard, moving past the constraints of native reporting.
- Active Read Time: Go beyond simple page views to measure how many seconds employees spend on the page, helping you see if they are skimming or actually digesting the text.
- Click-Through Rates (CTR): Track whether AI-generated summaries in newsletters prompt employees to click through to full-length articles.
- Social Feedback: Monitor comments, likes, and shares on Viva Engage to see if Copilot-drafted announcements generate natural employee discussion.
- Readership Retention: Evaluate where employees drop off in longer articles to see if synthetic structures fail to hold attention.
Watch for the synthetic tone penalty
While Copilot is highly efficient, an overly synthetic, formulaic tone can alienate readers. In fact, third-party research shows that while 56% of people might initially prefer AI-written articles, 52% will completely disengage if they suspect the content is AI-generated[4]. In internal communications, where trust and authenticity are critical, this disengagement can quietly tank your internal communication KPIs. If employee read times drop off sharply on Copilot-assisted articles, it is a clear sign that you need to inject more human voice and editorial care into your drafts.
Leverage deep cross-channel analytics
Standard native reporting is not up to this task. For instance, SharePoint’s built-in limits restrict your data history and prevent you from segmenting your audience or conducting cross-channel comparisons. To truly understand employee behaviour, we need tools that bridge these gaps. With our Communication Insights platform, you can view all these metrics in one centralised place, with unlimited historical data and rich audience segmentation via Active Directory. Because we are SOC 2 Type 2 certified and GDPR compliant by design, your corporate data remains fully protected. The platform deploys in just a couple of hours using Azure AD or Entra ID, allowing you to start measuring and optimising your Copilot pilot immediately.
Embrace honesty: The realities of Power BI and Microsoft native reporting
As you adopt or pilot Microsoft Copilot to streamline internal communications, it is tempting to look at custom Power BI reporting as the default solution for your measurement needs. After all, if Microsoft provides the content generation tools, they must provide a straightforward path to analyse the results. However, internal communications leaders quickly encounter significant hurdles when building custom dashboards. While Power BI is an exceptional tool for business intelligence, using it to track employee engagement across multiple collaboration spaces requires a complex infrastructure. Many organisations end up spending weeks trying to extract data rather than focusing on how to improve your impact or adapt your strategy.
Understand the Microsoft Graph API limitations
The technical foundation for any custom Microsoft 365 dashboard is the Microsoft Graph API, which handles the reporting endpoints for SharePoint and Teams. Unfortunately, this API is not always reliable, presenting occasional odd KPI values and occasional days of missing data where engagement metrics fail to load[5]. For communications leaders trying to make data-driven decisions, this level of instability is highly disruptive. When you attempt to build custom Power BI dashboards for your SharePoint data, you must dedicate technical resources to monitor, repair, and clean these data streams constantly, diverting valuable time from actual strategic communications.
Reconcile mismatched KPIs and reporting caps
Even if your technical team manages to establish a consistent data pipeline, you will likely face frustrating discrepancies between different interfaces. Internal communication teams running Power BI over SharePoint frequently see different KPI values in Power BI than in native SharePoint on the same data. This mismatch happens because the backend API endpoints use different update schedules, data latency rules, and aggregation filters compared to the real-time native SharePoint statistics. Furthermore, Microsoft native analytics enforce a strict cap on data history, typically restricting your historical view to just six months. This makes year-on-year benchmarking impossible unless you build and maintain your own SQL database or data warehouse, which dramatically escalates the cost and complexity of your custom build.
| Metric or Feature | Microsoft Native Analytics | Custom Power BI Setup | Communication Insights |
|---|---|---|---|
| Data History Capacity | Capped at 6 months of data | Requires building a custom database to store history | Unlimited historical data by default |
| Channel Integration | Siloed reports for SharePoint, Teams, and Viva Engage | Requires complex custom integrations for each channel | Single cross-channel view across all internal platforms |
| Audience Segmentation | Basic native filters without HR metadata | Requires manual mapping of Active Directory files | Automated segmentation via Active Directory or HR file imports |
| Setup and Deployment | Instantly active but highly limited | Weeks or months of development and API testing | Deploys in a couple of hours with secure SSO |
Rather than wasting your valuable budget on building and maintaining a custom infrastructure, we believe in a more efficient path. At Tryane, we offer a dedicated solution to these reporting headaches. Our cross-channel platform, Communication Insights, connects your internal communication channels into one centralised place, eliminating data silos without any custom coding. It deploys in a couple of hours using SSO via Azure AD or Entra ID, plus a direct channel connection. It is SOC 2 Type 2 certified and GDPR compliant by design, hosting your data in the EU by default with US-hosted options available. While our own Power BI integration is currently on our product roadmap to allow even more reporting flexibility, Tryane already provides pre-built, executive-ready internal communications dashboards that give you the exact insights you need. This lets you bypass the limitations of SharePoint native analytics and focus on making your internal communications more effective.
Unify your view: Cross-channel analytics for the AI-powered digital workplace
At least 77% of internal communicators are now using generative AI tools like ChatGPT or Microsoft Copilot to streamline their workflows and draft messages more efficiently[6]. However, while Copilot is an exceptional assistant for drafting and summarisation, it does not measure employee engagement. It helps you publish faster, but it cannot tell you if employees actually read, understood, or acted on those messages. To make data-driven decisions, internal communication leaders must establish a separate, robust analytics system to compare the impact of Copilot-assisted content against human-authored content.
| Capability Area | What Microsoft Copilot Solves | What Tryane Analytics Delivers |
|---|---|---|
| Content Creation | Drafts and summarises messages in seconds | Evaluates which content drives real engagement |
| Channel Integration | Distributes across M365 channels individually | Unifies SharePoint, Teams, and Viva Engage data in one view |
| Historical Tracking | No long-term historical trends or data archiving | Secures unlimited data history beyond native limits |
Break down your channel silos with Communication Insights
To manage an AI-assisted workplace effectively, you need an all-in-one platform that brings your data together. Our central product, Communication Insights, provides a unified, cross-channel single view across SharePoint, Viva Engage, Microsoft Teams, and email newsletters. Instead of logging into separate systems to guess which campaigns worked, we help you see the entire employee journey in one place. Getting started is seamless: our platform deploys in a couple of hours using secure single sign-on (SSO) via Azure AD or Entra ID, combined with your standard channel connections. This lets you immediately track whether a Copilot-summarised post on Teams performs better than a fully hand-crafted newsletter.
Understand which audiences read your posts with advanced targeting
Understanding the difference between AI-generated and human-authored impact requires deep segmentation, not just generic page views. With Communication Insights, we empower you to segment your audience using Active Directory or a direct HR file import. This lets you see if different departments, countries, or roles engage more with specific content styles. Because we prioritise enterprise-grade security, Tryane is SOC 2 Type 2 certified and GDPR compliant by design. We host your data in the EU by default, with US-based data residency available on demand. Crucially, our platform provides unlimited history for your data, bypassing the restrictive six-month native caps that make long-term trend analysis impossible under standard SharePoint analytics limits.
Stop wasting time on unreliable custom dashboards
Many IC leaders attempt to bypass native limitations by building their own SharePoint Power BI dashboards. However, our guide to Power BI reporting reveals that the Microsoft Graph reporting API is not always reliable, leading to occasional odd KPI values or days of missing data. Furthermore, IC teams running Power BI over SharePoint frequently see different KPI values in Power BI than in native SharePoint on the exact same data. While we have a native Power BI integration on our roadmap, we currently resolve these issues by providing our own robust dashboards equipped with executive-ready templates. These templates allow you to compile board-ready reports in minutes, helping you prove the value of your communications strategy directly to leadership without the technical headache.
Frequently asked questions
Can Microsoft Copilot track the performance of my internal communications?
No, Microsoft Copilot does not track or measure content performance. While Copilot is an excellent tool for drafting and summarising content, it operates entirely on the creation side. To measure employee engagement, page views, and click-through rates across your intranet or enterprise social channels, you must use a dedicated analytics platform like Tryane Communication Insights.
How do early users rate the productivity impact of Microsoft Copilot?
According to Microsoft’s Work Trend Index, early Copilot users report significant productivity gains. In fact, of early users stated they were more productive, and 85% reported that Copilot helped them get to a good first draft faster, reducing overall drafting time
How can I compare human-authored versus Copilot-assisted content?
You can compare performance by implementing custom tags or metadata on your SharePoint news posts and Viva Engage threads. By segmenting your content into ‘human-authored’ and ‘Copilot-assisted’ categories, you can use Analytics for SharePoint to monitor metrics like read time, scroll depth, and active engagement to see which style resonates more with your workforce.
Why do my Power BI reports show different KPIs than native SharePoint?
This discrepancy is a common issue for Microsoft 365 administrators. The Microsoft Graph reporting API, which feeds Power BI, can be unreliable, occasionally leading to missing data or delayed metrics. As a result, custom Power BI setups frequently display different KPI values than native SharePoint dashboards on the exact same data.
Does Microsoft native analytics provide a cross-channel view?
No. Native Microsoft tools provide separate, siloed dashboards for SharePoint, Teams, and Viva Engage. This forces internal communicators to manually compile metrics to understand overall reach. Tryane Communication Insights solves this by centralising your metrics into a single cross-channel view.
How long does it take to deploy a cross-channel analytics solution like Tryane?
Tryane is built to integrate seamlessly with your existing Microsoft 365 environment. It deploys in a couple of hours using secure Single Sign-On (SSO) via Azure AD or Entra ID and direct channel connections, without requiring complex custom configurations.
Sources
Further reading
• Measuring cross-channel internal communications
• Audience segmentation for internal communications
• The five internal communication KPIs that show your IC is working
• Measuring frontline worker communications
Tryane runs a 15-minute working session with Heads of Internal Communication, walking through your current measurement setup and showing where the segmentation gaps sit on your own Microsoft 365 tenant. Book a slot with Jérémy.