Why are SNDS and SFMC reports showing discrepancies in email delivery data, and how to resolve it?

Summary

Discrepancies between SNDS and SFMC reports arise from several factors: different reporting methodologies (SFMC reports on sends, SNDS on delivery), data processing delays in SNDS, Microsoft's potential 'silent drops,' varying definitions of acceptance, filtering, and bounces, and inconsistent bounce categorization. Resolution involves verifying data across platforms, proactive reputation management, understanding bounce codes, analyzing SMTP logs, monitoring engagement, and using tools like seed lists and feedback loops.

Key findings

  • Methodology Differences: SFMC reports emails sent, while SNDS observes post-delivery attempts, leading to discrepancies.
  • SNDS Data Delays: Data in SNDS is often delayed due to processing and aggregation.
  • Silent Drops: Microsoft may silently drop emails, affecting SNDS data.
  • Bounce Categorization Variances: SFMC and SNDS might categorize bounces differently, impacting data.
  • Deliverability Factors: IP reputation, engagement metrics, and spam filtering affect data reported by both platforms.

Key considerations

  • Verify Data: Compare data from SFMC and SNDS to identify discrepancies.
  • Proactive Reputation Management: Actively manage your sender reputation and address deliverability problems.
  • Understand Bounce Codes: Check specific bounce codes reported by SFMC to understand bounce categorization.
  • Analyze SMTP Logs: Review SMTP logs for detailed information on email transactions.
  • Monitor Engagement: Monitor open rates, click-through rates, and spam complaints.
  • Use Seed Lists: Utilize seed lists and inbox placement testing to understand how emails are being treated.
  • Segment Lists: Segment your email lists and monitor metrics for each segment.
  • Implement Feedback Loops: Set up feedback loops to address spam complaints.
  • Consistent Sending Practices: Maintain consistent sending volume and timing.
  • Contact Microsoft Support: If problems persist, contact Microsoft Support directly.

What email marketers say
10Marketer opinions

Discrepancies between SNDS (Microsoft's Smart Network Data Services) and SFMC (Salesforce Marketing Cloud) reports on email delivery data can arise due to several factors, including how each system categorizes bounces (especially soft bounces and deferred deliveries), the potential for "silent drops" where emails are not fully processed, data aggregation delays, and variations in filtering based on IP reputation. Resolving these discrepancies involves verifying IP reputation, analyzing SMTP logs, contacting Microsoft support, maintaining consistent sending practices, using seed lists for inbox placement testing, monitoring engagement metrics, and segmenting email lists.

Key opinions

  • Bounce Categorization: SFMC and SNDS may categorize bounces differently, leading to variations in reported data. SNDS may not reflect soft bounces the same way SFMC does.
  • Silent Drops: Microsoft may silently drop emails, meaning they are not fully processed, which affects the data reported by SNDS.
  • Data Delays: Data aggregation delays in SNDS can cause discrepancies when comparing it with SFMC's near real-time data.
  • IP Reputation: A poor IP reputation can lead to filtering or blocking by Microsoft, impacting how delivery data is reported in both SFMC and SNDS.
  • Engagement Metrics: Low email engagement metrics like open rates and click-through rates can indicate spam filtering, which can affect reported delivery data.

Key considerations

  • Verify IP Reputation: Use tools like Talos or SenderScore to check your IP reputation.
  • Analyze SMTP Logs: Review SMTP logs for detailed information on email transactions.
  • Contact Microsoft Support: If discrepancies persist, contact Microsoft support for assistance.
  • Maintain Consistent Sending: Ensure consistent volume and timing in your sending practices.
  • Inbox Placement Testing: Use seed lists and inbox placement testing to understand how emails are treated by mailbox providers.
  • Monitor Engagement Metrics: Track open rates and click-through rates to identify potential spam filtering issues.
  • Segment Email Lists: Segment your email lists and monitor delivery metrics for each segment to identify specific issues.
Marketer view

Marketer from Email Geeks explains that, as far as they know, Microsoft does not do deferred bounces for blocks; they just bounce them immediately.

May 2023 - Email Geeks
Marketer view

Email marketer from Mailjet suggests Monitoring engagement metrics, such as open rates and click-through rates, to gain insights into the performance of the campaign. If email engagement metrics are low, it may be a sign that emails are being filtered into spam folders, which can cause variations when compared with the reported data.

December 2022 - Mailjet
Marketer view

Email marketer from Reddit suggests checking the specific bounce codes reported by SFMC. Discrepancies may occur if SFMC categorizes certain soft bounces or deferred deliveries differently than SNDS.

December 2021 - Reddit
Marketer view

Email marketer from StackExchange suggests analyzing SMTP logs for detailed information on email transactions. This can provide a more granular view of delivery issues and help pinpoint the source of discrepancies between SFMC and SNDS.

June 2023 - StackExchange
Marketer view

Email marketer from EmailGeekForum suggests segmenting your email lists and closely monitoring the delivery metrics for each segment. This can help identify specific issues affecting certain types of recipients, potentially revealing discrepancies in reporting.

October 2022 - EmailGeekForum
Marketer view

Email marketer from Email Deliverability Blog recommends contacting Microsoft support directly if discrepancies persist. Microsoft's support team may be able to provide insights into filtering or delivery issues affecting your domain.

September 2021 - Email Deliverability Blog
Marketer view

Email marketer from LinkedIn suggests verifying the IP reputation of your sending infrastructure using tools like Talos or SenderScore. A poor IP reputation may lead to filtering or blocking by Microsoft, which can be reflected differently in SFMC and SNDS.

November 2022 - LinkedIn
Marketer view

Email marketer from MarketingProfs advises maintaining consistent sending practices, including consistent volume and sending times. Sudden changes in sending behavior can trigger filtering and lead to reporting discrepancies.

June 2022 - MarketingProfs
Marketer view

Marketer from Email Geeks shares that they have noticed a lot more cases with "silent drops" at Microsoft. DATA column not showing the full volume that is being sent could be an indication of that, even though it shouldn't be when it comes to SMTP level functionality.

May 2024 - Email Geeks
Marketer view

Email marketer from EmailOnAcid suggests using seed lists and inbox placement testing to get insights into how your emails are being treated by Microsoft and other mailbox providers. The result of the tests can then be compared with SFMC and SNDS data, and can help to identify potential discrepancies.

October 2023 - EmailOnAcid

What the experts say
5Expert opinions

Discrepancies between SNDS (Microsoft Smart Network Data Services) and SFMC (Salesforce Marketing Cloud) reports arise due to differing methodologies. SFMC reports on emails sent, while SNDS observes post-delivery outcomes. Verify SNDS data with SFMC, keeping in mind spam folder placements are reflected in RCPT counts. Proactive reputation management, addressing deliverability, and monitoring metrics are crucial for improving data consistency between the two platforms.

Key opinions

  • Different Methodologies: SFMC reports on emails sent, while SNDS tracks post-delivery outcomes.
  • Spam Folder Visibility: Mail delivered to the spam folder still registers in the RCPT (Recipient) count.
  • Data Verification: Cross-verify SNDS numbers with SFMC reports to identify discrepancies.

Key considerations

  • Proactive Reputation Management: Actively manage your sender reputation to ensure better deliverability.
  • Address Deliverability Problems: Identify and fix deliverability issues to improve data consistency.
  • Monitor Bounce Rates: Track bounce rates to understand potential issues with email delivery.
Expert view

Expert from Email Geeks shares that you can verify the numbers in SNDS with the numbers from SFMC.

June 2021 - Email Geeks
Expert view

Expert from Email Geeks asks if SFMC's reports of “delivered” match the numbers that SNDS is giving.

December 2022 - Email Geeks
Expert view

Expert from Email Geeks shares that mail going to the spam folder will show in the RCPTs.

May 2024 - Email Geeks
Expert view

Expert from Spam Resource explains that differences often arise from the distinct methodologies used by SFMC and SNDS. SFMC reports on emails sent from its platform, while SNDS observes data post-delivery attempts. This difference in perspective can lead to variances, especially around deferred or filtered messages.

March 2021 - Spam Resource
Expert view

Expert from Word to the Wise explains that implementing proactive reputation management is key. Addressing deliverability problems, monitoring bounce rates, and actively managing your sender reputation directly will improve data consistency across both SFMC and SNDS.

July 2024 - Word to the Wise

What the documentation says
5Technical articles

Discrepancies between SNDS and SFMC reports stem from data processing delays in SNDS, differing definitions of acceptance and filtering, and variations in bounce categorization. To resolve, focus on SNDS trends rather than individual data points, understand how SFMC classifies bounces (hard vs. soft), and implement feedback loops to address spam complaints.

Key findings

  • Data Processing Delays: SNDS data is often delayed due to processing and aggregation, unlike SFMC's near real-time data.
  • Differing Definitions: Microsoft and SFMC have different definitions of acceptance, filtering, and bounces.
  • Bounce Categorization: SFMC handles and categorizes bounces based on response codes, influencing data aggregation.

Key considerations

  • Focus on Trends: When using SNDS, focus on data trends instead of individual data points.
  • Understand SFMC Bounce Classification: Know how SFMC classifies hard vs. soft bounces.
  • Implement Feedback Loops: Set up feedback loops to identify and address spam complaints.
Technical article

Documentation from Microsoft provides guidance on interpreting SNDS data and troubleshooting discrepancies. Suggests focusing on trends over individual data points and understanding how different filters and metrics correlate.

July 2024 - Microsoft
Technical article

Documentation from Microsoft explains that data in SNDS might be delayed due to processing times and aggregation. Discrepancies can arise when comparing real-time SFMC data with SNDS, which reflects aggregated data with potential delays.

November 2022 - Microsoft
Technical article

Documentation from Salesforce explains that SFMC handles bounce processing and categorizes them based on different response codes. It is important to understand how SFMC classifies bounces, especially differentiating between hard and soft bounces, and how it could affect the aggregation of data when compared with SNDS.

August 2024 - Salesforce
Technical article

Documentation from Salesforce explains that SFMC's deliverability reports are based on the platform's internal tracking of email events. These reports may differ from SNDS due to variations in how Microsoft defines acceptance, filtering, and bounces.

January 2025 - Salesforce
Technical article

Documentation from SparkPost suggests setting up feedback loops to identify and address spam complaints. Feedback loops will give the sender insights into user-reported spam issues, providing important feedback on email content and sending practices, which will impact the data aggregated.

December 2021 - SparkPost