What data sources contribute to Sender Score and how reliable is it for deliverability?

Summary

Experts and marketers largely agree that Sender Score should be viewed as one of many data points and not the sole determinant of email deliverability. The data contributing to Sender Score primarily comes from cable/phone/network providers, spam filtering companies, and spam trap networks, and it often excludes major freemail providers like Gmail, Microsoft, Apple, and Yahoo. Factors that influence Sender Score include spam complaints, external blacklists, sending volume, and email content quality. While Sender Score can be useful for identifying potential deliverability issues or sudden drops in reputation, its algorithm is opaque, it may not accurately reflect inbox placement across all ISPs, and its influence is declining as mailbox providers increasingly rely on engagement and authentication. Improving overall sender reputation, which in turn can affect Sender Score, involves sending valuable content, segmenting and regularly cleaning email lists, monitoring engagement metrics, and employing proper email authentication. In addition, monitoring receiver-specific reputation via tools like Gmail Postmaster Tools is crucial, as Gmail's view of IP reputation is independent of Sender Score and directly affects Gmail deliverability. A focus on content, link, and domain reputation is important, as IP reputation acts as a minimum threshold for acceptance, but content and domain reputation determine final placement.

Key findings

  • Limited Reliance: Sender Score should not be the sole metric for assessing deliverability.
  • Data Source Limitations: Data primarily comes from cable ISPs, spam traps, and filtering companies, often excluding major freemail providers.
  • Opaque Algorithm: Sender Score's algorithm is opaque, impacting accuracy across all ISPs.
  • Declining Influence: The influence of Sender Score is declining as providers focus on engagement and authentication.
  • Independent Gmail Reputation: Gmail's IP reputation is independent of Sender Score and directly affects Gmail deliverability.
  • Key Influencing Factors: Spam complaints, blacklists, sending volume, and content quality influence Sender Score.
  • IP Reputation Threshold: IP Reputation acts as a minimum threshold and after this content and domain reputation affect delivery placement.

Key considerations

  • Holistic Deliverability Strategy: Implement a holistic strategy that considers numerous deliverability metrics, not just Sender Score.
  • Focus on Sender Reputation: Prioritize building a positive sender reputation through valuable content, clean lists, and high engagement.
  • Monitor Receiver-Specific Reputation: Utilize tools like Gmail Postmaster Tools to monitor receiver-specific IP reputation.
  • Optimize for Engagement: Optimize email programs for engagement, as this is increasingly important to mailbox providers.
  • Proper Authentication: Ensure proper email authentication (SPF, DKIM, DMARC) to improve deliverability.
  • Regular Monitoring: Regularly monitor Sender Score alongside other metrics to proactively address issues.

What email marketers say
11Marketer opinions

Experts and marketers generally agree that Sender Score is just one factor among many influencing email deliverability, and should not be solely relied upon. Data primarily comes from US cable ISPs, some trap providers, and smaller email hosting companies, with limited or no data from major freemail providers like Gmail, Yahoo, or Hotmail. Factors impacting Sender Score include spam complaints, external blacklists, sending volume, and email content quality. Sender Score can be useful for identifying potential deliverability issues, but its algorithm is opaque, and it may not accurately reflect inbox placement across all ISPs. Improving sender reputation, which affects Sender Score, involves consistently sending valuable content, segmenting email lists, regularly cleaning email lists, and monitoring engagement metrics. Other, more important metrics that contribute to deliverability are authentication, engagement, and content.

Key opinions

  • Data Sources: Sender Score primarily uses data from US cable ISPs, spam traps, and smaller hosting companies; major freemail providers are typically not included.
  • Reliability: Sender Score's reliability is limited; it is best used as one data point among many, and its algorithm is opaque.
  • Factors Influencing: Sender Score is influenced by spam complaints, blacklists, sending volume, and email content quality.
  • Usefulness: Sender Score can help identify potential deliverability issues, but should be used in conjunction with other metrics.
  • Alternative Metrics: Engagement, authentication, and content quality are all equally or more important than Sender Score for deliverability.

Key considerations

  • Holistic Approach: Don't rely solely on Sender Score; consider a broader range of deliverability metrics.
  • Sender Reputation: Focus on improving overall sender reputation through valuable content, list hygiene, and engagement.
  • Proactive Monitoring: Regularly monitor Sender Score alongside other metrics to identify and address potential issues early.
  • ISP Variations: Recognize that Sender Score may not accurately reflect deliverability across all ISPs; consider receiver-specific reputations.
  • Authentication Importance: Ensure proper email authentication (SPF, DKIM, DMARC) as a foundational element of deliverability.
Marketer view

Email marketer from Reddit.com explains, in a Reddit thread about email deliverability, one user, u/EmailExpert, stated that Sender Score is one data point among many and to not rely on it entirely because its algorithm is opaque, and it may not reflect the reality of inbox placement across all ISPs.

May 2021 - Reddit.com
Marketer view

Email marketer from Mailjet.com shares that improving sender reputation, which affects Sender Score, involves consistently sending valuable content, segmenting email lists, regularly cleaning email lists to remove inactive subscribers, and monitoring engagement metrics. They stated this demonstrates to ISPs that the sender is responsible and trustworthy.

March 2023 - Mailjet.com
Marketer view

Email marketer from Email Marketing Forum in an email marketing discussion, user EmailGuru explained that Sender Score is just one of many metrics and should not be the only metric relied upon and that he uses it as a 'quick health check' for IP reputation but always uses other sources to build a complete view.

March 2021 - Email Marketing Forum
Marketer view

Email marketer from EmailAcademy.com shares that Sender Score is not the be-all and end-all of deliverability and highlights that while it provides insight, relying solely on it is not recommended. Sender Score gives some indication of your sending reputation but that it is not the only factor.

January 2022 - EmailAcademy.com
Marketer view

Email marketer from CampaignMonitor.com explains that the main factors affecting deliverability are authentication, sender reputation, engagement, and content. And that while Sender Score could be a small part of that it's very much the 'tip of the iceberg' and authentication and engagement are far more important.

August 2021 - CampaignMonitor.com
Marketer view

Email marketer from EmailToolTester.com explains that regularly monitoring Sender Score allows you to proactively identify potential deliverability issues and address them before they significantly impact email performance and indicates that this monitoring provides an early warning system.

March 2023 - EmailToolTester.com
Marketer view

Email marketer from GlockApps.com shares that Sender Score can be useful for identifying potential deliverability issues, such as sudden drops in reputation, and indicates that this drop can prompt further investigation into sending practices, list hygiene, and content quality. However, it should be used in conjunction with other deliverability metrics.

July 2024 - GlockApps.com
Marketer view

Email marketer from MailMonitor.com explains that factors influencing Sender Score include spam complaints, external blacklists, sending volume, and the quality of email content. They emphasize the importance of consistent and legitimate email marketing practices for maintaining a healthy Sender Score.

April 2024 - MailMonitor.com
Marketer view

Marketer from Email Geeks shares their experience from a meeting about 10 years ago where ReturnPath indicated that SenderScore data primarily came from US cable mailbox providers, not AOL/Yahoo or Gmail. They were unsure whether Hotmail was included.

December 2022 - Email Geeks
Marketer view

Email marketer from Litmus.com shares that building a good sender reputation and achieving high deliverability, which can indirectly influence Sender Score over time, involves sending relevant and personalized content, using proper email authentication, maintaining clean email lists, and monitoring engagement metrics to improve future campaigns.

March 2024 - Litmus.com
Marketer view

Marketer from Email Geeks states there are no freemail data sources in Sender Score, it uses cable ISPs, some trap providers, and some smaller email hosting companies. They say Sender Score can be useful to troubleshoot root cause issues but the score is unreliable.

June 2023 - Email Geeks

What the experts say
5Expert opinions

Experts generally express skepticism about Sender Score's value and reliability for determining email deliverability. While Sender Score uses data from various ISPs and feedback loops, its utility is limited. It's considered just one metric and may not accurately reflect deliverability across all mailbox providers. Its influence is declining as mailbox providers rely more on engagement and authentication. Sender Score should not be the only metric used. Focus should be on content, link, and domain reputation, as well as receiver-specific reputation as seen through tools like Gmail Postmaster Tools. IP reputation is a minimum threshold, not a guarantee of inbox placement.

Key opinions

  • Limited Utility: Sender Score has limited utility and may not accurately reflect deliverability across all providers.
  • Data Issues: The data used by Sender Score may be incomplete and outdated.
  • Declining Influence: Sender Score's influence is declining as mailbox providers prioritize engagement and authentication.
  • Receiver-Specific Reputation: Reputation is receiver-specific; use tools like Gmail Postmaster Tools for insights.
  • Minimum Threshold: IP reputation is a minimum threshold for acceptance, but content and domain reputation determine final placement.

Key considerations

  • Don't Rely Solely: Do not rely solely on Sender Score for deliverability assessment.
  • Focus on Content: Prioritize content, link, and domain reputation to improve deliverability.
  • Monitor Receiver Reputation: Monitor receiver-specific reputation using tools like Gmail Postmaster Tools.
  • Authentication and Engagement: Focus on strong authentication and high engagement to improve deliverability.
  • Holistic Approach: Use Sender Score as one data point within a holistic deliverability strategy.
Expert view

Expert from Email Geeks recommends using Gmail postmaster tools to see what Gmail thinks of your IP reputation, emphasizing that reputation is receiver-specific.

October 2024 - Email Geeks
Expert view

Expert from Spam Resource responds that Sender Score relies on data from various ISPs and feedback loops, but its overall utility is limited. They add that it's best seen as one data point among many and might not accurately reflect deliverability across all mailbox providers. They also claim that the data they use is often incomplete and outdated.

April 2022 - Spam Resource
Expert view

Expert from Word to the Wise explains that while Sender Score can provide a general sense of your IP's reputation, it is just one metric and should not be the only metric used. They say that it's influence is declining as mailbox providers rely more on engagement and authentication.

December 2023 - Word to the Wise
Expert view

Expert from Email Geeks explains that SenderScore is a proprietary number that does not really reflect anything about your sending IP and advises not to bother caring about it. They state that we don't know who contributes data to it but assumes that the folks who used ReturnPath's data contributed data back to them, potentially including Microsoft and some cable companies. Mentions that AOL may have contributed data at one point, but it's unclear if that survived mergers. They also state that they stopped including SenderScore in deliverability analysis around 2013/2014 because it wasn't a useful data point.

December 2023 - Email Geeks
Expert view

Expert from Email Geeks states that IP reputation acts as a minimum threshold for mail acceptance. After that, content, link, and domain reputation influence message delivery location.

August 2024 - Email Geeks

What the documentation says
4Technical articles

Documentation indicates that Sender Score aggregates reputation metrics from various sources within Validity's provider network, primarily consisting of cable/phone/network providers, spam filtering companies, and spam trap networks. Major freemail providers like Gmail, Microsoft, Apple, and Yahoo do not directly contribute. Sender reputation, which influences Sender Score, is affected by factors such as spam complaints, bounce rates, engagement metrics, and authentication practices. However, Gmail's own view of IP reputation is independent of Sender Score and directly impacts deliverability to Gmail users.

Key findings

  • Data Sources (Validity): Validity's Sender Score aggregates reputation data from cable/phone/network providers, spam filtering companies, and spam traps.
  • Exclusion of Major Providers: Gmail, Microsoft, Apple, and Yahoo do not directly contribute data to Sender Score.
  • Influencing Factors: Sender reputation (affecting Sender Score) is influenced by spam complaints, bounce rates, engagement, and authentication.
  • Gmail's Independent Reputation: Gmail's view of IP reputation is independent of Sender Score and directly impacts Gmail deliverability.

Key considerations

  • Limited Scope of Data: Recognize that Sender Score's data primarily comes from cable/phone/network providers, excluding major freemail providers.
  • Focus on Multiple Factors: Address spam complaints, bounce rates, engagement, and authentication practices to improve sender reputation.
  • Gmail-Specific Strategy: Maintain a positive IP reputation with Gmail independent of Sender Score by ensuring low spam rates and good sending practices.
  • Holistic Assessment: Understand that Sender Score is just one factor in deliverability, and a holistic assessment is necessary.
Technical article

Documentation from SparkPost.com explains that sender reputation, which influences Sender Score, is affected by factors such as spam complaints, bounce rates, engagement metrics, and authentication practices (SPF, DKIM, DMARC). It highlights the importance of monitoring and addressing these factors to maintain a positive reputation.

September 2021 - SparkPost.com
Technical article

Documentation from Google Postmaster Tools states that Gmail's view of your IP reputation directly impacts deliverability to Gmail users, and that this is independent of any Sender Score. Highlighting that consistent low spam rates and good sending practices improve your IP reputation and inbox placement.

August 2023 - Google.com
Technical article

Documentation from Validity.com explains that the Validity Provider Network captures reputation metrics for Sender Score, powered by mailbox providers, spam filtering companies, spam trap networks, and includes over 100 million mailboxes and millions of unique IP addresses. It partners with cable/phone/network providers but specifies that Gmail, Microsoft, Apple, and Yahoo don't contribute directly.

January 2022 - Validity.com
Technical article

Documentation from SendGrid.com explains that factors impacting deliverability, and indirectly Sender Score, include sender authentication (SPF, DKIM, DMARC), engagement rates, spam complaints, and sending volume. It emphasizes the importance of building a positive sender reputation through responsible email marketing practices.

August 2022 - SendGrid.com