Why do some ESPs recommend SPF records when they are not needed?

Summary

ESPs recommend SPF records, even when DKIM is implemented, due to a combination of historical practices, backward compatibility, simplified implementation, and perceived improvements in deliverability and security. Many ESPs initially recommended SPF before DKIM was widely adopted, and some older systems still rely on it. SPF is also easier to understand and implement for less technical users. Furthermore, including SPF can serve as an additional layer of security and may be checked by some email providers, even if DKIM is in place, to enhance deliverability. Some recommendations also stem from a desire to manage customer expectations and to set a first step towards full DMARC implementation. However, some sources note the landscape surrounding ESP SPF recommendations and documentation can be confusing and outdated.

Key findings

  • Historical Context: SPF was the primary email authentication method before DKIM's widespread adoption.
  • Backward Compatibility: Older systems and some email providers still rely on SPF for authentication.
  • Simplicity and Ease of Implementation: SPF is easier to understand and implement for less technical users, serving as a starting point for email authentication.
  • Supplementary Security Layer: SPF can provide an additional layer of security, supplementing DKIM and DMARC implementations.
  • Perceived Deliverability Benefits: Including SPF records can improve email deliverability, as some providers still check SPF, even with DKIM.
  • Customer Management: Recommending SPF can help manage customer expectations and demonstrate proactive security measures.
  • Initial Step to DMARC: Implementing SPF can be a first step towards broader email authentication strategies, facilitating the adoption of DMARC.
  • Outdated Documentation: Many ESPs provide poor outdated documentation, leading to confusion

Key considerations

  • DKIM Validation: Determine whether DKIM is properly configured and validated across different email systems.
  • Evaluate Redundancy: Assess the actual benefits of SPF in conjunction with DKIM and DMARC to avoid unnecessary complexity.
  • Simplifying Complex Tasks: Offer simpler documentation which is up-to-date
  • Target Audience Expertise: Tailor recommendations based on the technical expertise of the target audience, simplifying authentication methods where appropriate.
  • Security: Adopt a holistic security strategy combining SPF, DKIM, and DMARC.

What email marketers say
14Marketer opinions

ESPs recommend SPF records, even when DKIM is implemented, for a variety of reasons. These include historical practices, backwards compatibility with older email systems, support for less technically savvy users, and as a supplementary measure for improved deliverability and security. Many ESPs initially recommended SPF before DKIM was widely adopted. Some email servers still weigh SPF results in spam filtering, especially for smaller senders. Additionally, ESPs may recommend SPF as a way to manage customer expectations and provide a sense of security. The practice of adding SPF records may also stem from inertia in documentation or to provide IT teams more information to work with, making it a stepping stone for implementing DMARC.

Key opinions

  • Historical Practices: SPF was the primary authentication method before DKIM and is still recommended by some ESPs due to legacy systems and practices.
  • Backward Compatibility: Older email systems may still rely on SPF, making it necessary for compatibility with a wider range of systems.
  • Ease of Understanding: SPF is considered simpler to understand and implement for less technical users compared to DKIM.
  • Supplementary Security: SPF can serve as an additional layer of security, supplementing DKIM and providing defense-in-depth.
  • Deliverability Improvement: Including SPF records can improve email deliverability rates, as some email providers still check SPF, even with DKIM in place.
  • Customer Reassurance: Recommending SPF can reassure clients and provide a sense of security, even if DKIM is sufficient.
  • Initial DMARC Step: Implementing SPF alongside DKIM can be a first step for organizations towards implementing DMARC, as it gives IT teams more data to work with.

Key considerations

  • DKIM Sufficiency: Evaluate whether DKIM alone is sufficient for email authentication, considering the target audience and the capabilities of their email systems.
  • Potential Redundancy: Assess the potential redundancy of SPF when DKIM is properly configured, weighing the benefits against the complexity of managing SPF records.
  • Target Audience Tech Savviness: Consider the technical proficiency of the target audience when deciding whether to recommend SPF, as it might simplify the setup process for less technical users.
  • Backward Compatibility Needs: Evaluate the need for backward compatibility with older email systems that may still rely on SPF for authentication.
  • Deliverability Enhancement: Determine whether including SPF records alongside DKIM provides a measurable improvement in email deliverability rates.
  • Maintenance Overhead: Balance the benefits of including SPF with the maintenance overhead of managing SPF records, including DNS lookups and potential authentication issues.
  • Security Layers: Consider whether a defense-in-depth approach with both SPF and DKIM is necessary for enhanced security, weighing the complexity and potential overlap.
Marketer view

Email marketer from Mailhardener Blog shares that SPF records were often recommended because they were the primary authentication method before DKIM became widespread. Some ESPs maintain this recommendation to support older systems or due to inertia in their documentation.

April 2022 - Mailhardener Blog
Marketer view

Email marketer from EmailDudes Forum shares that ESPs might suggest SPF records to reassure less tech-savvy clients. They suggest that the continued advice provides a sense of security, even though DKIM effectively handles the authentication process.

June 2023 - EmailDudes Forum
Marketer view

Email marketer from Email Geeks explains that Mailchimp's SPF recommendation was a 'quick and dirty' solution to address support issues when they didn't support custom DKIM for shared IP senders, allowing IT teams to resolve issues where users couldn't email their own company/domain.

September 2021 - Email Geeks
Marketer view

Email marketer from EmailOnAcid shares that SPF is included as some email systems may use it as one factor to evaluate email authenticity. They suggest that while SPF may not be required due to DKIM, some organizations include it anyway as a belt-and-braces approach to improve deliverability rates.

May 2023 - EmailOnAcid
Marketer view

Email marketer from Reddit explains that some ESPs recommend SPF because it's a simple, easily understood authentication method. They suggest that it is often included in setup guides for less technical users, even though DKIM provides superior protection against spoofing and phishing.

August 2023 - Reddit
Marketer view

Email marketer from Email Geeks shares that clients may believe they need an SPF record because Mailchimp previously recommended it. He suggests disabling and re-enabling authentication in Mailchimp to see that the SPF part is now replaced with a third DKIM CNAME record.

January 2024 - Email Geeks
Marketer view

Email marketer from Mailjet states that some ESPs recommend SPF because it has historically been a standard authentication method. Although DKIM is now widely used, including SPF can ensure better deliverability, especially when recipients' servers rely more on SPF. They suggest that it provides redundancy.

July 2021 - Mailjet
Marketer view

Email marketer from Email Geeks explains that almost every third-party service gets the SPF part wrong, citing Sendgrid, Mailgun, and AmazonSES as examples where they recommend adding their include mechanism without proper context, leading to misconfiguration.

May 2023 - Email Geeks
Marketer view

Email marketer from Gmass shares that SPF records may be recommended for older email systems that have not fully adopted DKIM. They also explain that SPF can provide an additional layer of security in certain edge cases. However, they explain that DKIM is usually sufficient.

December 2021 - Gmass
Marketer view

Email marketer from Postmark mentions that SPF is still checked by some email providers, even if DKIM is in place. Although DKIM provides a robust authentication mechanism, SPF is also recommended for improved deliverability.

March 2023 - Postmark
Marketer view

Email marketer from Email Geeks highlights that many sites, including Mailchimp, incorrectly advise adding an SPF record. He emphasizes that AWeber gets it right by stating no SPF record update is needed and that he never exceeds the 10 DNS lookup rule.

June 2023 - Email Geeks
Marketer view

Email marketer from Email Geeks explains that many clients are convinced they need an SPF record for Mailchimp in the visible FROM domain, leading to confusion and potential issues like exceeding the DNS lookup limit. He recommends checking dmarcian's article and notes that many sites incorrectly advise adding an SPF record for Mailchimp when it's unnecessary.

March 2023 - Email Geeks
Marketer view

Email marketer from StackOverflow answers that some ESPs recommend SPF records for backwards compatibility and as a supplementary measure. They explain some email servers may still heavily weigh SPF results in their spam filtering algorithms, especially for smaller senders or those with less established reputations.

September 2022 - StackOverflow
Marketer view

Email marketer from Validity states that some ESPs recommend SPF, even with DKIM, as a defense-in-depth approach. This approach assumes that relying on multiple layers of security is better than relying on a single measure, and having both SPF and DKIM can provide improved authentication results.

May 2022 - Validity

What the experts say
3Expert opinions

The provided answers suggest varied reasons for ESPs recommending SPF records even when they aren't strictly necessary. One viewpoint is that the landscape of ESP SPF records and related documentation is confusing and problematic. Another perspective is that ESPs use SPF recommendations to manage customer expectations by showing proactive security measures. Finally, a more strategic reason is offered: SPF serves as a simplified initial step, or a gateway for less technical clients to understand email authentication before moving onto more complex systems like DKIM.

Key opinions

  • Confused Landscape: The handling of SPF records by ESPs and their associated documentation are often confusing and poorly implemented.
  • Customer Expectation: SPF recommendations can be a way for ESPs to demonstrate proactive security measures to their customers.
  • Simplified First Step: SPF provides an easier, less complex introduction to email authentication for non-technical users before adopting DKIM.

Key considerations

  • Documentation Clarity: ESPs should strive for clearer, more accurate, and up-to-date documentation regarding SPF and DKIM.
  • Alternative Security Communication: ESPs should explore alternative ways to communicate security measures to customers without relying solely on potentially redundant SPF recommendations.
  • User Education Path: ESPs should create a clear educational path for users to transition from SPF to DKIM as they become more familiar with email authentication.
Expert view

Expert from Email Geeks succinctly states that ESP SPF records and their documentation are a train wreck.

November 2022 - Email Geeks
Expert view

Expert from SpamResource explains that some ESPs may recommend SPF records to manage customer expectations, providing a checklist item to demonstrate proactive security measures, even when DKIM offers more comprehensive authentication.

April 2022 - SpamResource
Expert view

Expert from Word to the Wise explains that while DKIM is more robust, SPF can be easier to initially configure. Some ESPs suggest SPF as a stepping stone for less technical clients to familiarize themselves with email authentication concepts.

June 2023 - Word to the Wise

What the documentation says
6Technical articles

Documentation sources indicate that SPF records, while seemingly redundant with DKIM, are still recommended by some ESPs for historical reasons, backward compatibility, and as a fallback mechanism. SPF was an earlier authentication method, and older systems or poorly configured servers may still rely on it. It can act as a quick check for receiving servers or provide additional authentication even with DKIM implemented. Moreover, SPF is simpler to implement and understand, serving as a first step towards broader email authentication strategies and giving IT teams more information to manage email security.

Key findings

  • Historical Significance: SPF served as the primary email authentication method before DKIM became widespread.
  • Backward Compatibility: Older systems and poorly configured email servers may still rely on SPF for authentication.
  • Fallback Mechanism: SPF can act as a fallback for systems that do not fully support DKIM, ensuring broader compatibility.
  • Simplified Implementation: SPF is easier to implement and understand, making it a useful starting point for email authentication.
  • Additional Information: Implementing both SPF and DKIM gives IT teams more information to work with when managing email security.

Key considerations

  • DKIM Support: Assess whether the receiving systems fully support DKIM before relying solely on it.
  • Authentication Strategy: Determine a comprehensive email authentication strategy, considering both SPF and DKIM.
  • Implementation Complexity: Evaluate the complexity of implementing and managing SPF records.
  • Security Risk: Weigh the potential security risks of relying solely on SPF if DKIM is not properly configured.
  • IT Knowledge: Consider IT's knowledge and understanding of SPF implementation if the clients need to set up SPF themselves.
Technical article

Documentation from dmarcian explains that ESPs sometimes recommend SPF records because email authentication practices can be complex. While DMARC is the standard for protecting against spoofing, implementing SPF and DKIM gives IT teams more information to work with. It provides a first step to implementing DMARC.

September 2023 - dmarcian
Technical article

Documentation from EasyDMARC explains that SPF records might seem redundant with DKIM but historically addressed issues with email forwarding and compatibility. Some ESPs may still recommend it for legacy reasons or to cover edge cases, even though DKIM is generally sufficient for authentication.

October 2021 - EasyDMARC
Technical article

Documentation from Microsoft explains that ESPs recommend SPF records because it provides a basic level of authentication that is easy to implement and understand. Microsoft explains that it can help in scenarios where DKIM is not properly configured, and offers a means to verify the sender's domain.

December 2022 - Microsoft Learn
Technical article

Documentation from SparkPost explains that some ESPs recommend SPF because it was an earlier method of email authentication. While DKIM is now preferred and more robust, SPF can act as a fallback for systems that don't fully support DKIM, thus ensuring broader compatibility.

December 2021 - SparkPost
Technical article

Documentation from RFC Editor explains that while DKIM provides a stronger form of authentication, SPF can still be useful. It shares that SPF checks the MAIL FROM address, while DKIM authenticates the message content and headers. Some receiving servers might use SPF as a quick check to reduce the load on more complex DKIM validation processes.

August 2021 - RFC Editor
Technical article

Documentation from AuthSMTP answers that older systems and poorly configured email servers may still rely on SPF. Even if DKIM is correctly implemented, an SPF record provides an additional layer of authentication that some mail servers use to determine email legitimacy.

April 2022 - AuthSMTP