Cold Testing
Written by Justin Goodman, CIC, CISC, CLCS, CEO and Co-Founder, Total CSR
Published: August 27, 2026 · Last reviewed: August 27, 2026
In plain language: Cold testing means someone calls a producer or agent pretending to be a shopper, with no warning given, to check whether the agent follows required disclosure and sales scripts. Agencies use it to catch bad habits before a real client complaint or lawsuit does.
Technical definition: Cold testing is an errors and omissions loss control method in which a compliance reviewer or third-party auditor places an unannounced test call to a producer to evaluate adherence to mandated disclosures, needs-analysis questions, and licensing representations, without the producer's foreknowledge that the call is a test.
Cold Testing at a Glance
| Attribute | Detail |
|---|---|
| Also known as | Mystery shopping, script compliance testing, unannounced call monitoring |
| Category | Errors and omissions risk management practice |
| Lines of business | Errors and Omissions Insurance, Professional Liability |
| Industries most affected | Insurance agencies, brokerages, call centers, direct-to-consumer carriers |
| Related forms or endorsements | None (operational practice, not a policy form) |
| Who bears the risk | Producing agency, individual producer, and the E&O carrier if a gap surfaces in a claim |
| Common solution | Recorded script libraries, scheduled cold test cycles, documented corrective action plans |
| Also interacts with | Warm testing, call recording retention policy, licensing compliance audits |
Key Takeaways
- Cold testing is an unannounced test call used to confirm a producer follows required disclosure and sales language exactly as trained.
- Cold testing matters in day-to-day agency work because it exposes real behavior under normal conditions, not rehearsed behavior producers show when they know they are being watched.
- The most common pitfall is treating a single passing cold test as proof of ongoing compliance, when compliance can drift within weeks without reinforcement.
- A quick win for agencies is pairing cold testing with a written corrective action log, since documentation of the correction is often what protects the agency in an E&O claim, not the test itself.
On This Page
- What Is Cold Testing in Insurance?
- How Does Cold Testing Work?
- Real Claim Examples Involving Cold Testing
- Cold Testing vs. Warm Testing: What Is the Difference?
- What Are the Most Common Mistakes With Cold Testing?
- How to Explain Cold Testing to a Client
- Frequently Asked Questions About Cold Testing
- Related Insurance Terms
- About the Author
What Is Cold Testing in Insurance?
Cold testing is a quality control technique agencies and carriers use to verify that a producer actually says what compliance requires when a real customer is on the line, not just what the producer says during a scheduled evaluation. The practice exists because scripted disclosures, such as coverage limitations, replacement cost explanations, or licensing statements, are only protective if delivered consistently. A producer who recites the correct language during a supervised role-play but skips it on live calls creates the exact gap that turns a routine E&O policy into an active claim.
The legal reasoning behind cold testing sits close to the doctrine of reasonable care in professional liability. Courts and regulators generally look at what a producer actually told a client, not what the agency's training manual says should have been said. If a client alleges they were never informed a policy excluded flood damage, an agency's best defense is a documented, repeatable pattern showing that disclosure language was consistently delivered and independently verified, not just written down somewhere.
A concrete example: a personal lines agency requires producers to state that earthquake coverage is excluded and available for an additional premium on every homeowners quote call. A compliance auditor places a cold call posing as a new prospect. The producer completes the entire quote without mentioning the earthquake exclusion. Because the call was unannounced, the agency now has honest evidence of a real gap, rather than a false sense of security from a scripted supervised call where the producer knew to include the disclosure.
Total CSR's assessment work with agencies consistently shows that producers who pass supervised script reviews fail cold tests on the same material at a rate high enough to be a pattern, not an outlier, particularly on time-sensitive disclosures like coverage exclusions and premium financing terms that get rushed during a live sales conversation.
How Does Cold Testing Work?
- The script baseline. The agency or carrier defines the required disclosure language, licensing statements, and needs-analysis questions producers must deliver on every applicable call.
- The unannounced call. A compliance reviewer, secret shopper, or automated testing vendor places a call to the producer posing as a genuine prospect, with no advance notice to the producer or their supervisor.
- The recording and scoring. The call is recorded and scored against the baseline script, noting omissions, inaccuracies, or unlicensed representations.
- The gap identification. Any deviation from required language is flagged, categorized by severity, and routed to the producer's supervisor or compliance officer.
- The corrective action. The producer receives targeted retraining or coaching on the specific gap, and the correction is documented in the compliance file for future E&O defense purposes.
Real Claim Examples Involving Cold Testing
Missed flood exclusion disclosure on a coastal homeowners quote
A coastal agency's cold testing program revealed that a producer consistently failed to mention that flood damage required a separate NFIP policy when quoting homeowners coverage. Before the gap was caught and corrected, a client experienced a basement flood and filed a complaint alleging the agency never disclosed the exclusion. Because the agency had cold-test records showing the specific gap was identified and remediated for that producer only weeks earlier, the agency demonstrated an active compliance program to its E&O carrier, which supported a stronger defense posture during the claim investigation.
Licensing misstatement caught before regulatory action
A multi-state agency used cold testing to check whether producers correctly stated their licensed states before quoting out-of-state business. A test call uncovered a producer implying they were licensed in a state where they were not yet appointed. The agency pulled the producer from that territory immediately and documented the correction, avoiding what could have escalated into an unauthorized insurance practice complaint with the state department of insurance.
Premium financing terms omitted on commercial quotes
A commercial lines call center's cold test program found that producers routinely skipped required disclosures about premium finance interest rates and cancellation terms when clients chose installment billing. A client later disputed a cancellation notice, claiming they were never told about the finance agreement's terms. The agency's cold test documentation showing the gap had already been flagged agency-wide, with a training rollout in progress, helped establish that the omission was a known and actively managed risk rather than willful concealment.
Cold Testing vs. Warm Testing: What Is the Difference?
Cold testing evaluates a producer with no advance warning that a test is occurring, while warm testing, sometimes called a scheduled script review, evaluates the same producer with prior notice that a supervisor or compliance reviewer will be listening or scoring the call. Both are quality assurance tools, but they measure different things and agencies typically need both to get an accurate compliance picture.
| Comparison area | Cold Testing | Warm Testing |
|---|---|---|
| Primary use case | Measuring true, unrehearsed producer behavior | Measuring producer knowledge and script familiarity |
| Coverage / concept type | E&O loss control practice | E&O loss control practice |
| Typical exclusions | Does not evaluate producer's technical knowledge in isolation | Does not reveal behavior under real, unmonitored conditions |
| Who is most affected by errors | New producers and high-volume call center staff | Producers who over-prepare for known evaluation windows |
| Common mistakes | Treating one passing test as ongoing proof of compliance | Assuming scheduled review results reflect daily call behavior |
What Are the Most Common Mistakes With Cold Testing?
- Running cold tests once a year instead of on a recurring cycle, which lets script drift return long before the next test catches it.
- Failing to document corrective action after a failed test, leaving the agency with evidence of a known gap but no proof it was fixed, which can worsen an E&O claim outcome rather than help it.
- Testing only new hires and skipping tenured producers, when Total CSR's assessment data consistently shows experienced producers drift furthest from scripted language because they rely on memory instead of the written disclosure.
- Using the same test scenario repeatedly, which allows word-of-mouth among producers to spread the test pattern and defeats the purpose of an unannounced check.
- Storing cold test recordings without a retention policy, creating uncertainty about whether documentation will exist when a claim surfaces months or years later.
- Treating cold testing as a punitive tool rather than a coaching tool, which drives producers to hide problems instead of reporting them.
How to Explain Cold Testing to a Client
Explaining Cold Testing to a personal lines client
Cold testing is something we do internally to make sure every agent explains your coverage the same way, every time, even when nobody is watching. We occasionally have someone call in as a test shopper to check that our team is giving accurate, complete information. It is one of the ways we work to protect you from being under-informed about your policy.
Explaining Cold Testing to a small business owner
Cold testing is a compliance check we run on our own producers, using surprise test calls to confirm they are covering all the required disclosures on every quote. Think of it as an internal audit that happens without warning, so we catch gaps in real conditions instead of a rehearsed review. It helps make sure the coverage conversations you and your team have with us are consistent and complete.
Explaining Cold Testing to a CFO or risk manager
Cold testing is part of our errors and omissions risk management program, where we place unannounced test calls to our own producers to verify script and disclosure compliance under live conditions rather than supervised conditions. The results feed directly into our corrective action documentation, which is part of what we can show our E&O carrier if a coverage dispute ever arises. It is a proactive control designed to catch gaps before they become claims, and we would be glad to share our testing cadence with your team if useful for your vendor risk review.
Frequently Asked Questions About Cold Testing
What is the difference between cold testing and a customer complaint audit?
Cold testing is proactive and uses a simulated call before any real problem occurs, while a customer complaint audit is reactive and reviews an actual client interaction after a complaint has been filed. Cold testing is designed to catch gaps before they cause harm, whereas a complaint audit investigates harm that has already happened. Agencies with mature compliance programs use both, since each catches different types of risk.
Who typically performs cold testing at an agency?
Cold testing can be performed internally by a compliance officer or supervisor, or outsourced to a third-party mystery shopping vendor that specializes in insurance compliance testing. Larger agencies and call centers often use third-party vendors specifically so the test caller is unfamiliar to producers and cannot be recognized. Smaller agencies frequently rely on a compliance manager or trusted colleague from a different office location.
Does cold testing protect an agency from an E&O claim?
Cold testing alone does not prevent a claim, but documented cold testing combined with corrective action can materially strengthen an agency's defense position when a claim alleges inadequate disclosure. The value lies in showing a pattern of active, ongoing quality control rather than a one-time compliance effort. An E&O carrier reviewing a claim file responds very differently to a documented program than to no evidence of oversight at all.
How often should an agency run cold tests?
Most agencies benefit from a recurring cycle, commonly monthly or quarterly, rather than a single annual event, because script compliance tends to drift steadily over time without reinforcement. High-turnover call centers and agencies selling complex commercial lines products often test more frequently given the higher stakes of a missed disclosure. The right cadence depends on producer volume, product complexity, and the agency's claims history.
Can a producer refuse to be cold tested?
Cold testing is an internal quality assurance and employment practice, not a regulatory requirement, so specific policies vary by agency employment agreement and state employment law. Most agencies build cold testing into producer training and performance expectations from the start, which reduces pushback. Producers are generally informed that cold testing occurs as part of the compliance program, even though they are not told when any specific call will happen.
Related Insurance Terms
- Errors and Omissions Insurance: A professional liability policy that covers an insurance agency against claims of negligence, misrepresentation, or inadequate advice; cold testing is a loss control tool used to reduce the likelihood and severity of claims under this coverage.
- Warm Testing: A scheduled, announced script review that evaluates producer knowledge under known conditions, often used alongside cold testing to build a complete compliance picture.
- Quality Assurance Monitoring: The broader category of ongoing call review and coaching practices that includes both cold and warm testing as specific methods.
- Producer Compliance Audit: A formal review of a producer's licensing, disclosures, and documentation practices, often triggered by patterns identified through cold testing results.
- E&O Loss Control: The overall set of practices, including cold testing, training, and documentation standards, that agencies use to reduce professional liability exposure before a claim occurs.
About the Author
Justin Goodman, CIC, CCIP, CISC, CLCS, CRIS, PCIA, QCLS, MFHR CEO and Co-Founder, Total CSR, Inc.
Justin Goodman is a third-generation insurance broker with over two decades in agency operations. He has trained more than 50,000 CSRs, account managers, and producers in commercial and personal lines coverage, from workers' compensation to construction risk. He was named 2024 Insurance Journal Agent of the Year and one of the nation's top five construction insurance experts by Risk & Insurance. He is the author of Retain, which applies cognitive science research on memory and knowledge transfer to insurance training, and speaks nationally on how agencies build durable technical expertise in their teams.