Two insurance employees reviewing data and analytics on two computer screens.

Insurance Data Quality: Why AI and Analytics Stall, and What Actually Fixes It

Posted in: Blog

Poor data quality is a major contributing factor to why AI and analytics initiatives stall and fail. These data quality issues aren’t caused by careless data entry – they’re continuously and reliably produced by the way the systems underneath are put together. Cleanup projects may work for a limited time and then the data starts drifting again.  

Data quality is an architecture outcome and it’s fixed at the point of capture and definition.  

What Causes Poor Data Quality in Insurance? 

There are five common structural causes of poor data quality in insurance: 

  1. Product and rating definitions are authored per transaction rather than once. This is a root cause but rarely discussed. When a coverage change means a new product variant without any version lineage, it causes issues in reporting. 
  2. System fragmentation and the duplicate work it forces. Policy administration in one system, claims in a second, finance in a third, reinsurance in a spreadsheet. Every handoff is another data-entry event, introducing the chance for errors.  
  3. Free text where it should be a structured field. This introduces errors and inconsistencies and can make it difficult for analytics. This is in part caused by risk details arriving via PDF or email or over the phone, but unstructured fields by default is a decision.  
  4. No validation at the point of capture. Errors go into the system and are either caught only at month-end reporting by someone who can’t correct them or not found at all.  
  5. Spreadsheets as the integration layer. Bordereaux, program reporting and reinsurance schedules are often reconciled by hand.  

Why is Data Quality an Urgent Problem? 

Data quality is an urgent problem because it’s the binding constraing on both halves of your data strategy: the analytics you rely on today and the AI initiatives you’re exploring.  

AM Best’s April 2026 survey found that roughly 60% of more than 150 insurers and MGAs expect AI to significantly transform their business model and 41% are already using AI. They ranked data readiness as the leading barrier – ahead of security, privacy and legacy integration.  

Datos Insights’ 2026 insurer IT survey found data quality and governance is now the top execution challenge for large insurers. At the same time, roughly a third of midsize insurers’ transformation budgets go to data infrastructure and analytics. Data is simultaneously the biggest priority and the biggest obstacle. 

AI is reliant on quality data to be effective. Before this technology, people were the error-correction layer. An experienced underwriter who knew the broker, the region and the risk could compensate and fill in the missing information. An AI model can’t do that.  This is why many AI pilots do well but fail to scale. 

Analytics fails more quietly. A bad report produces a plausible number that isn’t questioned. Or reporting just isn’t used because it’s known it’s not accurate. Furthermore, you can only segment what you’ve structured – many insurers and MGAs can report loss ratio for a book of business but not by construction type, occupancy, or other fields which is where pricing and appetite decisions should be made.  

The Uncomfortable Truth: A New Policy Administration Doesn’t Clear Your Data 

Replacing your policy administration system won’t fix your data quality issues on its own. Even if the system is designed to require you to setup products and workflows with data quality in mind, it doesn’t clean up your historical data. A modern core platform will stop the causes from operating going forward and giving you a single place where the current definitions live, so remediation is a finite piece of work rather than a regular one.  

What Fixes Data Quality Issues Structurally

There are 5 main capabilities that fix the 5 causes of data quality issues for insurers, MGAs, and program brokers: 

  1. A since source of truth. Policy, claims, finance and reinsurance are written against the same record, so there is no reconciliation step. 
  2. Definitions authored once and versioned. Products, rules and rating is built in one place and reused everywhere with version history, so any number can be traced back to the definition that produced it. 
  3. Validation and rules at the point of capture. Conditional questioning and rules-based referral at entry, so an error is caught by the person who can immediately fix it. 
  4. Capture at the source, once. Nobody downstream has to re-key it. 
  5. A data warehouse you own, with real-time access. Reporting off a structured, current source.  

This is how we designed the Modular Solutions platform to operate: it’s a policy administration system that’s holistic, with policy, claims, finance, reinsurance, broker portal, and direct-to-consumer in one platform. Our Product Module is an end-to-end product designer that offers versioning. Validation and rules are enforced at the point of capture. It offers API connectivity, meaning no more duplicate entry and everything is visible on the policy record. Finally, you have a data warehouse with full ownership and access to your data. 

Where to Start with Improving Data Quality 

None of this requires an immediate platform decision or change. These steps are all worth doing to help improve data quality: 

  1. Pick one number you don’t trust. This can be loss ratio by program, renewal or retention figure, whatever it is that’s important and inaccurate.  
  2. Trace the number back to its origin and understand what is causing the inaccuracies.  
  3. Audit definitions, not records. Count how many versions of this product exist and how many of them you could reconstruct today.  
  4. Fix definitions before migration, not after. Having this figured out will drastically help with product design, implementation, and future data quality.  

How can a modern policy administration system improve data quality?  

By removing the causes rather than correcting the symptoms. A modern policy administration system holds policy, claims, finance and reinsurance on one record, authors product and rating definitions once with version history, and validates at the point of capture — so errors are prevented. 

Will migrating to a new policy administration clean our existing data? 

No. Migration moves your data as it is and historical inconsistency, errors, and missing information don’t resolve. What should change is that the causes behind these issues should be resolved, so remediation becomes a finite project instead of an ongoing one. 

How much of a data quality problem is really a people problem? 

Less than most assume. If a field can be skipped, captured as free text, or re-typed between systems, the error rate is a design outcome rather than a discipline one. Training can help, absolutely, but the issues still boil down to the system.  

 Data Quality, In Conclusion 

Improving data quality has a reputation for being slow, expensive and thankless. Mostly it’s the third. Tracing one number takes about a week, and it tells you whether you have a cleanup problem or an architecture problem. Only one of those is solved by cleaning. 

If you want a second set of eyes on what you find, we’re glad to help. Book a walkthrough and we’ll show you what author-once definitions and a single policy record look like on a live book.