← Foundation Course /Module 04 - What the Model Doesn't Know /Lesson 4.2
MODULE 04 · WHAT THE MODEL DOESN'T KNOW

From Model Output
to Professional Decision

📖 ~20 min · Lesson 13 of 15 · 3 micro-checks + quiz · Foundation Level · Free
Cairn Underwriting - Edinburgh · When the Model Says One Thing and Experience Says Another

Cairn Underwriting is a managing general agent based in Edinburgh, writing specialty property and marine risk across the UK and Northern Europe. Their senior underwriter, David, has been writing Norwegian offshore energy risks for fourteen years. He knows the North Sea platforms, the operators, the loss history, and the seasonal risk patterns better than any model does.

A new submission arrives: a large production platform with USD 180M TIV. The cat model run by Cairn's junior analyst, Anya returns a 1-in-100 year OEP of USD 31M and an AAL of USD 890K. David looks at the numbers and shakes his head. "The model is underestimating this. That platform is old, poorly maintained, and in a zone where the model's storm data is thin. I'd put the real number at least 40% higher."

Anya is uncertain. But David has fourteen years of experience telling him something different. Who is right and more importantly, whose view should determine the price?

A cat model output is the beginning of a professional assessment, not the end of one. What is the relationship between model output and the decisions that follow and what role does judgement play in the gap between the number and the decision?

The Number Is Not the Decision

Every cat model output is a starting point. It tells the analyst and the underwriter, what a probabilistic model calculated given a set of inputs, assumptions, and physical science calibrations. What it does not tell anyone is whether to accept the risk, at what price, in what structure, or with what conditions. Those are decisions. Decisions require judgement. The model provides essential input to that judgement but cannot replace it.

This is not a limitation of current cat models, it is a structural feature of what models are. A cat model is a quantitative framework built on historical data, physical science, and calibration assumptions. It knows what it has been calibrated to. It does not know the maintenance history of a specific offshore platform. It does not know that a new building's contractor cut corners on the roof connections. It does not know that a city's drainage system has deteriorated since the flood maps it is using were drawn. The practitioner carries that knowledge.

The Right Relationship

The model is one input into a professional view of risk. It is typically the most important quantitative input the anchor for the expected loss calculation and the tail risk estimate. But it sits alongside market knowledge, exposure data quality assessment, non-modelled item evaluation, and underwriting experience. A decision made purely from the model ignores what the model cannot know. A decision made purely from experience without the model ignores the discipline the model provides. Professional cat modelling practice is the combination of both.

How the Number moves from the Model to a Decision

Between the moment Anya runs the model and the moment David decides whether to bind the Norwegian platform, several things happen. Each step adds information or context that the model alone could not provide. Understanding this journey is what allows a new practitioner to understand where their work fits in the larger professional process.

M
Step 1 - Model Output
The model produces the numbers

Anya runs the stochastic catalogue against the platform's exposure data. The model returns an AAL of USD 890K and a 1-in-100 year OEP of USD 31M. These figures reflect the physical science of North Sea storm hazard, the platform's TIV and reported construction class, and the financial terms of the policy. The model has done everything it was designed to do.

A
Step 2 - Analyst Assessment
The analyst evaluates data quality and model fitness

Anya reviews what the model was given. The construction class was reported as "offshore steel platform" a broad category. The year built is 1987 older than many of the damage functions were calibrated to. The geocoding is accurate to platform coordinates. She notes that the model's North Sea storm catalogue is thinner than its UK onshore catalogue. She documents these observations. The model number is reliable within the limits of what it was given.

J
Step 3 - Contextual Knowledge
The underwriter adds what the model cannot know

David brings years of North Sea experience to the number. He knows the operator's maintenance record from previous submissions. He knows the platform's structural inspection history. He knows that the zone it operates in has seen more severe storm intensity in recent years than the historical average the model's catalogue was built on. None of this is in the model. All of it is relevant to the actual risk.

D
Step 4 - Professional Decision
A view of risk is formed and a decision is made

David and Anya together form a view: the model's USD 31M 1-in-100 year figure is a reasonable quantitative anchor, but given the data quality gaps and the platform-specific concerns, the practical view of risk warrants a loading. They agree on a view of approximately USD 43M at the 1-in-100 year level, a 39% upward adjustment which feeds the pricing recommendation. The decision to bind, decline, or seek more information rests with David. The model informed the starting point. The professional judgement determined the view.

Micro-Check · Before You Continue

Anya is presenting the Norwegian platform analysis to David. She says: "The model shows a 1-in-100 year OEP of USD 31M, which I'd take as the base estimate. But the model's North Sea storm catalogue is calibrated primarily to historical data from the period 1970-2010, and the platform's 1987 vintage means its damage functions may not fully reflect its actual structural condition. I'd suggest presenting this with a range rather than a single figure." Is Anya doing her job correctly and what does her approach illustrate about the analyst's role?

Yes, Anya is doing exactly what a good analyst does. She has produced the model output, assessed its limitations, and communicated both the number and the context that qualifies it. The model's North Sea catalogue vintage and the platform's age are legitimate sources of additional uncertainty beyond what the model's standard output captures. Presenting a range rather than a single figure honestly represents what the model can and cannot say with confidence. Her approach illustrates that the analyst's role is not just to produce a number but to characterise the reliability of that number, to tell the underwriter where the model can be trusted and where its limitation means the professional judgement is needed.

What "View of Risk" Means

In professional cat modelling practice, a "view of risk" is the considered position on a risk's expected loss and tail exposure that an organisation adopts for pricing and accumulation management. It is not synonymous with the model output. It incorporates the model output as the primary quantitative input and then layers on the additional context data quality assessment, non-modelled item evaluation, market knowledge, and underwriting experience that the model alone cannot provide.

What Goes Into a View of Risk - Cairn's Norwegian Platform

From the Model

1-in-100 year OEP: USD 31M based on stochastic storm catalogue

AAL: USD 890K from probability-weighted event losses

Physical damage only no BI, no pollution liability

Generic offshore steel construction damage functions

From Professional Judgement

Platform age and maintenance record suggest higher-than-default vulnerability

Operator's historical loss frequency above market average known from prior submissions

Recent storm intensity trend in this zone

Non-modelled BI and pollution liability exposure needs separate assessment

The view of risk is what the underwriter takes into the pricing conversation. It may be numerically close to the model output if the data is good, the peril is well-calibrated, and no significant contextual factors pull in either direction. It may diverge substantially if there are data quality gaps, non-modelled exposures, or market intelligence that changes the picture. What matters is that the view is explicit and reasoned not a gut feeling overriding the model, and not blind acceptance of the model ignoring everything else.

When and Why Judgement Diverges from the Model

There are legitimate reasons to form a view above or below the model output. Understanding when those reasons apply and when a divergence from the model is instead a red flag is one of the core professional skills the cat modelling practice develops over time.

Reasons a Professional View Might Diverge from Model Output

↑ View above model

Data quality gaps in the exposure: incomplete COPE, approximate geocoding, or missing TIV components mean the model is working with less information than the risk actually presents. The model's output may understate the risk simply because it did not receive accurate inputs.

↑ View above model

Known non-modelled items: significant BI exposure, demand surge risk in a concentrated geography, secondary perils the model does not capture, or litigation risk in a market known for loss amplification all justify a view above the raw physical damage output.

↑ View above model

Market intelligence the model cannot access: knowledge of a specific operator's poor maintenance record, a building's known structural deficiencies, or a location's local drainage problems that are not reflected in the model's hazard grid.

↓ View below model

Confirmed risk mitigation the model defaults conservatively on: a newly retrofitted building the model treats as older stock, a sprinkler-protected warehouse the model applies a standard fire loading to, or a coastal property with documented flood barriers the model's grid does not capture.

↓ View below model

Model conservatism in thin-data regions: for some geographies and perils, models apply conservative defaults where data is sparse. If an independent assessment of the risk produces a more optimistic view, the professional judgement may sit below the raw model output.

= View with model

Good data, well-calibrated peril, no material non-modelled items: a well-geocoded modern building in a mature insurance market with confirmed COPE and accurate TIV, assessed on a well-calibrated peril like US hurricane windstorm. Here the model output is often the most reliable single estimate available and diverging from it requires explicit justification.

The Discipline That Makes Judgement Professional

Adjusting the view of risk above or below the model is not something that should be done casually or without documentation. A professional view of risk states the model output, identifies the reasons for any adjustment, quantifies the adjustment where possible, and records the reasoning. An adjustment that cannot be explained and documented is not professional judgement it is overriding the model for reasons the organisation cannot assess or audit

Micro-Check · Before You Continue

David's upward adjustment to Cairn's view of risk on the Norwegian platform is based on his experience with the operator and his assessment of recent storm intensity trends. Anya is uncomfortable because the adjustment is not directly derived from the model. Is her discomfort justified and what would make David's adjustment more professionally defensible?

Anya's discomfort is understandable but only partly justified. The model cannot be the sole input to a professional view of risk. If it were the vast body of market knowledge, underwriting experience, and contextual intelligence that practitioners carry would be systematically excluded from pricing decisions. David's knowledge of the operator's maintenance record and the storm intensity trend are legitimate inputs that the model genuinely cannot access. The discomfort becomes fully justified if David's adjustment is not documented. A 39% upward loading applied because "it feels right" to a senior underwriter is not auditable, not transferable if David leaves. What makes it professionally defensible is explicit reasoning: "We apply a 20% loading to the 1-in-100 year figure for platform vintage and maintenance concerns, and a further 15% loading for non-modelled storm intensity trend, based on the following specific observations..." With that documentation, the adjustment is a professional judgement.

What Sign-Off Means

In most professional cat modelling environments, model outputs do not go directly to the underwriter. They pass through a review and sign-off process, a check that the run was configured correctly, the data quality is understood, the limitations have been identified, and the output is fit for the purpose it is being used for. This process exists because the downstream consequences of a model run, pricing decisions, capital allocation, regulatory submissions are consequential enough for verification.

Sign-off is not a guarantee that the model is right. It is a confirmation that the model was used correctly, with known-quality inputs, and that the limitations of the output have been appropriately characterised. A signed-off model run on poor-quality exposure data is still a model run on poor-quality data. Sign-off documents does not correct what was missing.

Understanding what sign-off means and what it does not mean, matters for practitioners at every level. A junior analyst preparing a run for sign-off needs to understand that their responsibility is not just to produce a number but to document what the number does and does not reflect. A senior analyst reviewing a run for sign-off is confirming that the work was done correctly and that the caveats are complete. Neither is certifying that the output is the truth, only that it is what the model produced given the inputs it received.

Micro-Check · Before You Continue

Cairn's head of cat modelling reviews Anya's Norwegian platform run before it goes to David. She approves the run but notes in the sign-off that the North Sea storm catalogue vintage introduces additional uncertainty at higher return periods, and that no BI loading has been applied. David receives the output with these caveats attached. What has the sign-off process achieved and what has it not achieved?

The sign-off has achieved three things. First, it confirms the run was technically correct. The model was configured appropriately. The exposure data was used as received and` the financial terms were applied correctly. Second, it ensures the limitations travel with the output. David cannot claim he was not told about the catalogue vintage concern or the missing BI component. Third, it creates an audit trail, if the risk is bound and a loss occurs, Cairn can demonstrate that the modelling was conducted appropriately and the limitations were disclosed.

What it has not achieved: it has not corrected the catalogue vintage concern, it has not added a BI estimate, and it has not made the model output more accurate. The sign-off documents the work; it does not improve the underlying data or model calibration. David still needs to form his own view of risk, the sign-off tells him what the model produced and what caveats apply, but the professional decision about whether to bind and at what price remains his.

Common Misconceptions

01
"The model makes the decision"

The model produces an output. The decision is made by the underwriter, who uses the output as one input among several. A decision made purely from model output ignores everything the model cannot know. No professional pricing or risk acceptance decision is or should be made by handing the model output directly to the binding authority without contextualisation.

02
"Experienced underwriters don't need the model"

Experience provides irreplaceable context. It does not provide a probability distribution over thousands of synthetic events calibrated to the physical science of hazard. David's fourteen years of North Sea experience tells him the model is underestimating, it does not give him an AAL or an EP curve. The model and the experience are complements, not substitutes.

03
"Adjusting away from model output is unprofessional"

Adjusting without documented reasoning is unprofessional. Adjusting with explicit, reasoned, documented justification is exactly what the professional view of risk is supposed to represent. The model is calibrated to general patterns; the professional view incorporates specific knowledge the model cannot access. Both are necessary.

04
"Sign-off means the output is correct"

Sign-off means the output was correctly produced from the inputs provided, and the limitations are documented. It does not mean the inputs were accurate, the model was the right tool for this risk, or the output will match the actual loss. Sign-off is a process discipline, not an accuracy guarantee.

Key Terms

View of Risk

The considered professional position on a risk's expected loss and tail exposure, incorporating model output plus additional context on data quality assessment, non-modelled item evaluation, and underwriting experience. The basis on which pricing and acceptance decisions are made.

Model Output

The numerical result produced by a cat model run AAL, EP curve, return period losses. The primary quantitative input to the view of risk.

Underwriting Judgement

The professional assessment brought by an experienced underwriter to supplement model output, knowledge of specific risks, operators, markets, and loss patterns that no model can access. Works alongside model output to form the view of risk.

Loading

An upward adjustment applied to a model output to account for known limitations, non-modelled items, data quality gaps, or specific risk factors that justify a view above the base model estimate. Must be documented and reasoned to be professionally defensible.

Sign-Off

The review and approval process confirming that a model run was correctly configured, the data quality is understood, and the limitations are documented. Confirms the work was done correctly.

Binding Authority

The authority to formally accept a risk and issue a policy. In most underwriting environments, the cat modelling analyst does not hold binding authority they inform the underwriter's decision, which is exercised by the person with delegated authority to bind.

Knowledge Check - Lesson 4.2

Five questions · 4 of 5 correct (80%) to pass

1. Anya produces a cat model run for a new submission, a warehouse complex in Rotterdam with excellent exposure data, precise geocoding, confirmed construction class, and full COPE. The peril is European windstorm, a mature, well-calibrated model domain. The 1-in-100 year OEP is USD 8.4M. David reviews the run and says the figure looks right to him based on his experience. Should Cairn's view of risk for pricing purposes be materially different from USD 8.4M, and why?

AYes, a professional view of risk should always include a loading above model output to account for non-modelled items and model uncertainty. An unloaded model figure should never be used directly for pricing.
BNot necessarily. This is the scenario where model output and view of risk should be closest: good data, well-calibrated peril, experienced underwriter whose market knowledge confirms rather than challenges the figure. If there are no significant non-modelled items, no data quality concerns, and no market intelligence pulling in a different direction, the professional view may well sit close to the USD 8.4M model output. Diverging from a reliable model output without specific reason is not professional judgement, it is arbitrary adjustment. The discipline cuts both ways: just as undocumented upward adjustments are not professional, undocumented downward adjustments or reflexive loading on a reliable figure are equally unjustified.
CYes, David's experience adds value that the model cannot provide. His confirmation that the figure "looks right" is itself an upward confirmation that the model is at the right level, which means the view of risk should incorporate a small loading to reflect the additional confidence the experience provides.
DNo, for mature European windstorm, the model output is so well-calibrated that professional judgement adds no value. Cairn's view of risk should be set exactly at the model output of USD 8.4M in all cases.

2. David decides to apply a 40% loading to the Norwegian platform's modelled AAL of USD 890K, making Cairn's view of risk AAL USD 1.25M. He does not document his reasoning. Six months later, David moves to a competitor firm. A new underwriter inherits the account. Why is the absence of documentation a professional problem, and what specifically has been lost?

AThe absence of documentation is only a problem if the account incurs a loss, in that case, Cairn cannot demonstrate the loading was appropriate. As long as no loss occurs, undocumented loadings are a normal feature of underwriting practice.
BThree things have been lost. First, the reasoning: the new underwriter sees USD 1.25M as the view of risk but has no way of knowing whether that figure includes a loading, what it was for, or whether it was appropriate for the specific characteristics of this platform. She cannot assess whether the loading should still apply at renewal or whether circumstances have changed. Second, the audit trail: if a loss occurs, Cairn cannot demonstrate that the pricing reflected a considered, reasoned view rather than an arbitrary adjustment. Third, the learning: if the 40% loading proved to be right, or wrong, the organisation cannot learn from that outcome because it cannot connect the loading to the specific factors that justified it. Undocumented professional judgement is knowledge that stays in one person's head and leaves with them.
CThe absence of documentation is a regulatory problem but not an underwriting problem. Regulators may require documented pricing rationale, but from a pure risk management perspective, experienced underwriters are trusted to apply loadings based on their market knowledge without needing to justify every adjustment in writing.
DThe problem is limited, the new underwriter can simply run the model again and apply her own judgement. The absence of David's documentation means the account is reset to model output at renewal, which is the appropriate default when the prior underwriter's reasoning is unavailable.

3. Cairn's head of cat modelling signs off on a model run for a Turkish industrial portfolio. The sign-off notes that the exposure data has several locations geocoded at city level and that construction class is unknown for 30% of locations. Two months later, the portfolio incurs a large earthquake loss that significantly exceeds the modelled estimate. Is the sign-off a defensible position, and what does it not protect against?

ANo, the sign-off is indefensible. Signing off on a run with known data quality gaps that could affect the output is a professional failure. The run should have been rejected until the data quality issues were resolved.
BThe sign-off is defensible as a process, it correctly documented the data quality limitations before the run was used for pricing. A model run with known limitations used with disclosed caveats is professionally acceptable; the alternative of refusing to model until all data is perfect would prevent most real-world underwriting. What the sign-off does not protect against is the consequence of the limitations themselves, if the city-level geocodes placed locations in lower-hazard grid cells than their actual positions, and the unknown construction defaults understated vulnerability, the model output was less reliable than good data would have produced. The sign-off documents the limitations; it does not correct them. The earthquake loss exceeding the modelled estimate is the consequence of the data quality, not of the sign-off process.
CThe sign-off is defensible only if Cairn applied a loading to the model output to account for the data quality concerns. A signed-off run with data quality gaps and no loading is professionally indefensible because the known limitations should have resulted in an upward adjustment to the view of risk.
DThe sign-off is irrelevant, what matters is whether the pricing was adequate for the risk. If the premium collected was sufficient to cover the loss, the process was sound regardless of the sign-off documentation. If it was not sufficient, the sign-off cannot protect Cairn from the commercial consequences.

4. A junior analyst at Cairn tells Anya: "My job is to run the model and hand the number to the underwriter. What they do with it after that is their business." What is wrong with this view of the analyst role?

ANothing is wrong with it, the division of labour is appropriate. The analyst produces the technical output; the underwriter applies professional judgement. Keeping these roles distinct prevents analysts from overstepping into underwriting decisions they are not qualified to make.
BThe analyst is the only person in the chain who fully understands what the model produced and why. Handing the number without context, without the data quality assessment, without the non-modelled item identification, without the model limitation caveats, gives the underwriter a figure that looks complete but may be incomplete in ways they cannot detect. The analyst's responsibility is not just technical production but contextual communication: telling the underwriter what the number does and does not reflect, so the professional view of risk incorporates the right information. An analyst who hands a number and considers their work done has produced output, not analysis.
CThe problem is one of career development rather than professional responsibility. An analyst who disengages after producing the number misses the opportunity to learn from how the underwriter uses the output, which is important for developing the professional judgement they will need as they advance.
DThe view is wrong only for complex risks where the data quality is poor. For clean, well-modelled risks, handing the number to the underwriter without additional context is appropriate and efficient.

5. Cairn considers two approaches to the Norwegian platform. Approach A: use the model output of USD 31M as the view of risk and price accordingly. Approach B: refuse to bind the risk because the model output is uncertain and cannot be fully trusted. Why are both approaches wrong, and what does the right approach look like?

AOnly Approach A is wrong. The model output carries too much uncertainty for this risk to be used without significant adjustment. Approach B is prudent risk management, declining risks where model uncertainty is high prevents adverse selection and protects the portfolio.
BBoth are wrong. Approach A treats the model output as the complete view of risk, ignoring everything the model cannot know, including the platform-specific concerns David has identified and the non-modelled BI exposure. Approach B treats model uncertainty as a reason not to underwrite, which would make most specialty risk uninsurable, since model uncertainty exists in almost all non-standard risks. The right approach is what Cairn actually does: use the model output as the primary quantitative anchor, layer on the contextual knowledge through documented professional judgement, form an explicit view of risk with the adjustment reasoned and recorded, and price from that view. Uncertainty is not a reason to decline, it is a reason to price for the uncertainty, disclose the limitations to the relevant stakeholders, and monitor the risk carefully.
CBoth approaches are wrong only in extreme cases. For most risks, using the model output directly (Approach A) is the correct basis for pricing. For high-uncertainty risks, declining (Approach B) is appropriate risk management. The Norwegian platform falls somewhere in between, the right approach depends on Cairn's risk appetite.
DApproach A is correct for Cairn's cat modelling team and Approach B is correct for the underwriter. The analyst should present the model output without adjustment; the underwriter's decision to bind or decline based on the full picture of risk is the appropriate exercise of the binding authority.