Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Level 3 — Practicing

At Level 3, VERA is no longer about whether to apply the framework. The question is only how well.


What Level 3 Feels Like

Level 3 is where VERA becomes organizational infrastructure rather than individual initiative. The defining characteristic is reproducibility: any significant claim produced by any practitioner in a Level 3 organization can be audited against the Verification Protocol. The quality may vary — some practitioners are more skilled than others — but the process is applied by everyone, all the time, for all significant claims.

This is a qualitative shift from Level 2. At Level 2, VERA work exists alongside normal work. At Level 3, VERA work is normal work — at least for significant claims. When someone asks “what’s the evidence for that?” the answer is a claim record, not a recollection. When someone asks “has this been verified?” the answer is a Verification Record identifier, not “yes, we reviewed it.”

The texture of daily work at Level 3 is different. Meetings where significant claims are introduced include references to verification state. Decision documents cite VERA claim IDs. When new evidence appears, it is assessed against existing claims to identify which ones require re-evaluation. When a claim is contested, there is a process for handling the contest — and it is used.

What Level 3 is not: it is not perfect. Reasoning chains at Level 3 still sometimes have gaps. Evidence sets sometimes have missing items. Verification is sometimes self-verification when independent verifiers are not available. What distinguishes Level 3 from Level 2 is not the absence of these imperfections — it is that imperfections are identified, documented, and addressed through the verification and review process, rather than being invisible or ignored.

The Level 3 organization has also resolved the person-dependence problem of Level 2. VERA practices survive personnel changes. When the original VERA champion moves on, others continue the practice — not because VERA is loved by everyone, but because it is mandated, resourced, and embedded enough in workflows that continuing it is easier than not.


The Six Domains at Level 3

Evidence

At Level 3, evidence documentation is a required part of producing any significant claim. “Significant” is defined in the organizational VERA policy — not assumed or interpreted ad hoc. The definition typically includes: claims that inform decisions above a defined stakes threshold, claims that will be communicated externally, claims that will be used as evidence in other claims, and claims that will be reviewed by oversight bodies or regulators.

Prospective search plans are written before evidence collection for all significant claims. This is the single hardest Level 3 Evidence habit to establish. It requires discipline at the moment when the practitioner is most eager to start searching — and it requires trust that the time invested in planning will be recovered in search efficiency and absence-evidence quality. Organizations that have successfully established this habit typically do so by making the search plan a deliverable: the plan must be submitted before search begins, creating an accountability point.

Evidence quality ratings are applied consistently across the team using a shared reference rather than each practitioner’s interpretation of the tiers. In practice, this means the organization has documented examples of Primary, Secondary, Tertiary, and Testimonial evidence in their specific domain — not just the abstract definitions — so that tier assignment is calibrated rather than variable.

Independence assessment is routine. Source collapse is caught in verification rather than slipping through. The evidence set for a claim reliably includes contrary evidence — not just supporting evidence — because the prospective search plan included anticipated contrary evidence sources, and the verification criteria check for their presence.

Level 3 Evidence indicators:

  • Every significant claim produced in the last 90 days has a rated evidence set with a documented prospective search plan
  • Absent evidence is systematically recorded; claims are not treated as having complete evidence sets when significant expected evidence types are missing
  • Evidence independence assessment is a standard part of evidence set review; source collapse errors are caught before verification completes
  • Domain-specific evidence quality examples exist and are used to calibrate ratings across practitioners

Reasoning

At Level 3, reasoning chains are standard, not exceptional. Every significant claim has one — not a summary of supporting considerations, but a step-by-step argument from evidence to conclusion with labeled inference types and documented assumptions.

The quality standard for Level 3 reasoning chains is: any practitioner in the organization should be able to read the chain and evaluate it. This is a calibration point. If a reasoning chain requires the domain expertise of its author to parse — if the logical steps only make sense to someone who already knows the field deeply — it is not an explicit enough chain. The inference steps must be written out completely enough to be followed by a VERA-competent non-specialist.

Peer reasoning review is a routine practice at Level 3. Not every claim needs a formal peer review of its reasoning chain, but claims above a significance threshold — those informing high-stakes decisions, those being communicated externally, those serving as evidence for other important claims — get reasoning chain review as a standard step, separate from and preceding formal verification.

Assumption documentation has matured by Level 3. Practitioners document not only the assumptions they are conscious of making but also actively search for hidden assumptions — premises the reasoning chain requires but doesn’t state. The habit of “what would need to be true for this step to work?” applied systematically to each reasoning step is the mechanism. It is not natural; it is a practiced discipline.

Level 3 Reasoning indicators:

  • Every significant claim has a step-by-step reasoning chain with labeled inference types
  • Reasoning chains are readable and evaluable by VERA-competent practitioners without domain expertise
  • Peer reasoning review is in place for high-significance claims prior to verification
  • Assumption documentation is comprehensive; the verification process includes checks for hidden assumptions

Verification

At Level 3, the Verification Protocol is applied consistently to all significant claims. “Consistently” means: using the same criteria, producing the same format of verification record, and applying the same standards for what “Met” means for each criterion.

Independence requirements are assessed for every verification event, not assumed. The verification record documents the verifier’s independence level (Foundational, Peer, or Expert) and the basis for that assessment. Verification records are complete: they document the findings for each criterion, not just the final state.

The verification process produces failures. This is a Level 3 quality signal — not a negative one. At Level 2, verification often feels like a hurdle that claims pass through. At Level 3, a meaningful percentage of claims submitted for verification come back for revision: the evidence set is incomplete, the reasoning chain has a gap, a contrary evidence item has not been addressed. The failure rate is tracked (at Level 4 it becomes a formal metric) and is used informally at Level 3 to assess whether claims are being prepared carefully.

Contested claims have a defined process that has been invoked at least once. The first contested claim is typically the organizational moment that crystallizes what the process must accomplish: a claim has been verified, someone believes the verification was wrong, and there must be a way to handle that dispute that is both fair and epistemically rigorous. By Level 3, this process exists and is documented.

Level 3 Verification indicators:

  • Verification Protocol is applied to all significant claims; no significant claims are self-described as verified without a Verification Record
  • All verification records are complete, with per-criterion findings and confidence ratings with justification
  • A non-trivial percentage of submitted claims are returned for revision rather than verified
  • Contested claim process exists and has been invoked at least once

Governance

Level 3 Governance is the critical transition that makes everything else sustainable. It consists of three elements: mandate, ownership, and scope.

Mandate: There is a documented organizational decision — a policy, a standard operating procedure, a leadership declaration — that significant claims will be documented and verified using VERA. The mandate is not a recommendation; it has consequences for non-compliance (at minimum, significant claims without VERA documentation are not treated as verified in decision-making contexts).

Ownership: Someone — a person, a role, a committee — is formally responsible for VERA practice. This owner is accountable for: ensuring practitioners are trained, maintaining the claim registry, setting the significance threshold (which claims require VERA treatment), and handling escalations when verification disputes or governance questions arise. The owner is not responsible for doing all VERA work — they are responsible for the framework within which others do VERA work.

Scope: The organization has defined which claims require VERA treatment. This definition is precise enough to apply consistently — not “important claims” but something like “claims that will be presented to the board, communicated in public materials, used to support regulatory submissions, or inform capital allocation decisions above $X.” Practitioners should be able to determine, for any given claim, whether it falls within scope without asking for guidance.

Training is a component of Level 3 Governance. New practitioners who join the organization receive VERA training as part of onboarding — not as optional enrichment, but as a required competency for their role.

Level 3 Governance indicators:

  • A documented VERA policy exists with named ownership
  • The significance threshold (which claims require VERA treatment) is defined in writing
  • New practitioners receive VERA training as part of onboarding
  • At least one person has formal accountability for VERA practice outcomes

Sovereignty

At Level 3, the formal sovereignty assessment has been completed. All five Sovereignty Principles have been evaluated: each is rated as fully met, partially met, or not met. Gaps are documented with specific descriptions of what is missing, and a remediation plan exists with owners and target dates.

The sovereignty assessment is itself a VERA claim: it has an evidence set (the specific tools, processes, and policies assessed against each principle), a reasoning chain (why each rating was assigned), and a verification state (it has been reviewed by someone other than the person who conducted the assessment).

Data Sovereignty (S1) is typically the easiest to assess at Level 3, because evidence documentation practice has generated the evidence needed: if evidence items have source references, access dates, and chain-of-custody documentation, it is straightforward to evaluate whether those sources are accessible and exportable. The common finding at Level 3 S1 assessment is that some evidence is stored in systems where organizational access is not guaranteed beyond the current vendor relationship.

Reasoning Sovereignty (S2) assessment at Level 3 typically finds that reasoning chains are visible to their authors and immediate collaborators, but that the claim registry’s accessibility determines whether anyone affected by a claim can actually trace its reasoning. This drives the claim registry accessibility requirement.

Process Sovereignty (S4) assessment is the most organizationally consequential at Level 3. It asks: are verification criteria published before claims are submitted? Can anyone affected by a claim access the Verification Record? Can the claim be formally challenged? The honest answer at Level 3 is often “the criteria are documented in the Verification Protocol, but they haven’t been published in a stakeholder-accessible format.”

Level 3 Sovereignty indicators:

  • Formal sovereignty assessment completed within the last 18 months
  • All five principles rated with specific evidence for each rating
  • Remediation plan exists for any principle rated “not met” or “partially met”
  • Claim records and Verification Records are accessible to stakeholders who are affected by those claims (not just to the practitioners who created them)

Integration

At Level 3, VERA has moved from a parallel practice to a visible presence in the organization’s knowledge artifacts and workflows. The specific integrations vary by organization, but the common ones at Level 3 include:

Claim registry: A centralized, accessible place where all documented claims can be found. At Level 3 this may be as simple as a maintained table in a shared wiki, with columns for claim ID, statement, verification state, and date. What matters is that it exists, is actively maintained, and can be used by anyone in the organization to find a claim.

Decision documentation: When significant decisions are made, the claim records supporting those decisions are referenced by ID. The decision document does not need to reproduce the claim’s evidence set and reasoning chain — it links to them. This creates a searchable record of which claims informed which decisions, which is essential for later review and audit.

Meeting practice: In meetings where significant claims are discussed, verification state is a normal part of the conversation. “Is that verified?” is a question people ask and expect a VERA-formatted answer to, not a question that derails discussion.

Review triggers: When new evidence appears — a new study is published, a regulatory ruling is issued, a key assumption changes — there is a process for identifying which existing claims might be affected and triggering their review.

Level 3 Integration indicators:

  • A claim registry exists, is actively maintained, and is used by practitioners to look up existing claims before creating new ones
  • Decision documents reference claim records by ID
  • New evidence triggers a defined process for reviewing affected claims
  • VERA notation (claim IDs, verification state) appears routinely in standard organizational outputs

Why Level 3 Is the Primary Target

The VERA Maturity Model is calibrated so that Level 3 delivers the core VERA value proposition without the organizational complexity that Levels 4 and 5 require. An organization operating consistently at Level 3 across all six domains has:

  • Epistemic accountability: every significant claim is traceable to evidence and reasoning
  • Audit capability: any claim can be examined, challenged, and re-evaluated
  • Decision quality: decisions made on Level 3 claims have a documented basis that can be reviewed
  • Error recovery: when a verified claim turns out to be wrong, the evidence and reasoning can be traced, the error located, and the impact on downstream claims assessed

Levels 4 and 5 add important capabilities — measurement, continuous improvement, institutional leadership, and full sovereignty — but these capabilities require organizational investment that is not proportionate for organizations where epistemic quality is a supporting rather than primary function.

Teams and individuals whose work primarily involves strategic research, policy development, regulated decision-making, or published claims should aspire to Level 4. For everyone else, sustained Level 3 is the goal.


Level 3 Anti-Patterns

The Compliance Surface

Organizations that reach Level 3 through governance pressure — where VERA documentation is required, so it gets done — sometimes produce claims that meet formal requirements without epistemic substance. The evidence set is populated with items but they weren’t gathered through a prospective search. The reasoning chain has the right format but the steps are vague. The verification record exists but the criteria were not genuinely applied.

The compliance surface is detected by going one level deeper in any part of the claim record and asking: “Can this be substantiated?” If the prospective search plan says “searched online databases” without specifying what was searched and what terms were used, it is a compliance artifact, not a real plan. The verification process is the primary mechanism for catching compliance surface — which is why verification independence matters so much at Level 3.

The Significance Threshold Creep

Organizations tend to find reasons to classify more and more claims as below the significance threshold — and therefore not requiring VERA treatment. This is natural. VERA work takes time. Not everything needs it. But if the threshold creeps to the point where very few claims are actually documented, the mandate becomes meaningless.

The significance threshold must be reviewed by the VERA owner at regular intervals. An organization whose threshold has effectively covered 10% of significant decisions — when the policy intended it to cover 80% — has a governance failure, not a VERA failure.

The Registry Graveyard

A claim registry that is not maintained becomes worse than no registry: it gives the impression that claims have been vetted when some of them are stale, superseded, or no longer relevant. Review cadences (established in Verification Protocol Phase 5) are the mechanism. Level 3 governance must include enforcement of review cadences, not just their documentation.


Moving from Level 3 to Level 4

The Level 3-to-4 transition is fundamentally a shift from managing practice to managing quality. Level 3 ensures that VERA is applied. Level 4 ensures that VERA is applied well and improving.

Specific transitions required:

Evidence → L4: Evidence quality metrics are tracked as aggregate data, not just documented in individual claims. The organization knows: what percentage of its claims have Tier 1 evidence as part of their evidence set? What is the average evidence tier distribution? How has this changed over the past six months?

Reasoning → L4: Reasoning quality is assessed against written criteria at a program level. Common reasoning gaps — the errors that appear most frequently across claims — are tracked and addressed through targeted training or pattern development.

Verification → L4: Verification quality metrics exist: pass rate (what percentage of submitted claims are verified on first submission?), rework rate, time-to-verify, contested claim rate. These metrics are reviewed on a regular cadence by the VERA governance function.

Governance → L4: A governance committee or equivalent body exists with defined membership, meeting cadence, and decision authority. VERA is included in organizational reporting at a level of granularity that allows trend monitoring.

Sovereignty → L4: Sovereignty gaps identified in the Level 3 assessment are being actively remediated. Vendor dependencies are managed with documented exit plans. AI tool sovereignty is assessed.

Integration → L4: VERA is part of formal organizational processes — not just visible in artifacts, but required at decision gates, included in project management templates, and represented in governance reporting.


Level 3 Self-Assessment Checklist

Evidence (all must be Yes for Level 3):

  • Every significant claim produced in the last 90 days has a rated evidence set
  • Prospective search plans are documented before evidence collection for all significant claims
  • Absent evidence is recorded for all significant claims
  • Domain-specific evidence quality examples exist and are used to calibrate ratings across practitioners

Reasoning (all must be Yes for Level 3):

  • Every significant claim has an explicit step-by-step reasoning chain with labeled inference types
  • Reasoning chains can be evaluated by VERA-competent non-specialists
  • Peer reasoning review is in place for high-significance claims before formal verification

Verification (all must be Yes for Level 3):

  • Verification Protocol is applied to all significant claims; no exceptions
  • All verification records are complete with per-criterion findings and confidence ratings
  • A non-trivial percentage of submitted claims are returned for revision (verification is not a rubber stamp)
  • Contested claim process exists in writing and has been invoked at least once

Governance (all must be Yes for Level 3):

  • A documented VERA policy exists with named ownership
  • Significance threshold is defined in writing and applied consistently
  • VERA training is included in onboarding for relevant roles
  • Non-compliant significant claims are not treated as verified in decision-making

Sovereignty (all must be Yes for Level 3):

  • Formal sovereignty assessment completed within the last 18 months
  • All five principles have specific ratings with evidence
  • Remediation plan with owners and dates exists for any gaps
  • Claim records and verification records are accessible to affected stakeholders

Integration (all must be Yes for Level 3):

  • Claim registry exists, is maintained, and is actively used
  • Decision documents reference claim records by ID
  • New evidence triggers a defined review process for affected claims

Proceed to Level 4 — Governing to understand what measured, continuously improving VERA practice looks like.