The AI Margin Call on Semantic Debt by Lee Dittmar

Why Legal Organizations Must Address Data Architecture Now

By Lee Dittmar, Co-Founder, President & Chief Commercial Officer
Infinity Data AI, Co-Author, "The AI-Enabled Law Firm" (ABA, 2026)

The Discovery

Infinity Data AI serves enterprises across all industries and sectors. Our work didn't start with a focus on law firms as a target market. But as I collaborated with Carole Stern Switzer on "The AI-Enabled Law Firm" and reflected on the implementation challenges, something crystallized: the data challenges facing legal organizations are significant and must be addressed before AI can deliver real value.

From 1980 through 1996, I worked closely with dozens of Am Law firms and Fortune 500 general counsel offices in contexts ranging from complex administrative and regulatory proceedings to multi-party civil litigation. I served as expert witness, managed discovery operations, coordinated multiple experts, and advised on settlements and other resolutions. That experience gave me deep insight into how legal organizations manage knowledge under pressure.

After transitioning into enterprise technology and digital transformation, I could see both the power of what technology could enable and the structural constraints that prevented legal organizations from fully leveraging it. Working with Carole, who practiced law for many years before co-founding OCEG, reinforced how these challenges manifest in daily legal work.

Full transparency: I was already building semantic infrastructure at Infinity when Carole and I started the book. But writing 16 chapters on AI implementation across every aspect of legal practice, from ethics to workforce planning to client communication, forced me to see semantic debt as a foundational constraint, not just a technical problem. The book isn't about Infinity. But Infinity solves the data problem the book exposes.

What Is Semantic Debt?

Even in well-managed legal organizations, knowledge often exists across disconnected systems:

• Contract templates and precedents scattered across document management systems

• Matter strategies and outcomes locked in email archives and individual expertise

• Client risk profiles that exist primarily as institutional memory

• Compliance requirements buried in unstructured policy documents

• Practice group terminology where the same term carries different meanings in different contexts

This fragmentation creates semantic debt: the accumulated cost of deferring explicit, machine-interpretable meaning.

For decades, this was manageable. Reporting tolerated inconsistency. Governance operated through review and documentation. Attorneys bridged gaps with their expertise and institutional knowledge.

AI is the margin call on that debt.

Why AI Forces the Reckoning

AI systems reason across entities, context, and policy. When meaning is implicit rather than encoded, AI inherits ambiguity.

Consider a practical example: When analyzing a contract, does "material breach" follow the governing jurisdiction's definition, your practice area's interpretation, or the client's specific risk thresholds?

While advanced AI can often infer context and disambiguate meaning, without formal semantic constraints, you face critical governance gaps:

• You can't audit which definition was actually applied

• You can't guarantee consistency across similar matters

• You can't enforce client-specific interpretations systematically

• You can't explain to regulators or clients how the AI reached its conclusion

As organizations deploy multiple AI models and agents into production workflows, this ambiguity compounds into serious risk.

Many enterprise AI initiatives struggle not because of insufficient data volume or weak models, but because semantic debt constrains trust, explainability, and scalability. This challenge is structural in nature and often manifests as multiple symptoms - inconsistent AI outputs, unexplainable recommendations, governance failures - rather than a single identifiable problem.

Organizations that attributed these failures to "AI not being ready" are discovering the real constraint was their data infrastructure all along.

The Infinity Approach: Making Meaning Operational

Through my work on the book, I realized that Infinity addresses exactly this foundational challenge. Our cross-industry experience means we recognize the structural pattern instantly - including in legal practice.

We've built a Semantic Operating System (SOS)—infrastructure that encodes enterprise meaning, governance rules, and validation logic directly into AI interactions.

At its core is the Enterprise Knowledge Model (EKM): a live, machine-interpretable representation of entities, relationships, definitions, and policies.

Unlike static knowledge graphs or metadata catalogs that document relationships passively, the EKM operates at runtime—actively constraining AI behavior. Think of it as the difference between a map of the building and the building's security system that actually controls access.

Here's what this means in practice:

Meaning enforcement: When your AI analyzes a contract, the EKM ensures "material breach" is interpreted according to the correct jurisdiction, practice context, and client thresholds—automatically enforced through semantic constraints rather than relying on attorney memory or post-hoc review.

Technically, this works through formal constraints encoded in the EKM that execute before the AI generates output. Just as a compiler won't let you assign a string to an integer variable, the EKM won't let an AI apply the wrong jurisdictional definition to a contract term.

Executable governance: Policy constraints run at interaction time. AI outputs are validated against formal business rules before delivery. Governance isn't documented after the fact—it's executed as the AI operates.

Immediate validation: Every AI interaction is resolved within governed semantic boundaries. Evidence and lineage are generated by design, not reconstructed afterward through manual audit trails.

Addressing the Market Landscape

While several vendors offer knowledge graphs and governance overlays, Infinity's approach differs in enforcing semantic constraints at runtime rather than documenting them retrospectively. The semantic layer isn't a feature—it's the foundation.

Why This Matters for Legal Organizations

The legal profession's AI transformation isn't just about selecting better tools, training your people, or implementing governance policies. Those are necessary but insufficient.

The deeper requirement is resolving the semantic debt that prevents any AI system—current or future—from operating reliably at the scale and with the trust that legal practice demands.

Semantic debt is structural. It persists regardless of model improvement. Even perfectly reliable AI models cannot compensate for fragmented definitions, implicit policies, or inconsistent enterprise meaning.

This is the data readiness foundation the book emphasizes throughout. It's one of the key prerequisites that often determines whether your AI investments deliver transformational value or join the long list of promising pilots that never scale.

Bounded domain implementations can reach production within approximately 90 days, with governance logic encoded once and reused across expanding AI use cases—reducing structural total cost of ownership as you scale.

The Path Forward

"The AI-Enabled Law Firm" charts the journey legal organizations must take. It addresses strategy, governance, ethics, workforce planning, client communication, and much more.

Infinity Data AI provides the foundational infrastructure that makes that journey possible—the semantic layer that transforms AI from probabilistic approximation into governed, auditable, trustworthy capability.

AI is the margin call on semantic debt. The question is whether legal organizations will address the foundation proactively—or discover its absence when AI initiatives fail to scale.

Let's Talk

If you want to discuss what data readiness actually requires in practice for your firm or legal department, I'd welcome the conversation.

Reach out at lee@infinity-data.ai

Lee Dittmar
Co-Founder, President & Chief Commercial Officer
Infinity Data AI

Co-Author, "The AI-Enabled Law Firm" (ABA, 2026)