AI Contract Review: First Pass Yes, Sign-Off No

A 40-page framework agreement, three annexes and a deadline on Friday. The temptation is to hand it to a chatbot and ask for the risks. That can help if the workflow is right. It can also be dangerous if nobody knows where the tool's limits are.

The jagged frontier

The study by Harvard Business School and Boston Consulting Group coined an image for this: the jagged frontier. Tasks of similar difficulty fall partly inside and partly outside what AI does well. Inside, consultants became faster and better. On tasks beyond the frontier, they were 19 percentage points less likely to be correctS with AI than without. The AI sounded convincing and was still wrong.

Legal judgement is typical frontier territory. Whether a liability cap is reasonable depends on the deal, the counterparty and the negotiating position. The Danish study by Humlum and Vestergaard found measurable but limited time savings for lawyers.

What AI does reliably

Finding clauses, structuring them and comparing them with a standard. If you have a playbook with standard positions, AI can do the first pass. Legal assessment starts after that.

We have not yet seen a German legal operations case study with independently verified time figures.

The workflow

Here is our playbook with standard positions: [insert]. Review the attached draft contract. List every deviation from the playbook with clause number, a verbatim quote of the passage, a risk rating (high, medium, low) and a suggested wording. Explicitly name every playbook position that is missing from the contract. Do not invent clauses.

Limits and risks

• Hallucinated clauses: Always require a verbatim quote with its location and check it in the original.
• Professional secrecy: Law firms and legal departments with professional secrecy obligations must observe Section 203 of the German Criminal Code before client data goes to external providers.
• Data processing: No contract with personal data goes into a tool without a data processing agreement and a business licence.
• Accountability: A person signs off. Put that in your internal policy.

How to start

1. Write a playbook with ten standard positions for your most common contract type.
2. Test the first pass on five contracts you have already negotiated and whose outcome you know.
3. Count what AI found, missed and invented.
4. Use the workflow on new contracts only once the hit rate is right.

Sources

1. SDell'Acqua et al.: Navigating the Jagged Technological Frontier, HBS Working Paper 24-013, 2023 (report by Legal Dive)
2. SHumlum, Vestergaard: Large Language Models, Small Labor Market Effects, NBER WP 33777, 2025
3. RGerman Criminal Code, Section 203 (violation of private secrets)