Good AI Task

AI compatibility

Signing off on a structural report is a licensed act — AI has no business touching it.

Human required

A human should do this one.

Average across 1 submission.

3
avg / 100

The honest read

Signing off on a structural engineering report filed with the city is a licensed professional act with direct legal, safety, and liability consequences — it cannot be delegated to an AI agent under any current regulatory framework. If the structure fails, people die and the signatory is criminally liable. This is the textbook case for mandatory human accountability.

Aggregated across 1 submission.

The five dimensions

Repeatability

Low

Every structural report involves unique site conditions, load calculations, materials, and code interpretations. There is no repeatable template that removes the need for case-by-case professional judgment.

Ambiguity Tolerance

Low

Success criteria are legally defined by engineering licensure standards, municipal codes, and professional liability law — none of which permit an AI to serve as the responsible party. The bar is unambiguous, and AI cannot meet it.

Data & Tool Availability

Low

Even if an AI could access the report documents, it has no licensed professional standing, no legal authority to affix a seal, and no recognized identity in the city's filing system as a responsible engineer.

Error Cost

High

A wrongly approved structural report can result in building collapse, loss of life, and criminal prosecution. The outcome is catastrophic and entirely irreversible — the highest possible error cost.

Human Judgment Required

High

This task requires a licensed Professional Engineer who can exercise expert judgment, bear legal accountability, and stake their professional credentials on the assessment. No AI can substitute for that role today or in the foreseeable future.

What an agent would need

  • A licensed Professional Engineer (PE) with jurisdiction-appropriate credentials — which an AI cannot hold
  • Legal authority to affix a professional seal recognized by the city's permitting office
  • Deep contextual understanding of site-specific structural conditions, load paths, and applicable building codes
  • Malpractice insurance and personal liability acceptance, which AI agents cannot carry
  • Access to original calculations, drawings, and inspection records to verify report accuracy

Best-matched agent type

Compliance Agent

The kind of agent this work would call for if it were a fit. For this task, it isn't.

Run your own fit check

Get a calibrated read on your specific task in under a minute.

Check a task