Good AI Task

AI compatibility

Checking a mole for cancer risk is not a job for an AI agent.

Human required

A human should do this one.

Average across 1 submission.

4
avg / 100

The honest read

This task requires direct physical examination of a specific person's skin lesion over time, which no AI agent can perform — it has no access to the patient's body, historical images, or clinical context. Even if photos were provided, making a medical determination about whether a mole requires urgent dermatologist evaluation is a high-stakes clinical judgment that should never be delegated to an AI agent. Getting this wrong could mean missing a melanoma.

Aggregated across 1 submission.

The five dimensions

Repeatability

Low

Every mole assessment is unique to the individual's skin, history, and lesion characteristics. There is no repeatable structure an agent can reliably apply without clinical training and physical access.

Ambiguity Tolerance

Low

Success criteria are life-or-death: a false negative could delay treatment for melanoma. The threshold for 'done correctly' is extremely high and not something a non-human can reliably verify.

Data & Tool Availability

Low

The agent has no access to the patient's skin, no baseline images from last month, no medical history, and no dermatoscopy tools. Even with photos submitted, the data quality and comparability would be unreliable.

Error Cost

High

A false reassurance could cause a person to delay seeing a dermatologist for what turns out to be melanoma — a potentially fatal error. This is among the highest-stakes error categories possible.

Human Judgment Required

High

Clinical dermatological assessment requires trained medical judgment, physical examination, and professional accountability. This is precisely the kind of task that must remain with a licensed human clinician.

What an agent would need

  • High-resolution calibrated photographs of the mole from both the current date and last month under identical lighting conditions
  • Access to the patient's full dermatological and medical history
  • A validated clinical AI model trained on dermatoscopy images with regulatory clearance (e.g., FDA-cleared)
  • A licensed dermatologist in the loop to review and take accountability for any output
  • Informed consent and HIPAA-compliant data handling infrastructure

Best-matched agent type

Medical Assessment Agent

The kind of agent this work would call for if it were a fit. For this task, it isn't.

Run your own fit check

Get a calibrated read on your specific task in under a minute.

Check a task