A hospital deploys an AI sepsis early-warning system that gives emergency department physicians a risk score and brief rationale for each patient.

Which design choice would most directly support appropriately calibrated trust by the intended users?

Question

A hospital deploys an AI sepsis early-warning system that gives emergency department physicians a risk score and brief rationale for each patient.

Which design choice would most directly support appropriately calibrated trust by the intended users?

BlackTom AI · Accepted Answer

Calibrated trust hinges on case-level transparency: clinicians need both the score and context about how much to trust it for this patient.

1. Relevant knowledge points and concepts
- Trust calibration: users should neither over-rely (automation bias) nor underuse (distrust) an AI. Appropriate calibration requires actionable output plus uncertainty and scope information.
- Explainability: concise, clinically relevant reasons (key contributing factors) help clinicians evaluate plausibility.
- Intended use and reliability warnings: knowing whether a case falls inside the model’s training distribution and any case-specific data limitations affects how much weight to place on the alert.
- Human-AI workflow: information must be presented before action so clinicians can integrate it into decision-making.

2. Step-by-step reasoning
- Step 1: Clinician receives a risk score. Alone, a number invites either blind acceptance or dismissal.
- Step 2: Providing key contributing factors lets the clinician check concordance with clinical findings (face validity).
- Step 3: Indicating whether the case is within intended use signals if model behavior is likely reliable for this patient.
- Step 4: Case-specific reliability warnings (e.g., missing vitals, unusual comorbidity profile) explain increased uncertainty.
- Step 5: Presenting these elements before action enables clinicians to weight the alert appropriately and decide next steps.

3. Calculations
- No numeric calculations required; the argument is conceptual and workflow-focused.

4. Why the correct answer is correct
- Showing the score, contributors, intended-use flag, and case-specific reliability warnings directly equips clinicians to judge both the signal and its uncertainty, which is the essence of calibrated trust.

5. Why other options are incorrect
- Option 2: Performance summaries and identical displays lack per-case applicability and intended-use flags; they don’t indicate when the model may be unreliable for a specific patient.
- Option 3: A “clinically reviewed” badge and overall accuracy can create false reassurance and conceal case-level limitations.
- Option 4: Mandatory accept/override and post-hoc monitoring aids governance but does not proactively give clinicians the contextual reliability information needed to calibrate trust before acting.

6. Conclusion
The best design is to show the risk score with key contributing factors, whether the alert is within the tool’s intended use, and any case-specific reliability warnings before physicians act on the alert — matching the provided correct answer.

A hospital deploys an AI sepsis early-warning system that gives emergency department physicians a risk score and brief rationale for each patient. Which design choice would most directly support appropriately calibrated trust by the intended users?单项选择题

类似问题

An image-recognition model labels a medical image as suspicious and highlights the regions that most influenced the classification. What is the most appropriate description of how the highlighting functions as an explanation for patients and doctors?

Which of the following best describes why explainability is a subject of ethical significance in "high-stakes" AI systems?

What does London mean wen he describes deep learning AI's reasoning as "atheoretical, associationist, and opaque"? (Check BOTH that apply)

Which of the following best describes a contrastive explanation in AI?

The words interpretable and explainable are closely related. However, in machine learning they refer to slightly different aspects of model behaviour. Choose the most appropriate definition below.

What is the purpose of explainable AI?

更多留学生实用工具

智能学习助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单