An AI model is deployed in a pilot study despite known but unmitigated risks of systematic misclassification in a minority subgroup.
Which ethical principle is primarily compromised?

Question

BlackTom AI · Accepted Answer

Non-maleficence—the obligation to avoid causing harm—is the primary principle compromised here. Non-maleficence is commonly stated as “do no harm” and requires that practitioners and developers refrain from actions that foreseeably injure individuals or groups.

Relevant knowledge points and concepts:
- Non-maleficence: duty to prevent or minimize foreseeable harm.
- Foreseeability: if a risk is known and unmitigated, harm is foreseeable.
- Systematic misclassification: leads to concrete harms (wrong diagnoses, inappropriate treatment, denied services).
- Other ethical principles (justice, autonomy, transparency) are related but address different primary concerns.

Step-by-step reasoning:
1) The scenario states a known, unmitigated risk of systematic misclassification affecting a minority subgroup. That establishes foreseeability of harm.  
2) Deploying the model in a pilot study despite that knowledge means actors accepted or ignored preventable risk.  
3) Systematic misclassification can cause direct harms (clinical mismanagement, denial of resources, psychological harm), so deployment exposes individuals to harm.  
4) The ethical duty most directly violated by knowingly exposing people to foreseeable harms is non-maleficence.

Why the correct answer is correct:
- Non-maleficence focuses on preventing harm; knowingly deploying a system that will systematically misclassify a vulnerable subgroup is a direct breach of that duty. The actors had information allowing mitigation but proceeded, which is antithetical to “do no harm.”

Why the other options are less correct:
- Justice deals with fairness and equitable distribution of benefits/risks. While relevant (minority subgroup harmed), the immediate issue is causing harm rather than distributive fairness per se.  
- Autonomy concerns informed consent and self-determination; only implicated if subjects were not informed, but the core wrongdoing is harm.  
- Transparency concerns openness about functioning/risks; lack of transparency can worsen harm, but the principal ethical violation remains the infliction of foreseeable harm.

Conclusion: The primary ethical principle compromised is Non-maleficence, which matches the provided answer.

An AI model is deployed in a pilot study despite known but unmitigated risks of systematic misclassification in a minority subgroup. Which ethical principle is primarily compromised?单项选择题

类似问题

In the context of privacy and intellectual property, which of the following actions is considered appropriate?

In the context of privacy and intellectual property, which of the following actions is considered appropriate?在隐私和知识产权的背景下，以下哪一项行为被认为是合适的？

From the seminar on "Delivering AI and Digital Transformation for Social Good" , please list and comment on 2 key takeaways请从“利用人工智能和数字化转型造福社会”研讨会中列举并评论两个主要收获。

更多留学生实用工具

智能学习助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单