An AI model is deployed in a pilot study despite known but unmitigated risks of systematic misclassification in a minority subgroup.
Which ethical principle is primarily compromised?

Question

BlackTom AI · Accepted Answer

Non-maleficence—the obligation to avoid causing harm—is the primary principle compromised here. Non-maleficence is commonly stated as “do no harm” and requires that practitioners and developers refrain from actions that foreseeably injure individuals or groups.

Relevant knowledge points and concepts:
- Non-maleficence: duty to prevent or minimize foreseeable harm.
- Foreseeability: if a risk is known and unmitigated, harm is foreseeable.
- Systematic misclassification: leads to concrete harms (wrong diagnoses, inappropriate treatment, denied services).
- Other ethical principles (justice, autonomy, transparency) are related but address different primary concerns.

Step-by-step reasoning:
1) The scenario states a known, unmitigated risk of systematic misclassification affecting a minority subgroup. That establishes foreseeability of harm.  
2) Deploying the model in a pilot study despite that knowledge means actors accepted or ignored preventable risk.  
3) Systematic misclassification can cause direct harms (clinical mismanagement, denial of resources, psychological harm), so deployment exposes individuals to harm.  
4) The ethical duty most directly violated by knowingly exposing people to foreseeable harms is non-maleficence.

Why the correct answer is correct:
- Non-maleficence focuses on preventing harm; knowingly deploying a system that will systematically misclassify a vulnerable subgroup is a direct breach of that duty. The actors had information allowing mitigation but proceeded, which is antithetical to “do no harm.”

Why the other options are less correct:
- Justice deals with fairness and equitable distribution of benefits/risks. While relevant (minority subgroup harmed), the immediate issue is causing harm rather than distributive fairness per se.  
- Autonomy concerns informed consent and self-determination; only implicated if subjects were not informed, but the core wrongdoing is harm.  
- Transparency concerns openness about functioning/risks; lack of transparency can worsen harm, but the principal ethical violation remains the infliction of foreseeable harm.

Conclusion: The primary ethical principle compromised is Non-maleficence, which matches the provided answer.

An AI model is deployed in a pilot study despite known but unmitigated risks of systematic misclassification in a minority subgroup. Which ethical principle is primarily compromised?单项选择题

类似问题

Why has principlism from medical ethics been especially influential in AI ethics?

According to John Tasioulas in his paper "Artificial Intelligence, Humanistic Ethics", which was a reading in this subject, what is one major problem with treating AI ethics mainly as a matter of optimization and preference satisfaction?

Please enter the completion code you received after passing the UNSW College Student AI Module with 100%. The code you received is case sensitive so you must make sure to copy it directly.

更多留学生实用工具

智能学习助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单