Discrimination of artificial intelligence in healthcare

Currently, artificial intelligence (AI) plays an important role in various fields as a primary worker or assistant, especially in healthcare. AI has many functions that can be performed even better than humans do due to the high speed of compiling a large amount of data from various sources (Internet and electronic health records), which increases the productivity of doctors. Less discussed, though equally important, is the discrimination of AI in healthcare. Doctors, who have a lot of responsibility, cannot rely on AI due to multiple vulnerabilities. First, AI collects huge amounts of data. However, AI does not guarantee error-free results, despite its non-autonomy and operator control, since human factors can play a role, becoming a source of inaccuracy. Therefore, a high risk of using poor quality data in further decision-making processes exists. Errors, biases (ethnic, gender, age, and social), and data gaps worsen AI outcomes, leading, for example, to discrimination against minorities and inaccurate prescriptions. In addition, AI may act unethically or even violate laws (e.g., Title VI, Section 1557 of the Affordable Care Act, which prohibits discrimination by race, color, national origin, sex, age, or disability in certain healthcare programs and activities).

Secondly, AI may be called secretive due to the indeterminacy of the algorithms. This means that no one can explain how or why the AI reached this or that decision, as stated by Judea Pearl in The Book of Why: The New Science of Cause and Effect. Therefore, doctors cannot check the facts and make sure that the analysis is done correctly and the conclusion is accurate. Difficulties in solving real-world problems using AI that cannot be solved by formal and mathematical rules of logic as humans do (e.g., natural language and face recognition) must be recognized. AI makes the work of medical professionals easier, however, posing many unresolved problems that mislead doctors and contribute to wrong decisions.