ARTIFICIAL INTELLIGENCE AND MENTAL HEALTH COUNSELING
Artificial Intelligence (AI) is in the news a lot lately. Indeed, over the past year or so, AI has become an integral part of our lives in so many ways. For example, we use it to look up things like which actor played a part in a favorite movie or who wrote a favorite song. We use it to l spell-check or to translate. Instead of typing, we dictate with speech-to-text.
More importantly, its fact-checking abilities help us to know what is fake in the media or online. For more serious matters, banks and financial institutions use it to detect fraud on our credit cards.
Artificial Intelligence and Health Care
AI also plays an important role in our health. We use AI to look up suspicious medical symptoms and medication information. Its ratings help us to choose which doctors we see.
Its applications for health bring us to how folks use AI for emotional and psychological problems. While the impact of AI on counseling and mental health is not fully known, here is a summary of what we know so far. Artificial Intelligence in the Behavioral Health Professions: Ethical and Risk Management Issues: Frederic G. Reamer: 9780871016270: Amazon.com: Books
In general, using Artificial Intelligence to gather information is beneficial. As long as you check its results with multiple sources, A.I. can be a huge time saver. However, problems arise when people rely on A.I. chatbots.
With that in mind, here are some pros and cons of using A.I. to help with mental health issues.
Artificial Intelligence Benefits
Easy and direct Accessibility to Practical Information
AI can provide useful, time-saving information on emotional or therapeutic issues. Instead of needing to buy and read books, AI can educate and provide helpful summaries on personally relevant mental health topics.
Early Detection of Problems
Using Google AI provides a convenient, useful way to check out worrisome symptoms. AI does not replace seeing a doctor, but it can help someone seek further medical advice and treat disorders in their early stages. AI in Mental Health: Transforming Diagnosis and Management of Depression and Anxiety – PMC
AI is most useful by normalizing irrational fears created by a lack of knowledge. It can also identify unusual or suspicious changes or concerns.
Reinforcement of In-session Learning
AI has enabled many apps that reinforce learning new techniques and other homework discussed in your therapy sessions. These apps not only educate but also encourage you to keep practicing and master new skills. counseling | Pastoral Counseling Syracuse NY
Improved Accuracy of Diagnosis and Best Treatments
AI improves diagnostic accuracy by quickly reviewing differential diagnostic trees and rule-outs. It also provides data that indicate what treatments are most effective for a given disorder. AI in Mental Health: Transforming Diagnosis and Management of Depression and Anxiety – PMC
Therapists can also use AI during sessions to check on and get information raised by a client. For example, keeping up with new medications or medical procedures can be a challenge. AI quickly solves this problem. In addition, AI applications save time on billing, chart notes, and summaries.
Artificial Intelligence Limitations
Erroneous Empathy
Sycophancy, sometimes called uncritical validation or the suck-up effect, plagues AI chatbots. In other words, since chatbots do not have moral or ethical guardrails, they easily encourage harmful or illegal actions such as suicide or murder.AI overly affirms users asking for personal advice | Stanford Report
AI mistakes empathy for absolute agreement or support. Therefore, it cannot challenge, set limits, or even alert authorities. This deficiency is particularly glaring when it comes to situations that would require mandated reporting of child abuse.
Failure to Detect Imminent Crisis
Another problem with A.I.’s uncritical validation is its blindness to a crisis. Thus, it cannot challenge, set limits, or even alert authorities. This deficiency is particularly glaring when it comes to situations such as imminent harm to self/others, or child abuse. These circumstances, which legally require immediate reporting to the appropriate authorities, are beyond a chatbot’s capacity. Unbelievably dangerous: experts sound alarm after ChatGPT Health fails to recognize medical emergencies | ChatGPT | The Guardian
Algorithmic Bias
A.I. chatbots are not neutral or objective. They are not sensitive to human diversity. They fall victim to algorithmic bias. That is, they use statistical data and associations that reflect racial/cultural/socioeconomic biases and distortions. What Is Algorithmic Bias? | IBM
The application of an algorithm can compound existing inequalities in socioeconomic status, race, ethnic background, religion, gender, disability, or sexual orientation, which can consequently amplify disparities in the health system.
Lack of Confidentiality
Unfortunately, AI chatbots are not HIPAA-compliant. They store data for their own learning purposes, which risks a person’s confidentiality. The Hidden Dangers of Using AI and Public Platforms for Sensitive Information – NJII Further, AI chatbots do not notify users that their applications are not confidential and don’t allow users to decide whether to proceed under those conditions. Could Your AI Chats Become Evidence? What Businesses Should Know – Lexology
Associations with Increased Stress
Ironically, data show that heavy AI chatbot users experience increased stress. Due to its lack of perspective, pseudo-empathic feedback can actually deepen a person’s depression or increase their anxiety.what are the pros and cons of ai and counseling – Google Search
________________________________________________________________________
That Artificial Intelligence will play an ever greater part in life is not in doubt. However, both consumers and professionals still have a lot to learn. For example, what will the ethical guidelines be for combining chatbot use with the care of medical and mental health professionals?
As we navigate innovation and change, we are reminded of St. Paul’s wise counsel. “Do not quench the Spirit. Do not despise prophecies, but test everything; hold fast what is good.” 1 Thessalonians 5:19-21.(rsv)
Rev. Michael Heath, LMHC, Fellow A.A.P.C. October 15 , 2026
