ChatGPT was released in 2022, and in the years since its revolutionized daily life for millions of people. From organizing schedules to rewriting emails, it’s good at plenty of things. However, this chatbot isn’t capable of handling every aspect of your life or business.
Large language models like ChatGPT sometimes generate incorrect or outdated information while sounding completely confident. That’s not a huge deal if you’re brainstorming a party theme or writing a practice email. But when it comes to sensitive areas like money (especially your taxes), health, or legal issues, a wrong answer can create serious problems.
Don’t miss any of our unbiased tech content and lab-based reviews. Add CNET as a preferred Google source.
That’s why it’s just as important to know when to avoid ChatGPT as it is to know how to get the most from it. To help you steer clear of the biggest pitfalls, here are 11 specific situations where turning to an AI chatbot could cause more harm than good.
(Disclosure: Ziff Davis, the parent company of CNET, in April filed a lawsuit against ChatGPT maker OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.)
I’ve definitely fed ChatGPT my symptoms out of curiosity, but the answers that come back can read like your worst nightmare. As you pore over potential diagnoses, you could swing from dehydration and the flu to some type of cancer. I have a lump on my chest and entered that information into ChatGPT. Lo and behold, it told me I may have cancer. In fact, I have a lipoma, which is not cancerous and occurs in one in every 1,000 people. My licensed doctor told me that.
I’m not saying there are no good uses of ChatGPT for health: It can help you draft questions for your next appointment, translate medical jargon and organize a symptom timeline so you can walk in better prepared. And that could help make doctor visits less overwhelming. However, AI can’t order labs or examine you, and it definitely doesn’t carry malpractice insurance. Know its limits.
2. Taking care of your mental health
ChatGPT can offer grounding techniques, sure, but it can’t pick up the phone when you’re in real trouble with your mental health. I know some people use ChatGPT as a substitute therapist. CNET’s Corin Cesaric found it mildly helpful for working through grief, as long as she kept its limits front of mind. But as someone who has a very real, very human therapist, I can tell you that ChatGPT is still really only a pale imitation at best, and incredibly risky at worst.
ChatpGPT doesn’t have lived experience, can’t read your body language or tone, and has zero capacity for genuine empathy. It can only simulate it. A licensed therapist operates under legal mandates and professional codes that protect you from harm. ChatGPT doesn’t. Its advice can misfire, overlook red flags or unintentionally reinforce biases baked into its training data. Leave the deeper work — the hard, messy, human work — to an actual human who is trained to properly handle it. If you or someone you love is in crisis, please dial 988 in the US, or your local hotline.
4. Getting personalized financial or tax planning
ChatGPT can explain what an ETF is, but it doesn’t know your debt-to-income ratio, state tax bracket, filing status, deductions, retirement goals or risk appetite. Because its training data may stop short of the current tax year, and of the latest rate hikes, its guidance may well be stale when you hit enter.
I have friends who dump their 1099 totals into ChatGPT for a DIY return. The chatbot simply can’t replace a CPA who can catch a hidden deduction worth a few hundred dollars or flag a mistake that could cost you thousands. When real money, filing deadlines, and IRS penalties are on the line, call a professional, not AI. Also, be aware that anything you share with an AI chatbot will probably become part of its training data, and that includes your income, your Social Security number and your bank routing information.
6. Doing anything illegal
This one is self-explanatory.
7. Cheating on schoolwork
I’d be lying if I said I never cheated on my exams. In high school, I used my first-generation iPod Touch to sneak a peek at a few cumbersome equations I had difficulty memorizing in AP calculus, a stunt I’m not particularly proud of. But with AI, the scale of modern cheating makes that look remarkably tame.
Turnitin and similar detectors are getting better at spotting AI-generated prose every semester, and professors can already hear “ChatGPT voice” a mile away (thanks for ruining my beloved em dash). Suspension, expulsion and getting your license revoked are real risks. It’s best to use ChatGPT as a study buddy, not a ghostwriter. You’re also just cheating yourself out of an education if you have ChatGPT do the work for you.
10. Drafting a will or other legally binding contract
ChatGPT is great for breaking down basic concepts. If you want to know more about a revocable living trust, ask away. However, the moment you ask it to draft actual legal text, you’re rolling the dice. Estate and family-law rules vary by state, and sometimes even by county, so skipping a witness signature or omitting the notarization clause can get your whole document tossed. Rather, let ChatGPT help you build a checklist of questions for your lawyer, then pay that lawyer to turn that checklist into a document that stands up in court.
Leave a Reply