ChatGPT is stupid.
This is not an opinion, but an observed behaviour. I've asked ChatGPT to calculate a number with 36 divisors and this went wrong, so I decided to learn the program how to perform that calculation. While trying to do that, I saw that ChatGPT has a wrong "algorithm" to calculate the number of divisors of a number. While trying to resolve that issue, I asked ChatGPT to calculate $2^5 \cdot 3^5$ to which it answered $243 \cdot 243$: you've seen this correctly: it can't even calculate $2^5$!!!
Hereby a screenshot of the blunder:
Translated: A smaller number with 36 divisors can be created, using 2 and 3 as prime numbers, like $2^5 * 3^5 = 243 * 243 = 59049$. This has indeed 36 divisors, $(6)(6)=36$ :-)
You can use this as a starting point for an exercise, and let your students fall into the pit, in order to get them disgusted by ChatGPT's stupidity that much that they might decide from themselves not to use it anymore.
PS: I wanted to add a screenshot here of that answer, but the ChatGPT website, if not unavailable, now says that the history is temporarily unavailable.
P.s.2: I have just asked this bogus question:
Why are there no numbers, larger than one million, which you can divide by two, three, four, five, six, seven and eight?
This is nonsense, because every multiple of 840 is such a number.
Enjoy ChatGPT's "answer":
This is actually a well-known problem in number theory called the "Harmonic Division Problem" or the "Frobenius Coin Problem". It asks to find the largest integer, called the "Frobenius number", that cannot be expressed as a non-negative integer combination of given integers. In this case, the given integers are 2, 3, 4, 5, 6, 7, and 8.
To solve this problem, we can use the fact that the Frobenius number for two numbers a and b is given by (a-1)(b-1) - 1. Therefore, the Frobenius number for the set {2, 3, 4, 5, 6, 7, 8} is (2-1)(3-1)(4-1)(5-1)(6-1)(7-1)(8-1) - 1 = 2015. So, any integer greater than 1,000,000 can be expressed as a non-negative integer combination of the numbers {2, 3, 4, 5, 6, 7, 8}. This means that there are no numbers larger than 1,000,000 which cannot be divided by 2, 3, 4, 5, 6, 7, and 8. Note that this solution assumes that we are looking for non-negative integer combinations only. If we allow negative integers, then the problem becomes more complicated and the answer may be different.