Students are not accustomed to speaking/writing precisely. When presented with an affirmation, such as a homogeneous linear system of equations has always a nontrivial solution a student may realize that the statement is false for some particular overdetermined system without realizing that the existence of a particular counterexample invalidates the affirmation. This occurs because in colloquial speech one customarily qualifies affirmations, so it is habitual to speak of something as true when it is generally true. In the opposite direction, a student might consider the affirmation true because it is true for all underdetermined systems and systems ... We have to teach students the difference between mathematical (or, more generally, careful, precise, technical) speech and colloquial speech. This is perhaps the most important reason we teach linear algebra to so many students who will not later use its results in an instrumental way.
The only way to teach this, so far as I can see, is to force students to explain carefully the reasoning in a number of illustrative examples. One way to do it is to make an affirmation and ask the student to decide whether it is true or false, providing justification in the case of truth, and a counterexample in the case of falsity. Often it helps to put side by side superficially (that is, verbally) similar problems. For example consider the following affirmations:
1. A matrix is orthogonally diagonalizable if and only if it is symmetric.
2. A matrix is diagonalizable if and only if it is symmetric.
Many students will not distinguish between "diagonalizable" and "orthogonally diagonalizable" so will not see any difference between the affirmations. Putting the two affirmations side by side signals to a mildly attentive student that there is a difference between them. This will be true even for students who have already seen in class an example of a $2 \times 2$ diagonalizable matrix that is not symmetric, and had it pointed out to them explicitly that this matrix is diagonalizable but not orthogonally diagonalizable. So one has to explain the reasoning in detail.
At the bottom is the (quite general) confusion between necessary and sufficient conditions. Most people do not distinguish well between the two until taught to do so. This has to do with what Polya called plausible inference. While it is true mathematically that just because A implies B it need not be the case that B implies A, in scientific, and less technical contexts, the truth of B is evidence in favor of A. This mode of thinking is natural to thoughtful and observant people, and useful in many contexts, although it is not correct in purely mathematical contexts. It is the math teacher's job to indicate how mathematicians use language differently from others, and why it is useful to do this. This is part of why we fuss so much about questions such as whether every conservative vector field has a potential.
This is my sense of what V. I. Arnol'd meant when he wrote (in his usual intentionally tendentious style) on p. 740 of this article (although I do not share Arnol'd's antagonism to Bourbaki):
Now it became possible to apply the techniques developed in the problem of adiabatic invariants. As soon as I accomplished that,
Kolmogorov suggested that I should submit the paper on perpetual
adiabatic invariance to ZHETF, the main physical journal in the USSR.
A few weeks later, M. A. Leontovich (who was, as far as I remember, a
deputy to the editor-in-chief of ZHETF) invited me to his home (near
the Atomic Energy Institute of the USSR Academy of Sciences) to
discuss the manuscript. Having fed me, as usual, by boiled buckwheat
and calling me, as usual, “Dimka” (M. A. called me in such a way until
his death), Mikhail Aleksandrovich explained to me that the paper
could not be published in ZhETF due to the following reasons.
The manuscript contained the words “theorem” and “proof” forbidden in ZhETF.
The manuscript claimed that “A implies B” while every physicist knew examples showing that B does not imply A.
The manuscript used the unintelligible terms “Lebesgue measure”, “invariant tori”, “Diophantine conditions”.
Mikhail Aleksandrovich therefore proposed that I should rewrite the
paper.
Now I realize how right he was in defending a physical journal
from the Bourbaki-like mathematical jargon.
For instance, indeed,
while claiming that “A implies B” the author must point out explicitly
whether the converse holds, otherwise any reader not spoiled by the
mathematical slang would understand the claim as “A is equivalent to
B”.