I suggest having a class discussion about formal logical phrases and symbols, and how to translate those into natural English. For example, your student wrote this
For a and b to be relatively prime, gcd(a,b) = 1 = ax + by s.t. x, y are integers.
Surely, their intended message was this:
$\forall a,b\in \mathbb{Z}\large{\textbf{.}}\normalsize (a\text{ and }b\text{ are relatively prime}) \iff \exists x,y\in\mathbb{Z}\large{\textbf{.}}\normalsize ax+by=1$
Show them both and have the class discuss the ways in which the two versions are similar and dissimilar. The point of this discussion is not to clarify that the student's version is "wrong", nor that the other version is "more correct". Rather, the point is to have students think at all about how their mathematical writing comes across to others who read it, and to recognize that there are often many ways of saying the same thing, and some can be clearer or less ambiguous than others.
When I teach an intro to proofs course, the first month or so is a combination of content (sets, proof techniques) and an introduction to quantifiers and logical symbols. We practice translating between "wordy sentences" and "mathy/symbolic sentences", like the two examples above. In the process of translating symbolic sentences into natural English language sentences, we collectively realize what I wanted them to learn all along: "such that" comes after an existential quantification.
Another suggestion, "such that" is perfectly synonymous with the wordier but perhaps more natural phrase "with the property that". Perhaps you can exclusively use that one with your students for a while until they use it comfortably and correctly.
Addendum: In fact, I have a $\LaTeX$ macro for the "large dot", and the shorthand is \st for "such that": \newcommand{\st}{{\text{\huge {.}}}\;}
Edit: If you have not used the logical symbols $\forall$ and $\exists$ and they are not part of your course learning objectives, you can replace them with the words "for every" and "there exists". Again, the motivation behind comparing the two versions is not "formal vs. informal" necessarily, but rather striving for correctness, clarity, and a lack of ambiguity.