What basic math skills (e.g., polynomial manipulation, trigonometry, complex numbers) is reasonable for us to expect students to have when they enroll in a linear algebra course at the university level?
Yes, all those things should be reasonable expectations for students coming into a linear algebra course. If it's a standard topic in Algebra 2 or lower, then by all means it is reasonably fair game for university-level Linear Algebra.
Here's the thing though: so many realities within math education are completely unreasonable. In particular, students often lack unreasonably much foundational knowledge coming into courses, when confronted with this issue, they often unreasonably argue that the course should drop to their level instead of them rising to the level of the course.
How to actually fix the problem
I've had to deal with something like your situation before. The remedy isn't easy. If you really want to fix the problem, then you have to hold your students accountable for learning the material in the course, including the prerequisite material that they are missing.
But here's the thing: it's not reasonable to expect your students to learn things on their own -- and it's entirely possible that they were somehow able to pass Algebra 2 without demonstrating sufficient mastery of the material. (The usual culprits are grade inflation and/or lowering of standards.)
So, if you want to actually fix the problem, then unfortunately you have to put forth a ton of effort supporting students through remedial assignments/assessments AND help sessions, while simultaneously "holding the line" in a hardcore way. You have to be a supportive hard-ass. It's a delicate balance.
What usually happens instead
What usually ends up happening instead is everyone turns a blind eye and pushes the problem further down the line: the instructor just gives the usual lectures/assignments, curves (or otherwise inflates) the grades, students go along with it, and the problem is left for their next instructor to deal with (or not deal with).
Response to a student
And when student challenges our assumptions by saying "it's not what the course is about" when they fail to carry out basic mathematics task, what should our response be?
"Go look at the standard linear algebra textbooks. Do they cover computing the eigenvalues of a 3x3 matrix? You bet. Why? Because that's a fundamental skill.
If I only give you 2x2 matrix problems and don't make you learn this fundamental skill, then not only am I neglecting my professional duty, but I'm also setting you and all your classmates up to fail in whatever math course you take after this. And I'm not going to do that.
What I'm going to do instead is support you in learning this stuff. I'm not going to lower the bar for you, but I am going to help you rise to meet it.
So why don't you come to my office hours on Tuesday and we'll go over how to factor a cubic by grouping. That was covered in Algebra 2, so you're probably just rusty. And even if you somehow got through Algebra 2 without having learned that, then don't worry I'm willing to work with you to get you back on track.
But remember, this is a two-way street: I'll coach you, but the only way coaching works is if you show up and put the work in. So I'm expecting to see you there Tuesday."
What about students who don't accept your support and still complain?
Not your problem. Don't worry about it. You can lead a horse to water, but you can't make it drink.
As you probably know by now, in the teaching profession there are going to be plenty of students who use you as a scapegoat for their own laziness. You just gotta develop a thick skin towards these things.
Edit: In the advice above, I'm assuming that you covered the case of 3x3 matrices (that result in factoring by grouping) in class.
It's come to light in the comments that the exercises in your book were all 2x2 matrices, and that makes me question whether you covered the 3x3 case in class. If you didn't, then the student is justified in their complaint.
I agree with what JonathanZ says in the comments: "make sure that the material on the exam is a subset of the [types of] problems they've worked on during homework." This follows as a consequence of "it's not reasonable to expect your students to learn things on their own."