One could make a lot of arguments either way. However, with respect to the AP curriculum as it stands, it makes sense to include infinite series, because Taylor Series are there. Why do I say this? Why include Taylor Series at this venture?
Well, the main viewpoint of the AP calculus curriculum should be local linearity. It should be how the major rules for derivates, L'Hopital's Rule, and even the FTC are justified -- not absurd limit arguments (have them see the "clever zero" somewhere else). Please see Dan Teague's resources from the North Carolina School of Mathematics or comment if you want me to post some resources for those things. Taylor polynomials naturally flow from this discussion, because you might be curious as to which functions accept a "locally quadratic" approximation. Why stop there?
Now that you've justified and played with getting ever better Taylor Polynomials and approximations for all sorts of practical purposes (including discussion of error!), one begins to conjecture what happens as the number of terms goes to infinity and bam! Convergence is necessary. Then you step back and talk about series convergence so that way you can attack all of those lovely Taylor Series with justification for their convergence to functions.
I 100000% disagree with just randomly starting with infinite series. That is not logical and is completely disconnected. It's a tool for justifying things you really want.
One could also find other reasons to talk about infinite series (not on the AP test) such as the Basel problem of Euler which gives us the lovely
$\displaystyle\sum_{k=1}^{\infty}\frac{1}{k^2}=\frac{\pi^2}{6}$.
I HIGHLY recommend looking at the pdf here: Basel Problem and having your class go through the document as part of the review for the AP exam. Maybe split them up into groups and have each group present on a section or something? If there isn't enough time, go over it together as a comprehensive, single problem (going through its historical development in sections 1-4 of the pdf) that requires many of the tools from the latter part of the BC curriculum. The exercises are great review problems!
Section 5 is short and after the firepower of section 4, one looks at
$\displaystyle\sum_{k=1}^{\infty}\frac{1}{k^3}$
thinking awesome! I have the tools to attack this. Wait. No I don't! Mathematics isn't dead --- no one knows how to do this, and it's been centuries since Euler solved the rather similar problem! A good way to end a BC calc course in my mind, emphasizing there is a lot of math to be learned, because it's a vibrant, living subject where a simple change in familiar, solved problems results in something unknown.