Just to put my two cents in ... I graduated from a tiny four year liberal-arts school in the middle of Wisconsin. (I would definitely reccomend Ripon College to anyone.) The CS department was part of the Math department and there were 6 graduating seniors in both departments combined when I was a senior. 3 Math majors, 1 CS majors, and two doubles. (Two of the Math majors doubled, but not in CS. One, I think, was Psychology.)

Your choice of college is less important than you think. Yes, you do have the opportunity in a larger college to be exposed to a number of projects you wouldn't normally see, like AI or robotics. However, in a smaller school, you get something very precious - time with your professor. My largest class throughout my college career was 22. That was my Ethics course. All my freshman courses were under 20 students. The largest class was Biology 101, at 75 students. That was also the only course with TA's. All my professors knew my name.

What am I doing now? I'm three years out of school and working as a well-respected consultant. I feel I actually learned more about what good programming by having math professors teach me. Programming is a very difficult art to get right. You need discipline in your thinking. If you want to avoid math, then you shouldn't expect to be a crackerjack programmer. Think about it.

------
We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.