Does it matter where I get my Bachelor degree if I'm going to go on to get a PhD?

While it won't matter for jobs, it will matter for getting into PhD programs. The higher ranked the undergrad school, the better your chances of getting into a great PhD program - and you'll need opportunities to do research as well. It doesn't matter if the school doesn't have graduate programs; you won't do your bachelors and PhD at the same school. Some liberal arts colleges have fantastic bachelors programs.