I'd say go as high as possible (what you want/within reason). The Source Engine is so optimized/old enough at this point you could probably run HL2 on a toaster. Assuming you're smart about how you compress your .vtf's, it's not going to be an issue. As you said, if worst comes to worst we can also scale down as well.
EDIT: What KM said, yeah.