How do you choose a sampling rate for a new signal processing study?

I'm designing a new acquisition setup and keep second-guessing the sampling rate, since oversampling helps with some analyses but complicates storage and downstream processing.

I'd like to hear how others justify their choice in papers and grant applications.

What criteria do you use to settle on a rate that reviewers will accept?