How do you decide which molecular descriptors to use in a QSAR model?

I am building QSAR models and keep running into the problem of choosing descriptors that are both interpretable and predictive.

There are so many options that the choice often feels arbitrary, and reviewers ask why I picked one set over another.

How do you decide which descriptors to include, and how do you justify that choice in a paper?