How do you decide which semiotic framework fits a new dataset?

I keep running into the problem where I have collected signs, images, or texts and then have to choose between competing frameworks, and the choice shapes everything downstream.

I want to hear how others make that call in practice.

Do you start from the framework, the data, or the research question, and what makes you commit?