How do you evaluate a language model when your test set is too small?

I work on a low-resource language and my held-out test set is only a few thousand sentences, so the differences between systems are often within noise.

I am unsure whether to report confidence intervals, pool multiple splits, or just be more cautious in my claims.

How do others in similar low-resource settings handle evaluation and reporting?