How do you benchmark a new distributed algorithm fairly?
0 hearts0 comments0 replies
I keep reviewing papers where the baseline is a strawman or the testbed is a single cluster with no failure injection.
It makes it hard to tell whether a new protocol is genuinely better or just tuned to one setting.
What do you consider the minimum fair comparison when evaluating a distributed algorithm?