Feature: Option to auto-discard statistical outliers #837
Description
Hi @sharkdp . First, thanks for this great utility!
It would be nice if, after a batch of runs is complete and statistical data is available, I could have the option to auto-discard outliers and re-compute the statistical data. Threshold should be configurable, but I think +3-sigma is a reasonable "sane default" (debatable though).
We could also consider a limit for the number of discards possible to prevent accidentally missing a "double hump" histogram profile that would actually be good to know about. Something like "no more than 5% of runs can be discarded w/o warning".
I don't want to overcomplicate it. Just a simple filter would be a great start.
Thanks again!