While F-value and ANOVA are useful means of hypothesis testing, you might need something else. In that case, you might want to utilize the likes of the Taguchi Method.