This paper conducts a simulation study of the effects of violating the ANOVA normality assumption in the presence of Weibull data. Twelve specific Weibull distributions, characterizing the life data of a variety of real-world products and systems, are investigated. Confidence intervals on test significance and power are generated and compared against intervals from normally distributed data. The ANOVA procedure is found to be robust in the majority of cases. Furthermore, a designed experiment is conducted to isolate the effects of the Weibull shape and scale parameters within the preceding study. The shape parameter is found to have a significant effect on significance and power, whereas the scale parameter does not have a significant effect at the target α = 0.05 test significance level.