This paper assesses the effectiveness in scheduling independent jobs with earliness/tardiness costs and variable setup times applying the Overall Equipment Effectiveness (OEE). The OEE is a common metric for measuring the manufacturing productivity. We defined a mixed-integer linear programming formulation of the parallel machine scheduling problem with four different objective functions in order to compare different scheduling configurations. Real data, from a plastic container manufacturing company located in the Basque Country (Spain), were used to validate this approach. A sensitivity analysis was performed with different production capacities and earliness/tardiness costs in order to evaluate the trade-offs between economic performance (i.e., costs) and the partial rates of OEE (i.e., quality, performance and availability). The objective of this study is to propose a guideline to help management make decisions regarding the measurement and improvement of scheduling effectiveness through contemplating earliness, tardiness and variable setup times.