As operating the business in the economy, all enterprises are interested in the business efficiency. Business efficiency is not only a measure of organizational performance and business management but also it is a vital issue for businesses operations. That is why defining the factors affecting business performance in enterprises, especially small and medium-sized enterprises accounted for more than 80 percentage of the enterprises in Vietnam plays a very important role in helping business managers find solutions to improve the business efficiency. This paper is conducted to determine the factors affecting the business performance of these groups of businesses from the perspective of business managers and the business. This study is based on a survey from 100 business managers and 400 small and medium enterprises in Vietnam. Through the EFA analysis tool, we found some similarities in terms of the groups of factors affecting the business performance in small and medium enterprises in Vietnam between the perspective of business managers and perspective of the enterprises. Both the surveyed groups defined that there were three factor groups influencing the business efficiency: (1) group of institutional, policy and infrastructure factors, (2) group of factors associated with enterprises and (3) group of factors related to the environment outside the enterprise.