Responsible Supply Chain (RSC) has become an important issue in the agricultural supply chain, along with the development of the sustainable agriculture concept. Furthermore, responsible agriculture helps to ensure the availability of food and maintain land quality, enabling the land to last for a long time. However, in practice, creating a responsible agricultural supply chain is rather difficult, especially in developing countries, where numerous barriers hinder the implementation of RSCs. This study therefore is an exploratory research aimed at finding the barrier factors to implementing responsible action in the agricultural supply chain. Multiple Case study research methods were conducted to provide answers to the research question. Meanwhile, data collection was performed through in-depth interviews with two agribusiness companies, and interpretive Structural Modelling was used to analyse the data obtained. The results showed the barrier factors faced in implementing responsible action within the agricultural supply chain include poor organizational capabilities, external actor involvement, and lack of supply chain integration. Organizational capabilities, including cost management, knowledge management, and organizational policy, play a significant role in implementing a responsible agriculture supply chain. This Implementation is also highly dependent on external involvement by government or non-government organizations (NGOs), as some supply chains take responsible action because of obligations or pressure from these organizations. Another barrier is inadequate supply chain integration, including integration, information sharing, and incentive alignment among supply chain members. Meanwhile, inadequate budget management, as part of organizational capabilities, is the major barrier giving rise to other challenges. The results of this study serve as a reference for supply chains, especially in the agriculture industry, while creating programs in a bid to reduce these inhibiting factors, to ensure responsible actions are well implemented well and able to provide a competitive advantage for all supply chain members.