Over a decade, pharmacy samples have been significant in treating diseases. Moreover, unknown drug-drug based interaction (DDIs) that cause unwanted hostile drug events (ADEs) in various regimens treatment remain a constant problem. Since artificial intelligence (AI) is universal existing today, various model based on AI have been incorporated to identify the significant drug interaction to assist clinicians in decision making across pharmacotherapies. Moreover, even though the models which is through DDIs have significantly used to help physicians in assisting to make decisions, but there is a concern concerning the AI models reliability due to their nature. Safety of the patients is promoted by Explainable AI (XAI) and depicts by showcasing the decision-making strategy of the AI models.