The black-box nature of many artificial intelligence (AI) models presents challenges when employed to automate decision-making within the legal field, regarding the maintenance of the high standards for accountability, transparency and explainability required in the legal domain.