论文标题
迈向酥脆-ML(Q):具有质量保证方法的机器学习过程模型
Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology
论文作者
论文摘要
机器学习是一种在行业和学术界中建立的且经常使用的技术,但是仍然缺少改善机器学习应用成功和效率的标准过程模型。项目组织和机器学习从业人员在机器学习应用程序的整个生命周期中都需要指导,以满足业务期望。因此,我们提出了一个用于开发机器学习应用程序的过程模型,该过程涵盖了从定义范围到维护部署的机器学习应用程序的六个阶段。第一阶段将业务和数据理解与数据可用性相结合,通常会影响项目的可行性。第六阶段涵盖了监视和维护机器学习应用程序的最新方法,因为在不断变化的环境中,模型退化的风险是显着的。通过该过程的每项任务,我们提出了质量保证方法,该方法适用于我们以风险形式识别的机器学习开发中的挑战。该方法是从实践经验和科学文献中得出的,已被证明是一般和稳定的。该过程模型扩展了Crisp-DM,这是一个享有强大行业支持但缺乏解决机器学习特定任务的数据挖掘过程模型。我们的工作提出了针对机器学习应用程序量身定制的行业和应用程序中性流程模型,重点是用于质量保证的技术任务。
Machine learning is an established and frequently used technique in industry and academia but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine learning practitioners have a need for guidance throughout the life cycle of a machine learning application to meet business expectations. We therefore propose a process model for the development of machine learning applications, that covers six phases from defining the scope to maintaining the deployed machine learning application. The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project. The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications, as the risk of model degradation in a changing environment is eminent. With each task of the process, we propose quality assurance methodology that is suitable to adress challenges in machine learning development that we identify in form of risks. The methodology is drawn from practical experience and scientific literature and has proven to be general and stable. The process model expands on CRISP-DM, a data mining process model that enjoys strong industry support but lacks to address machine learning specific tasks. Our work proposes an industry and application neutral process model tailored for machine learning applications with focus on technical tasks for quality assurance.