AutomaticAI-A hybrid approach for automatic artificial intelligence algorithm selection and hyperparameter tuning

2021
Recently, more and more real life problems are solved using artificial intelligence (AI) algorithms. One of the biggest challenges when working with AI is the selection and tuning of the best algorithm for solving the problem. The results generated by a given AI algorithm heavily depend on the way in which its hyperparameters are set. In most cases the process of algorithm selection and tuning is a manual, time consuming process in which the developer, based on experience and intuition tries to find the best solution from quality and execution time perspective. In this paper we present a method for solving the problem of AI algorithm selection and tuning, without human intervention, in a fully automated way. The method is a hybrid approach, a combination between particle swarm optimization and simulated annealing. We compare our approach with other similar tools like Auto-sklearn or Hyperopt-sklearn. We demonstrate the time efficiency and high accuracy of this method with some experiments on some known datasets. The paper also presents a platform for AI processing that include a set of procedures and services necessary in case of automatic processing of big datasets as well as the method for AI algorithm selection and tuning. This platform is useful for researchers and developers in an incipient phase of application development, when the best solution must be decided; it is also useful for specialists in different domains (physics, industry, economy) with less experience in using AI algorithms, but which has to process huge amount of data in an automated way.
EXPERT SYSTEMS WITH APPLICATIONS
卷号:182
ISSN:0957-4174
来源机构
Technical University of Cluj Napoca
收录类型
SSCI
发表日期
2021
学科领域
循证管理学
国家
罗马尼亚
语种
英语
DOI
10.1016/j.eswa.2021.115225
其他关键词
MODEL SELECTION; PARAMETER SELECTION; OPTIMIZATION
EISSN
1873-6793
被引频次(WOS)
0
被引更新日期
2022-01
关键词
Particle swarm optimization Simulated annealing Automatic algorithm selection Automatic hyperparameter tuning