A recommendation system for meta-modeling: A meta-learning based approach

2016
Various meta-modeling techniques have been developed to replace computationally expensive simulation models. The performance of these meta-modeling techniques on different models is varied which makes existing model selection/recommendation approaches (e.g., trial-and-error, ensemble) problematic. To address these research gaps, we propose a general meta-modeling recommendation system using meta-learning which can automate the meta-modeling recommendation process by intelligently adapting the learning bias to problem characterizations. The proposed intelligent recommendation system includes four modules: (1) problem module, (2) meta-feature module which includes a comprehensive set of meta-features to characterize the geometrical properties of problems, (3) meta-learner module which compares the performance of instance-based and model-based learning approaches for optimal framework design, and (4) performance evaluation module which introduces two criteria, Spearman's ranking correlation coefficient and hit ratio, to evaluate the system on the accuracy of model ranking prediction and the precision of the best model recommendation, respectively. To further improve the performance of meta-learning for meta-modeling recommendation, different types of feature reduction techniques, including singular value decomposition, stepwise regression and ReliefF, are studied. Experiments show that our proposed framework is able to achieve 94% correlation on model rankings, and a 91% hit ratio on best model recommendation. Moreover, the computational cost of meta-modeling recommendation is significantly reduced from an order of minutes to seconds compared to traditional trial-and-error and ensemble process. The proposed framework can significantly advance the research in meta-modeling recommendation, and can be applied for data-driven system modeling. (C) 2015 Elsevier Ltd. All rights reserved.
EXPERT SYSTEMS WITH APPLICATIONS
页码:33-44|卷号:46
ISSN:0957-4174
收录类型
SSCI
发表日期
2016
学科领域
循证管理学
国家
美国
语种
英语
DOI
10.1016/j.eswa.2015.10.021
其他关键词
SUPPORT VECTOR REGRESSION; DESIGN; SELECTION; ENSEMBLE; APPROXIMATION; ALGORITHMS; PARAMETERS; MODEL
EISSN
1873-6793
资助机构
National Science FoundationNational Science Foundation (NSF) [CNS-1239257]; United States Transportation Command (USTRANSCOM); Air Force Institute of Technology (AFIT); National Science Foundation of ChinaNational Natural Science Foundation of China (NSFC) [71501132]
资助信息
This research was partially supported by funds from the National Science Foundation award (CNS-1239257), from the United States Transportation Command (USTRANSCOM) in concert with the Air Force Institute of Technology (AFIT) under an ongoing Memorandum of Agreement, and National Science Foundation of China (71501132). The U.S. Government is authorized to reproduce and distribute for governmental purposes notwithstanding any copyright annotation of the work by the author(s). The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of USTRANSCOM, AFIT, the Department of Defense, or the U.S. Government.
被引频次(WOS)
27
被引更新日期
2022-01
来源机构
Arizona State University Arizona State University-Tempe University of Illinois System University of Illinois Chicago University of Illinois Chicago Hospital Air Force Institute of Technology (AFIT)
关键词
Meta-learning Meta-model Simulation Recommendation system Algorithm selection Feature reduction