A Hybrid Approach Variable Selection Algorithm Based on Mutual Information for Data-Driven Industrial Soft-Sensor Applications
Abstract
The development of virtual sensors predicting the desired output requires a careful selection of input variables for model construction. In an industrial environment, datasets contain many instrumentation system measures; however, these variables are often non-relevant or excessive information. This paper proposes a variable selection algorithm based on mutual information examination, redundancy analysis, and variable reduction for soft-sensor modeling. A relevance calculation is performed in the first stage to select important variables using the mutual information criterion. Then, the detection and exclusion of redundant variables are carried out, penalizing undesired variables. Finally, the most relevant variables subset is determined through a wrapper method using Mallowssans' Cp metric to assess the fitting prediction performance. The approach was successfully applied to estimate the ethanol concentration for a distillation column process using an adaptive network-based fuzzy inference system architecture as a non-linear dynamic regression model. A comparative study was performed considering the application of correlation analysis and the method proposed in this study. Simulation results show the effectiveness of the proposed approach in the variable selection providing a reduction in search of suitable models that achieve faster results for developing soft sensors oriented to industrial applications.
Downloads
References
B. Lin, B. Recke, J. K. H. Knudsen, and S. B. Jørgensen, "A systematic approach for soft sensor development," Comput. Chem. Eng., vol. 31, no. 5-6, pp. 419-425, 2007. doi: https://doi.org/10.1016/j.compchemeng.2006.05.030
P. Kadlec, B. Gabrys, and S. Strandt, "Data-driven Soft Sensors in the process industry," Computers and Chemical Engineering, vol. 33, no. 4. pp. 795-814, 2009. doi: https://doi.org/10.1016/j.compchemeng.2008.12.012
I. Guyon, A. Elisseeff, and A. M. De, "An Introduction to Variable and Feature Selection," J. Mach. Learn. Res., vol. 3, pp. 1157-1182, 2003.
R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, no. 1-2, pp. 273-324, 1997. doi: https://doi.org/10.1016/S0004-3702(97)00043-X
S. Visalakshi and V. Radha, "A literature review of feature selection techniques and applications: Review of feature selection in data mining," 2014 IEEE Int. Conf. Comput. Intell. Comput. Res. IEEE ICCIC 2014, no. 1997, 2015. doi: https://doi.org/10.1109/ICCIC.2014.7238499
L. Fortuna, S. Graziani, and M. G. Xibilia, "Soft sensors for product quality monitoring in debutanizer distillation columns," Control Eng. Pract., vol. 13, no. 4, pp. 499-508, 2005. doi: https://doi.org/10.1016/j.conengprac.2004.04.013
S. B. Chitralekha and S. L. Shah, "Application of support vector regression for developing soft sensors for nonlinear processes," Can. J. Chem. Eng., vol. 88, no. 5, pp. 696-709, 2010. doi: https://doi.org/10.1002/cjce.20363
E. Y. Nagai, L. Valeria, and R. De Arruda, "Soft sensor based on Fuzzy Model indentification."
M. Liukkonen, E. Hälikkä, T. Hiltunen, and Y. Hiltunen, "Dynamic soft sensors for NOx emissions in a circulating fluidized bed boiler," Appl. Energy, vol. 97, no. x, pp. 483-490, 2012. doi: https://doi.org/10.1016/j.apenergy.2012.01.074
A. Rogina, I. Šiško, I. Mohler, Z. ̌ Ujević, and N. Bolf, "Soft sensor for continuous product quality estimation (in crude distillation unit)," Chem. Eng. Res. Des., vol. 89, no. January, pp. 2070-2077, 2011. doi: https://doi.org/10.1016/j.cherd.2011.01.003
X. Yuan, H. Yang, and N. S. Wang, "A method of variables selection for soft sensor based on distributed mutual information," vol. 7, no. 3, pp. 1164-1169, 2015.
F. Souza, R. Araújo, S. Soares, and J. Mendes, "VARIABLE SELECTION BASED ON MUTUAL INFORMATION FOR SOFT SENSORS APPLICATIONS," in Proceedings of the 9th Portuguese Conference on Automatic Control (Controlo 2010), 2009.
Q. Li, X. Du, W. Liu, and W. Ba, "Soft sensor modelling based on mutual information variable selection and partial least squares," Proc. - 2017 Chinese Autom. Congr. CAC 2017, vol. 2017-Janua, pp. 3649-3654, 2017. doi: https://doi.org/10.1109/CAC.2017.8243414
F. Curreri, S. Graziani, and M. G. Xibilia, "Input selection methods for data-driven Soft sensors design: Application to an industrial process," Inf. Sci. (Ny)., 2020. doi: https://doi.org/10.1016/j.ins.2020.05.028
F. Curreri, G. Fiumara, and M. G. Xibilia, "Input selection methods for soft sensor design: A survey," Futur. Internet, vol. 12, no. 6, pp. 1-24, 2020. doi: https://doi.org/10.3390/fi12060097
V. H. Alves Ribeiro and G. Reynoso-Meza, "Feature selection and regularization of interpretable soft sensors using evolutionary multi-objective optimization design procedures," Chemom. Intell. Lab. Syst., vol. 212, no. February, p. 104278, 2021. doi: https://doi.org/10.1016/j.chemolab.2021.104278
T. M. Cover and J. A. Thomas, Elements of Information Theory, Second Edi. Wiley Jhon & sons, 2006.
C. L. Mallows, "Some Comments on Cp," Technometrics, vol. 15, no. November, pp. 87-94, 1973. doi: https://doi.org/10.2307/1267380
R. Battiti, "Using Mutual Information for Selecting Features in Supervised Neural-Net Learning," Ieee Trans. Neural Networks, vol. 5, no. 4, pp. 537-550, 1994. doi: https://doi.org/10.1109/72.298224
H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, 2005. doi: https://doi.org/10.1109/TPAMI.2005.159
L. Gao and W. Wu, "Relevance assignation feature selection method based on mutual information for machine learning," Knowledge-Based Syst., vol. 209, p. 106439, Dec. 2020. doi: https://doi.org/10.1016/j.knosys.2020.106439
M. Mittal, S. C. Satapathy, V. Pal, B. Agarwal, L. M. Goyal, and P. Parwekar, "Prediction of coefficient of consolidation in soil using machine learning techniques," Microprocess. Microsyst., vol. 82, p. 103830, Apr. 2021. doi: https://doi.org/10.1016/j.micpro.2021.103830
D. Effrosynidis and A. Arampatzis, "An evaluation of feature selection methods for environmental data," Ecol. Inform., vol. 61, no. January, p. 101224, 2021. doi: https://doi.org/10.1016/j.ecoinf.2021.101224
J. S. R. Jang, "ANFIS: Adaptive-Network-Based Fuzzy Inference System," IEEE Trans. Syst. Man Cybern., vol. 23, no. 3, pp. 665-685, 1993. doi: https://doi.org/10.1109/21.256541
J.-S. R. Jang, "Input selection for ANFIS learning," Proc. IEEE 5th Int. Fuzzy Syst., vol. 2, pp. 1493-1499, 1996.
| Article metrics | |
|---|---|
| Abstract views | |
| Galley vies | |
| PDF Views | |
| HTML views | |
| Other views | |
