基于改进随机梯度Boosting算法的软测量建模

doi:10.11949/j.issn.0438-1157.20161624

化工学报

基于改进随机梯度Boosting算法的软测量建模

仓文涛, 杨慧中

江南大学轻工过程先进控制教育部重点实验室, 江苏无锡 214122

收稿日期:2016-11-16 修回日期:2016-11-26 出版日期:2017-03-05 发布日期:2017-03-05
通讯作者: 杨慧中,yhz_jn@163.com
基金资助:
国家自然科学基金项目（61273070）。

Soft sensor modelling method based on modified stochastic gradient Boosting algorithm

CANG Wentao, YANG Huizhong

Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University, Wuxi 214122, Jiangsu, China

Received:2016-11-16 Revised:2016-11-26 Online:2017-03-05 Published:2017-03-05
Contact: 10.11949/j.issn.0438-1157.20161624
Supported by:
supported by the National Natural Science Foundation of China (61273070).

摘要/Abstract

摘要：

在建立复杂化工过程软测量模型时，使用传统的随机梯度Boosting算法（SGB）建模若收缩参数v选取不当会明显降低算法收敛速度，且极易陷入过拟合，难以取得令人满意的泛化效果。为解决这一问题，提出了一种基于SGB集成学习的软测量建模方法，采用高斯过程回归作为基学习器，并针对SGB算法固有的不足，依据每一次迭代中弱学习机的反馈，自适应调整收缩参数v，改善了SGB算法的过度拟合，从而提高了集成模型的估计精度与学习效率。将该方法应用于某双酚A装置的软测量建模中，仿真结果表明，相比于传统SGB建模，该方法具有更高的泛化性能和学习效率。

关键词: 算法, 计算机模拟, 集成, 随机梯度Boosting, 软测量

Abstract:

When soft sensor models were constructed for complicated chemical processes by traditional stochastic gradient Boosting (SGB), improper selection of shrinkage parameters would reduce convergence rate of the algorithm, engender overfitting, and sometimes make it difficult to obtain a satisfactory generalization performance. In order to solve this problem, a modified SGB ensemble learning soft sensor was proposed, in which Gaussian process regression (GPR) was adopted as base learner and shrinkage parameters were automatically adjusted according to feedback of a weak learner in each iteration such that both estimation accuracy and learning efficiency were improved. Simulation results in an industrial process of bisphenol A production showed that the modified integration algorithm had higher learning efficiency and generalization performance than traditional SGB models.

Key words: algorithm, computer simulation, integration, stochastic gradient Boosting, soft sensor

中图分类号:

TP273

仓文涛, 杨慧中. 基于改进随机梯度Boosting算法的软测量建模[J]. 化工学报, DOI: 10.11949/j.issn.0438-1157.20161624.

CANG Wentao, YANG Huizhong. Soft sensor modelling method based on modified stochastic gradient Boosting algorithm[J]. CIESC Journal, DOI: 10.11949/j.issn.0438-1157.20161624.

参考文献 30

[1]	杨小梅, 刘文琦, 杨俊. 基于分阶段的LSSVM发酵过程建模[J]. 化工学报, 2013, 64(9):3262-3269. YANG X M, LIU W Q, YANG J. LSSVM modeling for fermentation process based on dividing stages[J]. CIESC Journal, 2013, 64(9):3262-3269.
[2]	曹鹏飞, 罗雄麟. 化工过程软测量建模方法研究进展[J]. 化工学报, 2013, 64(3):788-800. CAO P F, LUO X L. Modeling of soft sensor for chemical process[J]. CIESC Journal, 2013, 64(3):788-800.
[3]	KADLEC P, GABRYS B, STRANDT S. Data-driven soft sensors in the process industry[J]. Computers and Chemical Engineering, 2009, 33(4):795-814.
[4]	雷瑜, 杨慧中. 基于高斯过程和贝叶斯决策的组合模型软测量[J]. 化工学报, 2013, 64(12):4434-4438. LEI Y, YANG H Z. Combination model soft sensor based on Gaussian process and Bayesian committee machine[J]. CIESC Journal, 2013, 64(12):4434-4438.
[5]	CAO P F, LUO X L. Modeling for soft sensor systems and parameters updating online[J]. Journal of Process Control, 2014, 24(6):975-990.
[6]	JIN H P, CHEN X G, WANG L, et al. Adaptive soft sensor development based on online ensemble Gaussian process regression for nonlinear time-varying batch processes[J]. Industrial & Engineering Chemistry Research, 2015, 54(30):7320-7345.
[7]	CAO P F, LUO X L. Soft sensor model derived from wiener model structure:modeling and identification[J]. Chinese Journal of Chemical Engineering, 2014, 22(5):538-548.
[8]	GUO Y F, ZHAO Y, HUANG B. Development of soft sensor by incorporating the delayed infrequent and irregular measurements[J]. Journal of Process Control, 2014, 24(11):1733-1739.
[9]	LIU J L. Developing a soft sensor based on sparse partial least squares with variable selection[J]. Journal of Process Control, 2014, 24(7):1046-1056.
[10]	GE Z Q, HUANG B, SONG Z H. Mixture semi-supervised principal component regression model and soft sensor application[J]. AIChE Journal, 2014, 60(2):533-545.
[11]	YAN X D, YANG W, MA H H, et al. Soft sensor for ammonia concentration at the ammonia converter outlet based on an improved group search optimization and BP neural network[J]. Chinese Journal of Chemical Engineering, 2012, 20(6):1184-1190.
[12]	JIN X, WANG S Y, HUANG B, et al. Multiple model based LPV soft sensor development with irregular/missing process output measurement[J]. Control Engineering Practice, 2012, 20(2):165-172.
[13]	LIU Y, GAO Z L, LI P, et al. Just-in-time kernel learning with adaptive parameter selection for soft sensor modeling of batch processes[J]. Industrial & Engineering Chemistry Research, 2012, 51(11):4313-4327.
[14]	SHAO W M, TIAN X M, WANG P. Soft sensor development for nonlinear and time-varying processes based on supervised ensemble learning with improved process state partition[J]. Asia-Pacific Journal of Chemical Engineering, 2015, 10(2):282-296.
[15]	LIU Y Q, HUANG D P, LI Y. Development of interval soft sensors using enhanced just-in-time learning and inductive confidence predictor[J]. Industrial & Engineering Chemistry Research, 2012, 51(8):3356-3367.
[16]	WANG L, JIN H P, CHEN X G, et al. Soft sensor development based on the hierarchical ensemble of Gaussian process regression models for nonlinear and non-Gaussian chemical processes[J]. Industrial & Engineering Chemistry Research 2016, 55(28):7704-7719.
[17]	MA M D, WANG S J, WU M F, et al. Development of adaptive soft sensor based on statistical identification of key variables[J]. Control Engineering Practice, 2009, 17(9):1026-1034.
[18]	LI X L, SU H Y, CHU J. Multiple model soft sensor based on affinity propagation, Gaussian process and Bayesian committee machine[J]. Chinese Journal of Chemical Engineering, 2009, 17(1):95-99.
[19]	LIU J L. On-line soft sensor for polyethylene process with multiple production grades[J]. Control Engineering Practice, 2007, 15(7):769-778.
[20]	VALIANT L G. A theory of the learnable[J]. Communications of the ACM, 1984, 27(22):1134-1142.
[21]	SCHAPIRE R E. The strength of weak learnability[J]. Machine Learning, 1990, 5(2):197-227.
[22]	FREUND Y, SCHAPIRE R E. A decision-theoretic generalization of on-line learning and an application of boosting[J]. Journal of Computer and System Sciences, 1997, 55(1):119-139.
[23]	FRIEDMAN J H. Greedy function approximation:a gradient boosting machine[J]. The Annuals of Statistics, 2001, 29(5):1189-1232.
[24]	FRIEDMAN J H. Stochastic gradient boosting[J]. Computational Statistics and Data Analysis, 2002, 38(4):367-378.
[25]	CAO D S, XU Q S. The boosting:a new idea of building models[J]. Chemometrics and Intelligent Laboratory Systems, 2010, 100(1):1-11.
[26]	SUI Y, ZHANG L. Visual tracking via locally structured Gaussian process regression[J]. IEEE Signal Processing Letters, 2015, 22(9):1331-1335.
[27]	LIU Y, CHEN T, CHEN J H. Auto-switch Gaussian process regression-based probabilistic soft sensors for industrial multigrade processes with transitions[J]. Industrial & Engineering Chemistry Research, 2015, 54(18):5037-5047.
[28]	YAN W J, HU S Q, CHEN T, et al. Bayesian migration of Gaussian process regression for rapid process modeling and optimization[J]. Chemical Engineering Journal, 2011, 166(3):1095-1103.
[29]	GAO Y B, KONG X Y. Multivariate data modeling using modified kernel partial least squares[J]. Chemical Engineering Research and Design, 2015, 94(1):466-474.
[30]	ZHANG M H, XU Q S, MASSART D L. Boosting partial least squares[J]. Analytical Chemistry, 2005, 77(5):1423-1431.

基于改进随机梯度Boosting算法的软测量建模

Soft sensor modelling method based on modified stochastic gradient Boosting algorithm

PDF (PC)

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献 30

相关文章 15

编辑推荐

Metrics

本文评价

[1]	陈哲文, 魏俊杰, 张玉明. 超临界水煤气化耦合SOFC发电系统集成及其能量转化机制[J]. 化工学报, 2023, 74(9): 3888-3902.
[2]	曹跃, 余冲, 李智, 杨明磊. 工业数据驱动的加氢裂化装置多工况切换过渡状态检测[J]. 化工学报, 2023, 74(9): 3841-3854.
[3]	刘远超, 关斌, 钟建斌, 徐一帆, 蒋旭浩, 李耑. 单层XSe₂（X=Zr/Hf）的热电输运特性研究[J]. 化工学报, 2023, 74(9): 3968-3978.
[4]	尹刚, 李伊惠, 何飞, 曹文琦, 王民, 颜非亚, 向禹, 卢剑, 罗斌, 卢润廷. 基于KPCA和SVM的铝电解槽漏槽事故预警方法[J]. 化工学报, 2023, 74(8): 3419-3428.
[5]	诸程瑛, 王振雷. 基于改进深度强化学习的乙烯裂解炉操作优化[J]. 化工学报, 2023, 74(8): 3429-3437.
[6]	闫琳琦, 王振雷. 基于STA-BiLSTM-LightGBM组合模型的多步预测软测量建模[J]. 化工学报, 2023, 74(8): 3407-3418.
[7]	余娅洁, 李静茹, 周树锋, 李清彪, 詹国武. 基于天然生物模板构建纳米材料及集成催化剂研究进展[J]. 化工学报, 2023, 74(7): 2735-2752.
[8]	李贵贤, 曹阿波, 孟文亮, 王东亮, 杨勇, 周怀荣. 耦合固体氧化物电解槽的CO₂制甲醇过程设计与评价研究[J]. 化工学报, 2023, 74(7): 2999-3009.
[9]	文兆伦, 李沛睿, 张忠林, 杜晓, 侯起旺, 刘叶刚, 郝晓刚, 官国清. 基于自热再生的隔壁塔深冷空分工艺设计及优化[J]. 化工学报, 2023, 74(7): 2988-2998.
[10]	王光, 单发顺, 钱禹丞, 焦建芳. 基于集成学习传递熵的化工过程微小故障检测方法[J]. 化工学报, 2023, 74(7): 2967-2978.
[11]	邵伟明, 韩文学, 宋伟, 杨勇, 陈灿, 赵东亚. 基于分布式贝叶斯隐马尔可夫回归的动态软测量建模方法[J]. 化工学报, 2023, 74(6): 2495-2502.
[12]	邵远哲, 赵忠盖, 刘飞. 基于共同趋势模型的非平稳过程质量相关故障检测方法[J]. 化工学报, 2023, 74(6): 2522-2537.
[13]	高学金, 姚玉卓, 韩华云, 齐咏生. 基于注意力动态卷积自编码器的发酵过程故障监测[J]. 化工学报, 2023, 74(6): 2503-2521.
[14]	周继鹏, 何文军, 李涛. 异形催化剂上乙烯催化氧化失活动力学反应工程计算[J]. 化工学报, 2023, 74(6): 2416-2426.
[15]	刘尚豪, 贾胜坤, 罗祎青, 袁希钢. 基于梯度提升决策树的三组元精馏流程结构最优化[J]. 化工学报, 2023, 74(5): 2075-2087.