检索结果-南通市图书馆

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

在线全文

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2024年第1期11卷 18-36页

作者： Ding Wang Ning Gao Derong liu jinna li Frank L.Lewis IEEE the Faculty of Information Technology Beijing Key Laboratory of Computational Intelligence and Intelligent SystemBeijing Laboratory of Smart Environmental Protectionand Beijing Institute of Artificial IntelligenceBeijing University of TechnologyBeijing 100124China the School of System Design and Intelligent Manufacturing Southern University of Science and TechnologyShenzhen 518055China the Department of Electrical and Computer Engineering University of Illinois at ChicagoChicago IL 60607 USA the School of Information and Control Engineering Liaoning Petrochemical UniversityFushun 113001China the UTA Research Institute the University of Texas at ArlingtonArlington TX 76118 USA

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, ***, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation ***, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

关键词： Adaptive dynamic programming(ADP) advanced control complex environment data-driven control event-triggered design intelligent control neural networks nonlinear systems optimal control reinforcement learning(RL)

急性脑梗死患者血清BDNF、IL-18、hs-CRP水平与血管性认知障碍的相关性

在线全文

学校读者我要写书评

暂无评论

北京大学学报（医学版） 2024年第4期56卷 708-714页

作者：李晋娜许丽娜李敏宋怡张静贾龙斌晋城市人民医院神经内科山西晋城048000 长治医学院研究生学院山西长治046000

目的:探讨急性脑梗死患者血清脑源性神经营养因子(brain-derived neurotrophic factor, BDNF)、白细胞介素18(interleukin-18,IL-18)、超敏C反应蛋白(hypersensitivity C-reactive protein, hs-CRP)水平与血管性认知障碍(vascular cognitive impairment, VCI)的相关性,为早期预防VCI提供有价值的临床依据。方法:选取山西晋城市人民医院神经内科2019年5月至2020年4月急性脑梗死住院患者160例,按照是否合并认知障碍分为无认知障碍组(no cognitive impairment, NCI,57例)、非痴呆型血管性认知障碍组(vascular cognitive impairment no dementia, VCIND,56例)和血管性痴呆组(vascular dementia, VaD,47例)。采用蒙特利尔认知评估量表(Montreal cognitive assessment, MoCA)测评各组患者的认知功能,采用美国国立卫生研究院卒中量表(National Institute of Health stroke scale, NIHSS)评估患者的神经缺损程度(分为轻度组、中度组、重度组),采用Pullicino梗死灶面积计算方法计算梗死面积(分为小面积梗死组、中面积梗死组、大面积梗死组)。分别在脑梗死急性期(0~7 d)、恢复期(15~30 d)和6个月时,采用酶联免疫吸附试验(enzyme-linked immunosorbent assay, EliSA)检测各组患者血清BDNF、IL-18的含量,采用免疫比浊法测定血清hs-CRP的水平。观察不同程度神经功能缺损和不同梗死面积对血清BDNF、IL-18、hs-CRP的影响,比较NCI、VCIND和VaD三组患者BDNF、IL-18和hs-CRP的表达水平,分析其与VCI的相关性。结果:(1)神经功能缺损轻度组、小面积梗死组血清BDNF的水平和MoCA评分分别显著高于缺损中、重度组和中面积、大面积梗死组,其血清IL-18、hs-CRP水平分别显著低于缺损中、重度组和中面积、大面积梗死组,差异均有统计学意义(P<0.05);(2)NCI组、VCIND组、VaD组的BDNF水平在脑梗死急性期、恢复期和6个月时均呈递减趋势,急性期和恢复期差异有统计学意义(P<0.05),三组IL-18、hs-CRP水平在急性期、恢复期和6个月时均呈递增趋势,差异有统计学意义(P<0.05);(3)血清BDNF水平与MoCA评分呈正相关,与VCI的严重程度呈负相关,而IL-18、hs-CRP水平与MoCA评分呈负相关,与VCI的严重程度呈正相关。结论:血清BDNF、IL-18和hs-CRP参与了急性脑梗死后VCI发生发展的病理过程,BDNF发挥了积极的保护作用,IL-18和hs-CRP对认知功能造成了明显的损害,血清BDNF、IL-18和hs-CRP的表达水平与认知障碍的严重程度密切相关,可以作为VCI早期诊断的生物标记物。

关键词：脑梗死血管性认知障碍脑源性神经营养因子白细胞介素18 超敏C反应蛋白

维普期刊数据库博看期刊

Graphic theory on interval stability of networked control systems

在线全文

学校读者我要写书评

暂无评论

Journal of Systems Engineering and Electronics 2008年第6期19卷 1185-1190页

作者： li jinna Zhang Qingling Inst. of Systems Science Northeastern Univ. Shenyang 110004 P. R. China Dept. of Mathematics and Physics Shenyang Inst. of Chemical Technology Shenyang 110142 P. R. China

A new method on the interval stability of networked control systems （NCSs） with random delay and data packet dropout is studied. Combining interval systems and NCSs, a graphic condition on judging interval stability is presented in terms of the weighted diagraph theory in graph theory. Furthermore, utilizing the graph-theoretic algorithm, the delay-depended controller gains are obtained. Aiming at the same delay and data packed dropout, several controller gains are obtained, simultaneously. The example and simulation illustrate the effectiveness of the proposed method.

关键词： networked control systems interval stability weighted diagraph vertex matrix.

Controllability and observability of networked control systems with time-varying delays

在线全文

学校读者我要写书评

暂无评论

Journal of Systems Engineering and Electronics 2009年第4期20卷 800-806页

作者： li jinna Zhang Qingling li Yuan Inst. of Systems Science Northeastern Univ. Shenyang 110004 P. R. China Dept. of Mathematics and Physics Shenyang Inst. of Chemical Technology Shenyang 110142 P. R. China

The controllability and observability of networked control systems are studied. Aiming at the networked control system with time-varying delay, the sufficient and necessary conditions for complete controllability and complete observability of the system are presented, respectively. Because of Markov characteristic of the network-induced delay, in terms of stochastic theory, a sufficient and necessary condition for completely mean value controllability of networked control systems is obtained. Further, the conditions that the controllability and observability of networked control systems are equivalent to the initial time-invariant system are given. Controllability and observability realization indexes are also discussed, respectively. The numerical example demonstrates the effectiveness of the proposed theory.

关键词： networked control system controllability observability controllability realization index observability realization index.

Reinforcement learning for optimal tracking of large-scale systems with multitime scales

在线全文

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2023年第7期66卷 5-29页

作者： jinna li Hao NIE Tianyou CHAI Frank L.LEWIS School of Information and Control Engineering Liaoning Petrochemical University State Key Laboratory of Synthetical Automation for Process Industries Northeastern University UTA Research Institute University of Texas at Arlington

This paper aims to solve an optimal tracking control(OTC) problem of large-scale systems with multitime scales and coupled subsystems using singular perturbation(SP) theory and reinforcement learning(RL) techniques. A considerable contribution of this paper is the development of a data-driven SP-based RL method for the OTC of unknown large-scale systems with multitime scales. To achieve this, a multitime scale tracking problem was decomposed into a linear quadratic tracker problem for slow subsystems and a dynamical game problem for fast subsystems using the SP theory. Then, the distributed composite feedback controllers were found using a distributed off-policy integral RL algorithm that uses only measured data from the system in real time. Thus, the operational index can follow its prescribed target value via an approximately optimal approach. Theoretical analysis and proof are presented to demonstrate that the sum of the performances of reduced-order subsystems is approximately equal to the performance of the original large-scale system. Finally, numerical and practical examples are provided to validate the effectiveness of the proposed method.

关键词： reinforcement learning singular perturbation multitime scales data-driven control

State feedback control of network-based systems with packet disordering

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Journal of Systems Engineering and Electronics 2011年第2期22卷 306-313页

作者： jinna li Shiqian Han Meng Zheng Haibin YU Qingling Zhang Department of Science Shenyang University of Chemical Technology Shenyang 110142 P. R. China Key Lab of Industrial Informatics Shenyang Institute of Automation Chinese Academy of Sciences Shenyang 11016 P. R. China Institute of Systems Science Northeastern University Shenyang 110004 P. R. China

A new method that stabilizes network-based systems with both bounded delay and packet disordering is discussed under the state feedback controller. A novel model, fully describing the dynamic characteristic of network-based systems with packet disordering, is constructed. Different from the existing models of network-based systems, the number of delay items is time-varying in the model proposed. Further, this model is converted into a parameter-uncertain discrete-time system with time-varying delay item numbers in terms of matrix theory. Moreover, the less conservative stability condition is obtained by avoiding utilisation of Moon et al.’ inequality and bounding inequalities for quadratic functional terms. By solving a minization problem based on linear matrix inequalities, the state feedback controller is presented. A numerical example is given to illustrate the effectiveness of the proposed method.

关键词： network-based systems packet disordering time-varying delay item numbers stability.

在线全文

学校读者我要写书评

暂无评论

IPDI改性水性醇酸乳液的制备及性能研究

涂料工业 2024年第6期54卷 29-34,40页

作者：张璐程相林亓子怡张琪李金娜郑州大学化工学院郑州450001

水性醇酸涂料漆膜的硬度、光泽与耐水性较油性醇酸涂料差,改进这些性能对水性醇酸涂料的推广应用有重要意义。本研究以大豆油、季戊四醇及苯酐为原料,采用醇解法合成醇酸预聚体,并引入异佛尔酮二异氰酸酯(IPDI)改性,通过相反转法制成IPD... 详细信息

水性醇酸涂料漆膜的硬度、光泽与耐水性较油性醇酸涂料差,改进这些性能对水性醇酸涂料的推广应用有重要意义。本研究以大豆油、季戊四醇及苯酐为原料,采用醇解法合成醇酸预聚体,并引入异佛尔酮二异氰酸酯(IPDI)改性,通过相反转法制成IPDI改性水性醇酸乳液。研究了IPDI用量、中和剂AMP-95用量、乳化工艺对水性醇酸乳液性能的影响。结果表明:当IPDI用量(以苯酐的质量计)为50%,AMP-95用量(以树脂的质量计)为0.6%,乳化剂用量(以树脂的质量计)为5%,搅拌速度为4000 r/min时,所制得的水性醇酸乳液漆膜硬度达2H,光泽为90.87,表干2 h,耐水性24 h无异常,漆膜综合性能表现良好。

关键词： IPDI改性醇酸树脂相反转法中和剂

Optimal operational control for industrial processes based on Q-learning method

在线全文

学校读者我要写书评

暂无评论

Optimal operational control for industrial processes based o...

Model Predictive Control for Fermentation Process 25th

第36届中国控制会议

作者： jinna li Xize Gao Decheng Yuan Jialu Fan Lab of Operational Research and Cybernetics College of Information and EngineeringShenyang University of Chemical Technology State Key Lab of Synthetical Automation for Process Industries Northeastern University

ISBN: (纸本)9781538629185

It is difficult to accurately model productive processes and describe relationship between operational indices and controlled variables for complex modern industrial *** to design the optimal setpoints by using only data generated by operational processes,without requiring the knowledge of model parameters of operational processes,poses a challenge on designing optimal *** paper presents a state-observer based Q-learning algorithm to learn the optimal setpoints by utilizing only data,such that the real operational indices can track the desired values in an approximately optimal manner.A simulation experiment in flotation process is implemented to show the effectiveness of the proposed method.

关键词： optimal operational control setpoints approximate dynamical programming Q-learning

来源： cnki会议评论

在线全文

cnki会议

学校读者我要写书评

暂无评论

Model Predictive Control for Fermentation Process