检索结果-南通市图书馆

Robust cooperative multi-agent reinforcement learning via multi-view message certification

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2024年第4期67卷 131-145页

作者： Lei YUAN Tao JIANG Lihe LI Feng CHEN Zongzhang ZHANG Yang YU National Key Laboratory for Novel Software Technology Nanjing University Polixir technologies

Many multi-agent scenarios require message sharing among agents to promote coordination,hastening the robustness of multi-agent communication when policies are deployed in a message perturbation environment. Major relevant studies tackle this issue under specific assumptions, like a limited number of message channels would sustain perturbations, limiting the efficiency in complex scenarios. In this paper,we take a further step in addressing this issue by learning a robust cooperative multi-agent reinforcement learning via multi-view message certification, dubbed CroMAC. Agents trained under CroMAC can obtain guaranteed lower bounds on state-action values to identify and choose the optimal action under a worst-case deviation when the received messages are perturbed. Concretely, we first model multi-agent communication as a multi-view problem, where every message stands for a view of the state. Then we extract a certificated joint message representation by a multi-view variational autoencoder(MVAE) that uses a product-of-experts inference network. For the optimization phase, we do perturbations in the latent space of the state for a certificate guarantee. Then the learned joint message representation is used to approximate the certificated state representation during training. Extensive experiments in several cooperative multi-agent benchmarks validate the effectiveness of the proposed CroMAC.

关键词： multi-agent reinforcement learning robust communication adversarial training multi-view learning message certification

Shape embedding and retrieval in multi-ﬂow deformation

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Computational Visual Media 2024年第3期10卷 439-451页

作者： Baiqiang Leng Jingwei Huang Guanlin Shen Bin Wang School of Software Tsinghua UniversityBeijingChina Huawei technologies ShenzhenChina

We propose a uniﬁed 3D ﬂow frameworkfor joint learning of shape embedding and deformationfor different categories. Our goal is to recovershapes from imperfect point clouds by ﬁtting thebest shape template in a shape repository afterdeformation. Accordingly, we learn a shape embeddingfor template retrieval and a ﬂow-based network forrobust deformation. We note that the deformationﬂow can be quite different for different shapecategories. Therefore, we introduce a novel multi-hubmodule to learn multiple modes of deformation toincorporate such variation, providing a network whichcan handle a wide range of objects from differentcategories. The shape embedding is designed to retrievethe best-ﬁt template as the nearest neighbor in a latentspace. We replace the standard fully connected layerwith a tiny structure in the embedding that signiﬁcantlyreduces network complexity and further improvesdeformation quality. Experiments show the superiorityof our method to existing state-of-the-art methods viaqualitative and quantitative comparisons. Finally, ourmethod provides efficient and flexible deformation thatcan further be used for novel shape design.

关键词： deformation shape retrieval embedding reconstruction

Reinforcement Learning-Empowered Graph Convolutional Network Framework for Data Integrity Attack Detection in Cyber-Physical Systems

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

CSEE Journal of Power and Energy Systems 2024年第2期10卷 797-806页

作者： Edeh Vincent Mehdi Korki Mehdi Seyedmahmoudian Alex Stojcevski Saad Mekhilef School of Science Computingand Engineering TechnologiesSwinburne University of TechnologyMelbourneAustralia

The massive integration of communication and information technology with the large-scale power grid has enhanced the efficiency, safety, and economical operation of cyber-physical systems. However, the open and diversified communication environment of the smart grid is exposed to cyber-attacks. Data integrity attacks that can bypass conventional security techniques have been considered critical threats to the operation of the grid. Current detection techniques cannot learn the dynamic and heterogeneous characteristics of the smart grid and are unable to deal with non-euclidean data types. To address the issue, we propose a novel Deep-Q-Network scheme empowered with a graph convolutional network (GCN) framework to detect data integrity attacks in cyber-physical systems. The simulation results show that the proposed framework is scalable and achieves higher detection accuracy, unlike other benchmark techniques.

关键词： Deep reinforcement learning graph convolutional network heterogeneous smart grid network

Congener-derived template to construct lithiophilic organic-inorganic layer/interphase for high volumetric capacity dendrite-free Li metal batteries

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Chinese Chemical Letters 2024年第3期35卷 453-460页

作者： Kang Yang Long Li Yuanbin Xiao Qiaoli Zhang Chenpeng Xi Borong Li Yan Yu Chengkai Yang Key Laboratory of Advanced Materials technologies International(HongKong Macao and Taiwan)Joint Laboratory on Advanced Materials TechnologiesCollege of Materials Science and EngineeringFuzhou UniversityFuzhou 350108China

The development of lithium-metal batteries(LMBs)is seriously restricted by the out-of-control dendrites growth and infinite volume ***,a pervasive organic-inorganic layer construction strategy is reported for the composite lithium metal anode with congener-derived organic-inorganic solid electrolyte interphase(SEI).In this strategy,the organic-inorganic Ag@polydopamine(Ag@PDA)layer is coated on the arbitrary substrates by a simple two-step *** thin and stable congener-derived SEI is insitu formed with fewer inorganic components and more organic components during charging/*** polydopamine with sufficient adhesion groups and lithiophilic Ag layer realize near-zero nucleation overpotential during lithium *** low interface resistance and stable lithium deposition are ***,the practical areal and volumetric capacities of the composite anode with three-dimensional copper(3DCu)as the substrate are 10 mAh/cm^(2)and 1538 mAh/cm^3(*** mass of anode).The symmetrical cell shows very low polarization voltage(10 mV)and more than 2500 h cycles life at 1 mA/cm^(2)(1 mAh/cm^(2)).The LiNi_(0.8)Co_(0.1)Mn_(0.1)O_(2)(NCM811)-based full cells show improved capacity retention(82%)after 100 cycles at 0.5 *** modified lithiophilic anode with congener-derived interphase provides a promising strategy to realize the next-generation dendrite-free LMBs.

关键词： Lithium metal anode Congener-derived Lithiophilicity Volumetric capacity Organic-inorganic interphase

Managing the surge:A comprehensive review of the entire disposal framework for retired lithium-ion batteries from electric vehicles

在线全文

学校读者我要写书评

暂无评论

Journal of Energy Chemistry 2024年第5期92卷 648-680页

作者： Ruohan Guo Feng Wang M.Akbar Rhamdhani Yiming Xu Weixiang Shen Department of Engineering technologies School of ScienceComputing and Engineering TechnologiesSwinburne University of TechnologyMelbourne VIC 3122Australia Department of Chemistry and Biotechnology School of ScienceComputing and Engineering TechnologiesSwinburne University of TechnologyMelbourne VIC 3122Australia Department Mechanical and Product Design Engineering School of EngineeringSwinburne University of TechnologyMelbourne VIC 3122Australia

Anticipating the imminent surge of retired lithium-ion batteries(R-LIBs)from electric vehicles,the need for safe,cost-effective and environmentally friendly disposal technologies has *** paper seeks to offer a comprehensive overview of the entire disposal framework for R-LIBs,encompassing a broad spectrum of activities,including screening,repurposing and ***,we delve deeply into a thorough examination of current screening technologies,shifting the focus from a mere enumeration of screening methods to the exploration of the strategies for enhancing screening ***,we outline battery repurposing with associated key factors,summarizing stationary applications and sizing methods for R-LIBs in their second life.A particular light is shed on available reconditioning solutions,demonstrating their great potential in facilitating battery safety and lifetime in repurposing scenarios and identifying their techno-economic *** the realm of battery recycling,we present an extensive survey of pre-treatment options and subsequent material recovery ***,we introduce several global leading recyclers to illustrate their industrial processes and technical ***,relevant challenges and evolving trends are investigated in pursuit of a sustainable end-of-life management and disposal *** hope that this study can serve as a valuable resource for researchers,industry professionals and policymakers in this field,ultimately facilitating the adoption of proper disposal practices.

关键词： Lithium-ion battery Battery reproposing and recycling Miaieiials recovery technologies Techno-economic issues End-of-life management Disposal framework

Learning in games:a systematic review

在线全文

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2024年第7期67卷 133-159页

作者： Rong-Jun QIN Yang YU National Key Laboratory for Novel Software Technology Nanjing University Polixir technologies

Game theory studies the mathematical models for self-interested individuals. Nash equilibrium is arguably the most central solution in game theory. While finding the Nash equilibrium in general is known as polynomial parity arguments on directed graphs(PPAD)-complete, learning in games provides an alternative to approximate Nash equilibrium, which iteratively updates the player's strategy through interactions with other players. Rules and models have been developed for learning in games, such as fictitious play and no-regret learning. Particularly, with recent advances in online learning and deep reinforcement learning,techniques from these fields greatly boost the breakthroughs in learning in games from theory to *** a result, we have witnessed many superhuman game AI systems. The techniques used in these systems evolve from conventional search and learning to purely reinforcement learning(RL)-style learning methods,gradually getting rid of the domain knowledge. In this article, we systematically review the above techniques,discuss the trend of basic learning rules towards a unified framework, and recap applications in large ***, we discuss some future directions and make the prospect of future game AI systems. We hope this article will give some insights into designing novel approaches.

关键词： non-cooperative games learning in games no-regret learning reinforcement learning superhuman AI

同方期刊数据库

Antisense therapy:a potential breakthrough in the treatment of neurodegenerative diseases

在线全文

学校读者我要写书评

暂无评论

Neural Regeneration Research 2024年第5期19卷 1027-1035页

作者： Roberta Romano Cecilia Bucci Department of Biological and Environmental Sciences and technologies(DiSTeBA) University of SalentoLecceItaly

Neurodegenerative diseases are a group of disorders characterized by the progressive degeneration of neurons in the central or peripheral nervous ***,there is no cure for neurodegenerative diseases and this means a heavy burden for patients and the health system ***,it is necessary to find new therapeutic approaches,and antisense therapies offer this possibility,having the great advantage of not modifying cellular genome and potentially being *** preclinical and clinical studies aim to test the safety and effectiveness of antisense therapies in the treatment of neurodegenerative *** objective of this review is to summarize the recent advances in the development of these new technologies to treat the most common neurodegenerative diseases,with a focus on those antisense therapies that have already received the approval of the *** and Drug Administration.

关键词： Alzheimer’s disease amyotrophic lateral sclerosis antisense oligonucleotide Huntington’s disease neurodegenerative disorders Parkinson’s disease siRNA

Communication Resource-Efficient Vehicle Platooning Control With Various Spacing Policies

在线全文

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2024年第2期11卷 362-376页

作者： Xiaohua Ge Qing-Long Han Xian-Ming Zhang Derui Ding IEEE School of Science Computing and Engineering TechnologiesSwinburne University of TechnologyMelbourne VIC 3122Australia

Platooning represents one of the key features that connected automated vehicles may possess as it allows multiple automated vehicles to be maneuvered cooperatively with small headways on roads. However, a critical challenge in accomplishing automated vehicle platoons is to deal with the effects of intermittent and sporadic vehicle-to-vehicle data transmissions caused by limited wireless communication resources. This paper addresses the co-design problem of dynamic event-triggered communication scheduling and cooperative adaptive cruise control for a convoy of automated vehicles with diverse spacing policies. The central aim is to achieve automated vehicle platooning under various gap references with desired platoon stability and spacing performance requirements, while simultaneously improving communication efficiency. Toward this aim, a dynamic event-triggered scheduling mechanism is developed such that the intervehicle data transmissions are scheduled dynamically and efficiently over time. Then, a tractable co-design criterion on the existence of both the admissible event-driven cooperative adaptive cruise control law and the desired scheduling mechanism is derived. Finally, comparative simulation results are presented to substantiate the effectiveness and merits of the obtained results.

关键词： Automated vehicles constant time headway spacing constant spacing cooperative adaptive cruise control event-triggered communication vehicle platooning

Process metallurgy and data-driven prediction and feedback of blast furnace heat indicators

在线全文

学校读者我要写书评

暂无评论

International Journal of Minerals,Metallurgy and Materials 2024年第6期31卷 1228-1240页

作者： Quan Shi Jue Tang Mansheng Chu School of Metallurgy Northeastern UniversityShenyang 110819China Institute for Frontier technologies of Low-carbon Steelmaking Northeastern UniversityShenyang 110819China Engineering Research Center of Frontier technologies for Low-carbon Steelmaking(Ministry of Education) Shenyang 110819China

The prediction and control of furnace heat indicators are of great importance for improving the heat levels and conditions of the complex and difficult-to-operate hour-class delay blast furnace(BF)*** this work,a prediction and feedback model of furnace heat indicators based on the fusion of data-driven and BF ironmaking processes was *** data on raw and fuel materials,process op-eration,smelting state,and slag and iron discharge during the whole BF process comprised 171 variables with 9223 groups of data and were comprehensively analyzed.A novel method for the delay analysis of furnace heat indicators was *** extracted delay variables were found to play an important role in *** method that combined the genetic algorithm and stacking efficiently im-proved performance compared with the traditional machine learning algorithm in improving the hit ratio of the furnace heat prediction *** hit ratio for predicting the temperature of hot metal in the error range of±10℃ was 92.4%,and that for the chemical heat of hot metal in the error range of±0.1wt%was 93.3%.On the basis of the furnace heat prediction model and expert experience,a feedback model of furnace heat operation was established to obtain quantitative operation suggestions for stabilizing BF heat *** sugges-tions were highly accepted by BF ***,the comprehensive and dynamic model proposed in this work was successfully ap-plied in a practical BF *** improved the BF temperature level remarkably,increasing the furnace temperature stability rate from 54.9%to 84.9%.This improvement achieved considerable economic benefits.

关键词： blast furnace furnace heat genetic algorithm stacking prediction and feedback