检索结果-南通市图书馆

Multi-Agent Path Planning Method Based on Improved deep q-network in Dynamic Environments

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Journal of Shanghai Jiaotong university(Science) 2024年第4期29卷 601-612页

作者： LI Shuyi LI Minzhe JING Zhongliang School of Aeronautics and Astronautics Shanghai Jiao Tong UniversityShanghai200240China

The multi-agent path planning problem presents significant challenges in dynamic environments,primarily due to the ever-changing positions of obstacles and the complex interactions between agents’*** factors contribute to a tendency for the solution to converge slowly,and in some cases,diverge *** addressing this issue,this paper introduces a novel approach utilizing a double dueling deep q-network(D3qN),tailored for dynamic multi-agent environments.A novel reward function based on multi-agent positional constraints is designed,and a training strategy based on incremental learning is performed to achieve collaborative path planning of multiple ***,the greedy and Boltzmann probability selection policy is introduced for action selection and avoiding convergence to local *** match radar and image sensors,a convolutional neural network-long short-term memory(CNN-LSTM)architecture is constructed to extract the feature of multi-source measurement as the input of the *** algorithm’s efficacy and reliability are validated in a simulated environment,utilizing robot operating system and *** simulation results show that the proposed algorithm provides a real-time solution for path planning tasks in dynamic *** terms of the average success rate and accuracy,the proposed method is superior to other deep learning algorithms,and the convergence speed is also improved.

关键词： multi-agent path planning deep reinforcement learning deep q-network

Manufacturing Resource Scheduling Based on deep q-network

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Wuhan University Journal of Natural Sciences 2022年第6期27卷 531-538页

作者： ZHANG Yufei Zou Yuanhao ZHAO Xiaodong School of Electronic and Information Engineering Tongji UniversityShanghai 201804China

To optimize machine allocation and task dispatching in smart manufacturing factories, this paper proposes a manufacturing resource scheduling framework based on reinforcement learning(RL). The framework formulates the entire scheduling process as a multi-stage sequential decision problem, and further obtains the scheduling order by the combination of deep convolutional neural network(CNN) and improved deep q-network(DqN). Specifically, with respect to the representation of the Markov decision process(MDP), the feature matrix is considered as the state space and a set of heuristic dispatching rules are denoted as the action space. In addition, the deep CNN is employed to approximate the state-action values, and the double dueling deep qnetwork with prioritized experience replay and noisy network(D3qPN2) is adopted to determine the appropriate action according to the current state. In the experiments, compared with the traditional heuristic method, the proposed method is able to learn high-quality scheduling policy and achieve shorter makespan on the standard public datasets.

关键词： smart manufacturing job shop scheduling convolutional neural network deep q-network

UAV Autonomous Navigation for Wireless Powered Data Collection with Onboard deep q-network

在线全文

学校读者我要写书评

暂无评论

ZTE Communications 2023年第2期21卷 80-87页

作者： LI Yuting DING Yi GAO Jiangchuan LIU Yusha HU Jie YANG Kun School of Information and Communication Engineering University of Electronic Science and Technology of ChinaChengdu 611731China China Mobile Communications Group Jilin Co. Ltd.Changchun 130061China School of Computer Science and Electronic Engineering University of EssexColchester CO43SQUnited Kingdom

In a rechargeable wireless sensor network,utilizing the unmanned aerial vehicle(UAV)as a mobile base station(BS)to charge sensors and collect data effectively prolongs the network’s *** this paper,we jointly optimize the UAV’s flight trajectory and the sensor selection and operation modes to maximize the average data traffic of all sensors within a wireless sensor network(WSN)during finite UAV’s flight time,while ensuring the energy required for each sensor by wireless power transfer(WPT).We consider a practical scenario,where the UAV has no prior knowledge of sensor *** UAV performs autonomous navigation based on the status information obtained within the coverage area,which is modeled as a Markov decision process(MDP).The deep q-network(DqN)is employed to execute the navigation based on the UAV position,the battery level state,channel conditions and current data traffic of sensors within the UAV’s coverage *** simulation results demonstrate that the DqN algorithm significantly improves the network performance in terms of the average data traffic and trajectory design.

关键词： unmanned aerial vehicle wireless power transfer deep q-network autonomous navigation

A New Feature Selection Algorithm Based on deep q-network

在线全文

学校读者我要写书评

暂无评论

A New Feature Selection Algorithm Based on Deep Q-Network

Improving SINR via Joint Beam and Power Management for GEO and LEO Spectrum-Sharing Satellite Communication Systems

第40届中国控制会议

作者： Xinqian Li Jie Yao Jia Ren Liqiang Wang Faculty of Mechanical Engineering and Automation Zhejiang Sci-Tech University College of Mechanical & Automotive Engineering Zhejiang University of Water Resources & Electric Power

In machine learning tasks, feature selection is an important data preprocessing step. It improves the efficiency and prediction accuracy by removing redundant and irrelevant features in a dataset. Feature selection is essentially a search process for the optimal feature subset. Although the traditional feature selection methods can search feature subset effectively, they still have the problems of large scale and low classification accuracy. In this paper, a new automatic feature selection method based on deep q-network（DqN-FS） is proposed to solve the shortcomings of traditional feature selection. Firstly, the feature selection problem is formulated as a Markov decision process. Subsequently, the q network is used to optimize the search strategy of the optimal feature subset. Finally, the parameters of the q network are updated by stochastic gradient descent. This paper also considers an extensive study of the feature sequence setting for the proposed technique. The proposed methods are tested on 14 UCI standard datasets and then compared with mainstream feature selection methods. The results show the efficiency of DqNFS in searching for the optimal feature subsets.

关键词： Feature Selection deep q-network deep Reinforcement Learning Feature Ranking

来源： cnki会议评论

在线全文

cnki会议

学校读者我要写书评

暂无评论

China Communications 2022年第7期19卷 25-36页

作者： Xiaojin Ding Zhuangzhuang Ren Huanbin Lu Gengxin Zhang Telecommunication and networks National Engineering Research Center Nanjing University of Posts and TelecommunicationsNanjing 210003China

In this paper,we investigate a geosynchronous earth orbit(GEO)and low earth orbit(LEO)coexisting satellite communication *** decrease the interference imposed on the GEO user caused by LEO satellites,we propose a joint beammanagement and power-allocation(JBMPA)scheme to maximize signal-to-interference plus noise ratio(SINR)at the GEO user,whilst maintaining the ongoing wireless links spanning from LEO satellites to their corresponding ***,we first analyze the overlapping coverage among GEO and LEO satellites,to obtain the LEO-satellite set in which their beams impose interference on the GEO ***,considering the traffic of LEO satellites in the obtained set,we design a beam-management method to turn off and switch interference beams of LEO ***,we further propose a deep q-network(DqN)aided power allocation algorithm to allocate the transmit power for the ongoing LEO satellites in the obtained set,whose beams are unable to be *** results show that comparing with the traditional fixed beam with power allocation(FBPA)scheme,the proposed JBMPA can achieve a higher SINR and a lower outage probability,whilst guaranteeing the ongoing wireless transmissions of LEO satellites.

关键词： beam management deep q-network GEO-LEO coexisting power allocation

The application of reinforcement learning to NATM tunnel design

在线全文

学校读者我要写书评

暂无评论

Underground Space 2022年第6期7卷 990-1002页

作者： Enrico Soranzo Carlotta Guardiani Wei Wu University of Natural Resources and Life Sciences Feistmantelstraße 4Vienna 1180Austria

The New Austrian Tunnelling Method(NATM)tunnel design is performed by testing support classes against the geological *** propose to replace this manual process with reinforcement learning,a generic framework within the realm of artificial intelligence that solves control *** studies have demonstrated this possibility,albeit with methodological *** coupled the Finite Difference Method with a Python script,used the output of the first to train the machine learning model implemented in the latter and improved the choice of the support *** benchmark tests,we demonstrated that our method was capable of choosing the optimal support classes for various geological sets and showed the relation between its performance and the number of training episodes.

关键词： deep q-network NATM Reinforcement learning Support classes Tunnelling

Adaptive Electrospinning System Based on Reinforcement Learning for Uniform‑Thickness Nanofiber Air Filters

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Advanced Fiber Materials 2023年第2期5卷 617-631页

作者： Seok Hyeon Hwang Jin Yeong Song Hyun Il Ryu Jae Hee Oh Seungwook Lee Donggeun Lee Dong Yong Park Sang Min Park School of Mechanical Engineering Pusan National University63‑2 Busan University‑roGeumjeong‑guBusan 46241South Korea Smart Manufacturing Technology R&D Group Korea Institute of Industrial Technology320 Techno Sunhwan‑roYuga‑eupDalseong‑gunDaegu 42994Republic of Korea

Electrospinning is a simple and versatile method to produce nanofiber ***,owing to bending instability that occurs during the electrospinning process,electrospinning has frequently produced a non-uniform-thickness nanofiber filter,which deteriorates its air ***,an adaptive electrospinning system based on reinforcement learning(E-RL)was developed to produce uniform-thickness nanofiber *** E-RL accomplished a real-time thickness measurement of an electrospun nanofiber filter by measuring the transmitted light through the nanofiber filter using a camera placed at the bottom of the collector and converting it into thickness using the Beer–Lambert *** on the measured thickness,the E-RL detected the non-uniformity of the nanofiber filter thickness and manipulated the movable collector to alleviate the non-uniformity of the thickness by a pre-trained reinforcement learning(RL)*** the training of the RL algo-rithm,the nanofiber production simulation software based on the empirical model of the deposition of the nanofiber filter was developed,and the training process of the RL algorithm was repeated until the optimal policy was *** the training process with the simulation software,the trained model was transferred to the adaptive electrospinning *** the movement of the collector under the optimal strategy of RL algorithm,the non-uniformity of such nanofiber filters was significantly reduced by approximately five times in standard deviation and error for both simulation and *** finding has great potential in improving the reliability of electrospinning process and nanofiber filters used in research and industrial fields such as environment,energy,and biomedicine.

关键词： Electrospinning Nanofiber filter Uniform thickness Reinforcement learning deep q-network

deep Reinforcement Learning-Based Computation Offloading for 5G Vehicle-Aware Multi-Access Edge Computing network

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

China Communications 2021年第11期18卷 26-41页

作者： Ziying Wu Danfeng Yan State Key Laboratory of network and Switching Technology Beijing University of Posts and TelecommunicationsBeijing 100876China

Multi-access Edge Computing(MEC)is one of the key technologies of the future 5G *** deploying edge computing centers at the edge of wireless access network,the computation tasks can be offloaded to edge servers rather than the remote cloud server to meet the requirements of 5G low-latency and high-reliability application ***,with the development of IOV(Internet of Vehicles)technology,various delay-sensitive and compute-intensive in-vehicle applications continue to *** with traditional Internet business,these computation tasks have higher processing priority and lower delay *** this paper,we design a 5G-based vehicle-aware Multi-access Edge Computing network(VAMECN)and propose a joint optimization problem of minimizing total system *** view of the problem,a deep reinforcement learningbased joint computation offloading and task migration optimization(JCOTM)algorithm is proposed,considering the influences of multiple factors such as concurrent multiple computation tasks,system computing resources distribution,and network communication ***,the mixed integer nonlinear programming problem is described as a Markov Decision *** show that our proposed algorithm can effectively reduce task processing delay and equipment energy consumption,optimize computing offloading and resource allocation schemes,and improve system resource utilization,compared with other computing offloading policies.

关键词： multi-access edge computing computation offloading 5G vehicle-aware deep reinforcement learning deep q-network

现货市场环境下基于深度强化学习的光储联合电站储能系统最优运行方法

在线全文

学校读者我要写书评

暂无评论

电网技术 2022年第9期46卷 3365-3375页

作者：龚开王旭邓晖蒋传文马骏超房乐电力传输与功率变换控制教育部重点实验室(上海交通大学) 上海市闵行区200240 国网浙江省电力有限公司电力科学研究院浙江省杭州市310014 国网浙江省电力有限公司电力市场仿真实验室浙江省杭州市310014

光伏-储能联合电站不仅能够有效减少光伏实时出力偏差,也是一种能够提供电能量和调频辅助服务的潜在市场主体。为实现上述3类目标,与光伏出力协同的储能电量调度策略至关重要,然而目前大部分光储联合电站的储能电量调度策略无法同时协... 详细信息

光伏-储能联合电站不仅能够有效减少光伏实时出力偏差,也是一种能够提供电能量和调频辅助服务的潜在市场主体。为实现上述3类目标,与光伏出力协同的储能电量调度策略至关重要,然而目前大部分光储联合电站的储能电量调度策略无法同时协调降低光伏实时出力偏差和参与电能量与调频辅助服务市场3种决策;另一方面,电力现货市场价格与调频信号不确定性及储能电量调度策略将光储联合电站储能运行优化问题转化为一个随机动态非凸优化问题,现有相关研究大部分利用随机场景法或智能算法处理非凸优化,所获得的储能运行方案存在一定的局限性,且难以根据实时数据动态制定运行方案。因此,提出一种现货市场环境下基于DqN(deep q-network)的光储联合电站储能系统优化运行方法,该方法克服了非凸优化难题,结合所提储能电量闭环调度策略能够实现光储联合电站在考虑偏差考核成本、电能量收益、调频辅助服务收益下的储能系统小时级动态优化运行,进而最大化光-储联合电站的经济收益。测试算例通过实际市场数据验证了所提方法的可行性和有效性。

关键词：储能 deep q-network 不确定性电力市场最优运行