检索结果-南通市图书馆

Ensemble successor representations for task generalization in offline-to-online reinforcement learning

Science China(Information Sciences) 2024年第7期67卷 240-255页

作者： Changhong wang Xudong YU Chenjia BAI Qiaosheng ZHANG zhen wang Space Control and Inertial Technology Research Center Harbin Institute of Technology Shanghai Artificial Intelligence Laboratory Shenzhen Research Institute of Northwestern Polytechnical University School of Cybersecurity Northwestern Polytechnical University

In reinforcement learning(RL), training a policy from scratch with online experiences can be inefficient because of the difficulties in exploration. Recently, offline RL provides a promising solution by giving an initialized offline policy, which can be refined through online interactions. However, existing approaches primarily perform offline and online learning in the same task, without considering the task generalization problem in offline-to-online adaptation. In real-world applications, it is common that we only have an offline dataset from a specific task while aiming for fast online-adaptation for several tasks. To address this problem, our work builds upon the investigation of successor representations for task generalization in online RL and extends the framework to incorporate offline-to-online learning. We demonstrate that the conventional paradigm using successor features cannot effectively utilize offline data and improve the performance for the new task by online fine-tuning. To mitigate this, we introduce a novel methodology that leverages offline data to acquire an ensemble of successor representations and subsequently constructs ensemble Q functions. This approach enables robust representation learning from datasets with different coverage and facilitates fast adaption of Q functions towards new tasks during the online fine-tuning *** empirical evaluations provide compelling evidence showcasing the superior performance of our method in generalizing to diverse or even unseen tasks.

关键词： offline reinforcement learning online fine-tuning task generalization successor representations ensembles

来源：

同方期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Diffusion of a Ring Threaded on a Linear Chain

引用

Chinese Journal of Polymer Science 2020年第12期38卷 1409-1417页

作者： zhen-hua wang Yu-Yuan Lu Hui Jin Chuan-Fu Luo Li-Jia An State KeyLaboratory of Polymer Physics and Chemistry Changchun Istitute ofpplied Chemistry Chinese Academy of SciencesChangchun 130022 China University ofScience and Technology of China Hefei 230026China Changchun Istitute of Optics Fine Mechanics and PhysisChinese Acadermy of SciencesChangchun 130033China

A mesoscopic simulation is applied to investigate the effects of hydrodynamic interactions and axial chains on the dynamics of threaded *** hydrodynamic interactions significantly speed up the diffusion and relaxation of both free and threaded *** decoupled diffusion and relaxation dynamics indicate the broken of the Einstein-Stokes *** diffusion of a ring threaded on a flexible chain exhibits a synergism effect compared to that on an axial rod,which originates from the self-diffusion of the ring and the reptation-like motion of the axial ***,hydrodynamic interactions significantly improve the synergism effect,leading to an enhanced sliding motion of the threaded *** faster sliding of threaded rings suggests that the entropic barrier is negligible,which agrees well with the basic assumption of barrier-less confining tube at equilibrium in tube *** results provide a new perspective on analysis of the effects of topology constraints on polymer dynamics.

关键词： Hydrodynamic interactions Threaded ring Sliding dynamics Diffusion and relaxation

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Decentralized Primary Frequency Regulation for Hybrid Multi-terminal Direct Current Power Systems Considering Multi-source Enhancement

引用

Journal of Modern Power Systems and Clean Energy 2024年第3期12卷 958-970页

作者： Jialiang Wu zhen wang Ruixu Liu Yu Shan Chenxuan wang the College of Electrical Engineering Zhejiang UniversityHangzhou 310027China the Economic Research Institute of State Grid Zhejiang Electric Power Co. Ltd.Hangzhou 310016China

Hybrid multi-terminal direct current(MTDC)transmission technology has been a research focus,and primary frequency regulation(FR)improvement in the receiving-end system is one of the problems to be *** paper presents a decentralized primary FR scheme for hybrid MTDC power systems considering multi-source enhancement to help suppress frequency disturbance in the receiving-end *** the converters only need local frequency or DC voltage signal input to respond to system disturbance without communication or a control center,i.e.,a decentralized control *** proposed scheme can activate appropriate power sources to assist in FR in various system disturbance severities with fine-designed thresholds,ensuring sufficient utilization of each power *** better balance FR performance and FR resource participation,an evaluation index is proposed and the parameter optimization problem is further ***,the validity of the proposed scheme is verified by simulations in MATLAB/Simulink.

关键词： Decentralized control scheme primary frequency regulation(FR) rate of change of frequency(ROCOF) system frequency disturbance

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Clinical study of enhanced recovery after surgery in laparoscopic appendectomy for acute appendici

引用

World Journal of Gastrointestinal Surgery 2024年第3期16卷 816-822页

作者： Zhu-Lin Li hua-Chong Ma Yong Yang Jian-Jun Chen zhen-Jun wang Department of General Surgery Beijing Chao-Yang HospitalCapital Medical UniversityBeijing 100020China

BACKGROUND Enhanced recovery after surgery(ERAS)protocol is a comprehensive manage-ment modality that promotes patient recovery,especially in the patients undergo-ing digestive tumor ***,it is less commonly used in the *** To study the application value of ERAS in laparoscopic surgery for acute *** A total of 120 patients who underwent laparoscopic appendectomy due to acute appendicitis were divided into experimental group and control group by random number table method,including 63 patients in the experimental group and 57 patients in the control *** in the experimental group were managed with the ERAS protocol,and those in the control group were received the tra-ditional *** exhaust time,the hospitalization duration,the hospita-lization expense and the pain score between the two groups were *** There was no significant difference in age,gender,body mass index and Sunshine Appendicitis Grading System score between the experimental group and the con-trol group(P>0.05).Compared to the control group,the patients in the expe-rimental group had earlier exhaust time,shorter hospitalization time,less hospi-talization cost and lower degree of pain *** differences were statis-tically significant(P<0.01).CONCLUSION ERAS could significantly accelerate the recovery of patients who underwent la-paroscopic appendectomy for acute appendicitis,shorten the hospitalization time and reduce hospitalization *** is a safe and effective approach.

关键词： Enhanced recovery after surgery Appendicectomy Laparoscopy Acute appendicitis Treatment

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

A New Industrial Intrusion Detection Method Based on CNN-BiLSTM

引用

Computers, Materials & Continua 2024年第6期79卷 4297-4318页

作者： Jun wang Changfu Si zhen wang Qiang Fu College of Computer Science and Technology Shenyang University of Chemical TechnologyShenyang110142China

Nowadays,with the rapid development of industrial Internet technology,on the one hand,advanced industrial control systems(ICS)have improved industrial production ***,there are more and more cyber-attacks targeting industrial control *** ensure the security of industrial networks,intrusion detection systems have been widely used in industrial control systems,and deep neural networks have always been an effective method for identifying cyber *** intrusion detection methods still suffer from low accuracy and a high false alarm ***,it is important to build a more efficient intrusion detection *** paper proposes a hybrid deep learning intrusion detection method based on convolutional neural networks and bidirectional long short-term memory neural networks(CNN-BiLSTM).To address the issue of imbalanced data within the dataset and improve the model’s detection capabilities,the Synthetic Minority Over-sampling Technique-Edited Nearest Neighbors(SMOTE-ENN)algorithm is applied in the preprocessing *** algorithm is employed to generate synthetic instances for the minority class,simultaneously mitigating the impact of noise in the majority *** approach aims to create a more equitable distribution of classes,thereby enhancing the model’s ability to effectively identify patterns in both minority and majority *** the experimental phase,the detection performance of the method is verified using two data *** results show that the accuracy rate on the CICIDS-2017 data set reaches 97.7%.On the natural gas pipeline dataset collected by Lan Turnipseed from Mississippi State University in the United States,the accuracy rate also reaches 85.5%.

关键词： Intrusion detection convolutional neural network bidirectional long short-term memory neural network multi-head self-attention mechanism

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Triple reverse order law for the Drazin inverse

引用

Applied Mathematics(A Journal of Chinese Universities) 2024年第1期39卷 55-68页

作者： wang hua ZHONG Cheng-cheng College of Sciences Inner Mongolia University of TechnologyHohhot 010051China College of Engineering University of Jinan Quancheng CollegeYantai 265600China

In this paper,we investigate the reverse order law for Drazin inverse of three bound-ed linear operators under some commutation ***,the Drazin invertibility of sum is also obtained for two bounded linear operators and... 详细信息

关键词： Drazin inverse reverse order law space decomposition

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Musculoskeletal ultrasound to evaluate the efficacy of acupuncture: a review

引用

Journal of Traditional Chinese Medicine 2024年第3期44卷 629-632页

作者： wang Dingyue YU Yana wang Yiyuan ZHANG zhen Department of Ultrasound the First Affiliated Hospital of China Medical University

Acupuncture is a typical example of Traditional Chinese Medicine and has been used in China for hundreds of years to treat a wide range of illnesses. However, in the clinic, issues and deficiencies were primarily seen in four areas: loss of accuracy in the operation process; difficulty understanding the depth of acupuncture; difficulty using reinforcing and reducing techniques; and lack of a clear dynamic effect of acupuncture points following acupuncture. Musculoskeletal ultrasonography may quantitatively evaluate the acupuncture location and display the distribution of small nerves near and within the fascia of the acupuncture point in real time. The subjects were asked how they felt about receiving Qi when the needle body reached different depths and different tissues. The Qi obtained from an acupuncture point and the connective tissue of the fascia can be further understood by combining the physiological response of the acupuncture point with the anatomical structure,which offers a new method for defining the nature of the acupuncture point and standardizing the acupuncture point.

关键词： acupuncture De Qi dynamic effect musculoskeletal ultrasound visualization

来源：

同方期刊数据库评论

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Collaborative Charging Scheduling in Wireless Charging Sensor Networks

引用

Computers, Materials & Continua 2024年第4期79卷 1613-1630页

作者： Qiuyang wang zhen Xu Lei Yang School of Electrical and Electronic Engineering Wuhan Polytechnic UniversityWuhan430048China

Wireless sensor networks (WSNs) have the trouble of limited battery power, and wireless charging provides apromising solution to this problem, which is not easily affected by the external environment. In this paper, we studythe recharging of sensors in wireless rechargeable sensor networks (WRSNs) by scheduling two mobile chargers(MCs) to collaboratively charge sensors. We first formulate a novel sensor charging scheduling problem with theobjective of maximizing the number of surviving sensors, and further propose a collaborative charging schedulingalgorithm(CCSA) for WRSNs. In the scheme, the sensors are divided into important sensors and ordinary *** can adaptively collaboratively charge the sensors based on the energy limit ofMCs and the energy demandof sensors. Finally, we conducted comparative simulations. The simulation results show that the proposed algorithmcan effectively reduce the death rate of the sensor. The proposed algorithm provides a solution to the uncertaintyof node charging tasks and the collaborative challenges posed by multiple MCs in practical scenarios.

关键词： Wireless rechargeable sensor network mobile charger collaborative charging adaptive charging

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Double-stranded DNA-nucleic acid dye complex-sensitized biocatalytic photosynthesis:Base pairing-switched regeneration of nicotinamide cofactor

引用

Journal of Energy Chemistry 2024年第7期94卷 618-624页

作者： zhen Dong Yanying wang Dan Li Peng Wu College of Chemistry Sichuan UniversityChengdu 610064SichuanChina Analytical&Testing Centre State Key Laboratory of Hydraulics and Mountain River EngineeringSichuan UniversityChengdu 610064SichuanChina School of Chemistry and Chemical Engineering Henan Normal UniversityXinxiang 453007HenanChina

Photo-biocatalysis,the combination of photosensitization and biocatalysis,is an emerging solution for sunlight-based renewable *** is thus important to develop light antennas with both good light har-vesting and efficient electron ***,the intriguing electrical conductivity of dsDNA and its host effect(for nucleic acid dyes to harvest light)were explored simultaneously to develop a dsDNA-based light antenna for *** SYBR Green I(SG)as the example of the nucleic acid dye,the proposed SG-dsDNA system was found to be capable for visible-light-driven reduced nicotinamide adenine dinucleotide(NADH)regeneration,and the turnover frequency of which(1.35 min^(-1))exceeded most of the existing photocatalytic *** SG can only be hosted by dsDNA,meanwhile dsDNA can be formed through hybridization between single strand DNA and its complementary strand,the pro-posed system adds an extra control of the photocatalytic activity(DNA base pairing-based switch).When integrating the SG-dsDNA system with NADH-dependent horse liver alcohol dehydrogenase(HLADH),successful synthesis of 2-phenylpropanol(a crucial intermediates of profens manufacturing)was achieved.

关键词： Photosynthesis dsDNA SYBRGreenI TICT 2-phenylpropanol

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Identification of anti-gastric cancer effects and molecular mechanisms of resveratrol: From network pharmacology and bioinformatics to experimental validation

引用

World Journal of Gastrointestinal Oncology 2024年第2期16卷 493-513页

作者： Ying-Qian Ma Ming Zhang zhen-hua Sun Hong-Yue Tang Ying wang Jiang-Xue Liu Zhan-Xue Zhang Chao wang Department of Oncology Hebei General HospitalShijiazhuang 050051Hebei ProvinceChina School of Graduate Studies Hebei Medical UniversityShijiazhuang 050017Hebei ProvinceChina Clinical Medical Research Center Hebei General HospitalShijiazhuang 050051Hebei ProvinceChina Department of Gastrointestinal Surgery Second Hospital of Hebei Medical UniversityShijiazhuang 050000Hebei ProvinceChina

BACKGROUND Gastric cancer(GC)is one of the most aggressive malignancies with limited therapeutic options and a poor ***,a non-flavonoid poly-phenolic compound found in a variety of Chinese medicinal materials,has shown excellent anti-GC ***,its exact mechanisms of action in GC have not been *** To identify the effects of resveratrol on GC progression and explore the related molecular *** Action targets of resveratrol and GC-related targets were screened from public *** overlapping targets between the two were confirmed using a Venn diagram,and a“Resveratrol-Target-GC”network was constructed using Cyto-scape software version *** protein-protein interaction(PPI)network was constructed using STRING database and core targets were identified by PPI network *** Database for Annotation,Visualization and Integrated A total of 378 resveratrol action targets and 2154 GC disease targets were obtained from public databases,and 181 intersection targets between the two were screened by Venn *** top 20 core targets were identified by PPI network analysis of the overlapping *** function analysis mainly involved protein binding,identical protein binding,cytoplasm,nucleus,negative regulation of apoptotic process and response to xenobiotic *** enrichment analysis suggested that the involved signaling pathways mainly included PI3K-AKT signaling pathway,MAPK signaling pathway,IL-17 signaling pathway,TNF signaling pathway,ErbB signaling pathway,*** murine osteosarcoma viral oncogene homolog(FOS)and matrix metallopeptidase 9(MMP9)were selected by differential expression analysis,and they were closely associated with immune *** docking results showed that resveratrol docked well with these two *** treatment arrested the cell cycle at the S phase,induced apoptosis,and weakened viability,migration and invasion in a dose-dependent ***,re

关键词： Resveratrol Gastric cancer Network pharmacology Bioinformatics Molecular docking

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：