检索结果-南通市图书馆

SpikingMiniLM: energy-efficient spiking transformer for natural language understanding

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2024年第10期67卷 115-128页

作者： Jiayu zhang Jiangrong SHEN Zeke wang Qinghai guo Rui YAN Gang PAN Huajin TANG College of Computer Science and Technology Zhejiang University The State Key Lab of Brain-Machine Intelligence Zhejiang University Collaborative Innovation Center of Artificial Intelligence Zhejiang University Advanced Computing and Storage Laboratory Huawei Technologies Co. Ltd. College of Computer Science and Technology Zhejiang University of Technology MOE Frontier Science Center for Brain Science and Brain-Machine Integration Zhejiang University

In the era of large-scale pretrained models, artificial neural networks（ANNs） have excelled in natural language understanding（NLU） tasks. However, their success often necessitates substantial computational resources and energy consumption. To address this, we explore the potential of spiking neural networks（SNNs） in NLU——a promising avenue with demonstrated advantages, including reduced power consumption and improved efficiency due to their event-driven characteristics. We propose the SpikingMiniLM,a novel spiking Transformer model tailored for natural language understanding. We first introduce a multi-step encoding method to convert text embeddings into spike trains. Subsequently, we redesign the attention mechanism and residual connections to make our model operate on the pure spike-based paradigm without any normalization technique. To facilitate stable and fast convergence, we propose a general parameter initialization method grounded in the stable firing rate principle. Furthermore, we apply an ANN-to-SNN knowledge distillation to overcome the challenges of pretraining SNNs. Our approach achieves a macro-average score of 75.5 on the dev sets of the GLUE benchmark, retaining 98% of the performance exhibited by the teacher model MiniLMv2. Our smaller model also achieves similar performance to BERTMINIwith fewer parameters and much lower energy consumption, underscoring its competitiveness and resource efficiency in NLU tasks.

关键词： spiking neural networks natural language understanding spiking Transformer spike-based attention multi-step encoding ANN-to-SNN distillation

Macroscopic polarization enhancement boosting piezo-photocatalytic performance via Nb-doping on B-site of Bi_(4)Ti_(3)O_(12)nanosheets

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Journal of Advanced Ceramics 2024年第4期13卷 437-446页

作者： Hongjian Yu Xindong Wei Min wang Yan zhang Zheng Wu Fan guo Jie Han School of Chemistry and Chemical Engineering Yangzhou UniversityYangzhou 225002China Engineering Research Center of Ministry of Education for Geological Carbon Storage and Low Carbon Utilization of Resources Beijing Key Laboratory of Materials Utilization of Nonmetallic Minerals and Solid WastesNational Laboratory of Mineral MaterialsSchool of Material Sciences and TechnologyChina University of Geosciences(Beijing)Beijing 100083China School of Environmental and Chemical Engineering Xi’an Key Laboratory of Textile Chemical Engineering AuxiliariesXi'an Polytechnic UniversityXi'an 710048China

The development of a high-performance ferroelectric piezo-photocatalyst is an efficient strategy for advancing sustainability within the environmental and energy ***,a major challenge lies in the creation of a strong polarized electric field that can effectively hinder charge recombination,both within the bulk and on the surface of ***,we synthesize a series of Nb-doped Bi_(4)Ti_(3)O_(12)nanosheets via a facile one-pot hydrothermal method to achieve synergistically enhanced piezo-photocatalytic performance in CO_(2)reduction and pollutant *** optimized doped Bi_(4)Ti_(3)O_(12)demonstrates remarkable efficiency in the conversion of CO_(2)into CO,with a high production rate of 72.7μmol∙g−1∙h−1 without using co-catalysts or any sacrificial agent,surpassing the performance of unmodified Bi_(4)Ti_(3)O_(12)by up to 4.69 ***,our catalyst demonstrates ultra-fast piezo-photocatalytic degradation of organic pollutant Rhodamine B(RhB)at low concentrations and exceptional piezo-photocatalytic activity at high concentrations,outperforming most previously reported state-of-the-art *** systematic corroboration of catalyst characterization and experimental analysis reveals that the synergistic effect arises from the amplified macroscopic polarization induced by lattice distortion caused by the larger Nb ions,thereby improving piezo-photocatalytic *** research thus offers valuable insights into the direct design and fabrication of versatile catalytic systems,with applications spanning CO_(2)valorization and beyond.

关键词： CO_(2)reduction dye degradation piezo-photocatalysis Nb-doped Bi_(4)Ti_(3)O_(12) macroscopic polarization regulation

Configuration Synthesis and Grasping Performance Analysis of Multi-Loop Coupling Capture Mechanism for Launch and Recovery of Torpedo-Shaped Autonomous Underwater Vehicle

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

China Ocean Engineering 2024年第3期38卷 453-466页

作者： zhang guo-xing XIA Xin-lu guo Jin-wei School of Mechanical Engineering Jiangsu University of Science and TechnologyZhenjiang 212100China

Research of capture mechanisms with strong capture adaptability and stable grasp is important to solve the problem of launch and recovery of torpedo-shaped autonomous underwater vehicles(AUVs).A multi-loop coupling capture mechanism with strong adaptability and high retraction rate has been proposed for the launch and recovery of torpedo-shaped AUVs with different morphological ***,the principle of capturing motion retraction is described based on the appearance characteristics of torpedo-shaped AUVs,and the configuration synthesis of the capture mechanism is carried out using the method of constrained chain ***,the screw theory is employed to analyze the degree of freedom(DoF)of the capture ***,the 3D model of the capture mechanism is established,and the kinematics and dynamics simulations are carried *** with the capture orientation requirements of the capture mechanism,the statics and vibration characteristics analyses are carried ***,considering the capture process and the underwater working environment,the motion characteristics and hydraulics characteristics of the capture mechanism are ***,a principle prototype is developed and the torpedo-shaped AUVs capture experiment is *** work provides technical reserves for the research and development of AUV capture special equipment.

关键词： capture mechanism torpedo-shaped AUVs configuration synthesis launch and recovery grasping performance analysis

维普期刊数据库

Metabolic Dysregulation and Metabolite Imbalances in Acuteon-chronic Liver Failure:Impact on Immune Status

在线全文

学校读者我要写书评

暂无评论

Journal of Clinical and Translational Hepatology 2024年第10期12卷 865-877页

作者： Danmei zhang Chunxia Shi Yukun wang Jin guo Zuojiong Gong Department of Infectious Diseases Renmin Hospital of Wuhan UniversityWuhanHubeiChina

Liver failure encompasses a range of severe clinical syndromes resulting from the deterioration of liver function,triggered by factors both within and outside the *** the definition of acute-on-chronic liver failure(ACLF)may vary by region,it is universally recognized for its association with multiorgan failure,a robust inflammatory response,and high short-term mortality *** advances in metabolomics have provided insights into energy metabolism and metabolite alterations specific to ***,immunometabolism is increasingly acknowledged as a pivotal mechanism in regulating immune cell ***,understanding the energy metabolism pathways involved in ACLF and investigating how metabolite imbalances affect immune cell functionality are crucial for developing effective treatment strategies for *** review methodically examined the immune and metabolic states of ACLF patients and elucidated how alterations in metabolites impact immune functions,offering novel perspectives for immune regulation and therapeutic management of liver failure.

关键词： Acute-on-chronic liver failure Immunometabolism Metabolism Metabolic reprogramming Metabolomics Microenvironment

A new neural-network-based method for structural damage identification in single-layer reticulated shells

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Frontiers of Structural and Civil Engineering 2024年第1期18卷 104-121页

作者： Jindong zhang Xiaonong guo Shaohan ZONG Yujian zhang College of Civil Engineering Tongji UniversityShanghai 200092China China Construction Eighth Engineering Division Co. Ltd.Shanghai 200135China

Single-layer reticulated shells(SLRSs)find widespread application in the roofs of crucial public structures,such as gymnasiums and exhibition *** this paper,a new neural-network-based method for structural damage identification in SLRSs is ***,a damage vector index,NDL,that is related only to the damage localization,is proposed for SLRSs,and a damage data set is constructed from NDL *** the basis of visualization of the NDL damage data set,the structural damaged region locations are identified using convolutional neural networks(CNNs).By cross-dividing the damaged region locations and using parallel CNNs for each regional location,the damaged region locations can be quickly and efficiently identified and the undamaged region locations can be ***,a damage vector index,DS,that is related to the damage location and damage degree,is proposed for *** on the damaged region identified previously,a fully connected neural network(FCNN)is constructed to identify the location and damage degree of *** effectiveness and reliability of the proposed method are verified by considering a numerical case of a spherical *** calculation results showed that the proposed method can quickly eliminate candidate locations of potential damaged region locations and precisely determine the location and damage degree of members.

关键词： single-layer reticulated shell damage identification neural network convolutional neural network cross-partitioning method

SCancerRNA:Expression at the Single-cell Level and Interaction Resource of Non-coding RNA Biomarkers for Cancers

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Genomics, Proteomics & Bioinformatics 2024年第3期22卷 125-131页

作者： Hongzhe guo Liyuan zhang Xinran Cui Liang Cheng Tianyi Zhao Yadong wang Faculty of Computing Harbin Institute of TechnologyHarbin 150001China College of Bioinformatics Science and Technology Harbin Medical UniversityHarbin 150001China School of Medicine and Health Harbin Institute of TechnologyHarbin 150001China

Non-coding RNAs(ncRNAs)participate in multiple biological processes associated with cancers as tumor suppressors or oncogenic *** to their high stability in plasma,urine,and many other fluids,ncRNAs have the potential to serve as key biomarkers for early diagnosis and screening of *** cancer progression,tumor heterogeneity plays a crucial role,and it is particularly important to understand the gene expression patterns of individual *** the development of single-cell RNA sequencing(scRNA-seq)technologies,uncovering gene expression in different cell types for human cancers has become feasible by profiling transcriptomes at the cellular ***,a well-organized and comprehensive online resource that provides access to the expression of genes corresponding to ncRNA biomarkers in different cell types at the single-cell level is not available ***,we developed the SCancerRNA database to summarize experimentally supported data on long ncRNA,microRNA,PIWI-interacting RNA,small nucleolar RNA,and circular RNA biomarkers,as well as data on their differential expression at the cellular ***,we collected biological functions and clinical applications of biomarkers to facilitate the application of ncRNA biomarkers to cancer diagnosis,as well as the monitoring of progression and targeted *** also allows users to explore interaction networks of different types of ncRNAs,and build computational models in the *** is freely accessible at http://***/BioMarker.

关键词： Non-coding RNA Biomarker Cancer Single cell Interaction network

Tuning synergy between nickel and iron in Ruddlesden-Popper perovskites through controllable crystal dimensionalities towards enhanced oxygenevolving activity and stability

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Carbon Energy 2024年第6期6卷 113-123页

作者： Haijuan zhang Daqin Guan Yuxing Gu Hengyue Xu Chunchang wang Zongping Shao Youmin guo School of Materials Science and Technology Anhui UniversityHefeiAnhuiChina Department of Building and Real Estate The Hong Kong Polytechnic UniversityHung HomHong KongChina WA School of Mines:Minerals Energy and Chemical EngineeringCurtin UniversityPerthWestern AustraliaAustralia State Key Laboratory of Materials-Oriented Chemical Engineering Nanjing Tech UniversityNanjingJiangsuChina Tsinghua Shenzhen International Graduate School Tsinghua UniversityShenzhenGuangdongChina

Ni-Fe-based oxides are among the most promising catalysts developed to date for the bottleneck oxygen evolution reaction(OER)in water ***,understanding and mastering the synergy of Ni and Fe remain ***,we report that the synergy between Ni and Fe can be tailored by crystal dimensionality of Ni,Fe-contained Ruddlesden-Popper(RP)-type perovskites(La_(0.125)Sr_(0.875))n+1(Ni_(0.25)Fe_(0.75))nO3n+1(n=1,2,3),where the material with n=3 shows the best OER performance in alkaline *** X-ray absorption spectroscopy spectra before and after OER reveal that the material with n=3 shows enhanced Ni/Fe-O covalency to boost the electron transfer as compared to those with n=1 and n=*** experimental investigations demonstrate that the Fe ion is the active site and the Ni ion is the stable site in this system,where such unique synergy reaches the optimum at n=***,as n increases,the proportion of unstable rock-salt layers accordingly decreases and the leaching of ions(especially Sr^(2+))into the electrolyte is suppressed,which induces a decrease in the leaching of active Fe ions,ultimately leading to enhanced *** work provides a new avenue for rational catalyst design through the dimensional strategy.

关键词： crystal dimensionalities oxygen evolution reaction Ruddlesden-Popper perovskites synergy

Preparation of single atom catalysts for high sensitive gas sensing

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

International Journal of Extreme Manufacturing 2024年第3期6卷 216-248页

作者： Xinxin He Ping guo Xuyang An Yuyang Li Jiatai Chen Xingyu zhang Lifeng wang Mingjin Dai Chaoliang Tan Jia zhang Key Laboratory of Microsystems and Microstructure Manufacturing Ministry of EducationHarbin Institute of TechnologyHarbin 150080People’s Republic of China Institute for Frontier Materials Deakin UniversityWaurn Ponds CampusLocked Bag 20000Victoria 3220Australia School of Electrical and Electronic Engineering Nanyang Technological UniversitySingapore 639798Singapore Department of Electrical and Electronic Engineering The University of Hong KongPokfulam RoadHong Kong Special Administrative Region of China 999077People’s Republic of China Chongqing Research Institute Harbin Institute of TechnologyChongqing 401120People’s Republic of China

Single atom catalysts(SACs)have garnered significant attention in the field of catalysis over the past decade due to their exceptional atom utilization efficiency and distinct physical and chemical *** the semiconductor-based electrical gas sensor,the core is the catalysis process of target gas molecules on the sensitive *** this context,the SACs offer great potential for highly sensitive and selective gas sensing,however,only some of the bubbles come to the *** facilitate practical applications,we present a comprehensive review of the preparation strategies for SACs,with a focus on overcoming the challenges of aggregation and low *** research efforts have been devoted to investigating the gas sensing mechanism,exploring sensitive materials,optimizing device structures,and refining signal post-processing ***,the challenges and future perspectives on the SACs based gas sensing are presented.

关键词： single atom catalysts preparation sensing mechanism gas sensing

维普期刊数据库

Improving Satellite-Retrieved Cloud Base Height with Ground-Based Cloud Radar Measurements

在线全文

学校读者我要写书评

暂无评论

Advances in Atmospheric Sciences 2024年第11期41卷 2131-2140页

作者： Zhonghui TAN Ju wang Jianping guo Chao LIU Miao zhang Shuo MA College of Meteorology and Oceanography National University of Defense TechnologyChangsha 410073China State Key Laboratory of Severe Weather Chinese Academy of Meteorological SciencesBeijing 100081China Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters Nanjing University of Information Science&TechnologyNanjing 210044China Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration School of Atmospheric PhysicsNanjing University of Information Science&TechnologyNanjing 210044China National Satellite Meteorological Center(National Center for Space Weather) China Meteorological AdministrationBeijing 100081China

Cloud base height(CBH) is a crucial parameter for cloud radiative effect estimates, climate change simulations, and aviation guidance. However, due to the limited information on cloud vertical structures included in passive satellite radiometer observations, few operational satellite CBH products are currently available. This study presents a new method for retrieving CBH from satellite radiometers. The method first uses the combined measurements of satellite radiometers and ground-based cloud radars to develop a lookup table(LUT) of effective cloud water content(ECWC), representing the vertically varying cloud water content. This LUT allows for the conversion of cloud water path to cloud geometric thickness(CGT), enabling the estimation of CBH as the difference between cloud top height and CGT. Detailed comparative analysis of CBH estimates from the state-of-the-art ECWC LUT are conducted against four ground-based millimeter-wave cloud radar(MMCR) measurements, and results show that the mean bias(correlation coefficient) is0.18±1.79 km(0.73), which is lower(higher) than 0.23±2.11 km(0.67) as derived from the combined measurements of satellite radiometers and satellite radar-lidar(i.e., Cloud Sat and CALIPSO). Furthermore, the percentages of the CBH biases within 250 m increase by 5% to 10%, which varies by location. This indicates that the CBH estimates from our algorithm are more consistent with ground-based MMCR measurements. Therefore, this algorithm shows great potential for further improvement of the CBH retrievals as ground-based MMCR are being increasingly included in global surface meteorological observing networks, and the improved CBH retrievals will contribute to better cloud radiative effect estimates.

关键词： cloud base height passive radiometer ground-based cloud radar remote sensing

维普期刊数据库