检索结果-南通市图书馆

SpikingMiniLM: energy-efficient spiking transformer for natural language understanding

Science China(Information Sciences) 2024年第10期67卷 115-128页

作者： Jiayu ZHANG Jiangrong shen Zeke WANG Qinghai guo Rui YAN Gang PAN Huajin TANG College of Computer Science and Technology Zhejiang University The State Key Lab of Brain-Machine Intelligence Zhejiang University Collaborative Innovation Center of Artificial Intelligence Zhejiang University Advanced Computing and Storage Laboratory Huawei Technologies Co. Ltd. College of Computer Science and Technology Zhejiang University of Technology MOE Frontier Science Center for Brain Science and Brain-Machine Integration Zhejiang University

In the era of large-scale pretrained models, artificial neural networks（ANNs） have excelled in natural language understanding（NLU） tasks. However, their success often necessitates substantial computational resources and energy consumption. To address this, we explore the potential of spiking neural networks（SNNs） in NLU——a promising avenue with demonstrated advantages, including reduced power consumption and improved efficiency due to their event-driven characteristics. We propose the SpikingMiniLM,a novel spiking Transformer model tailored for natural language understanding. We first introduce a multi-step encoding method to convert text embeddings into spike trains. Subsequently, we redesign the attention mechanism and residual connections to make our model operate on the pure spike-based paradigm without any normalization technique. To facilitate stable and fast convergence, we propose a general parameter initialization method grounded in the stable firing rate principle. Furthermore, we apply an ANN-to-SNN knowledge distillation to overcome the challenges of pretraining SNNs. Our approach achieves a macro-average score of 75.5 on the dev sets of the GLUE benchmark, retaining 98% of the performance exhibited by the teacher model MiniLMv2. Our smaller model also achieves similar performance to BERTMINIwith fewer parameters and much lower energy consumption, underscoring its competitiveness and resource efficiency in NLU tasks.

关键词： spiking neural networks natural language understanding spiking Transformer spike-based attention multi-step encoding ANN-to-SNN distillation

来源：

同方期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Characteristics and genetic mechanism of the Mesoproterozoic rift system,Ordos Basin,China

引用

Energy Geoscience 2024年第1期5卷 141-152页

作者： Meng Li Xiangbin Yan Wei Zhang Yuanling guo Chaoying Liu Lingling Fan shuang Yang Petroleum Exploration and Production Research Institute SINOPECBeijing100083China Exploration and Development Research Institute SINOPEC North China CompanyZhengzhouHenan450006China

The Mesoproterozoic rifts are developed in the Ordos Basin located in the western margin of the North China *** on the latest 3D seismic data and previous research results,this study intends to discuss the zonal differential deformation characteristics and genetic mechanism of the Mesoproterozoic rifts in the Ordos ***-trending rifts are developed in the Mesoproterozoic in the south-central Ordos Basin,the main part of which are located near the western margin of the North China ***-trending rifts are developed in the north of the basin,while NW-NNW rifts in the Mesoproterozoic in Hangjinqi *** genetic mechanism of the Mesoproterozoic rifts is related to regional extensional stress field,plate boundary conditions and internal preexisting *** main extensional stress direction strikes NWW-SSE(120°)in the western margin of the North China Plate,based on the forward rift trend of the northern *** Hangjinqi area,the reactivation of the existing NWtrending Wulansu fault and NW-NW-trending Daolao fault,results in dextral shear stress *** boundary between the western margin of the North China Plate and its adjacent plates forms a nearly NS-trending preexisting basement tectonic belt,which intersects with the NWW-SSE(120°)extensional stress at an acute angle of 60°.Therefore,the western margin of the North China Plate is formed by oblique normal faults under oblique *** to the long time span of Columbia Supercontinent breakup(1.8e1.6 Ga),the oblique rift in the south-central Ordos Basin is formed under the continuous oblique extension at the western margin of the North China Plate.

关键词： Columbia Supercontinent Ordos Basin Rift system Mesoproterozoic Genetic mechanism

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Pulsations of Three Rapidly Oscillating Ap Stars TIC 96315731,TIC72392575,and TIC 318007796

引用

Research in Astronomy and Astrophysics 2024年第8期24卷 157-168页

作者： Hai-Jian Zhong Dong-Xiang shen Chun-Hua Zhu He-Lei Liu Su-Fen guo guo-Liang Lü School of Physical Science and Technology Xinjiang UniversityUrumqi 830046China Xinjiang Astronomical Observatory National Astronomical ObservatoriesChinese Academy of SciencesUrumqi 830000China

We analyze the frequencies of three known roAp stars,TIC 96315731,TIC 72392575,and TIC 318007796,using the light curves from the Transiting Exoplanet Survey *** TIC 96315731,the rotational and pulsational frequencies are 0.1498360 day^(-1)and 165.2609 day^(-1),*** the case of TIC 72392575,the rotational frequency is 0.25551 day^(-1).We detect a quintuplet of pulsation frequencies with a center frequency of135.9233 day^(-1),along with two signals within the second pair of rotational sidelobes of the quintuplet separated by the rotation *** two signals may correspond to the frequencies of a dipole *** TIC318007796,the rotational and pulsational frequencies are 0.2475021 day^(-1),192.73995 day^(-1),and196.33065 day^(-1),*** on the oblique pulsator model,we calculate the rotation inclination(i)and magnetic obliquity angle(b)for the stars,which provide the geometry of the pulsation *** the phases of the frequency quintuplets,the pulsation amplitude and phase modulation curves,and the results of spherical harmonic decomposition,we conclude that the pulsation modes of frequency quintuplets in TIC96315731,TIC 72392575,and TIC 318007796 correspond to distorted dipole mode,distorted quadrupole mode,and distorted dipole mode,respectively.

关键词： asteroseismology-techniques photometric-stars oscillations(including pulsations)-stars chemically peculiar

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Uniformity Control of Scanned Beam in 300 MeV Proton and Heavy Ion Accelerator Complex at SESRI

引用

原子能科学技术 2024年第4期58卷 705-713页

作者： HOU Lingxiao YUAN Youjin shen guodong RUAN shuang LIU Jie ZHU Yunpeng WANG Geng guo Hongliang LYU Mingbang GAO Daqing XU Zhiguo shenG Lina YANG Jiancheng Institute of Modern Physics Chinese Academy of SciencesLanzhou 730000China University of Chinese Academy of Sciences Beijing 100049China

In recent years,heavy ion accelerator technology has been rapidly developing worldwide and widely applied in the fields of space radiation simulation and particle ***,a very high uniformity in the irradiation area is required for the extracted ion beams,which is crucial because it directly affects the experimental precision and therapeutic ***,ultra-large-area and high-uniformity scanning are crucial requirements for spacecraft radiation effects assessment and serve as core specification for beamline terminal *** the 300 MeV proton and heavy ion accelerator complex at the Space Environment Simulation and Research Infrastructure(SESRI),proton and heavy ion beams will be accelerated and ultimately delivered to three irradiation *** order to achieve the required large irradiation area of 320 mm×320 mm,horizontal and vertical scanning magnets are used in the extraction beam ***,considering the various requirements for beam species and energies,the tracking accuracy of power supplies(PSs),the eddy current effect of scanning magnets,and the fluctuation of ion bunch structure will reduce the irradiation *** mitigate these effects,a beam uniformity optimization method based on the measured beam distribution was proposed and applied in the accelerator complex at *** the experiment,the uniformity is successfully optimized from 75%to over 90%after five iterations of adjustment to the PS *** this paper,the method and experimental results were introduced.

关键词： heavy ion accelerator beam uniformity scanning magnet MIC

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Energy Harvesting in the Wake of An Inverted C-Shaped Bluff Body

引用

China Ocean Engineering 2024年第1期38卷 68-80页

作者： WANG Jun-lei LI shen-fang Md.Mahbub ALAM ZHU Hong-jun HU guo-biao School of Mechanical and Power Engineering Zhengzhou UniversityZhengzhou 450000China Center for Turbulence Control Harbin Institute of Technology(Shenzhen)Shenzhen 518055China State Key Laboratory of Oil and Gas Reservoir Geology and Exploitation Southwest Petroleum UniversityChengdu 610500China Internet of Things Thrust The Hong Kong University of Science and Technology(Guangzhou)Guangzhou 511400China

This paper proposes a novel wake-induced vibration(WIV)-based energy harvesting system consisting of two bluff *** inverted C-shaped bluff body is stationary installed at the upstream position to generate an interference wake street,and a cylinder bluff body equipped with a transducer is elastically suspended at the downstream position to harness WIV *** hydrodynamics and energy harvesting(EH)performance of the proposed system are investigated via experimental *** reduced velocity(U*)ranging from 2 to 14(the corresponding Reynolds number ranging from 15100 to 106200)is considered in the present *** is found that the wake generated by the inverted C-shaped bluff body significantly affects the EH *** the opening angle(α)of the C-shaped bluff body increases the vibration amplitude of the downstream cylinder,thereby increasing the harvested *** the spacing(L)between two bluff bodies is two times the cylinder diameter(D),the wake-induced vibration(WIV)mode is observed,while the combined WIV and wake galloping(WG)mode occurs whenαis 150°,and L equals 3D or *** average drag coefficient becomes negative when L is 2D,3D,or *** carefully configuring a C-shaped bluff body,the wake generated by it can bring an augmenting effect on the vibration of the downstream EH *** example,the RMS power output of the proposed EH system reaches a maximum of 0.31 W at U*=8 and L=4D,which is 300%greater than that of its traditional ***,after a number of case stud-ies,it is identified that the proposed EH system can achieve the best performance whenαis 150°and L=2D.

关键词： wake-induced vibration vortex-induced vibration galloping energy harvesting bluff body

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Bipolar membrane electrodialysis integrated with in-situ CO_(2)absorption for simulated seawater concentrate utilization,carbon storage and production of sodium carbonate

引用

Journal of Environmental Sciences 2024年第8期142卷 21-32页

作者： Jingtao Bi Tianyi Chen Yue Xie Ruochen shen Bin Li Mengmeng Sun Xiaofu guo Yingying Zhao School of Chemical Engineering and Technology Hebei University of TechnologyTianjin 300401China Engineering Research Center of Seawater Utilization Technology of Ministry of Education School of Chemical Engineering and TechnologyHebei University of TechnologyTianjin 300401China Hebei Collaborative Innovation Center of Modern Marine Chemical Technology Tianjin 300401China Tianjin Key Laboratory of Chemical Process Safety Tianjin 300130China Shandong Technology Innovation Center of Seawater and Brine Efficient Utilization Weifang 262737China

In the context of carbon capture,utilization,and storage,the high-value utilization of carbon storage presents a significant *** address this challenge,this study employed the bipolar membrane electrodialysis integrated with carbon utilization technology to prepare Na_(2)CO_(3)products using simulated seawater concentrate,achieving simultaneous saline wastewater utilization,carbon storage and high-value production of Na_(2)CO_(3).The effects of various factors,including concentration of simulated seawater concentrate,current density,CO_(2)aeration rate,and circulating flow rate of alkali chamber,on the quality of Na_(2)CO_(3)product,carbon sequestration rate,and energy consumption were *** the optimal condition,the CO_(3)^(2-)concentration in the alkaline chamber reached a maximum of 0.817 mol/L with 98 mol%*** resulting carbon fixation rate was 70.50%,with energy consumption for carbon sequestration and product production of 5.7 k Whr/m^(3)CO_(2)and1237.8 k Whr/ton Na_(2)CO_(3),*** coupling design provides a triple-win outcome promoting waste reduction and efficient utilization of resources.

关键词： Bipolar membrane electrodialysis(BMED) Carbon capture Utilization and storage(CCUS) Seawater concentrate Sodium carbonate

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Nanotechnology’s frontier in combatting infectious and inflammatory diseases:prevention and treatment

引用

Signal Transduction and Targeted Therapy 2024年第3期9卷 998-1047页

作者： Yujing Huang Xiaohan guo Yi Wu Xingyu Chen Lixiang Feng Na Xie guobo shen Department of Biotherapy Cancer Center and State Key Laboratory of BiotherapyWest China Hospitaland West China School of Basic Medical Sciences and Forensic MedicineSichuan Universityand Collaborative Innovation Center for BiotherapyChengdu 610041China

Inflammation-associated diseases encompass a range of infectious diseases and non-infectious inflammatory diseases,which continuously pose one of the most serious threats to human health,attributed to factors such as the emergence of new pathogens,increasing drug resistance,changes in living environments and lifestyles,and the aging *** rapid advancements in mechanistic research and drug development for these diseases,current treatments often have limited efficacy and notable side effects,necessitating the development of more effective and targeted anti-inflammatory *** recent years,the rapid development of nanotechnology has provided crucial technological support for the prevention,treatment,and detection of inflammation-associated *** types of nanoparticles(NPs)play significant roles,serving as vaccine vehicles to enhance immunogenicity and as drug carriers to improve targeting and *** can also directly combat pathogens and *** addition,nanotechnology has facilitated the development of biosensors for pathogen detection and imaging techniques for inflammatory *** review categorizes and characterizes different types of NPs,summarizes their applications in the prevention,treatment,and detection of infectious and inflammatory *** also discusses the challenges associated with clinical translation in this field and explores the latest developments and *** conclusion,nanotechnology opens up new possibilities for the comprehensive management of infectious and inflammatory diseases.

关键词： prevention inflammatory treatment

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

THE EXISTENCE AND UNIQUENESS OF TIME-PERIODIC SOLUTIONS TO THE NON-ISOTHERMAL MODEL FOR COMPRESSIBLE NEMATIC LIQUID CRYSTALS IN A PERIODIC DOMAIN

引用

Acta Mathematica Scientia 2024年第3期44卷 947-972页

作者：陈爽郭闪闪许秋菊 School of Mathematical Sciences Chongqing Normal UniversityChongqing401331China

In this paper,we are concerned with a three-dimensional non-isothermal model for the compressible nematic liquid crystal flows in a periodic *** some smallness and structural assumptions imposed on the time-periodic force,we establish the existence of the time-periodic solutions to the system by using a regularized approximation scheme and the topological degree *** also prove a uniqueness result via energy estimates.

关键词： compressible nematic liquid crystals time-periodic solution topological degree theory energy estimates

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Programmable and reconfigurable humidity-driven actuators made with MXene(Ti_(3)C_(2)T_(x))-cellulose nanofiber composites for biomimetic applications

引用

Nano Research 2024年第7期17卷 6619-6629页

作者： Shaofeng Zeng Yuanji Ye Peidi Zhou Shimin Yi Qiaohang guo Huamin Chen guozhen shen Mingcen Weng School of Mechanical and Automotive Engineering Fujian University of TechnologyFuzhou 350118China School of Materials Science and Engineering Fujian Provincial Key Laboratory of Advanced Materials Processing and ApplicationKey Laboratory of Polymer Materials and Products of Universities in FujianFujian University of TechnologyFuzhou 350118China Institute of Smart Marine and Engineering Fujian University of TechnologyFuzhou 350118China Fujian Key Laboratory of Functional Marine Sensing Materials College of Materials and Chemical EngineeringMinjiang UniversityFuzhou 350108China School of Integrated Circuits and Electronics Beijing Institute of TechnologyBeijing 100081China

Smart actuators have a wide range of applications in bionics and energy *** ability to reconfigure shape is essential for soft actuators to achieve various shapes and deformations,which is a crucial feature for next-generation ***,it is still an enormous challenge to establish a straightforward approach to creating programmable and reconfigurable ***-cellulose nanofiber composite film(MCCF)with a brick-and-mortar hierarchical structure was produced through a vacuum filtration *** demonstrates impressive mechanical properties such as a tensile stress of 68 MPa and a Young’s modulus of 4.65 ***,the MCCF highlights its potential for water-assisted shaping/welding due to the abundance of hydrogen bonds between MXene and cellulose *** also showcases capabilities as a humiditydriven actuator with a rapid response rate of 550°·s^(−1).Using the methods of water-assisted shaping/welding,several bionic actuators(such as flower,butterfly,and muscle)based on MCCF were designed,highlighting their versatility in applications of smart *** research showcases the impressive capabilities of MXene-based actuators and offers beneficial insights for the advancement of future intelligent materials.

关键词： MXene cellulose nanofibers programmable actuators humidity-driven

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Updates of developments in interventional therapy for elderly patients with cardiovascular diseases

引用

Journal of Geriatric Cardiology 2024年第1期21卷 1-3页

作者： Hua shen Xun-Xun FENG Qian-Yun guo Yu-Jie ZHOU Beijing Key Laboratory of Precision Medicine of Coronary Atherosclerotic Disease Beijing Institute of Heart Lung and Blood Vessel DiseaseClinical Center for Coronary Heart DiseaseDepartment of CardiologyBeijing Anzhen HospitalCapital Medical UniversityBeijingChina

Cardiovascular diseases(CVD)are the leading cause of death in the world and one of the most common diseases in the elderly,with high prevalence and poor prognosis,which seriously affect the health of the elder *** report showed that global deaths from CVD increased from 12.4 million in 1990 to 19.8 million in 2022,reflecting the global population growth and aging,as well as the impact of metabolic,environmental,and behavioral risks.[1]With the progress of aging population,the burden of CVD in the elderly in China has increased year by year,and factors including multiple complications,organ function decline,and high complication rate have made the interventional treatment of CVD in the elderly one of the difficulties and focuses in the field of cardiology in China.

关键词： diseases patients prognosis

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：