检索结果-南通市图书馆

SpikingMiniLM: energy-efficient spiking transformer for natural language understanding

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2024年第10期67卷 115-128页

作者： Jiayu zhang Jiangrong SHEN Zeke wang Qinghai GUO Rui YAN gang PAN Huajin TANG College of Computer Science and Technology Zhejiang University The State Key Lab of Brain-Machine Intelligence Zhejiang University Collaborative Innovation Center of Artificial Intelligence Zhejiang University Advanced Computing and Storage Laboratory Huawei Technologies Co. Ltd. College of Computer Science and Technology Zhejiang University of Technology MOE Frontier Science Center for Brain Science and Brain-Machine Integration Zhejiang University

In the era of large-scale pretrained models, artificial neural networks（ANNs） have excelled in natural language understanding（NLU） tasks. However, their success often necessitates substantial computational resources and energy consumption. To address this, we explore the potential of spiking neural networks（SNNs） in NLU——a promising avenue with demonstrated advantages, including reduced power consumption and improved efficiency due to their event-driven characteristics. We propose the SpikingMiniLM,a novel spiking Transformer model tailored for natural language understanding. We first introduce a multi-step encoding method to convert text embeddings into spike trains. Subsequently, we redesign the attention mechanism and residual connections to make our model operate on the pure spike-based paradigm without any normalization technique. To facilitate stable and fast convergence, we propose a general parameter initialization method grounded in the stable firing rate principle. Furthermore, we apply an ANN-to-SNN knowledge distillation to overcome the challenges of pretraining SNNs. Our approach achieves a macro-average score of 75.5 on the dev sets of the GLUE benchmark, retaining 98% of the performance exhibited by the teacher model MiniLMv2. Our smaller model also achieves similar performance to BERTMINIwith fewer parameters and much lower energy consumption, underscoring its competitiveness and resource efficiency in NLU tasks.

关键词： spiking neural networks natural language understanding spiking Transformer spike-based attention multi-step encoding ANN-to-SNN distillation

同方期刊数据库

High-Efficiency photo-Induced Charge Transfer for SERS Sensing in N-Doped 3D-Graphene on Si Heterojunction

在线全文

学校读者我要写书评

暂无评论

Energy & Environmental Materials 2024年第2期7卷 268-276页

作者： Guanglin zhang Jie Sun Genwang Wei Shan zhang Zhengyi He Huijuan Wu Bingkun wang Siwei Yang Guqiao Ding Zhiduo Liu Zhiwen Jin Caichao Ye gang wang Department of Microelectronic Science and Engineering School of Physical Science and TechnologyNingbo UniversityNingbo 315211China Department of Biochemistry and Molecular Biology School of Basic Medical SciencesShenzhen UniversityShenzhen 518071China Academy for Advanced Interdisciplinary Studies&Department of Materials Science and Engineering Guangdong Provincial Key Laboratory of Computational Science and Material DesignSouthern University of Science and TechnologyShenzhen 518055China State Key Laboratory of Functional Materials for Informatics Shanghai Institute of Microsystem and Information TechnologyChinese Academy of SciencesShanghai 200050China Centre for Quantum Physics Key Laboratory of Advanced Optoelectronic Quantum Architecture and Measurement(MOE)School of PhysicsBeijing Institute of TechnologyBeijing 100081China School of Physical Science and Technology&Key Laboratory for Magnetism and Magnetic Materials of the Ministry of Education Lanzhou UniversityLanzhou 730000China

Nitrogen-doped three-dimensional graphene(N-doped 3D-graphene)is a graphene derivative with excellent adsorption capacity,large specific surface area,high porosity,and optoelectronic ***,N-doped 3D-graphene/Si heterojunctions were grown in situ directly on silicon(Si)substrates via plasma-assisted chemical vapor deposition(PACVD),which is promising for surface-enhanced Raman scattering(SERS)substrates *** analyses of theoretical simulation,incorporating N atoms in 3D-graphene are beneficial to increase the electronic state density of the system and enhance the charge transfer between the substrate and the target *** enhancement of the optical and electric fields benefits from the stronger light-matter interaction improved by the natural nano-resonator structure of N-doped *** as-prepared SERS substrates based on N-doped 3D-graphene/Si heterojunctions achieve ultra-low detection for various molecules:10^(-8)M for methylene blue(MB)and 10^(-9)M for crystal violet(CRV)with rhodamine(R6G)of 10^(10)*** practical detected,10^(-8)M thiram was precisely detected in apple peel *** results indicate that N-doped 3D-graphene/Si heterojunctions based-SERS substrates have promising applications in low-concentration molecular detection and food safety.

关键词： charge transfer DFT simulation N-doped 3D-graphene SERS Thiram detection

Brain development in newborns and infants after ECMO

在线全文

学校读者我要写书评

暂无评论

World Journal of Pediatrics 2024年第6期20卷 556-568页

作者： Kai Yan Lu-Kun Tang Fei-Fan Xiao Peng zhang Guo-Qiang Cheng Lai-Shuan wang Chun-Mei Lu Meng-Meng Ge Li-Yuan Hu Yuan-Feng Zhou Tian-Tian Xiao Yan Xu Zhao-Qing Yin gang-Feng Yan Guo-Ping Lu Qi Li Wen-Hao Zhou Department of Neonatology Children Hospital of Fudan UniversityShanghai 201102China Kunming Medical University Affiliated Dehong Hospital DehongYunnanChina Graduate School Kunming Medical UniversityKunmingYunnanChina Department of Neurology Children's Hospital of Fudan UniversityShanghaiChina School of Medicine Chengdu Women's and Children's Central HospitalUniversity of Electronic Science and Technology of ChinaChengduSichuanChina Department of Intensive Care Medicine Children's Hospital of Fudan UniversityShanghaiChina Department of Intensive Care Medicine The Sixth Medical Center of PLA General HospitalBeijingChina Key Laboratory of Neonatology National Health Care CommissionShanghaiChina

Background Extracorporeal membrane oxygenation(ECMO)not only significantly improves survival rates in severely ill neonates but also is associated with long-term neurodevelopmental *** systematically review the available literature on the neurodevelopmental outcomes of neonates and infants who have undergone ECMO treatment,with a focus on motor deficits,cognitive impairments,sensory impairments,and developmental *** review aims to understand the incidence,prevalence,and risk factors for these problems and to explore current nursing care and management *** sources A comprehensive literature search was performed across PubMed,EMBASE,and Web of Science using a wide array of keywords and phrases pertaining to ECMO,neonates,infants,and various facets of *** initial screening involved reviewing titles and abstracts to exclude irrelevant articles,followed by a full-text assessment of potentially relevant *** quality of each study was evaluated based on its research methodology and statistical ***,citation searches were conducted to identify potentially overlooked *** the focus was primarily on neonatal ECMO,studies involving children and adults were also included due to the limited availability of neonate-specific *** About 50%of neonates post-ECMO treatment exhibit varying degrees of brain injury,particularly in the frontal and temporoparietal white matter regions,often accompanied by neurological *** occur in 18%–23%of neonates within the first 24 hours,and bleeding events occur in 27%–60%of ECMO procedures,with up to 33%potentially experiencing ischemic *** some studies suggest that ECMO may negatively impact hearing and visual development,other studies have found no significant differences;hence,the influence of ECMO remains *** terms of cognitive,language,and intellectual development,ECMO treatment may be associated with potential deve

关键词： Brain development Extracorporeal membrane oxygenation Infants Neonates Neurological outcomes

Synthesis of cobalt-doped ZnO/rGO nanoparticles with visible-light photocatalytic activity through a cobalt-induced electrochemical method

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Journal of Energy Chemistry 2017年第3期26卷 549-555页

作者： Yuanquan Miao xuewen wang Wuyou wang Chengxi Zhou gang Feng Jianxin Cai Rongbin zhang The Institute of Applied Chemistry The College of ChemistryNanchang UniversityNanchang 330031JiangxiChina School of Resources Environmental&Chemical Engineering Nanchang UniversityNanchang 330031JiangxiChina

ZnO is a semiconductor photocatalyst widely applied in photodegradation of organic pollutants and in photoelectric conversion. ZnO exhibits low photocatalytic activity due to poor absorption in the visible region. In this work, a novel cobalt-induced electrochemical growth method was developed to synthesize cobalt-doped ZnO/rGO nanoparticles in an aqueous solution at room temperature. Cobalt-doped ZnO/rGO nanoparticles exhibited wider visible-light absorption band ranging from 400 nm to 700 nm due to cobalt doping. The surface structure of ZnO formed by the cobalt-induced electrochemical method without other ions is suitable for photocatalytic reactions. The cobalt-doped ZnO/rGO nanoparticles were found to exhibit in photodegradation and photo-electrochemical measurements and exhibited enhanced photocatalytic activity under visible-light irradiation.

关键词： Co-doped ZnO Electrochemical photodegradation photocatalysis

Sword Mountain Fair in the Depth of Memory

在线全文

学校读者我要写书评

暂无评论

China & The World Cultural Exchange 2005年第8期71卷 36-39页

作者： text by wang Xiaoli photo by zhang gang

Minhe Hui Ethnic Autonomous County, located in the east of northwest Qinghai Province, used to be a critical pathway linking Qinghai-Tibet Plateau and central China. Over the sweep of Chinese history, Minhe County has evolved into a community for different ethnic communities to inhibit together. The county consists of 14 ethnic groups, mainly including Han, Hui, Tu and Tibetan who believe in Buddhism, Lamanism, Taoism and Islam respectively,

关键词：青海自然地理少数民族风俗习惯

中低位直肠癌根治术后实现教科书式结局的影响因素分析及预测模型的建立

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

胃肠病学和肝病学杂志 2024年第8期33卷 999-1004页

作者：郭振王子晨张康洋张伟吴刚孙培春河南大学人民医院/河南省人民医院胃肠外科河南郑州450003

目的探讨中低位直肠癌根治术后实现教科书式结局(textbook outcome, TO)的影响因素。方法回顾性分析2022年1月至2024年2月我院胃肠外科收治的182例中低位直肠癌患者的临床病理资料;TO定义为同时满足以下条件:无再次干预;肿瘤切缘阴性... 详细信息

目的探讨中低位直肠癌根治术后实现教科书式结局(textbook outcome, TO)的影响因素。方法回顾性分析2022年1月至2024年2月我院胃肠外科收治的182例中低位直肠癌患者的临床病理资料;TO定义为同时满足以下条件:无再次干预;肿瘤切缘阴性;术后住院时间≤14 d;30 d内无计划外再住院;90 d内无死亡;清扫淋巴结数目≥12枚;术后无严重并发症(Clavien-Dindo分级≥2)。结果共计182例中低位直肠癌患者被纳入分析,其中123例(67.58%)患者术后实现了TO。所有患者均达到了肿瘤切缘阴性和90 d内无死亡;179例(98.35%)患者无再次干预,162例(89.01%)患者术后住院时间≤14 d, 181例(99.45%)患者30 d内无计划外再住院,163例(89.56%)患者清扫淋巴结数目≥12枚,123例(67.58%)患者术后无严重并发症。单因素分析结果显示,TO组与非TO组在手术方式、癌结节、NLR、PLR、SII方面比较,差异有统计学意义(P<0.05)。多因素分析结果显示,手术方式为Miles、存在癌结节、术前高SII是术后实现TO的独立影响因素(P<0.05)。结论手术方式为Miles、存在癌结节、术前高SII是中低位直肠癌根治术后实现TO的独立影响因素。

关键词：中低位直肠癌教科书式结局影响因素预测模型

A 40 Gbit/s fully integrated optical receiver analog front-end in 90 nm CMOS

在线全文

学校读者我要写书评

暂无评论

The Journal of China Universities of Posts and Telecommunications 2012年第1期19卷 124-128页

作者： XU Zhi-gang CHEN Ying-mei wang Tao CHEN Xue-hui zhang Li Institute of RF-&OE-ICs Southeast UniversityNanjing 210096China

A fully integrated 40 Gbit/s optical receiver analog front-end （AFE） including a transimpedance amplifier （TIA） and a limiting amplifier （LA） for short distance communication is described in this paper. The proposed TIA employs a modified regulated cascode （RGC） configuration as input stage, and adopts a third order interleaving active feedback gain stage. The LA utilizes nested active feedback, negative capacitance, and inductor peaking technology to achieve high voltage gain and wide bandwidth. The tiny photo current received by the receiver AFE is amplified to a single-ended voltage swing of 200 mV（p-p）. Simulation results show that the receiver AFE provides conversion gain of up to 83 dBΩ and bandwidth of 34.7 GHz, and the equivalent input noise current integrated from 1 MHz to 30 GHz is about 6.6 μA（rms）.

关键词： optical receiver transimpedance amplifier limiting amplifier active feedback negative capacitance inductor peaking

Subnetwork identification and chemical modulation for neural regeneration:A study combining network guided forest and heat diffusion model

在线全文

学校读者我要写书评

暂无评论

Frontiers of Electrical and Electronic Engineering in China 2018年第4期6卷 321-333页

作者： Hui wang gang wang Li-Da Zhu Xuan Xu Bo Diao Hong-Yu zhang Hubei Key Laboratory of Agricultural Bioinformatics College of InformaticsHuazhong Agricultural UniversityWuhan 430070China Department of Clinical Experiment Wuhan General Hospital of Guangzhou CommandWuhan 430070China Hubei Key Laboratory of Central Nervous System Tumor and Intervention Wuhan 430070China

The induction of neural regeneration is vital to the repair of spinal cord injury (SCI). While compared with peripheral nervous system (PNS), the regenerative capacity of the central nervous system (CNS) is extremely limited. This indicates that modulating the molecular pathways underlying PNS repair may lead to the discovery of potential treatment for CNS injury. Based on the gene expression profiles of dorsal root ganglion (DRG) after a sciatic nerve injury, we utilized network guided forest (NGF) to rank genes in terms of their capacity of distinguishing injured DRG from sham-operated controls. Gene importance scores deriving from NGF were used as initial heat in a heat diffusion model (HotNet2) to infer the subnetworks underlying neural regeneration in the DRG. After potential regulators of the subnetworks were found through Connectivity Map (cMap), candidate compounds were experimentally evaluated for their capacity to regenerate the damaged neurons. Gene ontology analysis of the subnetworks revealed ubiquinone biosynthetic process is crucial for neural regeneration. Moreover, almost half of the genes in these subnetworks are found to be related to neural regeneration via text mining. After screening compounds that are likely to modulate gene expressions of the subnetworks, three compounds were selected for the experiment. Of them, trichostatin A, a histone deacetylase inhibitor, was validated to enhance neurite outgrowth in vivo via an optic nerve crush mouse model. Our study identified subnetworks underlying neural regeneration, and validated a compound can promote neurite outgrowth by modulating these subnetworks. This work also suggests an alternative approach for drug repositioning that can be easily extended to other disease phenotypes.

关键词： network guided forest HotNet2 neural regeneration axon growth neurotrophic factors

Metal-organic frameworks nanoswitch:Toward photo-controllable endo/lysosomal rupture and release for enhanced cancer RNA interference

在线全文

学校读者我要写书评

暂无评论

Nano Research 2020年第1期13卷 238-245页

作者： Gan Lin Yang zhang Long zhang Junqing wang Ye Tian Wen Cai Shangui Tang Chengchao Chu JiaJing Zhou Peng Mi Xiaoyuan Chen gang Liu State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics&Center for Molecular Imaging and Translational Medicine School of Public HealthXiamen UniversityXiamen361102China The Department of Chemical Engineering The University of MelbourneParkvilleVictoria3010Australia School of Chemical and Biomedical Engineering Nanyang Technological UniversitySingapore637457Singapore State Key Laboratory of Biotherapy and Cancer Center West China HospitalCollaborative Innovation Center for BiotherapySichuan UniversityChengdu610041China Laboratory of Molecular Imaging and Nanomedicine National Institute of Biomedical Imaging and BioengineeringNational Institutes of HealthBethesdaMD20892USA

Endo/lysosomal escape and gene release are two critical bottlenecks in gene ***,a novel photo-controllable metal-organic frameworks(MOFs)nanoswitch is rationally designed for enhancing small interfering RNA(siRNA)*** single laser triggers the“off-to-on”switching of MOFs nanocomplexes,inducing significant siRNA release accompanied by rapid MOFs dissociation into protonatable 2-methylimidazalo and osmotic rupturing Zn2+ions,which cooperatively contribute to remarkable endo/lysosomal rupture(∼90%).The simultaneous endo/lysosomal rupture and release enable a high spatio-temporal control on RNA interference for effective cancer ***,the“off-to-on”switching also activates fluorescence recovery for real-time monitoring siRNA *** nanoswitch could easily be extended to deliver other therapeutic agents(e.g.,DNA,protein,anticancer drug)for overcoming endo/lysosomal entrapment.

关键词： metal-organic frameworks endo/lysosomal rupture and release photo-controllable nanoswitch RNA interference cancer therapy