检索结果-南通市图书馆

Optimizing Fine-Tuning in Quantized Language Models:An In-Depth Analysis of Key Variables

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Computers, Materials & Continua 2025年第1期82卷 307-325页

作者： Ao shen Zhiquan Lai Dongsheng li Xiaoyu Hu National Key Laboratory of Parallel and Distributed Computing National University of Defense TechnologyChangsha410073China Strategic Assessments and Consultation Institute Academy of Military ScienceBeijing100091China

Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning *** this approach allows models to specialize in specific tasks with reduced training costs,the substantial memory requirements during fine-tuning present a barrier to broader ***-Efficient Fine-Tuning(PEFT)techniques,such as Low-Rank Adaptation(LoRA),and parameter quantization methods have emerged as solutions to address these challenges by optimizing memory usage and computational *** these,QLoRA,which combines PEFT and quantization,has demonstrated notable success in reducing memory footprints during fine-tuning,prompting the development of various QLoRA *** these advancements,the quantitative impact of key variables on the fine-tuning performance of quantized LLMs remains *** study presents a comprehensive analysis of these key variables,focusing on their influence across different layer types and depths within LLM *** investigation uncovers several critical findings:(1)Larger layers,such as MLP layers,can maintain performance despite reductions in adapter rank,while smaller layers,like self-attention layers,aremore sensitive to such changes;(2)The effectiveness of balancing factors depends more on specific values rather than layer type or depth;(3)In quantization-aware fine-tuning,larger layers can effectively utilize smaller adapters,whereas smaller layers struggle to do *** insights suggest that layer type is a more significant determinant of fine-tuning success than layer depth when optimizing quantized ***,for the same discount of trainable parameters,reducing the trainable parameters in a larger layer is more effective in preserving fine-tuning accuracy than in a smaller *** study provides valuable guidance for more efficient fine-tuning strategies and opens avenues for further research into optimizing LLM

关键词： Large-scale Language Model Parameter-Efficient Fine-Tuning parameter quantization key variable trainable parameters experimental analysis

LARGE-SCALE PETROL-MEDICAL ENTERPRISE TECHNOLOGY INNOVATION SYSTEM MODEliNG AND IMPLEMENTING

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

LARGE-SCALE PETROL-MEDICAL ENTERPRISE TECHNOLOGY INNOVATION ...

2005年中国机械工程学会年会

作者： shen Jiang, li gang, XU Man (Management School, Tianjin University, Tianjin, 300072)

＜正＞In order to solve the implementation problems on complexity, multi-layer and span-platform in technology innovation of large-scale petrol-medical enterprises, a method of technology innovation modeling based on virtual enterprise was proposed. In this method, the technology innovation system consisted of strategic partnership selecting, virtual organization constructing and business process reengineering, and network platform and Virtual Enterprise Technology Innovation Decision Support System （VETI-DSS） architecting. By applying characteristic eigenvector, the technology innovation system was regarded as a virtual enterprise or a contractual organization to model the technology innovation system. Adopting data mining, OLAP, and decision model and algorithm, the VETI-DSS was described. Using UML, the solution on process management, acquisition process of product information, trial-production process of new products, data modeling of system, and information sharing in the core estate of technology innovation were put forward. At last, the implementing effects of this system applied in large-scale petrol-medical enterprises were analyzed.

关键词： virtual enterprise technique innovation decision support system information integrated

来源： cnki会议评论

在线全文

cnki会议

学校读者我要写书评

暂无评论

自由曲面四边形网格等杆长划分算法

空间结构 2016年第1期22卷 11-15,40页

作者：沈利刚龚景海上海交通大学土木工程系上海200240

自由曲面在建筑上的应用日益广泛,研究自由曲面的网格划分有着重要意义.以保证杆件长度完全相等为准则,基于NURBS提出了一种适用于大多数自由曲面的四边形网格划分算法,介绍了算法的基本流程和要点.本算法采用二分法进行数值计算,思路... 详细信息

自由曲面在建筑上的应用日益广泛,研究自由曲面的网格划分有着重要意义.以保证杆件长度完全相等为准则,基于NURBS提出了一种适用于大多数自由曲面的四边形网格划分算法,介绍了算法的基本流程和要点.本算法采用二分法进行数值计算,思路简单、效率良好,能够快速地对自由曲面进行网格划分.结合实例可以看到,本算法生成的网格杆件长度相等,同时能保证网格形状的相对规整,对坡度较陡的自由曲面和不规则边界有着良好的适应性.

关键词：自由曲面 NURBS 四边形网格等杆长划分

A Rapid Adaptation Approach for Dynamic Air‑Writing Recognition Using Wearable Wristbands with Self‑Supervised Contrastive Learning

在线全文

学校读者我要写书评

暂无评论

Nano-Micro Letters 2025年第2期17卷 417-431页

作者： Yunjian Guo Kunpeng li Wei Yue Nam‑Young Kim Yang li Guozhen shen Jong‑Chul Lee Department of Electronic Convergence Engineering Kwangwoon UniversitySeoul 01897South Korea Radio Frequency Integrated Circuit(RFIC)Bio Centre Kwangwoon UniversitySeoul 01897South Korea Department of Electronic Engineering Kwangwoon UniversitySeoul 01897South Korea School of Microelectronics Shandong UniversityJinan 250101People’s Republic of China State Key Laboratory of Integrated Chips and Systems Fudan UniversityShanghai 200433People’s Republic of China School of Integrated Circuits and Electronics Beijing Institute of TechnologyBeijing 100081People’s Republic of China

Wearable wristband systems leverage deep learning to revolutionize hand gesture recognition in daily *** existing approaches that often focus on static gestures and require extensive labeled data,the proposed wearable wristband with selfsupervised contrastive learning excels at dynamic motion tracking and adapts rapidly across multiple *** features a four-channel sensing array composed of an ionic hydrogel with hierarchical microcone structures and ultrathin flexible electrodes,resulting in high-sensitivity capacitance *** wireless transmission from a Wi-Fi module,the proposed algorithm learns latent features from the unlabeled signals of random wrist ***,only few-shot labeled data are sufficient for fine-tuning the model,enabling rapid adaptation to various *** system achieves a high accuracy of 94.9%in different scenarios,including the prediction of eight-direction commands,and air-writing of all numbers and *** proposed method facilitates smooth transitions between multiple tasks without the need for modifying the structure or undergoing extensive task-specific *** utility has been further extended to enhance human–machine interaction over digital platforms,such as game controls,calculators,and three-language login systems,offering users a natural and intuitive way of communication.

关键词： Wearable wristband Self-supervised contrastive learning Dynamic gesture Air-writing Human-machine interaction

Investigation of bubbles escape behavior from low basicity mold flux for high-Mn high-Al steels using 3D X-ray microscope

在线全文

学校读者我要写书评

暂无评论

International Journal of Minerals,Metallurgy and Materials 2025年第1期32卷 102-110页

作者： Qiang liu Xiang li shen Du Ming Gao Yanbin Yin Jiongming Zhang State Key Laboratory of Advanced Metallurgy University of Science and Technology BeijingBeijing 100083China

During the continuous casting process of high-Mn high-Al steels,various types of gases such as Ar need to escape through the top of the *** which,the behavior of bubbles traversing the liquid slag serves as a restrictive link,closely associated with viscosity and the thickness of liquid *** contrast to two-dimensional surface observation,three-dimensional(3D)analysis method can offer a more intuitive,accurate,and comprehensive ***,this study employs a 3D X-ray microscope(3D-XRM)to obtained spatial distribution and 3D morphological characteristics of residual bubbles in mold flux under different basicity of liquid slag,different temperatures,and different holding *** results indicate that as basicity of slag increases from 0.52 to 1.03,temperature increases from 1423 to 1573 K,the viscosity of slag decreases,the floating rate of bubbles *** addition,when holding time increases from 10 to 30 s,the bubbles floating distance increases,and the volume fraction and average equivalent sphere diameter of the bubbles solidified in the mold flux gradually *** one word,increasing the basicity,temperature,and holding time leading to an increase in the removal rate of bubbles especially for the *** findings of bubbles escape behavior provide valuable insights into optimizing low basicity mold flux for high-Mn high-Al steels.

关键词： mold flux low basicity bubbles three-dimensional X-ray microscope viscosity

Potential role and therapeutic implications of glutathione peroxidase 4 in the treatment of Alzheimer's disease

在线全文

学校读者我要写书评

暂无评论

Neural Regeneration Research 2025年第3期20卷 613-631页

作者： Yanxin shen Guimei Zhang Chunxiao Wei Panpan Zhao Yongchun Wang Mingxi li li Sun Department of Neurology and Neuroscience Center The First Hospital of Jilin UniversityJilin UniversityChangchunJilin ProvinceChina Cognitive Impairment Center Department of NeurologyThe First Hospital of Jilin UniversityJilin UniversityChangchunJilin ProvinceChina

Alzheimer's disease is an age-related neurodegenerative disorder with a complex and incompletely understood pathogenesis. Despite extensive research, a cure for Alzheimer's disease has not yet been found. Oxidative stress mediates excessive oxidative responses, and its involvement in Alzheimer's disease pathogenesis as a primary or secondary pathological event is widely accepted. As a member of the selenium-containing antioxidant enzyme family, glutathione peroxidase 4 reduces esterified phospholipid hydroperoxides to maintain cellular redox homeostasis. With the discovery of ferroptosis, the central role of glutathione peroxidase 4 in anti-lipid peroxidation in several diseases, including Alzheimer's disease, has received widespread attention. Increasing evidence suggests that glutathione peroxidase 4 expression is inhibited in the Alzheimer's disease brain, resulting in oxidative stress, inflammation, ferroptosis, and apoptosis, which are closely associated with pathological damage in Alzheimer's disease. Several therapeutic approaches, such as small molecule drugs, natural plant products, and non-pharmacological treatments, ameliorate pathological damage and cognitive function in Alzheimer's disease by promoting glutathione peroxidase 4 expression and enhancing glutathione peroxidase 4 activity. Therefore, glutathione peroxidase 4 upregulation may be a promising strategy for the treatment of Alzheimer's disease. This review provides an overview of the gene structure, biological functions, and regulatory mechanisms of glutathione peroxidase 4, a discussion on the important role of glutathione peroxidase 4 in pathological events closely related to Alzheimer's disease, and a summary of the advances in small-molecule drugs, natural plant products, and non-pharmacological therapies targeting glutathione peroxidase 4 for the treatment of Alzheimer's disease. Most prior studies on this subject used animal models, and relevant clinical studies are lacking. Future clinica

关键词： apoptosis ferroptosis inflammation lipid peroxidation natural plant products neurodegenerative disorder neuroprotection oxidative stress small-molecule drugs

Vector meson's spin alignments in high energy reactions

在线全文

学校读者我要写书评

暂无评论

Science China(Physics,Mechanics & Astronomy) 2025年第1期Mechanics & Astronomy) .卷 5-20页

作者： Jin-Hui Chen Zuo-Tang liang Yu-gang Ma Xin-li sheng Qun Wang Key Laboratory of Nuclear Physics and Ion-beam Application (MoE) Institute of Modern PhysicsFudan University Institute of Frontier and Interdisciplinary Science Key Laboratory of Particle Physics and Particle Irradiation (MOE)Shandong University INFN-Firenze Department of Modern Physics University of Science and Technology of China School of Mechanics and Physics Anhui University of Science and Technology

The global spin alignment of vector mesons has been observed by the STAR collaboration at the Relativistic Heavy Ion Collider （RHIC） at Brookhaven National Laboratory （BNL）.It provides a unique opportunity to probe the correlation between the polarized quark and antiquark in the strongly coupled quark-gluon plasma （sQGP） produced in relativistic heavy ion collisions,opening a new window to explore the properties of s *** addition,spin alignments of vector mesons have also been observed in other high-energy particle collisions such as e+e-annihilations at high energies where hadron production is dominated by quark fragmentation *** results obtained are quite different from those obtained in heavy ion collisions where quark coalescence/combination mechanism dominates suggesting strong dependence on hadronization *** comprehensive studies in different hadronization processes are *** this article,we present a brief review of theoretical and experimental advances in the study of vector meson’s spin alignments in a variety of high-energy particle collisions,with emphasis on hadronization mechanisms.

关键词： vector meson spin alignment global polarization relativistic heavy ion collisions fragmentation

Small extracellular vesicles derived from cerebral endothelial cells with elevated microRNA 27a promote ischemic stroke recovery

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Neural Regeneration Research 2025年第1期20卷 224-233页

作者： Yi Zhang Zhongwu liu Michael Chopp Michael Millman Yanfeng li Pasquale Cepparulo Amy Kemper Chao li li Zhang Zheng gang Zhang Department of Neurology Henry Ford HospitalDetroitMIUSA Department of Physics Oakland UniversityRochesterMIUSA Department of Pathology Henry Ford HospitalDetroitMIUSA Division of Pharmacology Department of NeuroscienceReproductive and Dentistry SciencesSchool of MedicineUniversity of Naples“Federico Ⅱ”NaplesItaly

Axonal remodeling is a critical aspect of ischemic brain repair processes and contributes to spontaneous functional *** previous in vitro study demonstrated that exosomes/small extracellular vesicles(sEVs)isolated from cerebral endothelial cells(CEC-sEVs)of ischemic brain promote axonal growth of embryonic cortical neurons and that microRNA 27a(miR-27a)is an elevated miRNA in ischemic *** the present study,we investigated whether normal CEC-sEVs engineered to enrich their levels of miR-27a(27a-sEVs)further enhance axonal growth and improve neurological outcomes after ischemic stroke when compared with treatment with non-engineered CEC-sEVs.27a-sEVs were isolated from the conditioned medium of healthy mouse CECs transfected with a lentiviral miR-27a expression *** EVs isolated from CECs transfected with a scramble vector(Scra-sEVs)were used as a *** male mice were subjected to permanent middle cerebral artery occlusion and then were randomly treated with 27a-sEVs or *** array of behavior assays was used to measure neurological *** with treatment of ischemic stroke with Scra-sEVs,treatment with 27a-sEVs significantly augmented axons and spines in the peri-infarct zone and in the corticospinal tract of the spinal grey matter of the denervated side,and significantly improved neurological *** vitro studies demonstrated that CEC-sEVs carrying reduced miR-27a abolished 27a-sEV-augmented axonal *** analysis revealed that 27a-sEVs systemically administered preferentially localized to the pre-synaptic active zone,while quantitative reverse transcription-polymerase chain reaction and Western Blot analysis showed elevated miR-27a,and reduced axonal inhibitory proteins Semaphorin 6A and Ras Homolog Family Member A in the peri-infarct *** of the Clathrin-dependent endocytosis pathway substantially reduced neuronal internalization of *** data provide evidence that 27a-sEVs have

关键词： axonal remodeling cerebral endothelial cells exosomes miR-27a mitochondria Semaphorin 6A small extracellular vesicles stroke

Photo‑Energized MoS_(2)/CNT Cathode for High‑Performance li–CO_(2)Batteries in a Wide‑Temperature Range

在线全文

学校读者我要写书评

暂无评论

Nano-Micro Letters 2025年第1期17卷 160-175页

作者： Tingsong Hu Wenyi lian Kang Hu Qiuju li Xueliang Cui Tengyu Yao Laifa shen Jiangsu Key Laboratory of Materials and Technologies for Energy Storage College of Materials Science and TechnologyNanjing University of Aeronautics and AstronauticsNanjing 210016People’s Republic of China

li–CO_(2) batteries are considered promising energy storage systems in extreme environments such as Mars;however,severe performance degradation will occur at a subzero temperature owning to the sluggish reaction ***,a photo-energized strategy adopting sustainable solar energy in wide working temperature range li–CO_(2) battery was achieved with a binder-free MoS_(2)/carbon nanotube(CNT)photo-electrode as *** unique layered structure and excellent photoelectric properties of MoS_(2) facilitate the abundant generation and rapid transfer of photo-excited carriers,which accelerate the CO_(2) reduction and li_(2)CO_(3) decomposition upon *** illuminated battery at room temperature exhibited high discharge voltage of 2.95 V and mitigated charge voltage of 3.27 V,attaining superior energy efficiency of 90.2%and excellent cycling stability of over 120 *** at an extremely low temperature of−30℃,the battery with same electrolyte can still deliver a small polarization of 0.45 V by the photoelectric and photothermal synergistic mechanism of MoS_(2)/CNT *** work demonstrates the promising potential of the photo-energized wide working temperature range li–CO_(2) battery in addressing the obstacle of charge overpotential and energy efficiency.

关键词： li-CO_(2)batteries Photo-energized Wide operation-temperature Kinetics MoS_(2)