检索结果-南通市图书馆

Optimizing Fine-Tuning in Quantized Language Models:An In-dept. Analysis of Key Variables

Computers, Materials & Continua 2025年第1期82卷 307-325页

作者： Ao Shen Zhiquan Lai Dongsheng Li Xiaoyu Hu National Key Laboratory of Parallel and Distributed Computing National University of Defense TechnologyChangsha410073China Strategic Assessments and Consultation Institute Academy of Military ScienceBeijing100091China

Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning *** this approach allows models to specialize in specific tasks with reduced training costs,the substantial memory requirements during fine-tuning present a barrier to broader ***-Efficient Fine-Tuning(PEFT)techniques,such as Low-Rank Adaptation(LoRA),and parameter quantization methods have emerged as solutions to address these challenges by optimizing memory usage and computational *** these,QLoRA,which combines PEFT and quantization,has demonstrated notable success in reducing memory footprints during fine-tuning,prompting the development of various QLoRA *** these advancements,the quantitative impact of key variables on the fine-tuning performance of quantized LLMs remains *** study presents a comprehensive analysis of these key variables,focusing on their influence across different layer types and dept.s within LLM *** investigation uncovers several critical findings:(1)Larger layers,such as MLP layers,can maintain performance despite reductions in adapter rank,while smaller layers,like self-attention layers,aremore sensitive to such changes;(2)The effectiveness of balancing factors depends more on specific values rather than layer type or dept.;(3)In quantization-aware fine-tuning,larger layers can effectively utilize smaller adapters,whereas smaller layers struggle to do *** insights suggest that layer type is a more significant determinant of fine-tuning success than layer dept. when optimizing quantized ***,for the same discount of trainable parameters,reducing the trainable parameters in a larger layer is more effective in preserving fine-tuning accuracy than in a smaller *** study provides valuable guidance for more efficient fine-tuning strategies and opens avenues for further research into optimizing LLM

关键词： Large-scale Language Model Parameter-Efficient Fine-Tuning parameter quantization key variable trainable parameters experimental analysis

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Underground laboratories · Deep underground observation ·Scientific questions—Insights from observations of multi-physic fields in deep underground labs

引用

science China Earth sciences 2025年

作者： Huiqi REN Yun WANG Chang CHEN Guangyu FU Longqing QIU Lianghui GUO Chengliang XIE Yongsheng HE Heping SUN Jiwen TENG Institute of defense Engineering Academy of Military Sciences State Kay Laboratory of Geological Processes and Mineral Resources Key Laboratory of Intraplate Volcanoes and Earthquakes Ministry of Education China University of Geosciences (Beijing) Shanghai Institute of Microsystem and Information technology Chinese Academy of Sciences Innovation Academy for Precision Measurement science and technology Chinese Academy of Sciences Institute of Geology and Geophysics Chinese Academy of Sciences

This paper presents a comprehensive review on recent development and research conducted in domestic and international underground laboratories. We first introduce the differences in three environments—surface, mountain tunnel cavities and underground coal mine tunnels—by examining cosmic ray background, ambient noises related to gravity and seismic measurement, and electromagnetic noises in magnetic and magnetotelluric measurements. We highlight potential misuse of the term Underground Lab or Deep Underground Lab when describing observations in different physical fields. We introduce unique features of underground coal mine tunnels in China, such as large spaces, ultra-quiet conditions, and ultra-clean environments. When comparing with mountain tunnel cavities and borehole observations, coal mine tunnel observations have superior long-term stability and high precision. Through observations and comparisons of multi-physic fields at surface and the deep underground, we find that the higher SNR seismic observations conducted in deep underground tunnels in coal mines are beneficial to improve velocity tomography of the solid earth. The gravity observation with a Superconducting Quantum Interference Device(SQUID) makes it possibly to capture slow earthquake, which has not been observed previously in the Chinese mainland. SQUID magnetic observations can detect fluctuations as weak as femto-Tesla(fT), enabling us to explore the attenuation of Schumann Resonance down to the solid Earth. This opens opportunities to investigate the connections between the Earth's magnetic field and the interactions within the human brain and heart. To improve the precision of quantum measurement,we should consider the possible effects of weak magnetic disturbances in deep underground environments. Finally, we discuss the importance of deep underground laboratories, observing facilities and techniques deployed in these laboratories, and their possible connection with respect to “deep space” an

关键词：

来源：

同方期刊数据库评论

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Statistical characteristics and classification of ionospheric mid-latitude trough as revealed by the observations of DMSP-F18

引用

Earth and Planetary Physics 2025年第1期9卷 137-147页

作者： Yi Liu JiuHou Lei FuQing Huang Su Zhou School of Earth and Space sciences University of Science and Technology of ChinaHefei 230026China School of science Guiyang UniversityGuiyang 550005China

Statistical characteristics and the classification of the topside ionospheric mid-latitude trough are systemically analyzed,using observations from the defense Meteorological Satellite Program F18(DMSP-F18)*** data was obtained at an altitude of around 860 km in near polar orbit,throughout *** study identified the auroral boundary based on the in-situ electron density and electron spectrum,allowing us to precisely determine the location of the mid-latitude *** differs from most previous works,which only use Total Electron Content(TEC)or in-situ electron *** our study,the troughs exhibited a higher occurrence rate in local winter than in summer,and extended to lower latitudes with increasing geomagnetic *** was found that the ionospheric mid-latitude trough,which is associated with temperature changes or enhanced ion drift,exhibited distinct ***,the ionospheric mid-latitude troughs related to electron temperature(Te)peak were located more equatorward of auroral oval boundary in winter than in *** ionospheric mid-latitude troughs related to Te-maximum were less frequently observed at 60−70°S magnetic latitude and 90−240°E ***,the troughs related to ion temperature(Ti)maximums were observed at relatively higher latitudes,occurring more frequently in *** addition,the troughs related to ion velocity(Vi)maximums could be observed in all *** troughs with the maximum-Ti and maximum-Vi were located closer to the equatorward boundary of the auroral oval at the nightside,and in both *** implies that enhanced ion drift velocity contributes to increased collisional frictional heating and enhanced ion temperatures,resulting in a density depletion within the trough region.

关键词： topside ionosphere mid-latitude trough ionospheric main trough auroral oval boundary temperature maximum

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Compound parabolic concentrator applied as receiving antenna in scattering optical communication

引用

Chinese Optics Letters 2010年第5期8卷 478-481页

作者：方靖岳张海良贾红辉尹红伟常胜利秦石乔 College of Optoelectric science and technology National University of Defense Technology College of science National University of Defense Technology

The two-dimensional（2D） compound parabolic concentrator＇s（CPC） characteristics are *** is shown that CPC＇s height is taller and its light collecting ability is stronger with the CPC＇s field of view decreasing when the bottom radius is *** to the ZEMAX analysis,CPC is good at collecting optical signal,and the antenna combining CPC with hemispherical lens can gather more optical signal than a single CPC or CPCs combined in *** light propagation of scattering optical communication based on multiple scattering is simulated by Monte Carlo method,and the results show that using CPC as receiving antenna can strengthen communication system＇s signal collecting ability and increase its communication distance.

关键词： Communication systems Concentration (process) Lens antennas Light propagation Monte Carlo methods Optical signal processing Parabolic antennas Receiving antennas Scattering

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Optical property of nanocomposite of mesoporous silica thin films incorporated with gold nanoparticles

引用

Chinese Optics Letters 2011年第3期9卷 69-72页

作者：方靖岳张学骜秦石乔常胜利 College of Optoelectric science and technology National University of Defense Technology College of science National University of Defense Technology

Amino-functionalized mesoporous silica thin films （MTFs） are produced using surface active agent F127,and then gold nanoparticles are introduced into the pore channels to prepare the Au/SiO 2 *** assembling the gold,the amino-functionalized MTF undergoes some shrinkage but remains a periodic structure as demonstrated by X-ray diffraction （XRD） *** nanocomposite shows an acute characteristic diffraction peak assigned to （111） plane of the face-centered-cubic structure of gold,indicating that gold nanoparticles crystallize well and grow in a preferred orientation in the pore *** surface plasma resonance （SPR） absorption peak near 570 nm undergoes a red-shift accompanied by a strengthening of intensity when HAuCl 4 is used to react with the amino groups on the internal pore surfaces for 4,6,and 8 *** simulative results are consistent with the experimental ones shows that the absorption property of the Au/SiO 2 nanocomposite is influenced by the dipping time,which affects the size and volume fraction of embedded gold nanoparticles.

关键词： Absorption Diffraction Gold Mesoporous materials Nanocomposites Nanoparticles Optical properties Silica Surface active agents Thin films X ray diffraction

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Implementation of ternary Shor's algorithm based on vibrational states of an ion in anharmonic potential

引用

Chinese Physics B 2015年第3期24卷 157-165页

作者：刘威陈书明张见吴春旺吴伟陈平形 College of Computer National University of Defense Technology science and technology on Parallel and Distributed Processing Laboratory (PDL) National University of Defense Technology College of science National University of Defense Technology

It is widely believed that Shor＇s factoring algorithm provides a driving force to boost the quantum computing ***, a serious obstacle to its binary implementation is the large number of quantum gates. Non-binary quantum computing is an efficient way to reduce the required number of elemental gates. Here, we propose optimization schemes for Shor＇s algorithm implementation and take a ternary version for factorizing 21 as an example. The optimized factorization is achieved by a two-qutrit quantum circuit, which consists of only two single qutrit gates and one ternary controlled-NOT gate. This two-qutrit quantum circuit is then encoded into the nine lower vibrational states of an ion trapped in a weakly anharmonic potential. Optimal control theory（OCT） is employed to derive the manipulation electric field for transferring the encoded states. The ternary Shor＇s algorithm can be implemented in one single step. Numerical simulation results show that the accuracy of the state transformations is about 0.9919.

关键词： ternary Shor's algorithm anharmonic ion trapping optimal control theory vibrational state

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

Time-domain analytic solutions of two-wire transmission line excited by a plane-wave field

引用

Chinese Physics B 2008年第10期17卷 3629-3634页

作者：倪谷炎颜力袁乃昌 College of science National University of Defense Technology College of Aerospace and Material Engineering National University of Defense Technology College of Electronic science and Engineering National University of Defense Technology

This paper reports that an analytic method is used to calculate the load responses of the two-wire transmission line excited by a plane-wave directly in the time domain. By the frequency-domain Baum Liu-Tesehe （BLT） equation, the time-domain analytic solutions are obtained and expressed in an infinite geometric series. Moreover, it is shown that there exist only finite nonzero terms in the infinite geometric series if the time variate is at a finite interval. In other word, the time-domain analytic solutions are expanded in a finite geometric series indeed if the time variate is at a finite interval. The computed results are subsequently compared with transient responses obtained by using the frequency-domain BLT equation via a fast Fourier transform, and the agreement is excellent.

关键词： transmission line analytic solution BLT equation coupling formulation.

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

GPU acceleration of subgraph isomorphism search in large scale graph

引用

Journal of Central South University 2015年第6期22卷 2238-2249页

作者：杨博卢凯高颖慧王小平徐凯 science and technology on Parallel and Distributed Processing Laboratory National University of Defense Technology College of Computer National University of Defense Technology Department of Electronic science and Engineering National University of Defense Technology

A novel framework for parallel subgraph isomorphism on GPUs is proposed, named GPUSI, which consists of GPU region exploration and GPU subgraph matching. The GPUSI iteratively enumerates subgraph instances and solves the subgraph isomorphism in a divide-and-conquer fashion. The framework completely relies on the graph traversal, and avoids the explicit join operation. Moreover, in order to improve its performance, a task-queue based method and the virtual-CSR graph structure are used to balance the workload among warps, and warp-centric programming model is used to balance the workload among threads in a warp. The prototype of GPUSI is implemented, and comprehensive experiments of various graph isomorphism operations are carried on diverse large graphs. The experiments clearly demonstrate that GPUSI has good scalability and can achieve speed-up of 1.4–2.6 compared to the state-of-the-art solutions.

关键词： parallel graph isomorphism GPU backtrack paradigm

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

QSobel:A novel quantum image edge extraction algorithm

引用

science China(Information sciences) 2015年第1期58卷 107-119页

作者： ZHANG Yi LU Kai GAO YingHui science and technology on Parallel and Distributed Processing Laboratory National University of Defense Technology College of Computer National University of Defense Technology College of Electronic science and Engineering National University of Defense Technology

Edge extraction is an indispensable task in digital image processing. With the sharp increase in the image data, real-time problem has become a limitation of the state of the art of edge extraction *** this paper, QSobel, a novel quantum image edge extraction algorithm is designed based on the flexible representation of quantum image(FRQI) and the famous edge extraction algorithm Sobel. Because FRQI utilizes the superposition state of qubit sequence to store all the pixels of an image, QSobel can calculate the Sobel gradients of the image intensity of all the pixels simultaneously. It is the main reason that QSobel can extract edges quite fast. Through designing and analyzing the quantum circuit of QSobel, we demonstrate that QSobel can extract edges in the computational complexity of O(n2) for a FRQI quantum image with a size of2 n × 2n. Compared with all the classical edge extraction algorithms and the existing quantum edge extraction algorithms, QSobel can utilize quantum parallel computation to reach a significant and exponential ***, QSobel would resolve the real-time problem of image edge extraction.

关键词： edge extraction quantum image processing FRQI Sobel computational complexity

来源：

同方期刊数据库评论

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Performance of 3D TPN against true-arbitrarily maneuvering target for exoatmospheric interception

引用

science China(Technological sciences) 2018年第8期61卷 1161-1174页

作者： LI KeBo LIANG YanGang SU WenShan CHEN Lei College of Aerospace science and Engineering National University of Defense Technology National Innovation Institute of defense technology Academy of Military Science

True proportional navigation(TPN) guidance law is widely used for exoatmospheric interception, for its robustness and ease of implementation. The performance of TPN against nonmaneuvering target or the maneuvering target with a specific acceleration had been analyzed before. However, the obtained results are not suitable for the realistic exoatmospheric interception scenario,since the target may maneuver along an arbitrary direction with an arbitrary but upper-bounded acceleration in the threedimensional(3 D) space, which is the so-called "true-arbitrarily maneuvering target" in this paper. With the help of the line-ofsight(LOS) rotation coordinate system, the performance of 3 D TPN against the true-arbitrarily maneuvering target is thoroughly analyzed using the Lyapunov-like approach. The upper-bound of the 3 D LOS rate is obtained, and so is that of the commanded acceleration of 3 D TPN. After that, the capture region of 3 D TPN is presented on the initial relative velocity plane. The nonlinear3 D relative kinematics between the interceptor and the target is taken into full account. Finally, the new theoretical findings are demonstrated by numerical simulations.

关键词： exoatmospheric interception 3D TPN true-arbitrarily maneuvering target capturability Lyapunov-like approach

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：