检索结果-南通市图书馆

Ensemble successor representations for task generalization in offline-to-online reinforcement learning

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2024年第7期67卷 240-255页

作者： Changhong WANG Xudong YU Chenjia BAI Qiaosheng ZHANG Zhen WANG space Control and Inertial Technology research Center Harbin Institute of Technology Shanghai Artificial Intelligence laboratory Shenzhen research Institute of Northwestern Polytechnical University School of Cybersecurity Northwestern Polytechnical University

In reinforcement learning(RL), training a policy from scratch with online experiences can be inefficient because of the difficulties in exploration. Recently, offline RL provides a promising solution by giving an initialized offline policy, which can be refined through online interactions. However, existing approaches primarily perform offline and online learning in the same task, without considering the task generalization problem in offline-to-online adaptation. In real-world applications, it is common that we only have an offline dataset from a specific task while aiming for fast online-adaptation for several tasks. To address this problem, our work builds upon the investigation of successor representations for task generalization in online RL and extends the framework to incorporate offline-to-online learning. We demonstrate that the conventional paradigm using successor features cannot effectively utilize offline data and improve the performance for the new task by online fine-tuning. To mitigate this, we introduce a novel methodology that leverages offline data to acquire an ensemble of successor representations and subsequently constructs ensemble Q functions. This approach enables robust representation learning from datasets with different coverage and facilitates fast adaption of Q functions towards new tasks during the online fine-tuning *** empirical evaluations provide compelling evidence showcasing the superior performance of our method in generalizing to diverse or even unseen tasks.

关键词： offline reinforcement learning online fine-tuning task generalization successor representations ensembles

同方期刊数据库

Analysis of the joint detection capability of the SMILE satellite and EISCAT-3D radar

在线全文

学校读者我要写书评

暂无评论

Earth and Planetary Physics 2024年第1期8卷 299-306页

作者： JiaoJiao Zhang TianRan Sun XiZheng Yu DaLin Li Hang Li JiaQi Guo ZongHua Ding Tao Chen Jian Wu Chi Wang State Key laboratory of space Weather National Space Science CenterChinese Academy of SciencesBeijing 100190China Key laboratory of Solar Activity and space Weather National Space Science CenterChinese Academy of SciencesBeijing 100190China University of Chinese Academy of Sciences Beijing 101408China Key laboratory of Electronics and Information Technology for space Systems Chinese Academy of SciencesBeijing 100190China China research Institute of Radio-wave Propagation Qingdao 266075China

The Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)satellite is a small magnetosphere–ionosphere link explorer developed cooperatively between China and *** pioneers the use of X-ray imaging technology to perform large-scale imaging of the Earth’s magnetosheath and polar cusp *** uses a high-precision ultraviolet imager to image the overall configuration of the aurora and monitor changes in the source of solar wind in real time,using in situ detection instruments to improve human understanding of the relationship between solar activity and changes in the Earth’s magnetic *** SMILE satellite is scheduled to launch in *** European Incoherent Scatter Sciences Association(EISCAT)-3D radar is a new generation of European incoherent scatter radar constructed by EISCAT and is the most advanced ground-based ionospheric experimental device in the high-latitude polar *** has multibeam and multidirectional quasi-real-time three-dimensional(3D)imaging capabilities,continuous monitoring and operation capabilities,and multiple-baseline interferometry *** detection by the SMILE satellite and the EISCAT-3D radar is of great significance for revealing the coupling process of the solar wind–magnetosphere–***,we performed an analysis of the joint detection capability of the SMILE satellite and EISCAT-3D,analyzed the period during which the two can perform joint detection,and defined the key scientific problems that can be solved by joint *** addition,we developed Web-based software to search for and visualize the joint detection period of the SMILE satellite and EISCAT-3D radar,which lays the foundation for subsequent joint detection experiments and scientific research.

关键词： Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)satellite European Incoherent Scatter Sciences Association(EISCAT)-3D radar joint detection

Macroscopic model and statistical model to characterize electromagnetic information of a digital coding metasurface

在线全文

学校读者我要写书评

暂无评论

National Science Review 2024年第3期11卷 159-171页

作者： Rui Wen Shao Jun Wei Wu Zheng Xing Wang Hui Xu Han Qing Yang Qiang Cheng Tie Jun Cui Institute of Electromagnetic space Southeast University State Key laboratory of Millimeter Waves Southeast University Peng Cheng laboratory Pazhou laboratory(Huangpu)

A digital coding metasurface is a platform connecting the digital space and electromagnetic wave space, and has therefore gained much attention due to its intriguing value in reshaping wireless channels and realizing new communication architectures. Correspondingly, there is an urgent need for electromagnetic information theory that reveals the upper limit of communication capacity and supports the accurate design of metasurface-based communication systems. To this end, we propose a macroscopic model and a statistical model of the digital coding metasurface. The macroscopic model uniformly accommodates both digital and electromagnetic aspects of the meta-atoms and predicts all possible scattered fields of the digital coding metasurface based on a small number of simulations or measurements. Full-wave simulations and experimental results show that the macroscopic model is feasible and accurate. A statistical model is further proposed to correlate the mutual coupling between meta-atoms with covariance and to calculate the entropy of the equivalent currents of digital coding metasurface. These two models can help reconfigurable intelligent surfaces achieve more accurate beamforming and channel estimation, and thus improve signal power and coverage. Moreover, the models will encourage the creation of a precoding codebook in metasurface-based direct digital modulation systems, with the aim of approaching the upper limit of channel capacity. With these two models, the concepts of current space and current entropy, as well as the analysis of information loss from the coding space to wave space, is established for the first time, helping to bridge the gap between the digital world and the physical world, and advancing developments of electromagnetic information theory and new-architecture wireless systems.

关键词： electromagnetic information theory current entropy current space digital coding metasurface macroscopic model statistical model

Are Solar Active Regions Born with Neutralized Currents?

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

research in Astronomy and Astrophysics 2024年第7期24卷 82-91页

作者： Aiying Duan Yaoyu Xing Chaowei Jiang Planetary Environmental and Astrobiological research laboratory (PEARL) School of Atmospheric SciencesSun Yat-sen University Yunnan Key laboratory of the Solar Physics and space Science Key laboratory of Tropical Atmosphere-Ocean System Sun Yat-sen UniversityMinistry of Education Institute of space Science and Applied Technology Harbin Institute of Technology

Solar active regions(ARs) are formed by the emergence of current-carrying magnetic flux tubes from below the photosphere. Although for an isolated flux tube the direct and return currents flowing along the tube should balance with each other, it remains controversial whether such a neutralization of currents is also maintained during the emergence process. Here we present a systematic survey of the degrees of the current neutralization in a large sample of flux-emerging ARs which appeared on the solar disk around the central meridian from 2010 to *** vector magnetograms taken by Helioseismic and Magnetic Imager onboard Solar Dynamic Observatory are employed to calculate the distributions of the vertical current density at the photosphere. Focusing on the main phase of flux emergence, i.e., the phase in which the total unsigned magnetic flux is continuously increased, we statistically examined the ratios of direct to return currents in all the ARs. Such a large-sample statistical study suggests that most of the ARs were born with currents close to neutralization. The degree of current neutralization seems to be not affected by the active-region size, the active-region growing rate, and the total unsigned *** only correlation of significance as found is that the stronger the magnetic field nonpotentiality is, the further the AR deviates from current neutrality, which supports previous event studies that eruption-productive ARs often have non-neutralized currents.

关键词： Sun: corona Sun: coronal mass ejections (CMEs) Sun: flares Sun: magnetic fields

Black holes as the source of dark energy:A stringent test with high-redshift JWST AGNs

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Science China(Physics,Mechanics & Astronomy) 2024年第2期67卷 181-188页

作者： Lei Lei Lei Zu Guan-Wen Yuan Zhao-Qiang Shen Yi-Ying Wang Yuan-Zhu Wang Zhen-Bo Su Wen-Ke Ren Shao-Peng Tang Hao Zhou Chi Zhang Zhi-Ping Jin Lei Feng Yi-Zhong Fan Da-Ming Wei Key laboratory of Dark Matter and space Astronomy Purple Mountain ObservatoryChinese Academy of SciencesNanjing 210023China School of Astronomy and space Science University of Science and Technology of ChinaHefei 230026China CAS Key laboratory for research in Galaxies and Cosmology Department of AstronomyUniversity of Science and Technology of ChinaHefei 230026China

Studies have proposed that there is evidence for cosmological coupling of black holes(BHs)with an index of k≈3;hence,BHs serve as the astrophysical source of dark ***,the data sample is limited for the redshifts of≤*** recent years,the James Webb space Telescope(JWST)has detected many high-redshift active galactic nuclei(AGNs)and *** the JWST NIRSpec-/NIRCam-resolved AGNs,three are determined to be in early-type host galaxies with a redshift of z~***,their M_(*)and MBH are in tension with the predicted cosmological coupling of black holes with k=3 at a confidence level of~2σ,which challenges the hypothesis that BHs serve as the origin of dark *** work on high-redshift AGNs using the JWST will further assess such a hypothesis by identifying more early-type host galaxies in the higher mass range.

关键词： dark energy supermassive black hole active galactic nuclei James Webb space Telescope

Rice gene OsUGT75A regulates seedling emergence under deep-sowing conditions

在线全文

学校读者我要写书评

暂无评论

The Crop Journal 2024年第1期12卷 133-141页

作者： Jia Zhao Siyu Liu Xiaoqian Zhao Zhibo Huang Shan Sun Zixuan Zeng Yongqi He Zhoufei Wang The laboratory of Seed Science and Technology Guangdong Key Laboratory of Plant Molecular BreedingNational Engineering Research Center of Plant Space BreedingSouth China Agricultural UniversityGuangzhou 510642GuangdongChina

Poor seedling emergence is a challenge for direct seeding of rice under deep-sowing field *** we reveal that UDP-glucosyltransferase OsUGT75A promotes rice seedling emergence under deepsowing conditions by increasing shoot *** of OsUGT75A was higher in the middle regions of the shoot and in shoots under deep-sowing *** of free abscisic acid(ABA)and jasmonates(JA)were higher in shoots of OsUGT75A mutants than in those of wild-type plants,and OsUGT75A mutants were more sensitive to ABA and JA *** shoot length was attributed to higher ABA INSENSITIVE 3(OsABI3)expression and lower JASMONATE-ZIM domain protein(OsJAZ)expression in *** extension by OsUGT75A is achieved mainly by promotion of cell *** elite haplotype of OsUGT75A associated with increased shoot length was identified among indica rice ***75A acts to increase seedling emergence under deep-sowing conditions.

关键词： Abscisic acid Deep-sowing Jasmonic acid Rice Shoot length

Improving the spaceborne GNSS-R altimetric precision based on the novel multilayer feedforward neural network weighted joint prediction model

在线全文

学校读者我要写书评

暂无评论

Defence Technology（防务技术） 2024年第2期32卷 271-284页

作者： Yiwen Zhang Wei Zheng Zongqiang Liu Qian Xuesen laboratory of space Technology China Academy of Space TechnologyBeijing 100094China China Academy of Aerospace Science and Innovation Beijing 100176China State Key laboratory of space-Ground Integrated Information Technology Beijing Institute of Satellite Information EngineeringBeijing 100194China

Global navigation satellite system-reflection(GNSS-R)sea surface altimetry based on satellite constellation platforms has become a new research direction and inevitable trend,which can meet the altimetric precision at the global scale required for underwater *** present,there are still research gaps for GNSS-R altimetry under this mode,and its altimetric capability cannot be specifically ***,GNSS-R satellite constellations that meet the global altimetry needs to be ***,the matching precision prediction model needs to be established to quantitatively predict the GNSS-R constellation altimetric ***,the GNSS-R constellations altimetric precision under different configuration parameters is calculated,and the mechanism of the influence of orbital altitude,orbital inclination,number of satellites and simulation period on the precision is analyzed,and a new multilayer feedforward neural network weighted joint prediction model is ***,the fit of the prediction model is verified and the performance capability of the model is tested by calculating the R2 value of the model as 0.9972 and the root mean square error(RMSE)as 0.0022,which indicates that the prediction capability of the model is ***,using the novel multilayer feedforward neural network weighted joint prediction model,and considering the research results and realistic costs,it is proposed that when the constellation is set to an orbital altitude of 500 km,orbital inclination of 75and the number of satellites is 6,the altimetry precision can reach 0.0732 m within one year simulation period,which can meet the requirements of underwater navigation precision,and thus can provide a reference basis for subsequent research on spaceborne GNSS-R sea surface altimetry.

关键词： GNSS-R satellite constellations Sea surface altimetric precision Underwater navigation Multilayer feedforward neural network

A novel model of the carbon cycle in the Cambrian ocean

在线全文

学校读者我要写书评

暂无评论

Science China Earth Sciences 2024年第6期67卷 1759-1778页

作者： Huajian WANG Shuichang ZHANG Xiaomei WANG Jin SU Yuntao YE Yuke LIU Key laboratory of Petroleum Geochemistry Research Institute of Petroleum Exploration and DevelopmentChina National Petroleum CorporationBeijing 100083China Key laboratory of Orogenic Belts and Crustal Evolution School of Earth and Space SciencesPeking UniversityBeijing 100871China

The classic model of the carbon cycle suggests that the extensive burial of ^(12)C-enriched organic carbon leads to a positive carbon isotope(δ^(13)C)excursion(CIE),while massive oxidation of organic carbon results in a negative ***,global events such as the BAsal Cambrian Carbon isotope Excursion(BACE)and the Steptoean Positive Carbon Isotope Excursion(SPICE)are global negative and positive δ^(13)C excursions,respectively,and they also exhibit significant organic carbon burial anomalies,displaying decoupling between carbon isotope anomalies and organic carbon *** on the analyses of the Cambrian carbon cycle and paleoceanographic evolution records from well Tadong2 in the Tarim Basin,we propose a novel model of the carbon cycle in the Cambrian ocean that incorporates oceanic dissolved organic carbon(DOC).Our findings are as follows.(1)The Cambrian ocean maintained substantial DOC reservoirs,which were regulated by ocean currents and paleo-redox conditions and exerted significant influence on the oceanic carbon cycle.(2)The oxidation of the oceanic DOC reservoirs during the early Cambrian led to the BACE and the Asian Phenomenon of the Cambrian petroleum systems,while the expansion of the oceanic DOC reservoirs during the SPICE resulted in a global positive δ^(13)C excursion and the absence of significant organic carbon burial.(3)The deep-basin sedimentary environment in the eastern depression of the Tarim Basin may have fostered the development of organic-rich black shales during the Furongian Series,corresponding to organic carbon burial during the SPICE and representing potential prospects for ultra-deep oil and gas *** research should focus on the formation mechanism,reserve scale,and influencing factors of the oceanic DOC reservoirs,as well as their resource and environmental *** is expected that new breakthroughs will be made in the fields of Earth system science and oil and gas exploration.

关键词： Carbon isotope Organic carbon BACE SPICE Dissolved organic carbon Climate change Black shale

同方期刊数据库

Microstructures and mechanical properties of laser-directed energy deposited CrCoNi medium-entropy alloy

在线全文

学校读者我要写书评

暂无评论

Rare Metals 2024年第7期43卷 3286-3300页

作者： Wen-Jie Zhao Chang-Yu Liu Peng-Cheng Che Zhi-Liang Ning Hong-Bo Fan Jian-Fei Sun Yong-Jiang Huang Alfonso H.W.Ngan National Key laboratory for Precision Hot Processing of Metals Harbin Institute of Technology space Environment Simulation research Infrastructure Harbin Institute of Technology Department of Mechanical Engineering The University of Hong Kong

The distinctive intrinsic heat treatment(IHT)originating from cyclic reheating in the laser-directed energy deposition(LDED) has attracted growing attention in recent *** this investigation,simulations and experimental characterizations were performed to examine the impact of IHT on the micros true ture and mechanical properties of LDED-fabricated CrCoNi medium-entropy alloy(MEA).The results show that the intensity of the IHT is proportional to the utilized laser energy density(LED).As the LED increased,significant dynamic recrystallization and grain refinement occurred within the alloy due to the enhanced intensity of ***,the high LED leads to severe hot cracking within the as-built MEA,resulting in inferior *** decreasing LED,the hot cracking was effectively ***,low LED weakened the intensity of IHT and consequently inhibited kinetic conditions of dynamic recrystallization,resulting in a heterogeneous grain structure characterized by multi-scale-sized *** structure provides significant hetero-deformation-induced hardening during plastic deformation,enabling the alloy to have a sustainable work-hardening *** expect that this work will have implications in taking full advantage of the unique IHT of the LDED process to fabricate ME As with excellent metallurgical quality and mechanical performance.

关键词： Intrinsic heat treatment Laser-directed energy deposition CrCoNi MEA Dynamic recrystallization Heterogeneous grain structure