检索结果-南通市图书馆

Robust video question answering via contrastive cross-modality representation learning

science China(Information sciences) 2024年第10期67卷 211-226页

作者： Xun YANG Jianming ZENG Dan GUO Shanshan WANG Jianfeng DONG Meng WANG school of Information science and Technology University of Science and Technology of China Institute of Artificial Intelligence Hefei Comprehensive National Science Center school of computer science and Information engineering Hefei University of Technology Institutes of Physical science and Information Technology Anhui University school of computer science and Technology Zhejiang Gongshang University

Video question answering(VideoQA) is a challenging yet important task that requires a joint understanding of low-level video content and high-level textual semantics. Despite the promising progress of existing efforts, recent studies revealed that current VideoQA models mostly tend to over-rely on the superficial correlations rooted in the dataset bias while overlooking the key video content, thus leading to unreliable results. Effectively understanding and modeling the temporal and semantic characteristics of a given video for robust VideoQA is crucial but, to our knowledge, has not been well investigated. To fill the research gap, we propose a robust VideoQA framework that can effectively model the cross-modality fusion and enforce the model to focus on the temporal and global content of videos when making a QA decision instead of exploiting the shortcuts in datasets. Specifically, we design a self-supervised contrastive learning objective to contrast the positive and negative pairs of multimodal input, where the fused representation of the original multimodal input is enforced to be closer to that of the intervened input based on video perturbation. We expect the fused representation to focus more on the global context of videos rather than some static keyframes. Moreover, we introduce an effective temporal order regularization to enforce the inherent sequential structure of videos for video representation. We also design a Kullback-Leibler divergence-based perturbation invariance regularization of the predicted answer distribution to improve the robustness of the model against temporal content perturbation of videos. Our method is model-agnostic and can be easily compatible with various VideoQA backbones. Extensive experimental results and analyses on several public datasets show the advantage of our method over the state-of-the-art methods in terms of both accuracy and robustness.

关键词： video question answering cross-modality fusion contrastive learning cross-media reasoning

来源：

同方期刊数据库评论

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Numerical simulation for the initial state of avalanche in polydisperse particle systems

引用

Chinese Physics B 2024年第2期33卷 405-412页

作者：韩韧李亭迟志鹏杨晖李然 school of Optical-Electrical and computer engineering University of Shanghai for Science and TechnologyShanghai 200093China

Numerical simulation is employed to investigate the initial state of avalanche in polydisperse particle *** and propagation processes are illustrated for pentadisperse and triadisperse particle systems,*** these processes,particles involved in the avalanche grow slowly in the early stage and explosively in the later stage,which is clearly different from the continuous and steady growth trend in the monodisperse *** examining the avalanche propagation,the number growth of particles involved in the avalanche and the slope of the number growth,the initial state can be divided into three stages:T1(nucleation stage),T2(propagation stage),T3(overall avalanche stage).We focus on the characteristics of the avalanche in the T2 stage,and find that propagation distances increase almost linearly in both axial and radial directions in polydisperse *** also consider the distribution characteristics of the average coordination number and average velocity for the moving *** results support that the polydisperse particle systems are more stable in the T2 stage.

关键词： avalanche initial state polydisperse particle systems propagation

来源：

维普期刊数据库

同方期刊数据库评论

在线全文

学校读者我要写书评

暂无评论

A Pre-Selection-Based Ant Colony System for Integrated Resources Scheduling Problem at Marine Container Terminal

引用

computers, Materials & Continua 2024年第8期80卷 2363-2385页

作者： Rong Wang Xinxin Xu Zijia Wang Fei Ji Nankun Mu school of Electronic and Information engineering South China University of TechnologyGuangzhou510641China school of computer science and Technology Ocean University of ChinaQingdao266100China school of computer science and Cyber engineering Guangzhou UniversityGuangzhou510006China school of computer science Chongqing UniversityChongqing400044China

Marine container terminal(MCT)plays a key role in the marine intelligent transportation system and international logistics ***,the efficiency of resource scheduling significantly influences the operation performance of *** solve the practical resource scheduling problem(RSP)in MCT efficiently,this paper has contributions to both the problem model and the algorithm ***,in the problem model,different from most of the existing studies that only consider scheduling part of the resources in MCT,we propose a unified mathematical model for formulating an integrated *** new integrated RSP model allocates and schedules multiple MCT resources simultaneously by taking the total cost minimization as the ***,in the algorithm design,a pre-selection-based ant colony system(PACS)approach is proposed based on graphic structure solution representation and a pre-selection *** the one hand,as the RSP can be formulated as the shortest path problem on the directed complete graph,the graphic structure is proposed to represent the solution encoding to consider multiple constraints and multiple factors of the RSP,which effectively avoids the generation of infeasible *** the other hand,the pre-selection strategy aims to reduce the computational burden of PACS and to fast obtain a higher-quality *** evaluate the performance of the proposed novel PACS in solving the new integrated RSP model,a set of test cases with different sizes is *** results and comparisons show the effectiveness and efficiency of the PACS algorithm,which can significantly outperform other state-of-the-art algorithms.

关键词： Resource scheduling problem(RSP) ant colony system(ACS) marine container terminal(MCT) pre-selection strategy

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Building a domain-specific compiler for emerging processors with a reusable approach

引用

science China(Information sciences) 2024年第1期67卷 20-38页

作者： Mingzhen LI Yi LIU Bangduo CHEN Hailong YANG Zhongzhi LUAN Depei QIAN State Key Laboratory of Software Development Environment school of computer science and engineering Beihang University

High-performance computing and deep learning domains have been motivating the design of domain-specific *** these processors can provide promising computation capability,they are notorious for exotic programming *** improve programming productivity and fully exploit the performance potential of these processors,domain-specific compilers(DSCs) have been ***,building DSCs for emerging processors requires tremendous engineering efforts because the commonly used compilation stack is difficult to be *** to the advent of multilevel intermediate representation(MLIR),DSC developers can leverage reusable infrastructure to extend their customized functionalities without rebuilding the entire compilation *** this paper,we further demonstrate the effectiveness of MLIR by extending its reusable infrastructure to embrace a heterogeneous many-core processor(Sunway processor).In particular,we design a new Sunway dialect and corresponding backend for the Sunway processor,fully exploiting its architectural advantage and hiding its programming *** show the ease of building a DSC,we leverage the Sunway dialect and existing MLIR dialects to build a stencil compiler for the Sunway *** experimental results show that our stencil compiler,built with a reusable approach,can even perform better than state-of-the-art stencil compilers.

关键词： domain-specific compiler emerging processor reusable dialect performance optimization MLIR

来源：

同方期刊数据库评论

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

Defect engineered nickel hydroxide nanosheets for advanced pseudocapacitor electrodes

引用

Nano Research 2024年第6期17卷 5233-5242页

作者： Yaohang Gu Yuxuan Zhang Xuanyu Wang Ateer Bao Bo Ni Haijun Pan Xiaoyan Zhang Xiwei Qi school of Materials science and engineering Northeastern UniversityShenyang 110189China College of Metallurgy and Energy North China University of Science and TechnologyTangshan 063210China Key Laboratory of Dielectric and Electrolyte Functional Material Hebei Province School of Resources and MaterialsNortheastern University at QinhuangdaoQinhuangdao 066004China school of Resources and Materials Northeastern University at QinhuangdaoQinhuangdao 066004China

While the past years have witnessed great achievement in pseudocapacitors,the inauguration of electrode materials of high-performance still remains a formidable ***,the capacity and rate capability of the electrode depends largely on its electrical conductivity,which ensures fast charge transfer kinetics in both the grain bulk and grain ***,nickel hydroxides with oxygen vacancies are facilely fabricated via a hydrothermal *** active materials exhibit a high specific capacitance of 3250 F·g^(−1)and a high areal of capacitance of 14.98 F·cm^(−2)at 4.6 mA·cm^(−2).The asymmetric supercapacitor device based on our material delivers a high energy density of~71.6 Wh·kg^(−1)and a power density of~17,300 W·kg^(−1)and could retain~95%of their initial capacitance even after 30,000 *** addition,the defect-rich hydroxides demonstrate higher electrical conductivity as well as dielectric constant,which is responsible for the superior pseudocapacitive *** new scientific strategy in terms of taking the advantages of oxygen vacancies might open up new opportunities for qualified pseudocapacitive materials of overall high performances not only for nickel hydroxides but also for other metal hydroxides/oxides.

关键词： pseudocapacitors nickel hydroxides oxygen vacancies electrical conductivity

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Japanese Sign Language Recognition by Combining Joint Skeleton-Based Handcrafted and Pixel-Based Deep Learning Features with Machine Learning Classification

引用

computer Modeling in engineering & sciences 2024年第6期139卷 2605-2625页

作者： Jungpil Shin Md.Al Mehedi Hasan Abu Saleh Musa Miah Kota Suzuki Koki Hirooka school of computer science and engineering The University of AizuAizuwakamatsu965-8580Japan Department of computer science&engineering Rajshahi University of Engineering&TechnologyRajshahi6204Bangladesh

Sign language recognition is vital for enhancing communication accessibility among the Deaf and hard-of-hearing *** Japan,approximately 360,000 individualswith hearing and speech disabilities rely on Japanese Sign Language(JSL)for ***,existing JSL recognition systems have faced significant performance limitations due to inherent *** response to these challenges,we present a novel JSL recognition system that employs a strategic fusion approach,combining joint skeleton-based handcrafted features and pixel-based deep learning *** system incorporates two distinct streams:the first stream extracts crucial handcrafted features,emphasizing the capture of hand and body movements within JSL ***,a deep learning-based transfer learning stream captures hierarchical representations of JSL gestures in the second ***,we concatenated the critical information of the first stream and the hierarchy of the second stream features to produce the multiple levels of the fusion features,aiming to create a comprehensive representation of the JSL *** reducing the dimensionality of the feature,a feature selection approach and a kernel-based support vector machine(SVM)were used for the *** assess the effectiveness of our approach,we conducted extensive experiments on our Lab JSL dataset and a publicly available Arabic sign language(ArSL)*** results unequivocally demonstrate that our fusion approach significantly enhances JSL recognition accuracy and robustness compared to individual feature sets or traditional recognition methods.

关键词： Japanese Sign Language(JSL) hand gesture recognition geometric feature distance feature angle feature GoogleNet

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Recommendation Method for Contrastive Enhancement of Neighborhood Information

引用

computers, Materials & Continua 2024年第1期78卷 453-472页

作者： Hairong Wang Beijing Zhou Lisi Zhang He Ma school of computer science and engineering North Minzu UniversityNingxia750021China

Knowledge graph can assist in improving recommendation performance and is widely applied in various person-alized recommendation ***,existing knowledge-aware recommendation methods face challenges such as weak user-item interaction supervisory signals and noise in the knowledge *** tackle these issues,this paper proposes a neighbor information contrast-enhanced recommendation method by adding subtle noise to construct contrast views and employing contrastive learning to strengthen supervisory signals and reduce knowledge ***,first,this paper adopts heterogeneous propagation and knowledge-aware attention networks to obtain multi-order neighbor embedding of users and items,mining the high-order neighbor informa-tion of users and ***,in the neighbor information,this paper introduces weak noise following a uniform distribution to construct neighbor contrast views,effectively reducing the time overhead of view *** paper then performs contrastive learning between neighbor views to promote the uniformity of view information,adjusting the neighbor structure,and achieving the goal of reducing the knowledge noise in the knowledge ***,this paper introduces multi-task learning to mitigate the problem of weak supervisory *** validate the effectiveness of our method,experiments are conducted on theMovieLens-1M,MovieLens-20M,Book-Crossing,and Last-FM *** results showthat compared to the best baselines,our method shows significant improvements in AUC and F1.

关键词： Contrastive learning knowledge graph recommendation method

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

CALTM:A Context-Aware Long-Term Time-Series Forecasting Model

引用

computer Modeling in engineering & sciences 2024年第4期139卷 873-891页

作者： Canghong Jin Jiapeng Chen Shuyu Wu Hao Wu Shuoping Wang Jing Ying school of computer and Computing science Hangzhou City UniversityHangzhou310015China school of computer science and engineering Macao University of Science and TechnologyMacao999078China College of computer science and Technology Zhejiang UniversityHangzhou310058China

Time series data plays a crucial role in intelligent transportation *** flow forecasting represents a precise estimation of future traffic flow within a specific region and time *** approaches,including sequence periodic,regression,and deep learning models,have shown promising results in short-term series ***,forecasting scenarios specifically focused on holiday traffic flow present unique challenges,such as distinct traffic patterns during vacations and the increased demand for long-term ***,the effectiveness of existing methods diminishes in such ***,we propose a novel longterm forecasting model based on scene matching and embedding fusion representation to forecast long-term holiday traffic *** model comprises three components:the similar scene matching module,responsible for extracting Similar Scene Features;the long-short term representation fusion module,which integrates scenario embeddings;and a simple fully connected layer at the head for making the final *** results on real datasets demonstrate that our model outperforms other methods,particularly in medium and long-term forecasting scenarios.

关键词： Traffic volume forecasting scene matching multi module fusion

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

A Gaussian Noise-Based Algorithm for Enhancing Backdoor Attacks

引用

computers, Materials & Continua 2024年第7期80卷 361-387页

作者： Hong Huang Yunfei Wang Guotao Yuan Xin Li school of computer science and engineering Sichuan University of Science&EngineeringYibin644000China

Deep Neural Networks(DNNs)are integral to various aspects of modern life,enhancing work ***-less,their susceptibility to diverse attack methods,including backdoor attacks,raises security *** aim to investigate backdoor attack methods for image categorization tasks,to promote the development of DNN towards higher *** on backdoor attacks currently faces significant challenges due to the distinct and abnormal data patterns of malicious samples,and the meticulous data screening by developers,hindering practical attack *** overcome these challenges,this study proposes a Gaussian Noise-Targeted Universal Adversarial Perturbation(GN-TUAP)*** approach restricts the direction of perturbations and normalizes abnormal pixel values,ensuring that perturbations progress as much as possible in a direction perpendicular to the decision hyperplane in linear *** limits anomalies within the perturbations improves their visual stealthiness,and makes them more challenging for defense methods to *** verify the effectiveness,stealthiness,and robustness of GN-TUAP,we proposed a comprehensive threat *** on this model,extensive experiments were conducted using the CIFAR-10,CIFAR-100,GTSRB,and MNIST datasets,comparing our method with existing state-of-the-art attack *** also tested our perturbation triggers using various defense methods and further experimented on the robustness of the triggers against noise filtering *** experimental outcomes demonstrate that backdoor attacks leveraging perturbations generated via our algorithm exhibit cross-model attack effectiveness and superior ***,they possess robust anti-detection capabilities and maintain commendable performance when subjected to noise-filtering methods.

关键词： Image classification model backdoor attack gaussian distribution Artificial Intelligence(AI)security

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

A Transfer Function Design for Medical Volume Data Using a Knowledge Database Based on Deep Image and Primitive Intensity Profile Features Retrieval

引用

Journal of computer science & Technology 2024年第2期39卷 320-335页

作者： Younhyun Jung Jim Kong 盛斌 Jinman Kim school of Computing Gachon UniversitySeongnam 13120Korea school of computer science The University of SydneySydney 2006Australia Department of computer science and engineering Shanghai Jiao Tong UniversityShanghai 200240China

Direct volume rendering(DVR)is a technique that emphasizes structures of interest(SOIs)within a volume visually,while simultaneously depicting adjacent regional information,e.g.,the spatial location of a structure concerning its *** DVR,transfer function(TF)plays a key role by enabling accurate identification of SOIs interactively as well as ensuring appropriate visibility of *** generation typically involves non-intuitive trial-and-error optimization of rendering parameters,which is time-consuming and *** at mitigating this manual process have led to approaches that make use of a knowledge database consisting of pre-designed TFs by domain *** these approaches,a user navigates the knowledge database to find the most suitable pre-designed TF for their input volume to visualize the *** these approaches potentially reduce the workload to generate the TFs,they,however,require manual TF navigation of the knowledge database,as well as the likely fine tuning of the selected TF to suit the *** this work,we propose a TF design approach,CBR-TF,where we introduce a new content-based retrieval(CBR)method to automatically navigate the knowledge *** of pre-designed TFs,our knowledge database contains volumes with SOI *** an input volume,our CBR-TF approach retrieves relevant volumes(with SOI labels)from the knowledge database;the retrieved labels are then used to generate and optimize TFs of the *** approach largely reduces manual TF navigation and fine *** our CBR-TF approach,we introduce a novel volumetric image feature which includes both a local primitive intensity profile along the SOIs and regional spatial semantics available from the co-planar images to the *** the regional spatial semantics,we adopt a convolutional neural network to obtain high-level image feature *** the intensity profile,we extend the dynamic time warping technique to address subtle alignment

关键词： data retrieval direct volume rendering ray analysis transfer function

来源：

维普期刊数据库评论

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

欢迎您,

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案：

请选择收藏分类：

通借通还

欢迎您,

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

在线全文

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：