检索结果-南通市图书馆

维普期刊数据库

A Comprehensive Pipeline for Complex Text-to-image synthesis

在线全文

学校读者我要写书评

暂无评论

Journal of Computer Science & Technology 2020年第3期35卷 522-537页

作者： Fei Fang Fei Luo Hong-Pan Zhang Hua-Jian Zhou Alix L.H.Chow Chun-Xia Xiao School of Computer Science Wuhan UniversityWuhan 430072China Xiaomi Technology Co.LTD Beijing 100085China

Synthesizing a complex scene image with multiple objects and background according to text description is a challenging problem.It needs to solve several difficult tasks across the fields of natural language processing and computer vision.We model it as a combination of semantic entity recognition,object retrieval and recombination,and objects’status optimization.To reach a satisfactory result,we propose a comprehensive pipeline to convert the input text to its visual counterpart.The pipeline includes text processing,foreground objects and background scene retrieval,image synthesis using constrained MCMC,and post-processing.Firstly,we roughly divide the objects parsed from the input text into foreground objects and background scenes.Secondly,we retrieve the required foreground objects from the foreground object dataset segmented from Microsoft COCO dataset,and retrieve an appropriate background scene image from the background image dataset extracted from the Internet.Thirdly,in order to ensure the rationality of foreground objects’positions and sizes in the image synthesis step,we design a cost function and use the Markov Chain Monte Carlo(MCMC)method as the optimizer to solve this constrained layout problem.Finally,to make the image look natural and harmonious,we further use Poisson-based and relighting-based methods to blend foreground objects and background scene image in the post-processing step.The synthesized results and comparison results based on Microsoft COCO dataset prove that our method outperforms some of the state-of-the-art methods based on generative adversarial networks(GANs)in visual quality of generated scene images.

关键词： image synthesis scene generation text-to-image conversion Markov Chain Monte Carlo(MCMC)

A Survey of GAN Based image synthesis

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Journal of Information Hiding and Privacy Protection 2022年第2期4卷 79-88页

作者： Jiahe Ni Engineering Research Center of Digital Forensics of Ministry of Education School of ComputerNanjing University of Information Science&TechnologyNanjing210044China

image generation is a hot topic in the academic recently,and has been applied to AI drawing,which can bring Vivid AI paintings without labor costs.In image generation,we represent the image as a random vector,assuming that the images of the natural scene obey an unknown distribution,we hope to estimate its distribution through some observation samples.Especially,with the development of GAN(Generative Adversarial Network),The generator and discriminator improve the model capability through adversarial,the quality of the generated image is also increasing.The image quality generated by the existing GAN based image generation model is so well-paint that it can be passed for genuine one.Based on the brief introduction of the concept ofGAN,this paper analyzes themain ideas of image synthesis,studies the representative SOTA GAN based image synthesis method.

关键词： Deep learning image synthesis SOTA generative adversarial network

Transformers in medical image analysis

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Intelligent Medicine 2023年第1期3卷 59-78页

作者： Kelei He Chen Gan Zhuoyuan Li Islem Rekik Zihao Yin Wen Ji Yang Gao Qian Wang Junfeng Zhang Dinggang Shen Medical School of Nanjing University NanjingJiangsu 210093China National Institute of Healthcare Data Science at Nanjing University NanjingJiangsu 210093China BASIRA Laboratory Faculty of Computer and Informatics EngineeringIstanbul Technical UniversityIstanbulTurkey School of Science and Engineering ComputingUniversity of DundeeUK State Key Laboratory for Novel Software Technology Nanjing UniversityNanjingJiangsu 210093China School of Biomedical Engineering ShanghaiTech UniversityShanghai 201210China Department of Research and Development Shanghai United Imaging Intelligence Co.Ltd.Shanghai 200030China Shanghai Clinical Research and Trial Center Shanghai 201703China

Transformers have dominated the field of natural language processing and have recently made an impact in the area of computer vision.In the field of medical image analysis,transformers have also been successfully used in to full-stack clinical applications,including image synthesis/reconstruction,registration,segmentation,detection,and diagnosis.This paper aimed to promote awareness of the applications of transformers in medical image analysis.Specifically,we first provided an overview of the core concepts of the attention mechanism built into transformers and other basic components.Second,we reviewed various transformer architectures tailored for medical image applications and discuss their limitations.Within this review,we investigated key challenges including the use of transformers in different learning paradigms,improving model efficiency,and coupling with other techniques.We hope this review would provide a comprehensive picture of transformers to readers with an interest in medical image analysis.

关键词： Transformer Medical image analysis Deep learning Diagnosis Registration Segmentation image synthesis Multi-task learning Multi-modal learning Weakly-supervised learning

Tight Sandstone image Augmentation for image Identification Using Deep Learning

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

Computer Systems Science & Engineering 2023年第10期47卷 1209-1231页

作者： Dongsheng Li Chunsheng Li Kejia Zhang Tao Liu Fang Liu Jingsong Yin Mingyue Liao School of Computer&Information Technology Northeast Petroleum UniversityDaqing163318China

Intelligent identification of sandstone slice images using deep learning technology is the development trend of mineral identification,and accurate mineral particle segmentation is the most critical step for intelligent identification.A typical identification model requires many training samples to learn as many distinguishable features as possible.However,limited by the difficulty of data acquisition,the high cost of labeling,and privacy protection,this has led to a sparse sample number and cannot meet the training requirements of deep learning image identification models.In order to increase the number of samples and improve the training effect of deep learning models,this paper proposes a tight sandstone image data augmentation method by combining the advantages of the data deformation method and the data oversampling method in the Putaohua reservoir in the Sanzhao Sag of the Songliao Basin as the target area.First,the Style Generative Adversarial Network(StyleGAN)is improved to generate high-resolution tight sandstone images to improve data diversity.Second,we improve the Automatic Data Augmentation(AutoAugment)algorithm to search for the optimal augmentation strategy to expand the data scale.Finally,we design comparison experiments to demonstrate that this method has obvious advantages in generating image quality and improving the identification effect of deep learning models in real application scenarios.

关键词： Tight sandstone image synthesis generative adversarial networks data augmentation image segmentation

Evolution and Effectiveness of Loss Functions in Generative Adversarial Networks

在线全文

维普期刊数据库

学校读者我要写书评

暂无评论

China Communications 2021年第10期18卷 45-76页

作者： Ali Syed Saqlain Fang Fang Tanvir Ahmad Liyun Wang Zain-ul Abidin School of Control and Computer Engineering North China Electric Power UniversityBeijing 102206China Department of Computer Science Portland State UniversityPortland 97207U.S. School of Information and Communication Engineering South West Jiaotong UniversityChengdu 610031China

Recently,the evolution of Generative Adversarial Networks(GANs)has embarked on a journey of revolutionizing the field of artificial and computational intelligence.To improve the generating ability of GANs,various loss functions are introduced to measure the degree of similarity between the samples generated by the generator and the real data samples,and the effectiveness of the loss functions in improving the generating ability of GANs.In this paper,we present a detailed survey for the loss functions used in GANs,and provide a critical analysis on the pros and cons of these loss functions.First,the basic theory of GANs along with the training mechanism are introduced.Then,the most commonly used loss functions in GANs are introduced and analyzed.Third,the experimental analyses and comparison of these loss functions are presented in different GAN architectures.Finally,several suggestions on choosing suitable loss functions for image synthesis tasks are given.

关键词： loss functions deep learning machine learning unsupervised learning generative adversarial networks(GANs) image synthesis

维普期刊数据库

A survey of the state-of-the-art in patch-based synthesis

在线全文

学校读者我要写书评

暂无评论

Computational Visual Media 2017年第1期3卷 3-20页

作者： Connelly Barnes Fang-Lue Zhang University of Virginia TNList Tsinghua University

This paper surveys the state-of-the-art of research in patch-based synthesis. Patch-based methods synthesize output images by copying small regions from exemplar imagery. This line of research originated from an area called "texture synthesis", which focused on creating regular or semi-regular textures from small exemplars. However, more recently, much research has focused on synthesis of larger and more diverse imagery, such as photos, photo collections, videos, and light fields. Additionally, recent research has focused on customizing the synthesis process for particular problem domains, such as synthesizing artistic or decorative brushes, synthesis of rich materials, and synthesis for 3D fabrication. This report investigates recent papers that follow these themes, with a particular emphasis on papers published since 2009,when the last survey in this area was published. This survey can serve as a tutorial for readers who are not yet familiar with these topics, as well as provide comparisons between these papers, and highlight some open problems in this area.

关键词： texture patch image synthesis texture synthesis

维普期刊数据库

Face-sketch learning with human sketch-drawing order enforcement

在线全文

学校读者我要写书评

暂无评论

Science China(Information Sciences) 2020年第11期63卷 298-311页

作者： Liang CHANG Lihua JIN Lifen WENG Wentao CHAO Xuguang WANG Xiaoming DENG Qiulei DONG School of Artificial Intelligence Beijing Normal University Department of Design Art Xiamen University of Technology Department of Automation North China Electric Power University Beijing Key Laboratory of Human Computer Interactions Institute of Software Chinese Academy of Sciences National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences School of Artificial Intelligence University of Chinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology Chinese Academy of Sciences

Dear editor,Although face-sketch synthesis generates a sketch from a given face photo automatically [1], it is an open research problem in computer vision [2–4]. Recently, several deep neural network (DNN)methods for... 详细信息

关键词： face sketch synthesis deep neural network order enforcement image synthesis generative adversarial network

MsCGAN:Multi-scale Conditional Generative Adversarial Networks for Person image Generation

在线全文

同方期刊数据库

学校读者我要写书评

暂无评论

MsCGAN:Multi-scale Conditional Generative Adversarial Networ...