Skip to content

anhtr-nguyn/Awesome-Diffusion-Models

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome License: MIT Made With Love

This repository contains a collection of resources and papers on Diffusion Models.

Contents

Resources

Introductory Posts

⏩ DiffusionFastForward: 01-Diffusion-Theory
Mikolaj Czerkawski (@mikonvergence)
[Website]
4 Feb 2023

How diffusion models work: the math from scratch
Sergios Karagiannakos,Nikolas Adaloglou
[Website]
24 Sep 2022

A Path to the Variational Diffusion Loss
Alex Alemi
[Website] [Colab]
15 Sep 2022

The Annotated Diffusion Model
Niels Rogge, Kashif Rasul
[Website]
06 Jun 2022

The recent rise of diffusion-based models
Maciej Domagała
[Website]
06 Jun 2022

Introduction to Diffusion Models for Machine Learning
Ryan O'Connor
[Website]
12 May 2022

Improving Diffusion Models as an Alternative To GANs
Arash Vahdat and Karsten Kreis
[Website-Part 1] [Website-Part 2]
26 Apr 2022

An introduction to Diffusion Probabilistic Models
Ayan Das
[Website]
04 Dec 2021

Introduction to deep generative modeling: Diffusion-based Deep Generative Models
Jakub Tomczak
[Website]
30 Aug 2021

What are Diffusion Models?
Lilian Weng
[Website]
11 Jul 2021

Diffusion Models as a kind of VAE
Angus Turner
[Website]
29 Jun 2021

Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song
[Website]
5 May 2021

Introductory Papers

Understanding Diffusion Models: A Unified Perspective
Calvin Luo
arXiv 2022. [Paper]
25 Aug 2022

How to Train Your Energy-Based Models
Yang Song, Diederik P. Kingma
arXiv 2022. [Paper]
9 Jan 2021

Introductory Videos

⏩ DiffusionFastForward
Mikolaj Czerkawski (@mikonvergence)
[Video]
4 Mar 2023

Diffusion models from scratch in PyTorch
DeepFindr
[Video]
18 Jul 2022

Diffusion Models | Paper Explanation | Math Explained
Outlier
[Video]
6 Jun 2022

What are Diffusion Models?
Ari Seff
[Video]
20 Apr 2022

Diffusion models explained
AI Coffee Break with Letitia
[Video]
23 Mar 2022

Introductory Lectures

Denoising Diffusion-based Generative Modeling: Foundations and Applications
Karsten Kreis, Ruiqi Gao, Arash Vahdat
[Page]
19 Jun 2022

Diffusion Probabilistic Models
Jascha Sohl-Dickstein, MIT 6.S192 - Lecture 22
[Video]
19 Apr 2022

Tutorial and Jupyter Notebook

⏩ DiffusionFastForward: train from scratch in colab
Mikolaj Czerkawski (@mikonvergence)
[Github] [notebook]

diffusion-for-beginners
ozanciga
[Github]

Beyond Diffusion: What is Personalized Image Generation and How Can You Customize Image Synthesis?
J. Rafid Siddiqui
[Github] [Medium]

Diffusion_models_tutorial
FilippoMB
[Github]

ScoreDiffusionModel
JeongJiHeon
[Github]

Minimal implementation of diffusion models
VSehwag
[Github]

diffusion_tutorial
sunlin-ai
[Github]

Denoising diffusion probabilistic models
acids-ircam
[Github]

Centipede Diffusion
Zalring
[Notebook]

Deforum Stable Diffusion
deforum
[Notebook]

Stable Diffusion Interpolation
None
[Notebook]

Keras Stable Diffusion: GPU starter example
None
[Notebook]

Huemin Jax Diffusion
huemin-art
[Notebook]

Disco Diffusion
alembics
[Notebook]

Simplified Disco Diffusion
entmike
[Notebook]

WAS's Disco Diffusion - Portrait Generator Playground
WASasquatch
[Notebook]

Diffusers - Hugging Face
huggingface
[Notebook]

Papers

Survey

A Comprehensive Survey on Knowledge Distillation of Diffusion Models
Weijian Luo
arXiv 2023. [Paper]
9 Apr 2023

A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material
Mengchun Zhang1, Maryam Qamar1, Taegoo Kang, Yuna Jung, Chenshuang Zhang, Sung-Ho Bae, Chaoning Zhang
arXiv 2023. [Paper]
4 Apr 2023

Audio Diffusion Model for Speech Synthesis: A Survey on Text To Speech and Speech Enhancement in Generative AI
Chenshuang Zhang, Chaoning Zhang, Sheng Zheng, Mengchun Zhang, Maryam Qamar, Sung-Ho Bae, In So Kweon
arXiv 2023. [Paper]
23 Mar 2023

Diffusion Models in NLP: A Survey
Yuansong Zhu, Yu Zhao
arXiv 2023. [Paper]
14 Mar 2023

Text-to-image Diffusion Model in Generative AI: A Survey
Chenshuang Zhang, Chaoning Zhang, Mengchun Zhang, In So Kweon
arXiv 2023. [Paper]
14 Mar 2023

Diffusion Models for Non-autoregressive Text Generation: A Survey
Yifan Li, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen
arXiv 2023. [Paper]
12 Mar 2023

Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Action
Zhiye Guo, Jian Liu, Yanli Wang, Mengrui Chen, Duolin Wang, Dong Xu, Jianlin Cheng
arXiv 2023. [Paper]
13 Feb 2023

Generative Diffusion Models on Graphs: Methods and Applications
Wenqi Fan, Chengyi Liu, Yunqing Liu, Jiatong Li, Hang Li, Hui Liu, Jiliang Tang, Qing Li
arXiv 2023. [Paper]
6 Feb 2023

Diffusion Models for Medical Image Analysis: A Comprehensive Survey
Amirhossein Kazerouni, Ehsan Khodapanah Aghdam, Moein Heidari, Reza Azad, Mohsen Fayyaz, Ilker Hacihaliloglu, Dorit Merhof
arXiv 2022. [Paper] [Github]
14 Nov 2022

Efficient Diffusion Models for Vision: A Survey
Anwaar Ulhaq, Naveed Akhtar, Ganna Pogrebna
arXiv 2022. [Paper]
7 Oct 2022

Diffusion Models in Vision: A Survey
Florinel-Alin Croitoru, Vlad Hondru, Radu Tudor Ionescu, Mubarak Shah
arXiv 2022. [Paper]
10 Sep 2022

A Survey on Generative Diffusion Model
Hanqun Cao, Cheng Tan, Zhangyang Gao, Guangyong Chen, Pheng-Ann Heng, Stan Z. Li
arXiv 2022. [Paper]
6 Sep 2022

Diffusion Models: A Comprehensive Survey of Methods and Applications
Ling Yang1, Zhilong Zhang1, Shenda Hong, Wentao Zhang
arXiv 2022. [Paper]
2 Sep 2022

Vision

Generation

DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning
Enze Xie, Lewei Yao, Han Shi, Zhili Liu, Daquan Zhou, Zhaoqiang Liu, Jiawei Li, Zhenguo Li
arXiv 2023. [Paper]
13 Apr 2023

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion
Johanna Karras, Aleksander Holynski, Ting-Chun Wang, Ira Kemelmacher-Shlizerman
arXiv 2023. [Paper] [Project] [Github]
12 Apr 2023

Reflected Diffusion Models
Aaron Lou, Stefano Ermon
arXiv 2023. [Paper]
10 Apr 2023

Binary Latent Diffusion
Ze Wang, Jiang Wang, Zicheng Liu, Qiang Qiu
arXiv 2023. [Paper]
10 Apr 2023

Diffusion Models as Masked Autoencoders
Chen Wei, Karttikeya Mangalam, Po-Yao Huang, Yanghao Li, Haoqi Fan, Hu Xu, Huiyu Wang, Cihang Xie, Alan Yuille, Christoph Feichtenhofer
arXiv 2023. [Paper] [Project]
6 Apr 2023

Few-shot Semantic Image Synthesis with Class Affinity Transfer
Marlène Careil, Jakob Verbeek, Stéphane Lathuilière
CVPR 2023. [Paper]
5 Apr 2023

EGC: Image Generation and Classification via a Diffusion Energy-Based Model
Qiushan Guo, Chuofan Ma, Yi Jiang, Zehuan Yuan, Yizhou Yu, Ping Luo
arxiv 2023. [Paper] [Project]
4 Apr 2023

Token Merging for Fast Stable Diffusion
Daniel Bolya, Judy Hoffman
arXiv 2023. [Paper] [Github]
30 Mar 2023

A Closer Look at Parameter-Efficient Tuning in Diffusion Models
Chendong Xiang, Fan Bao, Chongxuan Li, Hang Su, Jun Zhu
arXiv 2023. [Paper]
31 Mar 2023

-Diff: Infinite Resolution Diffusion with Subsampled Mollified States
Sam Bond-Taylor, Chris G. Willcocks
arXiv 2023. [Paper]
31 Mar 2023

3D-aware Image Generation using 2D Diffusion Models
Jianfeng Xiang, Jiaolong Yang, Binbin Huang, Xin Tong
arXiv 2023. [Paper] [Project]
31 Mar 2023

Consistent View Synthesis with Pose-Guided Diffusion Models
Hung-Yu Tseng, Qinbo Li, Changil Kim, Suhib Alsisan, Jia-Bin Huang, Johannes Kopf
CVPR 2023. [Paper]
30 Mar 2023

DiffCollage: Parallel Generation of Large Content with Diffusion Models
Qinsheng Zhang, Jiaming Song, Xun Huang, Yongxin Chen, Ming-Yu Liu
CVPR 2023. [Paper] [Project]
30 Mar 2023

Masked Diffusion Transformer is a Strong Image Synthesizer
Shanghua Gao, Pan Zhou, Ming-Ming Cheng, Shuicheng Yan
arXiv 2023. [Paper] [Github]
25 Mar 2023

Conditional Image-to-Video Generation with Latent Flow Diffusion Models
Haomiao Ni1, Changhao Shi1, Kai Li, Sharon X. Huang, Martin Renqiang Min
CVPR 2023. [Paper] [Github]
24 Mar 2023

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Gong Ming, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
arXiv 2023. [Paper] [Project]
22 Mar 2023

Object-Centric Slot Diffusion
Jindong Jiang, Fei Deng, Gautam Singh, Sungjin Ahn
arXiv 2023. [Paper]
20 Mar 2023

LDMVFI: Video Frame Interpolation with Latent Diffusion Models
Duolikun Danier, Fan Zhang, David Bull
arXiv 2023. [Paper]
16 Mar 2023

Efficient Diffusion Training via Min-SNR Weighting Strategy
Tiankai Hang, Shuyang Gu, Chen Li, Jianmin Bao, Dong Chen, Han Hu, Xin Geng, Baining Guo
arXiv 2023. [Paper]
16 Mar 2023

VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation
CVPR 2023. [Paper]
15 Mar 2023

Interpretable ODE-style Generative Diffusion Model via Force Field Construction
Weiyang Jin, Yongpei Zhu, Yuxi Peng
arXiv 2023. [Paper]
14 Mar 2023

Regularized Vector Quantization for Tokenized Image Synthesis
Jiahui Zhang, Fangneng Zhan, Christian Theobalt, Shijian Lu
arXiv 2023. [Paper]
11 Mar 2023

PARASOL: Parametric Style Control for Diffusion Image Synthesis
Gemma Canet Tarrés, Dan Ruta, Tu Bui, John Collomosse
arXiv 2023. [Paper]
11 Mar 2023

Brain-Diffuser: Natural scene reconstruction from fMRI signals using generative latent diffusion
Furkan Ozcelik, Rufin VanRullen
arXiv 2023. [Paper]
9 Mar 2023

Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation
Paul Hagemann, Lars Ruthotto, Gabriele Steidl, Nicole Tianjiao Yang
arXiv 2023. [Paper]
8 Mar 2023

TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillation
David Berthelot, Arnaud Autef, Jierui Lin, Dian Ang Yap, Shuangfei Zhai, Siyuan Hu, Daniel Zheng, Walter Talbott, Eric Gu
arXiv 2023. [Paper]
7 Mar 2023

Generative Diffusions in Augmented Spaces: A Complete Recipe
Kushagra Pandey, Stephan Mandt
arXiv 2023. [Paper]
3 Mar 2023

Consistency Models
Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever
arXiv 2023. [Paper]
2 Mar 2023

Diffusion Probabilistic Fields
Peiye Zhuang, Samira Abnar, Jiatao Gu, Alex Schwing, Joshua M. Susskind, Miguel Ángel Bautista
ICLR 2023. [Paper]
1 Mar 2023

Unsupervised Discovery of Semantic Latent Directions in Diffusion Models
Yong-Hyun Park1, Mingi Kwon1, Junghyo Jo, Youngjung Uh
arXiv 2023. [Paper]
24 Feb 2023

Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC
Yilun Du, Conor Durkan, Robin Strudel, Joshua B. Tenenbaum, Sander Dieleman, Rob Fergus, Jascha Sohl-Dickstein, Arnaud Doucet, Will Grathwohl
arXiv 2023. [Paper] [Project]
22 Feb 2023

Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
Xiaodong Wang1, Chenfei Wu1, Shengming Yin, Minheng Ni, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Fan Yang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
arXiv 2023. [Paper]
21 Feb 2023

On Calibrating Diffusion Probabilistic Models
Tianyu Pang, Cheng Lu, Chao Du, Min Lin, Shuicheng Yan, Zhijie Deng
arXiv 2023. [Paper] [Github]
21 Feb 2023

Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels
Zebin You, Yong Zhong, Fan Bao, Jiacheng Sun, Chongxuan Li, Jun Zhu
arXiv 2023. [Paper]
21 Feb 2023

Cross-domain Compositing with Pretrained Diffusion Models
Roy Hachnochi, Mingrui Zhao, Nadav Orzech, Rinon Gal, Ali Mahdavi-Amiri, Daniel Cohen-Or, Amit Haim Bermano
arXiv 2023. [Paper] [Github]
20 Feb 2023

Restoration based Generative Models
Jaemoo Choi1, Yesom Park1, Myungjoo Kang
arXiv 2023. [Paper]
20 Feb 2023

Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistent
Giannis Daras1, Yuval Dagan1, Alexandros G. Dimakis, Constantinos Daskalakis
arXiv 2023. [Paper] [Github]
17 Feb 2023

LayoutDiffuse: Adapting Foundational Diffusion Models for Layout-to-Image Generation
Jiaxin Cheng1, Xiao Liang1, Xingjian Shi, Tong He, Tianjun Xiao, Mu Li
arXiv 2023. [Paper]
16 Feb 2023

Video Probabilistic Diffusion Models in Projected Latent Space
Sihyun Yu, Kihyuk Sohn, Subin Kim, Jinwoo Shin
arXiv 2023. [Paper] [Github]
15 Feb 2023

DiffFaceSketch: High-Fidelity Face Image Synthesis with Sketch-Guided Latent Diffusion Model
Yichen Peng, Chunqi Zhao, Haoran Xie, Tsukasa Fukusato, Kazunori Miyata
arXiv 2023. [Paper]
14 Feb 2023

Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions
Raghav Singhal1, Mark Goldstein1, Rajesh Ranganath
arXiv 2023. [Paper]
14 Feb 2023

Preconditioned Score-based Generative Models
Li Zhang, Hengyuan Ma, Xiatian Zhu, Jianfeng Feng
arXiv 2023. [Paper] Github]
13 Feb 2023

Star-Shaped Denoising Diffusion Probabilistic Models
Andrey Okhotin, Dmitry Molchanov, Vladimir Arkhipkin, Grigory Bartosh, Aibek Alanov, Dmitry Vetrov
arXiv 2023. [Paper]
10 Feb 2023

UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models
Wenliang Zhao, Lujia Bai, Yongming Rao, Jie Zhou, Jiwen Lu
arXiv 2023. [Paper] [Project] [Github]
9 Feb 2023

Geometry of Score Based Generative Models
Sandesh Ghimire, Jinyang Liu, Armand Comas, Davin Hill, Aria Masoomi, Octavia Camps, Jennifer Dy
arXiv 2023. [Paper]
9 Feb 2023

Q-Diffusion: Quantizing Diffusion Models
Xiuyu Li, Long Lian, Yijiang Liu, Huanrui Yang, Zhen Dong, Daniel Kang, Shanghang Zhang, Kurt Keutzer
arXiv 2023. [Paper]
8 Feb 2023

PFGM++: Unlocking the Potential of Physics-Inspired Generative Models
Yilun Xu, Ziming Liu, Yonglong Tian, Shangyuan Tong, Max Tegmark, Tommi Jaakkola
arXiv 2023. [Paper] [Github]
8 Feb 2023

Long Horizon Temperature Scaling
Andy Shih, Dorsa Sadigh, Stefano Ermon
arXiv 2023. [Paper]
7 Feb 2023

Spatial Functa: Scaling Functa to ImageNet Classification and Generation
Matthias Bauer1, Emilien Dupont, Andy Brock, Dan Rosenbaum, Jonathan Schwarz, Hyunjik Kim1
arXiv 2023. [Paper]
6 Feb 2023

ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories
Zijian Zhang, Zhou Zhao, Jun Yu, Qi Tian
AAAI 2023. [Paper]
5 Feb 2023

Divide and Compose with Score Based Generative Models
Sandesh Ghimire, Armand Comas, Davin Hill, Aria Masoomi, Octavia Camps, Jennifer Dy
arXiv 2023. [Paper] [Github]
5 Feb 2023

Stable Target Field for Reduced Variance Score Estimation in Diffusion Models
Yilun Xu1, Shangyuan Tong1, Tommi Jaakkola
ICLR 2023. [Paper] [Github]
1 Feb 2023

DisDiff: Unsupervised Disentanglement of Diffusion Probabilistic Models
Tao Yang, Yuwang Wang, Yan Lv, Nanning Zheng
arXiv 2023. [Paper]
31 Jan 2023

Optimizing DDPM Sampling with Shortcut Fine-Tuning
Ying Fan, Kangwook Lee
arXiv 2023. [Paper]
31 Jan 2023

Learning Data Representations with Joint Diffusion Models
Kamil Deja, Tomasz Trzcinski, Jakub M. Tomczak
arXiv 2023. [Paper]
31 Jan 2023

ERA-Solver: Error-Robust Adams Solver for Fast Sampling of Diffusion Probabilistic Models
Shengmeng Li, Luping Liu, Zenghao Chai, Runnan Li, Xu Tan
arXiv 2023. [Paper]
30 Jan 2023

Don't Play Favorites: Minority Guidance for Diffusion Models
Soobin Um, Jong Chul Ye
arXiv 2023. [Paper] [Github]
29 Jan 2023

Accelerating Guided Diffusion Sampling with Splitting Numerical Methods
Suttisak Wizadwongsa, Supasorn Suwajanakorn
ICLR 2023. [Paper]
27 Jan 2023

Input Perturbation Reduces Exposure Bias in Diffusion Models
Mang Ning, Enver Sangineto, Angelo Porrello, Simone Calderara, Rita Cucchiara
arXiv 2023. [Paper] [Github]
27 Jan 2023

Minimizing Trajectory Curvature of ODE-based Generative Models
Sangyun Lee, Beomsu Kim, Jong Chul Ye
arXiv 2023. [Paper]
27 Jan 2023

simple diffusion: End-to-end diffusion for high resolution images
Emiel Hoogeboom1, Jonathan Heek1, Tim Salimans
arXiv 2023. [Paper]
26 Jan 2023

Fast Inference in Denoising Diffusion Models via MMD Finetuning
Emanuele Aiello, Diego Valsesia, Enrico Magli
arXiv 2023. [Paper] [Github]
19 Jan 2023

Exploring Transformer Backbones for Image Diffusion Models
Princy Chahal
arXiv 2022. [Paper]
27 Dec 2022

Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Models
Zijian Zhang, Zhou Zhao, Zhijie Lin
arXiv 2022. [Paper]
26 Dec 2022

Scalable Adaptive Computation for Iterative Generation
Allan Jabri, David Fleet, Ting Chen
arXiv 2022. [Paper]
22 Dec 2022

Hierarchically branched diffusion models for efficient and interpretable multi-class conditional generation
Alex M. Tseng, Tommaso Biancalani, Max Shen, Gabriele Scalia
arXiv 2022. [Paper]
21 Dec 2022

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv 2022. [Paper] [Github]
19 Dec 2022

Scalable Diffusion Models with Transformers
William Peebles, Saining Xie
arXiv 2022. [Paper] [Project] [Github]
19 Dec 2022

DAG: Depth-Aware Guidance with Denoising Diffusion Probabilistic Models
Gyeongnyeon Kim1, Wooseok Jang1, Gyuseong Lee1, Susung Hong, Junyoung Seo, Seungryong Kim
arXiv 2022. [Paper] [Project]
17 Dec 2022

Towards Practical Plug-and-Play Diffusion Models
Hyojun Go1, Yunsung Lee1, Jin-Young Kim1, Seunghyun Lee, Myeongho Jeong, Hyun Seung Lee, Seungtaek Choi
arXiv 2022. [Paper]
12 Dec 2022

Semantic Brain Decoding: from fMRI to conceptually similar image reconstruction of visual stimuli
Matteo Ferrante, Tommaso Boccato, Nicola Toschi
arXiv 2022. [Paper]
13 Dec 2022

MAGVIT: Masked Generative Video Transformer
Lijun Yu, Yong Cheng, Kihyuk Sohn, José Lezama, Han Zhang, Huiwen Chang, Alexander G. Hauptmann, Ming-Hsuan Yang, Yuan Hao, Irfan Essa, Lu Jiang
arXiv 2022. [Paper] Project]
10 Dec 2022

Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encoding
Gyeongman Kim, Hajin Shim, Hyunsu Kim, Yunjey Choi, Junho Kim, Eunho Yang
arXiv 2022. [Paper]
6 Dec 2022

Fine-grained Image Editing by Pixel-wise Guidance Using Diffusion Models
Naoki Matsunaga, Masato Ishii, Akio Hayakawa, Kenji Suzuki, Takuya Narihira
arXiv 2022. [Paper]
5 Dec 2022

VIDM: Video Implicit Diffusion Models
Kangfu Mei, Vishal M. Patel
arXiv 2022. [Paper] [Project] [Github]
1 Dec 2022

Why Are Conditional Generative Models Better Than Unconditional Ones?
Fan Bao, Chongxuan Li, Jiacheng Sun, Jun Zhu
arXiv 2022. [Paper]
1 Dec 2022

High-Fidelity Guided Image Synthesis with Latent Diffusion Models
Jaskirat Singh, Stephen Gould, Liang Zheng
arXiv 2022. [Paper] [Project]
30 Nov 2022

Score-based Continuous-time Discrete Diffusion Models
Haoran Sun, Lijun Yu, Bo Dai, Dale Schuurmans, Hanjun Dai
arXiv 2022. [Paper]
30 Nov 2022

Wavelet Diffusion Models are fast and scalable Image Generators
Hao Phung, Quan Dao, Anh Tran
arXiv 2022. [Paper]
29 Nov 2022

Dimensionality-Varying Diffusion Process
Han Zhang, Ruili Feng, Zhantao Yang, Lianghua Huang, Yu Liu, Yifei Zhang, Yujun Shen, Deli Zhao, Jingren Zhou, Fan Cheng
arXiv 2022. [Paper]
29 Nov 2022

Refining Generative Process with Discriminator Guidance in Score-based Diffusion Models
Dongjun Kim1, Yeongmin Kim1, Wanmo Kang, Il-Chul Moon
arXiv 2022. [Paper]
28 Nov 2022

Diffusion Probabilistic Model Made Slim
Xingyi Yang, Daquan Zhou, Jiashi Feng, Xinchao Wang
arXiv 2022. [Paper]
27 Nov 2022

Fast Sampling of Diffusion Models via Operator Learning
Hongkai Zheng, Weili Nie, Arash Vahdat, Kamyar Azizzadenesheli, Anima Anandkumar
arXiv 2022. [Paper]
24 Nov 2022

Latent Video Diffusion Models for High-Fidelity Video Generation with Arbitrary Lengths
Yingqing He, Tianyu Yang, Yong Zhang, Ying Shan, Qifeng Chen
arXiv 2022. [Paper]
23 Nov 2022

Paint by Example: Exemplar-based Image Editing with Diffusion Models
Binxin Yang, Shuyang Gu, Bo Zhang, Ting Zhang, Xuejin Chen, Xiaoyan Sun, Dong Chen, Fang Wen
arXiv 2022. [Paper]
23 Nov 2022

SinDiffusion: Learning a Diffusion Model from a Single Natural Image
Weilun Wang, Jianmin Bao, Wengang Zhou, Dongdong Chen, Dong Chen, Lu Yuan, Houqiang Li
arXiv 2022. [Paper] [Github]
22 Nov 2022

Accelerating Diffusion Sampling with Classifier-based Feature Distillation
Wujie Sun, Defang Chen, Can Wang, Deshi Ye, Yan Feng, Chun Chen
arXiv 2022. [Paper]
22 Nov 2022

SceneComposer: Any-Level Semantic Image Synthesis
Yu Zeng, Zhe Lin, Jianming Zhang, Qing Liu, John Collomosse, Jason Kuen, Vishal M. Patel
arXiv 2022. [Paper] [Project]
21 Nov 2022

Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Training
Ling Yang1, Zhilin Huang1, Yang Song, Shenda Hong, Guohao Li, Wentao Zhang, Bin Cui, Bernard Ghanem, Ming-Hsuan Yang
arXiv 2022. [Paper]
21 Nov 2022

SinFusion: Training Diffusion Models on a Single Image or Video
Yaniv Nikankin, Niv Haim, Michal Irani
arXiv 2022. [Paper]
21 Nov 2022

MagicVideo: Efficient Video Generation With Latent Diffusion Models
Daquan Zhou1, Weimin Wang1, Hanshu Yan, Weiwei Lv, Yizhe Zhu, Jiashi Feng
arXiv 2022. [Paper] [Project]
20 Nov 2022

Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding
Zijiao Chen, Jiaxin Qing, Tiange Xiang, Wan Lin Yue, Juan Helen Zhou
arXiv 2022. [Paper] [Project] [Github]
13 Nov 2022

Few-shot Image Generation with Diffusion Models
Jingyuan Zhu, Huimin Ma, Jiansheng Chen, Jian Yuan
arXiv 2022. [Paper]
7 Nov 2022

From Denoising Diffusions to Denoising Markov Models
Joe Benton, Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper] [Github]
7 Nov 2022

Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models
Muyang Li, Ji Lin, Chenlin Meng, Stefano Ermon, Song Han, Jun-Yan Zhu
NeurIPS 2022. [Paper] [Github]
4 Nov 2022

An optimal control perspective on diffusion-based generative modeling
Julius Berner, Lorenz Richter, Karen Ullrich
NeurIPS Workshop 2022. [Paper]
2 Nov 2022

Entropic Neural Optimal Transport via Diffusion Processes
Nikita Gushchin, Alexander Kolesov, Alexander Korotin, Dmitry Vetrov, Evgeny Burnaev
arXiv 2022. [Paper]
2 Nov 2022

DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu
NeurIPS 2022 (Oral). [Paper] [Github]
2 Nov 2022

Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models
Vikram Voleti, Christopher Pal, Adam Oberman
NeurIPS Workshop 2022. [Paper]
21 Oct 2022

Deep Equilibrium Approaches to Diffusion Models
Ashwini Pokle, Zhengyang Geng, Zico Kolter
NeurIPS 2022. [Paper] [Github]
23 Oct 2022

Representation Learning with Diffusion Models
Jeremias Traub
arXiv 2022. [Paper] [Github]
20 Oct 2022

Self-Guided Diffusion Models
Vincent Tao Hu1, David W Zhang1, Yuki M. Asano, Gertjan J. Burghouts, Cees G. M. Snoek
arXiv 2022. [Paper]
12 Oct 2022

GENIE: Higher-Order Denoising Diffusion Solvers
Tim Dockhorn, Arash Vahdat, Karsten Kreis
NeurIPS 2022. [Paper] [Project [Github]
11 Oct 2022

f-DM: A Multi-stage Diffusion Model via Progressive Signal Transformation
Jiatao Gu, Shuangfei Zhai, Yizhe Zhang, Miguel Angel Bautista, Josh Susskind
arXiv 2022. [Paper] [Project]
10 Oct 2022

On Distillation of Guided Diffusion Models
Chenlin Meng, Ruiqi Gao, Diederik P. Kingma, Stefano Ermon, Jonathan Ho, Tim Salimans
arXiv 2022. [Paper]
6 Oct 2022

Improving Sample Quality of Diffusion Model Using Self-Attention Guidance
Susung Hong, Gyuseong Lee, Wooseok Jang, Seungryong Kim
arXiv 2022. [Paper] [Project]
3 Oct 2022

OCD: Learning to Overfit with Conditional Diffusion Models
Shahar Shlomo Lutati, Lior Wolf
arXiv 2022. [Paper] [Github]
2 Oct 2022

Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2
Ali Borji
arXiv 2022. [Paper] [Github]
2 Oct 2022

Denoising MCMC for Accelerating Diffusion-Based Generative Models
Beomsu Kim, Jong Chul Ye
arXiv 2022. [Paper] [Github]
29 Sep 2022

All are Worth Words: a ViT Backbone for Score-based Diffusion Models
Fan Bao, Chongxuan Li, Yue Cao, Jun Zhu
arXiv 2022. [Paper]
25 Sep 2022

Neural Wavelet-domain Diffusion for 3D Shape Generation
Ka-Hei Hui, Ruihui Li, Jingyu Hu, Chi-Wing Fu
arXiv 2022. [Paper]
19 Sep 2022

Can segmentation models be trained with fully synthetically generated data?
Virginia Fernandez, Walter Hugo Lopez Pinaya, Pedro Borges, Petru-Daniel Tudosiu, Mark S Graham, Tom Vercauteren, M Jorge Cardoso
arXiv 2022. [Paper]
17 Sep 2022

Blurring Diffusion Models
Emiel Hoogeboom, Tim Salimans
arXiv 2022. [Paper]
12 Sep 2022

Soft Diffusion: Score Matching for General Corruptions
Giannis Daras, Mauricio Delbracio, Hossein Talebi, Alexandros G. Dimakis, Peyman Milanfar
arXiv 2022. [Paper]
12 Sep 2022

Improved Masked Image Generation with Token-Critic
José Lezama, Huiwen Chang, Lu Jiang, Irfan Essa
arXiv 2022. [Paper]
9 Sep 2022

Let us Build Bridges: Understanding and Extending Diffusion Generative Models
Xingchao Liu, Lemeng Wu, Mao Ye, Qiang Liu
arXiv 2022. [Paper]
31 Aug 2022

Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Wan-Cyuan Fan, Yen-Chun Chen, DongDong Chen, Yu Cheng, Lu Yuan, Yu-Chiang Frank Wang
arXiv 2022. [Paper]
29 Aug 2022

Adaptively-Realistic Image Generation from Stroke and Sketch with Diffusion Model
Shin-I Cheng1, Yu-Jie Chen1, Wei-Chen Chiu, Hsin-Ying Lee, Hung-Yu Tseng
arXiv 2022. [Paper] [Project]
26 Aug 2022

Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise
Arpit Bansal, Eitan Borgnia, Hong-Min Chu, Jie S. Li, Hamid Kazemi, Furong Huang, Micah Goldblum, Jonas Geiping, Tom Goldstein
arXiv 2022. [Paper] [Github]
19 Aug 2022

Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidance
Bahjat Kawar, Roy Ganz, Michael Elad
arXiv 2022. [Paper]
18 Aug 2022

Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model
Xiulong Yang1, Sheng-Min Shih1, Yinlin Fu, Xiaoting Zhao, Shihao Ji
arXiv 2022. [Paper] [Github]
16 Aug 2022

Applying Regularized Schrödinger-Bridge-Based Stochastic Process in Generative Modeling
Ki-Ung Song
arXiv 2022. [Paper] [Github]
15 Aug 2022

Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
Ting Chen, Ruixiang Zhang, Geoffrey Hinton
arXiv 2022. [Paper]
8 Aug 2022

Pyramidal Denoising Diffusion Probabilistic Models
Dohoon Ryu, Jong Chul Ye
arXiv 2022. [Paper]
3 Aug 2022

Progressive Deblurring of Diffusion Models for Coarse-to-Fine Image Synthesis
Sangyun Lee, Hyungjin Chung, Jaehyeon Kim, Jong Chul Ye
arxiv 2022. [Paper] [Github]
16 Jul 2022

Improving Diffusion Model Efficiency Through Patching
Troy Luhman, Eric Luhman
arXiv 2022. [Paper] [Github]
9 Jul 2022

Accelerating Score-based Generative Models with Preconditioned Diffusion Sampling
Hengyuan Ma, Li Zhang, Xiatian Zhu, Jianfeng Feng
ECCV 2022. [Paper]
5 Jul 2022

SPI-GAN: Distilling Score-based Generative Models with Straight-Path Interpolations
Jinsung Jeon, Noseong Park
arxiv 2022. [Paper]
29 Jun 2022

Entropy-driven Sampling and Training Scheme for Conditional Diffusion Generation
Shengming Li, Guangcong Zheng, Hui Wang, Taiping Yao, Yang Chen, Shoudong Ding, Xi Li
arXiv 2022. [Paper]
23 Jun 2022

Generative Modelling With Inverse Heat Dissipation
Severi Rissanen, Markus Heinonen, Arno Solin
arXiv 2022. [Paper] [Project]
21 Jun 2022

Diffusion models as plug-and-play priors
Alexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris Samaras
NeurIPS 2022. [Paper] [Github]
17 Jun 2022

A Flexible Diffusion Model
Weitao Du, Tao Yang, He Zhang, Yuanqi Du
arXiv 2022. [Paper]
17 Jun 2022

Lossy Compression with Gaussian Diffusion
Lucas Theis, Tim Salimans, Matthew D. Hoffman, Fabian Mentzer
arXiv 2022. [Paper]
17 Jun 2022

Maximum Likelihood Training for Score-Based Diffusion ODEs by High-Order Denoising Score Matching
Cheng Lu, Kaiwen Zheng, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu
ICML 2022. [Paper] [Github]
16 Jun 2022

Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models
Fan Bao, Chongxuan Li, Jiacheng Sun, Jun Zhu, Bo Zhang
ICML 2022. [Paper] [Github]
15 Jun 2022

Diffusion Models for Video Prediction and Infilling
Tobias Höppe, Arash Mehrjou, Stefan Bauer, Didrik Nielsen, Andrea Dittadi
arXiv 2022. [Paper]
15 Jun 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Github]
15 Jun 2022

gDDIM: Generalized denoising diffusion implicit models
Qinsheng Zhang, Molei Tao, Yongxin Chen
arXiv 2022. [Paper] [Github]
11 Jun 2022

How Much is Enough? A Study on Diffusion Times in Score-based Generative Models
Giulio Franzese, Simone Rossi, Lixuan Yang, Alessandro Finamore, Dario Rossi, Maurizio Filippone, Pietro Michiardi
arXiv 2022. [Paper]
10 Jun 2022

Image Generation with Multimodal Priors using Denoising Diffusion Probabilistic Models
Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M Patel
arXiv 2022. [Paper]
10 Jun 2022

Accelerating Score-based Generative Models for High-Resolution Image Synthesis
Hengyuan Ma, Li Zhang, Xiatian Zhu, Jingfeng Zhang, Jianfeng Feng
arXiv 2022. [Paper]
8 Jun 2022

Diffusion-GAN: Training GANs with Diffusion
Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
arXiv 2022. [Paper]
5 Jun 2022

DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, Jun Zhu
NeurrIPS 2022. [Paper] [Github]
2 Jun 2022

Elucidating the Design Space of Diffusion-Based Generative Models
Tero Karras, Miika Aittala, Timo Aila, Samuli Laine
NeurIPS 2022. [Paper]
1 Jun 2022

On Analyzing Generative and Denoising Capabilities of Diffusion-based Deep Generative Models
Kamil Deja, Anna Kuzina, Tomasz Trzciński, Jakub M. Tomczak
NeurIPS 2022. [Paper]
31 May 2022

Few-Shot Diffusion Models
Giorgio Giannone, Didrik Nielsen, Ole Winther
arXiv 2022. [Paper]
30 May 2022

A Continuous Time Framework for Discrete Denoising Models
Andrew Campbell, Joe Benton, Valentin De Bortoli, Tom Rainforth, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper]
30 May 2022

Maximum Likelihood Training of Implicit Nonlinear Diffusion Models
Dongjun Kim, Byeonghu Na, Se Jung Kwon, Dongsoo Lee, Wanmo Kang, Il-Chul Moon
NeurIPS 2022. [Paper]
27 May 2022

Accelerating Diffusion Models via Early Stop of the Diffusion Process
Zhaoyang Lyu, Xudong XU, Ceyuan Yang, Dahua Lin, Bo Dai
ICML 2022. [Paper]
25 May 2022

Flexible Diffusion Modeling of Long Videos
William Harvey, Saeid Naderiparizi, Vaden Masrani, Christian Weilbach, Frank Wood
arXiv 2022. [Paper] [Github]
23 May 2022

MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation
Vikram Voleti1, Alexia Jolicoeur-Martineau1, Christopher Pal
NeurIPS 2022. [Paper] [Github]
19 May 2022

On Conditioning the Input Noise for Controlled Image Generation with Diffusion Models
Vedant Singh1, Surgan Jandial1, Ayush Chopra, Siddharth Ramesh, Balaji Krishnamurthy, Vineeth N. Balasubramanian
CVPR Workshop 2022. [Paper]
8 May 2022

Subspace Diffusion Generative Models
Bowen Jing, Gabriele Corso, Renato Berlinghieri, Tommi Jaakkola
arXiv 2022. [Paper] [Github]
3 May 2022

Fast Sampling of Diffusion Models with Exponential Integrator
Qinsheng Zhang, Yongxin Chen
arXiv 2022. [Paper]
29 Apr 2022

Retrieval-Augmented Diffusion Models
Andreas Blattmann1, Robin Rombach1, Kaan Oktay, Björn Ommer
arXiv 2022. [Paper]
25 Apr 2022

Video Diffusion Models
Jonathan Ho1, Tim Salimans1, Alexey Gritsenko, William Chan, Mohammad Norouzi, David J. Fleet
NeurIPS 2022. [Paper]
7 Apr 2022

Perception Prioritized Training of Diffusion Models
Jooyoung Choi, Jungbeom Lee, Chaehun Shin, Sungwon Kim, Hyunwoo Kim, Sungroh Yoon
CVPR 2022. [Paper] [Github]
1 Apr 2022

Generating High Fidelity Data from Low-density Regions using Diffusion Models
Vikash Sehwag, Caner Hazirbas, Albert Gordo, Firat Ozgenel, Cristian Canton Ferrer
arXiv 2022. [Paper]
31 Mar 2022

Diffusion Models for Counterfactual Explanations
Guillaume Jeanneret, Loïc Simon, Frédéric Jurie
arXiv 2022. [Paper]
29 Mar 2022

Denoising Likelihood Score Matching for Conditional Score-based Data Generation
Chen-Hao Chao, Wei-Fang Sun, Bo-Wun Cheng, Yi-Chen Lo, Chia-Che Chang, Yu-Lun Liu, Yu-Lin Chang, Chia-Ping Chen, Chun-Yi Lee
ICLR 2022. [Paper]
27 Mar 2022

Diffusion Probabilistic Modeling for Video Generation
Ruihan Yang, Prakhar Srivastava, Stephan Mandt
arXiv 2022. [Paper] [Github]
16 Mar 2022

Dynamic Dual-Output Diffusion Models
Yaniv Benny, Lior Wolf
CVPR 2022. [Paper]
8 Mar 2022

Conditional Simulation Using Diffusion Schrödinger Bridges
Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper]
27 Feb 2022

Diffusion Causal Models for Counterfactual Estimation
Pedro Sanchez, Sotirios A. Tsaftaris
PMLR 2022. [Paper]
21 Feb 2022

Pseudo Numerical Methods for Diffusion Models on Manifolds
Luping Liu, Yi Ren, Zhijie Lin, Zhou Zhao
ICLR 2022. [Paper] [Github]
20 Feb 2022

Truncated Diffusion Probabilistic Models
Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou
arXiv 2022. [Paper]
19 Feb 2022

Understanding DDPM Latent Codes Through Optimal Transport
Valentin Khrulkov, Ivan Oseledets
arXiv 2022. [Paper]
14 Feb 2022

Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Quality
Daniel Watson, William Chan, Jonathan Ho, Mohammad Norouzi
ICLR 2022. [Paper]
11 Feb 2022

Diffusion bridges vector quantized Variational AutoEncoders
Max Cohen, Guillaume Quispe, Sylvain Le Corff, Charles Ollion, Eric Moulines
ICML 2022. [Paper]
10 Feb 2022

Progressive Distillation for Fast Sampling of Diffusion Models
Tim Salimans, Jonathan Ho
ICLR 2022. [Paper]
1 Feb 2022

Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models
Fan Bao, Chongxuan Li, Jun Zhu, Bo Zhang
ICLR 2022. [Paper]
17 Jan 2022

DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents
Kushagra Pandey, Avideep Mukherjee, Piyush Rai, Abhishek Kumar
arXiv 2022. [Paper] [Github]
2 Jan 2022

Itô-Taylor Sampling Scheme for Denoising Diffusion Probabilistic Models using Ideal Derivatives
Hideyuki Tachibana, Mocho Go, Muneyoshi Inahara, Yotaro Katayama, Yotaro Watanabe
arXiv 2021. [Paper]
26 Dec 2021

GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
Alex Nichol1, Prafulla Dhariwal1, Aditya Ramesh1, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, Mark Chen
ICML 2021. [Paper] [Github]
20 Dec 2021

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach1, Andreas Blattmann1, Dominik Lorenz, Patrick Esser, Björn Ommer
arXiv 2021. [Paper] [Github]
20 Dec 2021

Heavy-tailed denoising score matching
Jacob Deasy, Nikola Simidjievski, Pietro Liò
arXiv 2021. [Paper]
17 Dec 2021

High Fidelity Visualization of What Your Self-Supervised Representation Knows About
Florian Bordes, Randall Balestriero, Pascal Vincent
arXiv 2021. [Paper]
16 Dec 2021

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
Zhisheng Xiao, Karsten Kreis, Arash Vahdat
arXiv 2021. [Paper] [Project]
15 Dec 2021

Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
Tim Dockhorn, Arash Vahdat, Karsten Kreis
ICLR 2022. [Paper] [Project]
14 Dec 2021

More Control for Free! Image Synthesis with Semantic Diffusion Guidance
Xihui Liu, Dong Huk Park, Samaneh Azadi, Gong Zhang, Arman Chopikyan, Yuxiao Hu, Humphrey Shi, Anna Rohrbach, Trevor Darrell
arXiv 2021. [Paper]
10 Dec 2021

Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation
Minghui Hu, Yujie Wang, Tat-Jen Cham, Jianfei Yang, P.N.Suganthan
arXiv 2021. [Paper]
3 Dec 2021

Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
Konpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, Supasorn Suwajanakorn
CVPR 2022. [Paper] [Project] [Github]
30 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021

Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes
Sam Bond-Taylor1, Peter Hessey1, Hiroshi Sasaki, Toby P. Breckon, Chris G. Willcocks
arXiv 2021. [Paper] [Github]
24 Nov 2021

Diffusion Normalizing Flow
Qinsheng Zhang, Yongxin Chen
NeurIPS 2021. [Paper] [Github]
14 Oct 2021

Denoising Diffusion Gamma Models
Eliya Nachmani1, Robin San Roman1, Lior Wolf
arXiv 2021. [Paper]
10 Oct 2021

Score-based Generative Neural Networks for Large-Scale Optimal Transport
Max Daniels, Tyler Maunu, Paul Hand
arXiv 2021. [Paper]
7 Oct 2021

Score-Based Generative Classifiers
Roland S. Zimmermann, Lukas Schott, Yang Song, Benjamin A. Dunn, David A. Klindt
arXiv 2021. [Paper]
1 Oct 2021

Classifier-Free Diffusion Guidance
Jonathan Ho, Tim Salimans
NeurIPS Workshop 2021. [Paper]
28 Sep 2021

Bilateral Denoising Diffusion Models
Max W. Y. Lam, Jun Wang, Rongjie Huang, Dan Su, Dong Yu
arXiv 2021. [Paper] [Project]
26 Aug 2021

ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis
Patrick Esser1, Robin Rombach1, Andreas Blattmann1, Björn Ommer
NeurIPS 2021. [Paper] [Project]
19 Aug 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

SDEdit: Image Synthesis and Editing with Stochastic Differential Equations
Chenlin Meng, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, Stefano Ermon
ICLR 2021. [Paper] [Project] [Github]
2 Aug 2021

Structured Denoising Diffusion Models in Discrete State-Spaces
Jacob Austin1, Daniel D. Johnson1, Jonathan Ho, Daniel Tarlow, Rianne van den Berg
NeurIPS 2021. [Paper]
7 Jul 2021

Variational Diffusion Models
Diederik P. Kingma1, Tim Salimans1, Ben Poole, Jonathan Ho
arXiv 2021. [Paper] [Github]
1 Jul 2021

Diffusion Priors In Variational Autoencoders
Antoine Wehenkel1, Gilles Louppe1
ICML Workshop 2021. [Paper]
29 Jun 2021

Deep Generative Learning via Schrödinger Bridge
Gefei Wang, Yuling Jiao, Qian Xu, Yang Wang, Can Yang
ICML 2021. [Paper]
19 Jun 2021

Non Gaussian Denoising Diffusion Models
Eliya Nachmani1, Robin San Roman1, Lior Wolf
arXiv 2021. [Paper] [Project]
14 Jun 2021

D2C: Diffusion-Denoising Models for Few-shot Conditional Generation
Abhishek Sinha1, Jiaming Song1, Chenlin Meng, Stefano Ermon
NeurIPS 2021. [Paper] [Project] [Github]
12 Jun 2021

Score-based Generative Modeling in Latent Space
Arash Vahdat1, Karsten Kreis1, Jan Kautz
arXiv 2021. [Paper]
10 Jun 2021

Learning to Efficiently Sample from Diffusion Probabilistic Models
Daniel Watson, Jonathan Ho, Mohammad Norouzi, William Chan
arXiv 2021. [Paper]
7 Jun 2021

A Variational Perspective on Diffusion-Based Generative Models and Score Matching
Chin-Wei Huang, Jae Hyun Lim, Aaron Courville
NeurIPS 2021. [Paper] [Github]
5 Jun 2021

Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation
Dongjun Kim, Seungjae Shin, Kyungwoo Song, Wanmo Kang, Il-Chul Moon
ICML 2022. [Paper]
10 Jun 2021

Diffusion Schrödinger Bridge with Applications to Score-Based Generative Modeling
Valentin De Bortoli, James Thornton, Jeremy Heng, Arnaud Doucet
arXiv 2021. [Paper] [Project] [Github]
1 Jun 2021

On Fast Sampling of Diffusion Probabilistic Models
Zhifeng Kong, Wei Ping
ICML Workshop 2021. [Paper] [Github]
31 May 2021

Cascaded Diffusion Models for High Fidelity Image Generation
Jonathan Ho1, Chitwan Saharia1, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans
JMLR 2021. [Paper] [Project]
30 May 2021

Gotta Go Fast When Generating Data with Score-Based Models
Alexia Jolicoeur-Martineau, Ke Li, Rémi Piché-Taillefer, Tal Kachman, Ioannis Mitliagkas
arXiv 2021. [Paper] [Github]
28 May 2021

Diffusion Models Beat GANs on Image Synthesis
Prafulla Dhariwal1, Alex Nichol1
arXiv 2021. [Paper] [Github]
11 May 2021

Image Super-Resolution via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi
arXiv 2021. [Paper] [Project] [Github]
15 Apr 2021

Noise Estimation for Generative Diffusion Models
Robin San-Roman1, Eliya Nachmani1, Lior Wolf
arXiv 2021. [Paper]
6 Apr 2021

Improved Denoising Diffusion Probabilistic Models
Alex Nichol1, Prafulla Dhariwal1
ICLR 2021. [Paper] [Github]
18 Feb 2021

Maximum Likelihood Training of Score-Based Diffusion Models
Yang Song1, Conor Durkan1, Iain Murray, Stefano Ermon
arXiv 2021. [Paper]
22 Jan 2021

Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
Eric Luhman1, Troy Luhman1
arXiv 2021. [Paper] [Github]
7 Jan 2021

Learning Energy-Based Models by Diffusion Recovery Likelihood
Ruiqi Gao, Yang Song, Ben Poole, Ying Nian Wu, Diederik P. Kingma
ICLR 2021. [Paper] [Github]
15 Dec 2020

Score-Based Generative Modeling through Stochastic Differential Equations
Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, Ben Poole
ICLR 2021 (Oral). [Paper] [Github]
26 Nov 2020

Variational (Gradient) Estimate of the Score Function in Energy-based Latent Variable Models
Fan Bao, Kun Xu, Chongxuan Li, Lanqing Hong, Jun Zhu, Bo Zhang
ICML 2021. [Paper]
16 Oct 2020

Denoising Diffusion Implicit Models
Jiaming Song, Chenlin Meng, Stefano Ermon
ICLR 2021. [Paper] [Github]
6 Oct 2020

Adversarial score matching and improved sampling for image generation
Alexia Jolicoeur-Martineau1, Rémi Piché-Taillefer1, Rémi Tachet des Combes, Ioannis Mitliagkas
ICLR 2021. [Paper] [Github]
11 Sep 2020

Denoising Diffusion Probabilistic Models
Jonathan Ho, Ajay Jain, Pieter Abbeel
NeurIPS 2020. [Paper] [Github] [Github2]
19 Jun 2020

Improved Techniques for Training Score-Based Generative Models
Yang Song, Stefano Ermon
NeurIPS 2020. [Paper] [Github]
16 Jun 2020

Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song, Stefano Ermon
NeurIPS 2019. [Paper] [Project] [Github]
12 Jul 2019

Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limit
Belinda Tzen, Maxim Raginsky
arXiv 2019. [Paper]
23 May 2019

Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, Surya Ganguli
ICML 2015. [Paper] [Github]
2 Mar 2015

Segmentation

Ambiguous Medical Image Segmentation using Diffusion Models
Aimon Rahman, Jeya Maria Jose Valanarasu, Ilker Hacihaliloglu, Vishal M Patel
CVPR 2023. [Paper] [Github]
10 Apr 2023

BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentation
Tao Chen, Chenhui Wang, Hongming Shan
arXiv 2023. [Paper]
10 Apr 2023

Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentation
Haipeng Zhou, Lei Zhu, Yuyin Zhou
arXiv 2023. [Paper]
22 Mar 2023

Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Grading
Matthias Keicher, Matan Atad, David Schinz, Alexandra S. Gersing, Sarah C. Foreman, Sophia S. Goller, Juergen Weissinger, Jon Rischewski, Anna-Sophia Dietrich, Benedikt Wiestler, Jan S. Kirschke, Nassir Navab
arXiv 2023. [Paper]
21 Mar 2023

LD-ZNet: A Latent Diffusion Approach for Text-Based Image Segmentation
Koutilya Pnvr, Bharat Singh, Pallabi Ghosh, Behjat Siddiquie, David Jacobs
arXiv 2023. [Paper]
22 Mar 2023

DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models
Weijia Wu, Yuzhong Zhao, Mike Zheng Shou, Hong Zhou, Chunhua Shen
arXiv 2023. [Paper] [Project]
21 Mar 2023

Object-Centric Slot Diffusion
Jindong Jiang, Fei Deng, Gautam Singh, Sungjin Ahn
arXiv 2023. [Paper]
20 Mar 2023

Diff-UNet: A Diffusion Embedded Network for Volumetric Segmentation
Zhaohu Xing, Liang Wan, Huazhu Fu, Guang Yang, Lei Zhu
arXiv 2023. [Paper] [Github]
18 Mar 2023

DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery
Chaofan Ma1, Yuhuan Yang1, Chen Ju, Fei Zhang, Jinxiang Liu, Yu Wang, Ya Zhang, Yanfeng Wang
arXiv 2023. [Paper]
17 Mar 2023

Stochastic Segmentation with Conditional Categorical Diffusion Models
Lukas Zbinden1, Lars Doorenbos1, Theodoros Pissas, Raphael Sznitman, Pablo Márquez-Neila
arXiv 2023. [Paper] [Github]
15 Mar 2023

DiffBEV: Conditional Diffusion Model for Bird's Eye View Perception
Jiayu Zou, Zheng Zhu, Yun Ye, Xingang Wang
arXiv 2023. [Paper]
15 Mar 2023

Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation
Yunguan Fu, Yiwen Li, Shaheer U. Saeed, Matthew J. Clarkson, Yipeng Hu
arXiv 2023. [Paper] [Github]
10 Mar 2023

MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentation
Minh-Quan Le, Tam V. Nguyen, Trung-Nghia Le, Thanh-Toan Do, Minh N. Do, Minh-Triet Tran
arXiv 2023. [Paper]
9 Mar 2023

Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models
Jiarui Xu, Sifei Liu, Arash Vahdat, Wonmin Byeon, Xiaolong Wang, Shalini De Mello
arXiv 2023. [Paper] [Project]
8 Mar 2023

Semantic Diffusion Network for Semantic Segmentation
Haoru Tan1, Sitong Wu1, Jimin Pi
NeurIPS 2022. Paper]
4 Feb 2023

MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformer
Junde Wu, Rao Fu, Huihui Fang, Yu Zhang, Yanwu Xu
arXiv 2023. [Paper]
19 Jan 2023

DiffusionInst: Diffusion Model for Instance Segmentation
Zhangxuan Gu, Haoxing Chen, Zhuoer Xu, Jun Lan, Changhua Meng, Weiqiang Wang
arXiv 2022. [Paper] [Github]
6 DEc 2022

Multi-Class Segmentation from Aerial Views using Recursive Noise Diffusion
Benedikt Kolbeinsson, Krystian Mikolajczyk
arXiv 2022. [Paper]
1 Dec 2022

Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors
Ryan Burgert, Kanchana Ranasinghe, Xiang Li, Michael S. Ryoo
arXiv 2022. [Paper]
23 Nov 2022

Improved HER2 Tumor Segmentation with Subtype Balancing using Deep Generative Networks
Mathias Öttl, Jana Mönius, Matthias Rübner, Carol I. Geppert, Jingna Qiu, Frauke Wilm, Arndt Hartmann, Matthias W. Beckmann, Peter A. Fasching, Andreas Maier, Ramona Erber, Katharina Breininger
arXiv 2022. [Paper]
11 Nov 2022

MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model
Junde Wu, Huihui Fang, Yu Zhang, Yehui Yang, Yanwu Xu
arXiv 2022. [Paper]
1 Nov 2022

Accelerating Diffusion Models via Pre-segmentation Diffusion Sampling for Medical Image Segmentation
Xutao Guo, Yanwu Yang, Chenfei Ye, Shang Lu, Yang Xiang, Ting Ma
arXiv 2022. [Paper]
27 Oct 2022

Anatomically constrained CT image translation for heterogeneous blood vessel segmentation
Giammarco La Barbera, Haithem Boussaid, Francesco Maso, Sabine Sarnacki, Laurence Rouet, Pietro Gori, Isabelle Bloch
BMVC 2022. [Paper]
4 Oct 2022

Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentation
Boah Kim1, Yujin Oh1, Jong Chul Ye
arXiv 2022. [Paper]
29 Sep 2022

Can segmentation models be trained with fully synthetically generated data?
Virginia Fernandez, Walter Hugo Lopez Pinaya, Pedro Borges, Petru-Daniel Tudosiu, Mark S Graham, Tom Vercauteren, M Jorge Cardoso
arXiv 2022. [Paper]
17 Sep 2022

Let us Build Bridges: Understanding and Extending Diffusion Generative Models
Xingchao Liu, Lemeng Wu, Mao Ye, Qiang Liu
arXiv 2022. [Paper]
31 Aug 2022

Semantic Image Synthesis via Diffusion Models
Weilun Wang, Jianmin Bao, Wengang Zhou, Dongdong Chen, Dong Chen, Lu Yuan, Houqiang Li
arXiv 2022. [Paper]
30 Jun 2022

Remote Sensing Change Detection (Segmentation) using Denoising Diffusion Probabilistic Models
Wele Gedara Chaminda Bandara, Nithin Gopalakrishnan Nair, Vishal M. Patel
arXiv 2022. [Paper] [Github]
23 Jun 2022

Diffusion models as plug-and-play priors
Alexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris Samaras
arXiv 2022. [Paper]
17 Jun 2022

Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models
Walter H. L. Pinaya, Mark S. Graham, Robert Gray, Pedro F Da Costa, Petru-Daniel Tudosiu, Paul Wright, Yee H. Mah, Andrew D. MacKinnon, James T. Teo, Rolf Jager, David Werring, Geraint Rees, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardos
MICCAI 2022. [Paper]
7 Jun 2022

Decoder Denoising Pretraining for Semantic Segmentation
Emmanuel Brempong Asiedu, Simon Kornblith, Ting Chen, Niki Parmar, Matthias Minderer, Mohammad Norouzi
arXiv 2022. [Paper]
23 May 2022

Diffusion Models for Implicit Image Segmentation Ensembles
Julia Wolleb1, Robin Sandkühler1, Florentin Bieder, Philippe Valmaggia, Philippe C. Cattin
MIDL 2021. [Paper]
6 Dec 2021

Label-Efficient Semantic Segmentation with Diffusion Models
Dmitry Baranchuk, Ivan Rubachev, Andrey Voynov, Valentin Khrulkov, Artem Babenko
ICLR 2021. [Paper] [Github]
6 Dec 2021

SegDiff: Image Segmentation with Diffusion Probabilistic Models
Tomer Amit, Eliya Nachmani, Tal Shaharbany, Lior Wolf
arXiv 2021. [Paper]
1 Dec 2021

Inverse Problem

SPIRiT-Diffusion: Self-Consistency Driven Diffusion Model for Accelerated MRI
Zhuo-Xu Cui, Chentao Cao, Jing Cheng, Sen Jia, Hairong Zheng, Dong Liang, Yanjie Zhu
arXiv 2023. [Paper]
11 Apr 2023

Zero-shot CT Field-of-view Completion with Unconditional Generative Diffusion Prior
Kaiwen Xu, Aravind R. Krishnan, Thomas Z. Li, Yuankai Huo, Kim L. Sandler, Fabien Maldonado, Bennett A. Landman
arXiv 2023. [Paper]
7 Apr 2023

SketchFFusion: Sketch-guided image editing with diffusion model
Weihang Mao1, Bo Han1, Zihao Wang
arXiv 2023. [Paper]
6 Apr 2023

Inst-Inpaint: Instructing to Remove Objects with Diffusion Models
Ahmet Burak Yildirim, Vedat Baday, Erkut Erdem, Aykut Erdem, Aysegul Dundar
arXiv 2023. [Paper] [Project]
6 Apr 2023

Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models
Guanhua Zhang1, Jiabao Ji1, Yang Zhang, Mo Yu, Tommi Jaakkola, Shiyu Chang
arXiv 2023. [Paper] [Github]
6 Apr 2023

Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models
Yunxiang Li, Hua-Chieh Shao, Xiao Liang, Liyuan Chen, Ruiqi Li, Steve Jiang, Jing Wang, You Zhang
arXiv 2023. [Paper]
5 Apr 2023

Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolution
Brian Moser, Stanislav Frolov, Federico Raue, Sebastian Palacio, Andreas Dengel
arXiv 2023. [Paper]
4 Apr 2023

CoreDiff: Contextual Error-Modulated Generalized Diffusion Model for Low-Dose CT Denoising and Generalization
Qi Gao, Zilong Li, Junping Zhang, Yi Zhang, Hongming Shan
arXiv 2023. [Paper]
4 Apr 2023

Generative Diffusion Prior for Unified Image Restoration and Enhancement
Ben Fei1, Zhaoyang Lyu1, Liang Pan, Junzhe Zhang, Weidong Yang, Tianyue Luo, Bo Zhang, Bo Dai
CVPR 2023. [Paper]
3 Apr 2023

Implicit Diffusion Models for Continuous Super-Resolution
Sicheng Gao1, Xuhui Liu1, Bohan Zeng1, Sheng Xu, Yanjing Li, Xiaoyan Luo, Jianzhuang Liu, Xiantong Zhen, Baochang Zhang
CVPR 2023. [Paper]
29 Mar 2023

DiracDiffusion: Denoising and Incremental Reconstruction with Assured Data-Consistency
Zalan Fabian, Berk Tinaz, Mahdi Soltanolkotabi
arXiv 2023. [Paper]
25 Mar 2023

MindDiffuser: Controlled Image Reconstruction from Human Brain Activity with Semantic and Structural Diffusion
Yizhuo Lu, Changde Du, Dianpeng Wang, Huiguang He
arXiv 2023. [Paper]
24 Mar 2023

DisC-Diff: Disentangled Conditional Diffusion Model for Multi-Contrast MRI Super-Resolution
Ye Mao1, Lan Jiang1, Xi Chen, Chao Li
arXiv 2023. [Paper]
23 Mar 2023

Sub-volume-based Denoising Diffusion Probabilistic Model for Cone-beam CT Reconstruction from Incomplete Data
Wenjun Xia, Chuang Niu, Wenxiang Cong, Ge Wang
arXiv 2023. [Paper]
22 Mar 2023

A Perceptual Quality Assessment Exploration for AIGC Images
Zicheng Zhang, Chunyi Li, Wei Sun, Xiaohong Liu, Xiongkuo Min, Guangtao Zhai
arXiv 2023. [Paper]
22 Mar 2023

Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration
Mauricio Delbracio, Peyman Milanfar
arXiv 2023. [Paper]
20 Mar 2023

Efficient Neural Generation of 4K Masks for Homogeneous Diffusion Inpainting
Karl Schrader, Pascal Peter, Niklas Kämper, Joachim Weickert
arXiv 2023. [Paper]
17 Mar 2023

Denoising Diffusion Post-Processing for Low-Light Image Enhancement
Savvas Panagiotou, Anna S. Bosman
arXiv 2023. [Paper]
16 Mar 2023

SUD2: Supervision by Denoising Diffusion Models for Image Reconstruction
Matthew A. Chan, Sean I. Young, Christopher A. Metzler
arXiv 2023. [Paper]
16 Mar 2023

DiffIR: Efficient Diffusion Model for Image Restoration
Bin Xia, Yulun Zhang, Shiyin Wang, Yitong Wang, Xinglong Wu, Yapeng Tian, Wenming Yang, Luc Van Gool
arXiv 2023. [Paper]
16 Mar 2023

ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution
Shuyao Shang, Zhengyang Shan, Guangxing Liu, Jinglin Zhang
arXiv 2023. [Paper]
15 Mar 2023

Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
Jan Oscar Cross-Zamirski, Praveen Anand, Guy Williams, Elizabeth Mouchet, Yinhai Wang, Carola-Bibiane Schönlieb
arXiv 2023. [Paper] [Github]
15 Mar 2023

Diffusion Models for Contrast Harmonization of Magnetic Resonance Images
Alicia Durrer, Julia Wolleb, Florentin Bieder, Tim Sinnecker, Matthias Weigel, Robin Sandkühler, Cristina Granziera, Özgür Yaldizli, Philippe C. Cattin
arXiv 2023. [Paper]
14 Mar 2023

Synthesizing Realistic Image Restoration Training Pairs: A Diffusion Approach
Tao Yang, Peiran Ren, Xuansong xie, Lei Zhang
arXiv 2023. [Paper]
13 Mar 2023

DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration
Zhixin Wang, Xiaoyun Zhang, Ziying Zhang, Huangjie Zheng, Mingyuan Zhou, Ya Zhang, Yanfeng Wang
CVPR 2023. [Paper]
13 Mar 2023

DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration
Yuchun Miao, Lefei Zhang, Liangpei Zhang, Dacheng Tao
arXiv 2023. [Paper]
12 Mar 2023

Fast Diffusion Sampler for Inverse Problems by Geometric Decomposition
Hyungjin Chung, Suhyeon Lee, Jong Chul Ye
arXiv 2023. [Paper]
10 Mar 2023

Generalized Diffusion MRI Denoising and Super-Resolution using Swin Transformers
Amir Sadikov, Jamie Wren-Jarvis, Xinlei Pan, Lanya T. Cai, Pratik Mukherjee
arXiv 2023. [Paper]
10 Mar 2023

DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimation
Yiqun Duan, Zheng Zhu, Xianda Guo
arxiv 2023. [Paper] [Github]
9 Mar 2023

Learning Enhancement From Degradation: A Diffusion Model For Fundus Image Enhancement
Puijin Cheng, Li Lin, Yijin Huang, Huaqing He, Wenhan Luo, Xiaoying Tang
arXiv 2023. [Paper] [Github]
8 Mar 2023

Unlimited-Size Diffusion Restoration
Yinhuai Wang, Jiwen Yu, Runyi Yu, Jian Zhang
arXiv 2023. [Paper]
1 Mar 2023

Unsupervised Out-of-Distribution Detection with Diffusion Inpainting
Zhenzhen Liu1, Jin Peng Zhou1, Yufan Wang, Kilian Q. Weinberger
arXiv 2023. [Paper]
20 Feb 2023

Restoration based Generative Models
Jaemoo Choi1, Yesom Park1, Myungjoo Kang
arXiv 2023. [Paper]
20 Feb 2023

Explicit Diffusion of Gaussian Mixture Model Based Image Priors
Martin Zach, Thomas Pock, Erich Kobler, Antonin Chambolle
arXiv 2023. [Paper]
16 Feb 2023

Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild
Hshmat Sahak, Daniel Watson, Chitwan Saharia, David Fleet
arXiv 2023. [Paper]
15 Feb 2023

CDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-Resolution
Axi Niu, Kang Zhang, Trung X. Pham, Jinqiu Sun, Yu Zhu, In So Kweon, Yanning Zhang
arXiv 2023. [Paper]
14 Feb 2023

How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Control
Jacopo Teneggi, Matt Tivnan, J Webster Stayman, Jeremias Sulam
arXiv 2023. [Paper]
7 Feb 2023

DDM2: Self-Supervised Diffusion MRI Denoising with Generative Diffusion Models
Tiange Xiang, Mahmut Yurt, Ali B Syed, Kawin Setsompop, Akshay Chaudhari
ICLR 2023. [Paper] [Github]
6 Feb 2023

Diffusion Model for Generative Image Denoising
Yutong Xie, Minne Yuan, Bin Dong, Quanzheng Li
arXiv 2023. [Paper]
5 Feb 2023

A Theoretical Justification for Image Inpainting using Denoising Diffusion Probabilistic Models
Litu Rout, Advait Parulekar, Constantine Caramanis, Sanjay Shakkottai
arXiv 2023. [Paper]
2 Feb 2023

GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration
Naoki Murata, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
arXiv 2023. [Paper]
30 Jan 2023

Accelerating Guided Diffusion Sampling with Splitting Numerical Methods
Suttisak Wizadwongsa, Supasorn Suwajanakorn
ICLR 2023. [Paper]
27 Jan 2023

Diffusion Denoising for Low-Dose-CT Model
Runyi Li
arXiv 2023. [Paper]
27 Jan 2023

Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalization
Shangrong Yang, Chunyu Lin, Kang Liao, Yao Zhao
arXiv 2023. [Paper]
26 Jan 2023

RainDiffusion:When Unsupervised Learning Meets Diffusion Models for Real-world Image Deraining
Mingqiang Wei, Yiyang Shen, Yongzhen Wang, Haoran Xie, Fu Lee Wang
arXiv 2023. [Paper]
23 Jan 2023

Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models
Mingqiang Wei, Yiyang Shen, Yongzhen Wang, Haoran Xie, Fu Lee Wang
arXiv 2023. [Paper]
23 Jan 2023

Removing Structured Noise with Diffusion Models
Tristan S.W. Stevens1, Jean-Luc Robert1, Faik C. Meral Jason Yu, Jun Seob Shin, Ruud J.G. van Sloun
arXiv 2023. [Paper]
20 Jan 2023

Image Restoration with Mean-Reverting Stochastic Differential Equations
Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön
arXiv 2023. [Paper] [Github]
20 Jan 2023

DiffusionCT: Latent Diffusion Model for CT Image Standardization
Md Selim, Jie Zhang, Michael A. Brooks, Ge Wang, Jin Chen
arXiv 2023. [Paper]
20 Jan 2023

Targeted Image Reconstruction by Sampling Pre-trained Diffusion Model
Jiageng Zheng
arXiv 2023. [Paper]
18 Jan 2023

Annealed Score-Based Diffusion Model for MR Motion Artifact Reduction
Gyutaek Oh, Jeong Eun Lee, Jong Chul Ye
arXiv 2023. [Paper]
8 Jan 2023

Exploring Vision Transformers as Diffusion Learners
He Cao, Jianan Wang, Tianhe Ren, Xianbiao Qi, Yihao Chen, Yuan Yao, Lei Zhang
arXiv 2022. [Paper]
28 Dec 2022

Towards Blind Watermarking: Combining Invertible and Non-invertible Mechanisms
Rui Ma, Mengxi Guo, Yi Hou, Fan Yang, Yuan Li, Huizhu Jia, Xiaodong Xie
arXiv 2022. [Paper] [Github]
24 Dec 2022

Bi-Noising Diffusion: Towards Conditional Diffusion Models with Generative Restoration Priors
Kangfu Mei, Nithin Gopalakrishnan Nair, Vishal M. Patel
arXiv 2022. [Paper] [Project]
14 Dec 2022

SPIRiT-Diffusion: SPIRiT-driven Score-Based Generative Modeling for Vessel Wall imaging
Chentao Cao, Zhuo-Xu Cui, Jing Cheng, Sen Jia, Hairong Zheng, Dong Liang, Yanjie Zhu
arXiv 2022. [Paper]
14 Dec 2022

Universal Generative Modeling in Dual-domain for Dynamic MR Imaging
Chuanming Yu, Yu Guan, Ziwen Ke, Dong Liang, Qiegen Liu
arXiv 2022. [Paper]
15 Dec 2022

DifFace: Blind Face Restoration with Diffused Error Contraction
Zongsheng Yue, Chen Change Loy
arXiv 2022. [Paper] [Github]
13 Dec 2022

ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removal
Lanqing Guo, Chong Wang, Wenhan Yang, Siyu Huang, Yufei Wang, Hanspeter Pfister, Bihan Wen
arXiv 2022. [Paper]
9 Dec 2022

One Sample Diffusion Model in Projection Domain for Low-Dose CT Imaging
Bin Huang, Liu Zhang, Shiyu Lu, Boyu Lin, Weiwen Wu, Qiegen Liu
arXiv 2022. [Paper]
7 Dec 2022

SDM: Spatial Diffusion Model for Large Hole Image Inpainting
Wenbo Li, Xin Yu, Kun Zhou, Yibing Song, Zhe Lin, Jiaya Jia
arXiv 2022. [Paper]
6 Dec 2022

ADIR: Adaptive Diffusion for Image Reconstruction
Shady Abu-Hussein, Tom Tirer, Raja Giryes
arXiv 2022. [Paper] [Project]
6 Dec 2022

Image Deblurring with Domain Generalizable Diffusion Models
Mengwei Ren, Mauricio Delbracio, Hossein Talebi, Guido Gerig, Peyman Milanfar
arXiv 2022. [Paper]
4 Dec 2022

Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model
Yinhuai Wang1, Jiwen Yu1, Jian Zhang
arXiv 2022. [Paper] [Github]
1 Dec 2022

FREDSR: Fourier Residual Efficient Diffusive GAN for Single Image Super Resolution
Kyoungwan Woo1, Achyuta Rajaram1
arXiv 2022. [Paper]
30 Nov 2022

CHIMLE: Conditional Hierarchical IMLE for Multimodal Conditional Image Synthesis
Shichong Peng, Alireza Moazeni, Ke Li
arXiv 2022. [Paper]
25 Nov 2022

DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstruction
Jiaming Liu, Rushil Anirudh, Jayaraman J. Thiagarajan, Stewart He, K. Aditya Mohan, Ulugbek S. Kamilov, Hyojin Kim
arXiv 2022. [Paper]
22 Nov 2022

Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems
Xiangming Meng, Yoshiyuki Kabashima
arXiv 2022. [Paper] [Github]
20 Nov 2022

Parallel Diffusion Models of Operator and Image for Blind Inverse Problems
Hyungjin Chung1, Jeongsol Kim1, Sehui Kim, Jong Chul Ye
arXiv 2022. [Paper]
19 Nov 2022

Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models
Hyungjin Chung1, Dohoon Ryu1, Michael T. McCann, Marc L. Klasky, Jong Chul Ye
arXiv 2022. [Paper]
19 Nov 2022

Patch-Based Denoising Diffusion Probabilistic Model for Sparse-View CT Reconstruction
Wenjun Xia, Wenxiang Cong, Ge Wang
arXiv 2022. [Paper]
18 Nov 2022

A Structure-Guided Diffusion Model for Large-Hole Diverse Image Completion
Daichi Horita, Jiaolong Yang, Dong Chen, Yuki Koyama, Kiyoharu Aizawa
arXiv 2022. [Paper]
18 Nov 2022

Conffusion: Confidence Intervals for Diffusion Models
Eliahu Horwitz, Yedid Hoshen
arXiv 2022. [Paper]
17 Nov 2022

Superresolution Reconstruction of Single Image for Latent features
Xin Wang, Jing-Ke Yan, Jing-Ye Cai, Jian-Hua Deng, Qin Qin, Qin Wang, Heng Xiao, Yao Cheng, Peng-Fei Ye
arXiv 2022. [Paper]
16 Nov 2022

DriftRec: Adapting diffusion models to blind image restoration tasks
Simon Welker, Henry N. Chapman, Timo Gerkmann
arXiv 2022. [Paper]
12 Nov 2022

From Denoising Diffusions to Denoising Markov Models
Joe Benton, Yuyang Shi, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
arXiv 2022. [Paper] [Github]
7 Nov 2022

Intelligent Painter: Picture Composition With Resampling Diffusion Model
Wing-Fung Ku, Wan-Chi Siu, Xi Cheng, H. Anthony Chan
arXiv 2022. [Paper]
31 Oct 2022

Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report
Pouria Rouzrokh1, Bardia Khosravi1, Shahriar Faghani, Mana Moassefi, Sanaz Vahdati, Bradley J. Erickson
arXiv 2022. [Paper] [Github]
21 Oct 2022

DiffGAR: Model-Agnostic Restoration from Generative Artifacts Using Image-to-Image Diffusion Models
Yueqin Yin, Lianghua Huang, Yu Liu, Kaiqi Huang
arXiv 2022. [Paper]
16 Oct 2022

Low-Dose CT Using Denoising Diffusion Probabilistic Model for 20× Speedup
Wenjun Xia, Qing Lyu, Ge Wang
arXiv 2022. [Paper]
29 Sep 2022

Diffusion Posterior Sampling for General Noisy Inverse Problems
Hyungjin Chung1, Jeongsol Kim1, Michael T. Mccann, Marc L. Klasky, Jong Chul Ye
arXiv 2022. [Paper] [Github]
29 Sep 2022

Face Super-Resolution Using Stochastic Differential Equations
Marcelo dos Santos1, Rayson Laroca1, Rafael O. Ribeiro, João Neves, Hugo Proença, David Menotti
arXiv 2022. [Paper] [Github]
24 Sep 2022

JPEG Artifact Correction using Denoising Diffusion Restoration Models
Bahjat Kawar1, Jiaming Song1, Stefano Ermon, Michael Elad
arXiv 2022. [Paper]
23 Sep 2022

T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models
Nithin Gopalakrishnan Nair, Vishal M. Patel
arXiv 2022. [Paper]
19 Sep 2022

Delving Globally into Texture and Structure for Image Inpainting
Haipeng Liu, Yang Wang, Meng Wang, Yong Rui
ACM 2022. [Paper] [Github]
17 Sep 2022

PET image denoising based on denoising diffusion probabilistic models
Kuang Gong, Keith A. Johnson, Georges El Fakhri, Quanzheng Li, Tinsu Pan
arXiv 2022. [Paper]
13 Sep 2022

Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction
Zhuo-Xu Cui, Chentao Cao, Shaonan Liu, Qingyong Zhu, Jing Cheng, Haifeng Wang, Yanjie Zhu, Dong Liang
IEEE TMI 2022. [Paper]
2 Sep 2022

AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models
Nithin Gopalakrishnan Nair, Kangfu Mei, Vishal M Patel
arXiv 2022. [Paper]
24 Aug 2022

Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise
Arpit Bansal, Eitan Borgnia, Hong-Min Chu, Jie S. Li, Hamid Kazemi, Furong Huang, Micah Goldblum, Jonas Geiping, Tom Goldstein
arXiv 2022. [Paper] [Github]
19 Aug 2022

High-Frequency Space Diffusion Models for Accelerated MRI
Chentao Cao, Zhuo-Xu Cui, Shaonan Liu, Dong Liang, Yanjie Zhu
arXiv 2022. [Paper]
10 Aug 2022

Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
Ozan Özdenizci, Robert Legenstein
arXiv 2022. [Paper] [Github]
29 Jul 2022

Non-Uniform Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2022. [Paper]
20 Jul 2022

Unsupervised Medical Image Translation with Adversarial Diffusion Models
Muzaffer Özbey, Salman UH Dar, Hasan A Bedel, Onat Dalmaz, Şaban Özturk, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
17 Jul 2022

Adaptive Diffusion Priors for Accelerated MRI Reconstruction
Salman UH Dar, Şaban Öztürk, Yilmaz Korkmaz, Gokberk Elmas, Muzaffer Özbey, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
12 Jul 2022

A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion
Xiangxi Meng, Yuning Gu, Yongsheng Pan, Nizhuan Wang, Peng Xue, Mengkang Lu, Xuming He, Yiqiang Zhan, Dinggang Shen
arXiv 2022. [Paper]
7 Jul 2022

SAR Despeckling using a Denoising Diffusion Probabilistic Model
Malsha V. Perera, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel
arXiv 2022. [Paper]
9 Jun 2022

Improving Diffusion Models for Inverse Problems using Manifold Constraints
Hyungjin Chung1, Byeongsu Sim1, Dohoon Ryu, Jong Chul Ye
arXiv 2022. [Paper]
2 Jun 2022

The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion Models
Julia Wolleb1, Robin Sandkühler1, Florentin Bieder, Philippe C. Cattin
arXiv 2022. [Paper]
6 Apr 2022

MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusion
Hyungjin Chung, Eun Sun Lee, Jong Chul Ye
arXiv 2022. [Paper]
23 Mar 2022

Towards performant and reliable undersampled MR reconstruction via diffusion model sampling
Cheng Peng, Pengfei Guo, S. Kevin Zhou, Vishal Patel, Rama Chellappa
arXiv 2022. [Paper] [Github]
8 Mar 2022

Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction
Yutong Xie, Quanzheng Li
MICCAI 2022. [Paper] [Github]
5 Mar 2022

MRI Reconstruction via Data Driven Markov Chain with Joint Uncertainty Estimation
Guanxiong Luo, Martin Heide, Martin Uecker
arXiv 2022. [Paper] [Github]
3 Feb 2022

Unsupervised Denoising of Retinal OCT with Diffusion Probabilistic Model
Dewei Hu, Yuankai K. Tao, Ipek Oguz
arXiv 2022. [Paper] [Github]
27 Jan 2022

Denoising Diffusion Restoration Models
Bahjat Kawar, Michael Elad, Stefano Ermon, Jiaming Song
ICLR 2022 Workshop (Oral). [Paper]
27 Jan 2022

RePaint: Inpainting using Denoising Diffusion Probabilistic Models
Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, Luc Van Gool
CVPR 2022. [Paper] [Github]
24 Jan 2022

DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents
Kushagra Pandey, Avideep Mukherjee, Piyush Rai, Abhishek Kumar
arXiv 2022. [Paper] [Github]
2 Jan 2022

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach1, Andreas Blattmann1, Dominik Lorenz, Patrick Esser, Björn Ommer
CVPR 2022. [Paper] [Github]
20 Dec 2021

Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction
Hyungjin Chung, Byeongsu Sim, Jong Chul Ye
CVPR 2022. [Paper]
9 Dec 2021

Deblurring via Stochastic Refinement
Jay Whang, Mauricio Delbracio, Hossein Talebi, Chitwan Saharia, Alexandros G. Dimakis, Peyman Milanfar
CVPR 2022. [Paper]
5 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models
Yang Song1, Liyue Shen1, Lei Xing, Stefano Ermon
NeurIPS Workshop 2021. [Paper] [Github]
15 Nov 2021

S3RP: Self-Supervised Super-Resolution and Prediction for Advection-Diffusion Process
Chulin Wang, Kyongmin Yeo, Xiao Jin, Andres Codas, Levente J. Klein, Bruce Elmegreen
NeurIPS 2022. [Paper]
8 Nov 2021

Score-based diffusion models for accelerated MRI
Hyungjin Chung, Jong chul Ye
MIA 2021. [Paper] [Github]
8 Oct 2021

Autoregressive Diffusion Models
Emiel Hoogeboom, Alexey A. Gritsenko, Jasmijn Bastings, Ben Poole, Rianne van den Berg, Tim Salimans
ICLR 2022. [Paper]
5 Oct 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

Cascaded Diffusion Models for High Fidelity Image Generation
Jonathan Ho1, Chitwan Saharia1, William Chan, David J. Fleet, Mohammad Norouzi, Tim Salimans
arXiv 2021. [Paper] [Project]
30 May 2021

SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models
Haoying Li, Yifan Yang, Meng Chang, Huajun Feng, Zhihai Xu, Qi Li, Yueting Chen
ACM 2022. [Paper]
30 Apr 2021

Image Super-Resolution via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, Mohammad Norouzi
arXiv 2021. [Paper] [Project] [Github]
15 Apr 2021

Image Translation

DiffusionRig: Learning Personalized Priors for Facial Appearance Editing
Zheng Ding, Xuaner Zhang, Zhihao Xia, Lars Jebe, Zhuowen Tu, Xiuming Zhang
CVPR 2023. [Paper] [Project] [Github]
13 Apr 2023

Face Animation with an Attribute-Guided Diffusion Model
Bohan Zeng1, Xuhui Liu1, Sicheng Gao1, Boyu Liu, Hong Li, Jianzhuang Liu, Baochang Zhang
arXiv 2023. [Paper]
6 Apr 2023

Training-free Style Transfer Emerges from h-space in Diffusion models
Jaeseok Jeong1, Mingi Kwon1, Youngjung Uh
arXiv 2023. [Paper] [Project] [Github]
27 Mar 2023

Diffusion-based Target Sampler for Unsupervised Domain Adaptation
Yulong Zhang, Shuhao Chen, Yu Zhang, Jiangang Lu
arXiv 2023. [Paper]
17 Mar 2023

StyO: Stylize Your Face in Only One-Shot
Bonan Li, Zicheng Zhang, Xuecheng Nie, Congying Han, Yinhan Hu, Tiande Guo
arXiv 2023. [Paper]
6 Mar 2023

DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models
Shidong Cao1, Wenhao Chai1, Shengyu Hao, Yanting Zhang, Hangyue Chen, Gaoang Wang
arXiv 2023. [Paper]
14 Feb 2023

I2SB: Image-to-Image Schrödinger Bridge
Guan-Horng Liu, Arash Vahdat, De-An Huang, Evangelos A. Theodorou, Weili Nie, Anima Anandkumar
arXiv 2023. [Paper] [Project]
12 Feb 2023

Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion
Zihao Wang, Yingyu Yang, Maxime Sermesant, Hervé Delingette, Ona Wu
arXiv 2023. [Paper]
31 Jan 2023

DiffFace: Diffusion-based Face Swapping with Facial Guidance
Kihong Kim, Yunho Kim, Seokju Cho, Junyoung Seo, Jisu Nam, Kychul Lee, Seungryong Kim, KwangHee Lee
arXiv 2022. [Paper] [Project]
27 Dec 2022

HS-Diffusion: Learning a Semantic-Guided Diffusion Model for Head Swapping
Qinghe Wang, Lijie Liu, Miao Hua, Qian He, Pengfei Zhu, Bing Cao, Qinghua Hu
arXiv 2022. [Paper]
13 Dec 2022

Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidance
Chen Henry Wu, Fernando De la Torre
arXiv 2022. [Paper] [Github-1] [Github-2]
11 Oct 2022

Anatomically constrained CT image translation for heterogeneous blood vessel segmentation
Giammarco La Barbera, Haithem Boussaid, Francesco Maso, Sabine Sarnacki, Laurence Rouet, Pietro Gori, Isabelle Bloch
BMVC 2022. [Paper]
4 Oct 2022

Diffusion-based Image Translation using Disentangled Style and Content Representation
Gihyun Kwon, Jong Chul Ye
arXiv 2022. [Paper]
30 Sep 2022

MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translation
Junyoung Seo1, Gyuseong Lee1, Seokju Cho, Jiyoung Lee, Seungryong Kim
arXiv 2022. [Paper] [Project]
22 Sep 2022

Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
Ozan Özdenizci, Robert Legenstein
arXiv 2022. [Paper]
29 Jul 2022

Non-Uniform Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2022. [Paper]
20 Jul 2022

Unsupervised Medical Image Translation with Adversarial Diffusion Models
Muzaffer Özbey, Salman UH Dar, Hasan A Bedel, Onat Dalmaz, Şaban Özturk, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
17 Jul 2022

EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations
Min Zhao, Fan Bao, Chongxuan Li, Jun Zhu
arXiv 2022. [Paper]
14 Jul 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Github]
15 Jun 2022

Pretraining is All You Need for Image-to-Image Translation
Tengfei Wang, Ting Zhang, Bo Zhang, Hao Ouyang, Dong Chen, Qifeng Chen, Fang Wen
arXiv 2022. [Paper] [Project] [Github]
25 May 2022

VQBB: Image-to-image Translation with Vector Quantized Brownian Bridge
Bo Li, Kaitao Xue, Bin Liu, Yu-Kun Lai
arXiv 2022. [Paper]
16 May 2022

The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion Models
Julia Wolleb1, Robin Sandkühler1, Florentin Bieder, Philippe C. Cattin
arXiv 2022. [Paper]
6 Apr 2022

Dual Diffusion Implicit Bridges for Image-to-Image Translation
Xuan Su, Jiaming Song, Chenlin Meng, Stefano Ermon
arXiv 2022. [Paper]
16 Mar 2022

Denoising Diffusion Restoration Models
Bahjat Kawar, Michael Elad, Stefano Ermon, Jiaming Song
NeurIPS 2022. [Paper]
27 Jan 2022

DiffuseMorph: Unsupervised Deformable Image Registration Along Continuous Trajectory Using Diffusion Models
Boah Kim, Inhwa Han, Jong Chul Ye
arXiv 2021. [Paper]
9 Dec 2021

Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
Konpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, Supasorn Suwajanakorn
arXiv 2021. [Paper] [Project]
30 Dec 2021

Conditional Image Generation with Score-Based Diffusion Models
Georgios Batzolis, Jan Stanczuk, Carola-Bibiane Schönlieb, Christian Etmann
arXiv 2021. [Paper]
26 Nov 2021

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, Sungroh Yoon
ICCV 2021 (Oral). [Paper] [Github]
6 Aug 2021

UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models
Hiroshi Sasaki, Chris G. Willcocks, Toby P. Breckon
arXiv 2021. [Paper]
12 Apr 2021

Text driven Image Generation and Editing

Expressive Text-to-Image Generation with Rich Text
Songwei Ge, Taesung Park, Jun-Yan Zhu, Jia-Bin Huang
arXiv 2023. [Paper] [Project] [Github]
13 Apr 2023

An Edit Friendly DDPM Noise Space: Inversion and Manipulations
Inbar Huberman-Spiegelglas, Vladimir Kulikov, Tomer Michaeli
arXiv 2023. [Paper]
12 Apr 2023

Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA
James Seale Smith, Yen-Chang Hsu, Lingyu Zhang, Ting Hua, Zsolt Kira, Yilin Shen, Hongxia Jin
arXiv 2023. [Paper] [Project]
12 Apr 2023

HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models
Eslam Mohamed Bakr, Pengzhan Sun, Xiaoqian Shen, Faizan Farooq Khan, Li Erran Li, Mohamed Elhoseiny
arXiv 2023. [Paper] [Project]
11 Apr 2023

Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond
Mohammadreza Armandpour, Huangjie Zheng, Ali Sadeghian, Amir Sadeghian, Mingyuan Zhou
arXiv 2023. [Paper]
11 Apr 2023

Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Models
Nikita Starodubcev, Dmitry Baranchuk, Valentin Khrulkov, Artem Babenko
arXiv 2023. [Paper]
10 Apr 2023

HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation
Xuan Ju, Ailing Zeng, Chenchen Zhao, Jianan Wang, Lei Zhang, Qiang Xu
arXiv 2023. [Paper] [Github]
9 Apr 2023

Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis
Qiucheng Wu1, Yujian Liu1, Handong Zhao, Trung Bui, Zhe Lin, Yang Zhang, Shiyu Chang
arXiv 2023. [Paper] [Github]
7 Apr 2023

Zero-shot Generative Model Adaptation via Image-specific Prompt Learning
Jiayi Guo, Chaofei Wang, You Wu, Eric Zhang, Kai Wang, Xingqian Xu, Shiji Song, Humphrey Shi, Gao Huang
arXiv 2023. [Paper] [Github]
6 Apr 2023

Training-Free Layout Control with Cross-Attention Guidance
Minghao Chen, Iro Laina, Andrea Vedaldi
arXiv 2023. [Paper] [Project] [Github]
6 Apr 2023

Benchmarking Robustness to Text-Guided Corruptions
Mohammadreza Mofayezi1, Yasamin Medghalchi1
arXiv 2023. [Paper]
6 Apr 2023

DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model
Hoigi Seo1, Hayeon Kim1, Gwanghyun Kim, Se Young Chun
arXiv 2023. [Paper] [Project]
6 Apr 2023

Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Models
Xuhui Jia, Yang Zhao, Kelvin C.K. Chan, Yandong Li, Han Zhang, Boqing Gong, Tingbo Hou, Huisheng Wang, Yu-Chuan Su
arXiv 2023. [Paper]
5 Apr 2023

A Diffusion-based Method for Multi-turn Compositional Image Generation
Chao Wang, Xiaoyu Yang, Jinmiao Huang, Kevin Ferreira
arXiv 2023. [Paper]
5 Apr 2023

viz2viz: Prompt-driven stylized visualization generation using a diffusion model
Jiaqi Wu, John Joon Young Chung, Eytan Adar
arXiv 2023. [Paper]
4 Apr 2023

Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
Alberto Baldrati1, Davide Morelli1, Giuseppe Cartella, Marcella Cornia, Marco Bertini, Rita Cucchiara
arXiv 2023. [Paper]
4 Apr 2023

PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusion
Gwanghyun Kim, Ji Ha Jang, Se Young Chun
arXiv 2023. [Paper] [Project]
4 Apr 2023

Text-Conditioned Sampling Framework for Text-to-Image Generation with Masked Generative Models
Jaewoong Lee1, Sangwon Jang1, Jaehyeong Jo, Jaehong Yoon, Yunji Kim, Jin-Hwa Kim, Jung-Woo Ha, Sung Ju Hwang
arXiv 2023. [Paper]
4 Apr 2023

ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model
Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, Ziwei Liu
arXiv 2023. [Paper] [Project] [Github]
3 Apr 2023

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan, Kwan-Yee K. Wong
arXiv 2023. [Paper]
3 Apr 2023

DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance
Longwen Zhang1, Qiwei Qiu1, Hongyang Lin, Qixuan Zhang, Cheng Shi, Wei Yang, Ye Shi, Sibei Yang, Lan Xu, Jingyi Yu
arXiv 2023. [Paper] [Project]
1 Apr 2023

GlyphDraw: Learning to Draw Chinese Characters in Image Synthesis Models Coherently
Jian Ma, Mingjun Zhao, Chen Chen, Ruichen Wang, Di Niu, Haonan Lu, Xiaodong Lin
arXiv 2023. [Paper] [Project]
31 Mar 2023

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control
Ruixiang Jiang, Can Wang, Jingbo Zhang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
arXiv 2023. [Paper] [Project] [Github]
30 Mar 2023

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models
Vidit Goel1, Elia Peruzzo1, Yifan Jiang, Dejia Xu, Nicu Sebe, Trevor Darrell, Zhangyang Wang, Humphrey Shi
arXiv 2023. [Paper] [Github]
30 Mar 2023

Social Biases through the Text-to-Image Generation Lens
Ranjita Naik, Besmira Nushi
arXiv 2023. [Paper]
30 Mar 2023

Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models
Eric Zhang, Kai Wang, Xingqian Xu, Zhangyang Wang, Humphrey Shi
arXiv 2023. [Paper] [Github]
30 Mar 2023

DiffCollage: Parallel Generation of Large Content with Diffusion Models
Qinsheng Zhang, Jiaming Song, Xun Huang, Yongxin Chen, Ming-Yu Liu
CVPR 2023. [Paper] [Project]
30 Mar 2023

Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models
Wen Wang1, Kangyang Xie1, Zide Liu1, Hao Chen, Yue Cao, Xinlong Wang, Chunhua Shen
arXiv 2023. [Paper]
30 Mar 2023

Discriminative Class Tokens for Text-to-Image Diffusion Models
Idan Schwartz1, Vésteinn Snæbjarnarson1, Sagie Benaim, Hila Chefer, Ryan Cotterell, Lior Wolf, Serge Belongie
arXiv 2023. [Paper]
30 Mar 2023

LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation
Guangcong Zheng1, Xianpan Zhou1, Xuewei Li, Zhongang Qi, Ying Shan, Xi Li
CVPR 2023. [Paper] [Github]
30 Mar 2023

4D Facial Expression Diffusion Model
Kaifeng Zou, Sylvain Faisan, Boyang Yu, Sébastien Valette, Hyewon Seo
arXiv 2023. [Paper] [Github]
29 Mar 2023

MDP: A Generalized Framework for Text-Guided Image Editing by Manipulating the Diffusion Path
Qian Wang, Biao Zhang, Michael Birsak, Peter Wonka
arXiv 2023. [Paper] [Github]
29 Mar 2023

Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversion
Hiromichi Kamata, Yuiko Sakuma, Akio Hayakawa, Masato Ishii, Takuya Narihira
arXiv 2023. [Paper] [Github]
28 Mar 2023

StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing
Senmao Li, Joost van de Weijer, Taihang Hu, Fahad Shahbaz Khan, Qibin Hou, Yaxing Wang, Jian Yang
arXiv 2023. [Paper]
28 Mar 2023

Seer: Language Instructed Video Prediction with Latent Diffusion Models
Xianfan Gu, Chuan Wen, Jiaming Song, Yang Gao
arXiv 2023. [Paper]
27 Mar 2023

Debiasing Scores and Prompts of 2D Diffusion for Robust Text-to-3D Generation
Susung Hong1, Donghoon Ahn1, Seungryong Kim
arXiv 2023. [Paper]
27 Mar 2023

Anti-DreamBooth: Protecting users from personalized text-to-image synthesis
Thanh Van Le, Hao Phung, Thuan Hoang Nguyen, Quan Dao, Ngoc Tran, Anh Tran
arXiv 2023. [Paper] [Github]
27 Mar 2023

GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latents
Tenglong Ao, Zeyi Zhang, Libin Liu
arXiv 2023. [Paper]
26 Mar 2023

Better Aligning Text-to-Image Models with Human Preference
Xiaoshi Wu, Keqiang Sun, Feng Zhu, Rui Zhao, Hongsheng Li
arXiv 2023. [Paper] [Github]
25 Mar 2023

ISS++: Image as Stepping Stone for Text-Guided 3D Shape Generation
Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu
arXiv 2023. [Paper]
24 Mar 2023

DiffuScene: Scene Graph Denoising Diffusion Probabilistic Model for Generative Indoor Scene Synthesis
Jiapeng Tang, Yinyu Nie, Lev Markhasin, Angela Dai, Justus Thies, Matthias Nießner
arXiv 2023. [Paper] [Project]
24 Mar 2023

CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout
Yiqi Lin1, Haotian Bai1, Sijia Li, Haonan Lu, Xiaodong Lin, Hui Xiong, Lin Wang
arXiv 2023. [Paper] [Project]
24 Mar 2023

Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation
Rui Chen, Yongwei Chen, Ningxin Jiao, Kui Jia
arXiv 2023. [Paper]
24 Mar 2023

ReVersion: Diffusion-Based Relation Inversion from Images
Ziqi Huang1, Tianxing Wu1, Yuming Jiang, Kelvin C.K. Chan, Ziwei Liu
arXiv 2023. [Paper] [Project] [Github] 23 Mar 2023

Ablating Concepts in Text-to-Image Diffusion Models
Nupur Kumari, Bingliang Zhang, Sheng-Yu Wang, Eli Shechtman, Richard Zhang, Jun-Yan Zhu
arXiv 2023. [Paper]
23 Mar 2023

Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators
Levon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel, Zhangyang Wang, Shant Navasardyan, Humphrey Shi
arXiv 2023. [Paper] [Github]
23 Mar 2023

MagicFusion: Boosting Text-to-Image Generation Performance by Fusing Diffusion Models
Jing Zhao, Heliang Zheng, Chaoyue Wang, Long Lan, Wenjing Yang
arXiv 2023. [Paper] [Project] [Github]
23 Mar 2023

Pix2Video: Video Editing using Image Diffusion
Duygu Ceylan, Chun-Hao Paul Huang, Niloy J. Mitra
arXiv 2023. [Paper] [Project]
22 Mar 2023

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Ayaan Haque, Matthew Tancik, Alexei A. Efros, Aleksander Holynski, Angjoo Kanazawa
arXiv 2023. [Paper] [Project]
22 Mar 2023

SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation
Juil Koo1, Seungwoo Yoo1, Minh Hieu Nguyen1, Minhyuk Sung
arXiv 2023. [Paper] [Project]
21 Mar 2023

Vox-E: Text-guided Voxel Editing of 3D Objects
Etai Sella, Gal Fiebelman, Peter Hedman, Hadar Averbuch-Elor
arXiv 2023. [Paper] [Project]
21 Mar 2023

CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion
Geonmo Gu1, Sanghyuk Chun1, Wonjae Kim, HeeJae Jun, Yoohoon Kang, Sangdoo Yun
arXiv 2023. [Paper]
21 Mar 2023

3D-CLFusion: Fast Text-to-3D Rendering with Contrastive Latent Diffusion
Yu-Jhe Li, Kris Kitani
arXiv 2023. [Paper]
21 Mar 2023

Text2Tex: Text-driven Texture Synthesis via Diffusion Models
Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, Matthias Nießner
arXiv 2023. [Paper] [Project]
20 Mar 2023

Localizing Object-level Shape Variations with Text-to-Image Diffusion Models
Or Patashnik, Daniel Garibi, Idan Azuri, Hadar Averbuch-Elor, Daniel Cohen-Or
arXiv 2023. [Paper] [Project]
20 Mar 2023

SVDiff: Compact Parameter Space for Diffusion Fine-Tuning
Ligong Han, Yinxiao Li, Han Zhang, Peyman Milanfar, Dimitris Metaxas, Feng Yang
arXiv 2023. [Paper]
20 Mar 2023

Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models
René Haas, Inbar Huberman-Spiegelglas, Rotem Mulayoff, Tomer Michaeli
arXiv 2023. [Paper]
20 Mar 2023

SKED: Sketch-guided Text-based 3D Editing
Aryan Mikaeili, Or Perel, Daniel Cohen-Or, Ali Mahdavi-Amiri
arxiv 2023. [Paper]
19 Mar 2023

DialogPaint: A Dialog-based Image Editing Model
Jingxuan Wei1, Shiyu Wu1, Xin Jiang, Yequan Wang
arXiv 2023. [Paper]
17 Mar 2023

GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generation
Can Qin, Ning Yu, Chen Xing, Shu Zhang, Zeyuan Chen, Stefano Ermon, Yun Fu, Caiming Xiong, Ran Xu
arXiv 2023. [Paper]
17 Mar 2023

DiffusionRet: Generative Text-Video Retrieval with Diffusion Model
Peng Jin1, Hao Li1, Zesen Cheng, Kehan Li, Xiangyang Ji, Chang Liu, Li Yuan, Jie Chen
arXiv 2023. [Paper]
17 Mar 2023

FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model
Jiwen Yu, Yinhuai Wang, Chen Zhao, Bernard Ghanem, Jian Zhang
arXiv 2023. [Paper] [Github]
17 Mar 2023

Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generation
Yiyang Ma, Huan Yang, Wenjing Wang, Jianlong Fu, Jiaying Liu
arXiv 2023. [Paper]
16 Mar 2023

FateZero: Fusing Attentions for Zero-shot Text-based Video Editing
Chenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei, Xintao Wang, Ying Shan, Qifeng Chen
arXiv 2023. [Paper] [Project] [Github]
16 Mar 2023

HIVE: Harnessing Human Feedback for Instructional Visual Editing
Shu Zhang1, Xinyi Yang1, Yihao Feng1, Can Qin, Chia-Chih Chen, Ning Yu, Zeyuan Chen, Huan Wang, Silvio Savarese, Stefano Ermon, Caiming Xiong, Ran Xu
arXiv 2023. [Paper]
16 Mar 2023

P+: Extended Textual Conditioning in Text-to-Image Generation
Andrey Voynov, Qinghao Chu, Daniel Cohen-Or, Kfir Aberman
arXiv 2023. [Paper] [Project]
16 Mar 2023

Highly Personalized Text Embedding for Image Manipulation by Stable Diffusion
Inhwa Han1, Serin Yang1, Taesung Kwon, Jong Chul Ye
arXiv 2023. [Paper]
15 Mar 2023

Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models
Divya Kothandaraman, Tianyi Zhou, Ming Lin, Dinesh Manocha
arXiv 2023. [Paper] [Github]
15 Mar 2023

Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer
Serin Yang, Hyunmin Hwang, Jong Chul Ye
arXiv 2023. [Paper]
15 Mar 2023

Edit-A-Video: Single Video Editing with Object-Aware Consistency
Chaehun Shin1, Heeseung Kim1, Che Hyun Lee, Sang-gil Lee, Sungroh Yoon
arXiv 2023. [Paper] [Project]
14 Mar 2023

Editing Implicit Assumptions in Text-to-Image Diffusion Models
Hadas Orgad1, Bahjat Kawar1, Yonatan Belinkov
arXiv 2023. [Paper] [Project] [Github]
14 Mar 2023

Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation
Junyoung Seo1, Wooseok Jang1, Min-Seop Kwak1, Jaehoon Ko, Hyeonsu Kim, Junho Kim, Jin-Hwa Kim, Jiyoung Lee, Seungryong Kim
arXiv 2023. [Paper]
14 Mar 2023

Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, Nan Duan
arXiv 2023. [Paper] [Github]
8 Mar 2023

Video-P2P: Video Editing with Cross-attention Control
Shaoteng Liu, Yuechen Zhang, Wenbo Li, Zhe Lin, Jiaya Jia
arXiv 2023. [Paper] [Project]
8 Mar 2023

Erasing Concepts from Diffusion Models
Rohit Gandikota1, Joanna Materzynska1, Jaden Fiotto-Kaufman, David Bau
arXiv 2023. [Paper] [Project] [Github]
13 Mar 2023

One Transformer Fits All Distributions in Multi-Modal Diffusion at Scale
Fan Bao, Shen Nie, Kaiwen Xue, Chongxuan Li, Shi Pu, Yaole Wang, Gang Yue, Yue Cao, Hang Su, Jun Zhu
arXiv 2023. [Paper] [Github]
12 Mar 2023

Cones: Concept Neurons in Diffusion Models for Customized Generation
Zhiheng Liu1, Ruili Feng1, Kai Zhu, Yifei Zhang, Kecheng Zheng, Yu Liu, Deli Zhao, Jingren Zhou, Yang Cao
arXiv 2023. [Paper]
9 Mar 2023

A Prompt Log Analysis of Text-to-Image Generation Systems
Yutong Xie, Zhaoying Pan, Jinge Ma, Jie Luo, Qiaozhu Mei
arXiv 2023. [Paper]
8 Mar 2023

Zeroth-Order Optimization Meets Human Feedback: Provable Learning via Ranking Oracles
Zhiwei Tang, Dmitry Rybin, Tsung-Hui Chang
arXiv 2023. [Paper] [Github]
7 Mar 2023

Unleashing Text-to-Image Diffusion Models for Visual Perception
Wenliang Zhao1, Yongming Rao1, Zuyan Liu1, Benlin Liu, Jie Zhou, Jiwen Lu
arXiv 2023. [Paper] [Github]
3 Mar 2023

Collage Diffusion
Vishnu Sarukkai, Linden Li, Arden Ma, Christopher Ré, Kayvon Fatahalian
arXiv 2023. [Paper]
1 Mar 2023

Towards Enhanced Controllability of Diffusion Models
Wonwoong Cho, Hareesh Ravi, Midhun Harikumar, Vinh Khuc, Krishna Kumar Singh, Jingwan Lu, David I. Inouye, Ajinkya Kale
arXiv 2023. [Paper]
28 Feb 2023

Directed Diffusion: Direct Control of Object Placement through Attention Guidance
Wan-Duo Kurt Ma, J.P. Lewis, W. Bastiaan Kleijn, Thomas Leung
arXiv 2023. [Paper]
25 Feb 2023

Modulating Pretrained Diffusion Models for Multimodal Image Synthesis
Cusuh Ham, James Hays, Jingwan Lu, Krishna Kumar Singh, Zhifei Zhang, Tobias Hinz
arXiv 2023. [Paper]
24 Feb 2023

Region-Aware Diffusion for Zero-shot Text-driven Image Editing
Nisha Huang, Fan Tang, Weiming Dong, Tong-Yee Lee, Changsheng Xu
arXiv 2023. [Paper] [Github]
23 Feb 2023

Controlled and Conditional Text to Image Generation with Diffusion Prior
Pranav Aggarwal, Hareesh Ravi, Naveen Marri, Sachin Kelkar, Fengbin Chen, Vinh Khuc, Midhun Harikumar, Ritiz Tambi, Sudharshan Reddy Kakumanu, Purvak Lapsiya, Alvin Ghouas, Sarah Saber, Malavika Ramprasad, Baldo Faieta, Ajinkya Kale
arXiv 2023. [Paper]
23 Feb 2023

Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC
Yilun Du, Conor Durkan, Robin Strudel, Joshua B. Tenenbaum, Sander Dieleman, Rob Fergus, Jascha Sohl-Dickstein, Arnaud Doucet, Will Grathwohl
arXiv 2023. [Paper] [Project]
22 Feb 2023

Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
Xiaodong Wang1, Chenfei Wu1, Shengming Yin, Minheng Ni, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Fan Yang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
arXiv 2023. [Paper]
21 Feb 2023

Exploring the Representation Manifolds of Stable Diffusion Through the Lens of Intrinsic Dimension
Henry Kvinge, Davis Brown, Charles Godfrey
arXiv 2023. [Paper]
16 Feb 2023

Text-driven Visual Synthesis with Latent Diffusion Prior
Ting-Hsuan Liao, Songwei Ge, Yiran Xu, Yao-Chih Lee, Badour AlBahar, Jia-Bin Huang
arXiv 2023. [Paper] [Project]
16 Feb 2023

T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models
Chong Mou, Xintao Wang, Liangbin Xie, Jian Zhang, Zhongang Qi, Ying Shan, Xiaohu Qie
arXiv 2023. [Paper] [Github]
16 Feb 2023

MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
Omer Bar-Tal1, Lior Yariv1, Yaron Lipman, Tali Dekel
arXiv 2023. [Paper] Project] [Github]
16 Feb 2023

Boundary Guided Mixing Trajectory for Semantic Control with Diffusion Models
Ye Zhu, Yu Wu, Zhiwei Deng, Olga Russakovsky, Yan Yan
arXiv 2023. [Paper]
16 Feb 2023

Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation
Joshua Vendrow1, Saachi Jain1, Logan Engstrom, Aleksander Madry
arXiv 2023. [Paper] [Github]
15 Feb 2023

PRedItOR: Text Guided Image Editing with Diffusion Prior
Hareesh Ravi, Sachin Kelkar, Midhun Harikumar, Ajinkya Kale
arXiv 2023. [Paper]
15 Feb 2023

Text-Guided Scene Sketch-to-Photo Synthesis
AprilPyone MaungMaung, Makoto Shing, Kentaro Mitsui, Kei Sawada, Fumio Okura
arXiv 2023. [Paper]
14 Feb 2023

Universal Guidance for Diffusion Models
Arpit Bansal1, Hong-Min Chu1, Avi Schwarzschild, Soumyadip Sengupta, Micah Goldblum, Jonas Geiping, Tom Goldstein
arXiv 2023. [Paper] [Github]
14 Feb 2023

Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang, Maneesh Agrawala
arXiv 2023. [Paper] [Github]
10 Feb 2023

Analyzing Multimodal Objectives Through the Lens of Generative Diffusion Guidance
Chaerin Kong, Nojun Kwak
arXiv 2023. [Paper]
10 Feb 2023

Is This Loss Informative? Speeding Up Textual Inversion with Deterministic Objective Evaluation
Anton Voronov1, Mikhail Khoroshikh1, Artem Babenko, Max Ryabinin
arXiv 2023. [Paper]
9 Feb 2023

Q-Diffusion: Quantizing Diffusion Models
Xiuyu Li, Long Lian, Yijiang Liu, Huanrui Yang, Zhen Dong, Daniel Kang, Shanghang Zhang, Kurt Keutzer
arXiv 2023. [Paper]
8 Feb 2023

GLAZE: Protecting Artists from Style Mimicry by Text-to-Image Models
Shawn Shan, Jenna Cryan, Emily Wenger, Haitao Zheng, Rana Hanocka, Ben Y. Zhao
arXiv 2023. [Paper]
8 Feb 2023

Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Models
Hyeonho Jeong, Gihyun Kwon, Jong Chul Ye
arXiv 2023. [Paper]
8 Feb 2023

Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness
Felix Friedrich, Patrick Schramowski, Manuel Brack, Lukas Struppek, Dominik Hintersdorf, Sasha Luccioni, Kristian Kersting
arXiv 2023. [Paper]
7 Feb 2023

Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery
Yuxin Wen1, Neel Jain1, John Kirchenbauer, Micah Goldblum, Jonas Geiping, Tom Goldstein
arXiv 2023. [Paper] [Github]
7 Feb 2023

Zero-shot Image-to-Image Translation
Gaurav Parmar, Krishna Kumar Singh, Richard Zhang, Yijun Li, Jingwan Lu, Jun-Yan Zhu
arXiv 2023. [Paper]
6 Feb 2023

Structure and Content-Guided Video Synthesis with Diffusion Models
Patrick Esser, Johnathan Chiu, Parmida Atighehchian, Jonathan Granskog, Anastasis Germanidis
arXiv 2023. [Paper] [Project]
6 Feb 2023

Mixture of Diffusers for scene composition and high resolution image generation
Álvaro Barbero Jiménez
arXiv 2023. [Paper]
5 Feb 2023

ReDi: Efficient Learning-Free Diffusion Inference via Trajectory Retrieval
Kexun Zhang, Xianjun Yang, William Yang Wang, Lei Li
arXiv 2023. [Paper]
5 Feb 2023

Eliminating Prior Bias for Semantic Image Editing via Dual-Cycle Diffusion
Zuopeng Yang, Tianshu Chu, Xin Lin, Erdun Gao, Daqing Liu, Jie Yang, Chaoyue Wang
arXiv 2023. [Paper]
5 Feb 2023

Semantic-Guided Image Augmentation with Pre-trained Models
Bohan Li, Xinghao Wang, Xiao Xu, Yutai Hou, Yunlong Feng, Feng Wang, Wanxiang Che
arXiv 2023. [Paper]
4 Feb 2023

TEXTure: Text-Guided Texturing of 3D Shapes
Elad Richardson1, Gal Metzer1, Yuval Alaluf, Raja Giryes, Daniel Cohen-Or
arXiv 2023. [Paper] [Project] [Github]
3 Feb 2023

Dreamix: Video Diffusion Models are General Video Editors
Eyal Molad1, Eliahu Horwitz1, Dani Valevski1, Alex Rav Acha, Yossi Matias, Yael Pritch, Yaniv Leviathan, Yedid Hoshen
arXiv 2023. [Paper] [Project]
2 Feb 2023

Trash to Treasure: Using text-to-image models to inform the design of physical artefacts
Amy Smith1, Hope Schroeder1, Ziv Epstein, Michael Cook, Simon Colton, Andrew Lippman
arXiv 2023. [Paper]
1 Feb 2023

Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models
Hila Chefer1, Yuval Alaluf1, Yael Vinker, Lior Wolf, Daniel Cohen-Or
arXiv 2023. [Paper] [Project] [Github]
31 Jan 2023

Zero3D: Semantic-Driven Multi-Category 3D Shape Generation
Bo Han, Yitong Liu, Yixuan Shen
arXiv 2023. [Paper]
31 Jan 2023

Shape-aware Text-driven Layered Video Editing
Yao-Chih Lee, Ji-Ze Genevieve Jang, Yi-Ting Chen, Elizabeth Qiu, Jia-Bin Huang
arXiv 2023. [Paper] [Project]
30 Jan 2023

PromptMix: Text-to-image diffusion models enhance the performance of lightweight networks
Arian Bakhtiarnia, Qi Zhang, Alexandros Iosifidis
arXiv 2023. [Paper] [Github]
30 Jan 2023

GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesis
Ming Tao, Bing-Kun Bao, Hao Tang, Changsheng Xu
arXiv 2023. [Paper] [Github]
30 Jan 2023

SEGA: Instructing Diffusion using Semantic Dimensions
Manuel Brack, Felix Friedrich, Dominik Hintersdorf, Lukas Struppek, Patrick Schramowski, Kristian Kersting
arXiv 2023. [Paper]
28 Jan 2023

Towards Equitable Representation in Text-to-Image Synthesis Models with the Cross-Cultural Understanding Benchmark (CCUB) Dataset
Zhixuan Liu, Youeun Shin, Beverley-Claire Okogwu, Youngsik Yun, Lia Coleman, Peter Schaldenbrand, Jihie Kim, Jean Oh
arXiv 2023. [Paper]
28 Jan 2023

Text-To-4D Dynamic Scene Generation
Uriel Singer1, Shelly Sheynin1, Adam Polyak1, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, Yaniv Taigman
arXiv 2023. [Paper]
26 Jan 2023

Guiding Text-to-Image Diffusion Model Towards Grounded Generation
Ziyi Li, Qinye Zhou, Xiaoyun Zhang, Ya Zhang, Yanfeng Wang, Weidi Xie
arXiv 2023. [Paper] [Project]
12 Jan 2023

Visual Story Generation Based on Emotion and Keywords
Yuetian Chen, Ruohua Li, Bowen Shi, Peiru Liu, Mei Si
AAAI 2022. [Paper]
7 Jan 2023

Muse: Text-To-Image Generation via Masked Generative Transformers
Huiwen Chang1, Han Zhang1, Jarred Barber, AJ Maschinot, Jose Lezama, Lu Jiang, Ming-Hsuan Yang, Kevin Murphy, William T. Freeman, Michael Rubinstein, Yuanzhen Li, Dilip Krishnan
arXiv 2023. [Paper] [Project]
2 Jan 2023

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models
Jiale Xu, Xintao Wang, Weihao Cheng, Yan-Pei Cao, Ying Shan, Xiaohu Qie, Shenghua Gao
arXiv 2022. [Paper] [Project]
28 Dec 2022

Exploring Vision Transformers as Diffusion Learners
He Cao, Jianan Wang, Tianhe Ren, Xianbiao Qi, Yihao Chen, Yuan Yao, Lei Zhang
arXiv 2022. [Paper]
28 Dec 2022

Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Weixian Lei, Yuchao Gu, Wynne Hsu, Ying Shan, Xiaohu Qie, Mike Zheng Shou
arXiv 2022. [Paper] [Project]
22 Dec 2022

Optimizing Prompts for Text-to-Image Generation
Yaru Hao1, Zewen Chi1, Li Dong, Furu Wei
arXiv 2022. [Paper] [Project] [Github]
19 Dec 2022

Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models
Qiucheng Wu, Yujian Liu, Handong Zhao, Ajinkya Kale, Trung Bui, Tong Yu, Zhe Lin, Yang Zhang, Shiyu Chang
arXiv 2022. [Paper] [Github]
16 Dec 2022

TeTIm-Eval: a novel curated evaluation data set for comparing text-to-image models
Federico A. Galatolo, Mario G. C. A. Cimino, Edoardo Cogotti
arXiv 2022. [Paper]
15 Dec 2022

Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting
Su Wang1, Chitwan Saharia1, Ceslee Montgomery1, Jordi Pont-Tuset, Shai Noy, Stefano Pellegrini, Yasumasa Onoe, Sarah Laszlo, David J. Fleet, Radu Soricut, Jason Baldridge, Mohammad Norouzi, Peter Anderson, William Chan
arXiv 2022. [Paper]
13 Dec 2022

The Stable Artist: Steering Semantics in Diffusion Latent Space
Manuel Brack, Patrick Schramowski, Felix Friedrich, Dominik Hintersdorf, Kristian Kersting
arXiv 2022. [Paper]
12 Dec 2022

SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model
Shaoan Xie, Zhifei Zhang, Zhe Lin, Tobias Hinz, Kun Zhang
arXiv 2022. [Paper]
9 Dec 2022

Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang
arXiv 2022. [Paper] [Github]
9 Dec 2022

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis
Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, Christian Theobalt
arXiv 2022. [Paper] [Project]
8 Dec 2022

SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation
Yen-Chi Cheng, Hsin-Ying Lee, Sergey Tulyakov, Alexander Schwing, Liangyan Gui
arXiv 2022. [Paper] [Project]
8 Dec 2022

SINE: SINgle Image Editing with Text-to-Image Diffusion Models
Zhixing Zhang, Ligong Han, Arnab Ghosh, Dimitris Metaxas, Jian Ren
arXiv 2022. [Paper] [Project] [Github]
8 Dec 2022

Multi-Concept Customization of Text-to-Image Diffusion
Nupur Kumari, Bingliang Zhang, Richard Zhang, Eli Shechtman, Jun-Yan Zhu
arXiv 2022. [Paper] [Project]
8 Dec 2022

Diffusion Guided Domain Adaptation of Image Generators
Kunpeng Song, Ligong Han, Bingchen Liu, Dimitris Metaxas, Ahmed Elgammal
arXiv 2022. [Paper] [Project]
8 Dec 2022

Executing your Commands via Motion Diffusion in Latent Space
Xin Chen, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, Jingyi Yu, Gang Yu
arXiv 2022. [Paper] [Project]
8 Dec 2022

Magic: Multi Art Genre Intelligent Choreography Dataset and Network for 3D Dance Generation
Ronghui Li, Junfan Zhao, Yachao Zhang, Mingyang Su, Zeping Ren, Han Zhang, Xiu Li
arXiv 2022. [Paper]
7 Dec 2022

Judge, Localize, and Edit: Ensuring Visual Commonsense Morality for Text-to-Image Generation
Seongbeom Park, Suhong Moon, Jinkyu Kim
arXiv 2022. [Paper]
7 Dec 2022

NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors
Congyue Deng, Chiyu "Max'' Jiang, Charles R. Qi, Xinchen Yan, Yin Zhou, Leonidas Guibas, Dragomir Anguelov
arXiv 2022. [Paper]
6 Dec 2022

Diffusion-SDF: Text-to-Shape via Voxelized Diffusion
Muheng Li, Yueqi Duan, Jie Zhou, Jiwen Lu
arXiv 2022. [Paper]
6 Dec 2022

ADIR: Adaptive Diffusion for Image Reconstruction
Shady Abu-Hussein, Tom Tirer, Raja Giryes
arXiv 2022. [Paper] [Project]
6 Dec 2022

M-VADER: A Model for Diffusion with Multimodal Context
Samuel Weinbach1, Marco Bellagente1, Constantin Eichenberg, Andrew Dai, Robert Baldock, Souradeep Nanda, Björn Deiseroth, Koen Oostermeijer, Hannah Teufel, Andres Felipe Cruz-Salinas
arXiv 2022. [Paper]
6 Dec 2022

Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encoding
Gyeongman Kim, Hajin Shim, Hyunsu Kim, Yunjey Choi, Junho Kim, Eunho Yang
arXiv 2022. [Paper]
6 Dec 2022

Unite and Conquer: Cross Dataset Multimodal Synthesis using Diffusion Models
Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel
arXiv 2022. [Paper] [Project]
1 Dec 2022

Shape-Guided Diffusion with Inside-Outside Attention
Dong Huk Park1, Grace Luo1, Clayton Toste, Samaneh Azadi, Xihui Liu, Maka Karalashvili, Anna Rohrbach, Trevor Darrell
arXiv 2022. [Paper] [Project]
1 Dec 2022

SinDDM: A Single Image Denoising Diffusion Model
Vladimir Kulikov, Shahar Yadin, Matan Kleiner, Tomer Michaeli
arXiv 2022. [Paper] [Project]
29 Nov 2022

DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model
Gwanghyun Kim, Se Young Chun
arXiv 2022. [Paper] [Github]
29 Nov 2022

Unified Discrete Diffusion for Simultaneous Vision-Language Generation
Minghui Hu, Chuanxia Zheng, Heliang Zheng, Tat-Jen Cham, Chaoyue Wang, Zuopeng Yang, Dacheng Tao, Ponnuthurai N. Suganthan
arXiv 2022. [Paper]
27 Nov 2022

3DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models
Gang Li, Heliang Zheng, Chaoyue Wang, Chang Li, Changwen Zheng, Dacheng Tao
arXiv 2022. [Paper]
25 Nov 2022

SpaText: Spatio-Textual Representation for Controllable Image Generation
Omri Avrahami, Thomas Hayes, Oran Gafni, Sonal Gupta, Yaniv Taigman, Devi Parikh, Dani Lischinski, Ohad Fried, Xi Yin
arXiv 2022. [Paper] [Project]
25 Nov 2022

Sketch-Guided Text-to-Image Diffusion Models
Andrey Voynov, Kfir Aberman, Daniel Cohen-Or
arXiv 2022. [Paper] [Project]
24 Nov 2022

Shifted Diffusion for Text-to-image Generation
Yufan Zhou, Bingchen Liu, Yizhe Zhu, Xiao Yang, Changyou Chen, Jinhui Xu
arXiv 2022. [Paper]
24 Nov 2022

EDICT: Exact Diffusion Inversion via Coupled Transformations
Bram Wallace, Akash Gokul, Nikhil Naik
arXiv 2022. [Paper]
22 Nov 2022

Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation
Narek Tumanyan1, Michal Geyer1, Shai Bagon, Tali Dekel
arXiv 2022. [Paper]
22 Nov 2022

Human Evaluation of Text-to-Image Models on a Multi-Task Benchmark
Vitali Petsiuk, Alexander E. Siemenn, Saisamrit Surbehera, Zad Chin, Keith Tyser, Gregory Hunter, Arvind Raghavan, Yann Hicke, Bryan A. Plummer, Ori Kerret, Tonio Buonassisi, Kate Saenko, Armando Solar-Lezama, Iddo Drori
NeurIPS 2022. [Paper]
22 Nov 2022

SinDiffusion: Learning a Diffusion Model from a Single Natural Image
Weilun Wang, Jianmin Bao, Wengang Zhou, Dongdong Chen, Dong Chen, Lu Yuan, Houqiang Li
arXiv 2022. [Paper] [Github]
22 Nov 2022

SinFusion: Training Diffusion Models on a Single Image or Video
Yaniv Nikankin, Niv Haim, Michal Irani
arXiv 2022. [Paper]
21 Nov 2022

Investigating Prompt Engineering in Diffusion Models
Sam Witteveen, Martin Andrews
arXiv 2022. [Paper]
21 Nov 2022

VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models
Ajay Jain1, Amber Xie1, Pieter Abbeel
arXiv 2022. [Paper] [Project]
21 Nov 2022

DiffStyler: Controllable Dual Diffusion for Text-Driven Image Stylization
Nisha Huang, Yuxin Zhang, Fan Tang, Chongyang Ma, Haibin Huang, Yong Zhang, Weiming Dong, Changsheng Xu
arXiv 2022. [Paper]
19 Nov 2022

Magic3D: High-Resolution Text-to-3D Content Creation
Chen-Hsuan Lin1, Jun Gao1, Luming Tang1, Towaki Takikawa1, Xiaohui Zeng1, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, Tsung-Yi Lin
arXiv 2022. [Paper] [Project]
18 Nov 2022

Invariant Learning via Diffusion Dreamed Distribution Shifts
Priyatham Kattakinda, Alexander Levine, Soheil Feizi
arXiv 2022. [Paper]
18 Nov 2022

Null-text Inversion for Editing Real Images using Guided Diffusion Models
Ron Mokady, Amir Hertz, Kfir Aberman, Yael Pritch, Daniel Cohen-Or
arXiv 2022. [Paper]
17 Nov 2022

InstructPix2Pix: Learning to Follow Image Editing Instructions
Tim Brooks, Aleksander Holynski, Alexei A. Efros
arXiv 2022. [Paper]
17 Nov 2022

Versatile Diffusion: Text, Images and Variations All in One Diffusion Model
Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, Humphrey Shi
arXiv 2022. [Paper] [Github]
15 Nov 2022

Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models
Adham Elarabawy, Harish Kamath, Samuel Denton
arXiv 2022. [Paper]
15 Nov 2022

Arbitrary Style Guidance for Enhanced Diffusion-Based Text-to-Image Generation
Zhihong Pan, Xin Zhou, Hao Tian
arXiv 2022. [Paper]
14 Nov 2022

Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models
Patrick Schramowski, Manuel Brack, Björn Deiseroth, Kristian Kersting
arXiv 2022. [Paper] [Github]
9 Nov 2022

Rickrolling the Artist: Injecting Invisible Backdoors into Text-Guided Image Generation Models
Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
arXiv 2022. [Paper] [Github]
4 Nov 2022

eDiffi: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, Bryan Catanzaro, Tero Karras, Ming-Yu Liu
arXiv 2022. [Paper] [Github]
2 Nov 2022

MagicMix: Semantic Mixing with Diffusion Models
Jun Hao Liew, Hanshu Yan, Daquan Zhou, Jiashi Feng
arXiv 2022. [Paper] [Project]
28 Oct 2022

UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance
Wei Li, Xue Xu, Xinyan Xiao, Jiachen Liu, Hu Yang, Guohao Li, Zhanpeng Wang, Zhifan Feng, Qiaoqiao She, Yajuan Lyu, Hua Wu
arXiv 2022. [Paper]
28 Oct 2022

How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?
Hritik Bansal1, Da Yin1, Masoud Monajatipoor, Kai-Wei Chang
EMNLP 2022. [Paper] [Github]
27 Oct 2022

ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts
Zhida Feng1, Zhenyu Zhang1, Xintong Yu1, Yewei Fang, Lanxin Li, Xuyi Chen, Yuxiang Lu, Jiaxiang Liu, Weichong Yin, Shikun Feng, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
arXiv 2022. [Paper]
27 Oct 2022

DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models
Zijie J. Wang, Evan Montoya, David Munechika, Haoyang Yang, Benjamin Hoover, Duen Horng Chau
arXiv 2022. [Paper] [Project]
26 Oct 2022

Lafite2: Few-shot Text-to-Image Generation
Yufan Zhou, Chunyuan Li, Changyou Chen, Jianfeng Gao, Jinhui Xu
arXiv 2022. [Paper]
25 Oct 2022

High-Resolution Image Editing via Multi-Stage Blended Diffusion
Johannes Ackermann, Minjun Li
NeurIPS Workshop 2022. [Paper] [Github]
24 Oct 2022

Conditional Diffusion with Less Explicit Guidance via Model Predictive Control
Max W. Shen, Ehsan Hajiramezanali, Gabriele Scalia, Alex Tseng, Nathaniel Diamant, Tommaso Biancalani, Andreas Loukas
arXiv 2022. [Paper]
21 Oct 2022

A Visual Tour Of Current Challenges In Multimodal Language Models
Shashank Sonkar, Naiming Liu, Richard G. Baraniuk
arXiv 2022. [Paper]
22 Oct 2022

DiffEdit: Diffusion-based semantic image editing with mask guidance
Guillaume Couairon, Jakob Verbeek, Holger Schwenk, Matthieu Cord
arXiv 2022. [Paper]
20 Oct 2022

Diffusion Models already have a Semantic Latent Space
Mingi Kwon, Jaeseok Jeong, Youngjung Uh
arXiv 2022. [Paper] [Project]
20 Oct 2022

UniTune: Text-Driven Image Editing by Fine Tuning an Image Generation Model on a Single Image
Dani Valevski, Matan Kalman, Yossi Matias, Yaniv Leviathan
arXiv 2022. [Paper]
18 Oct 2022

Swinv2-Imagen: Hierarchical Vision Transformer Diffusion Models for Text-to-Image Generation
Ruijun Li, Weihua Li, Yi Yang, Hanyu Wei, Jianhua Jiang, Quan Bai
arXiv 2022. [Paper]
18 Oct 2022

Imagic: Text-Based Real Image Editing with Diffusion Models
Bahjat Kawar1, Shiran Zada1, Oran Lang, Omer Tov, Huiwen Chang, Tali Dekel, Inbar Mosseri, Michal Irani
arXiv 2022. [Paper]
17 Oct 2022

Leveraging Off-the-shelf Diffusion Model for Multi-attribute Fashion Image Manipulation
Chaerin Kong, DongHyeon Jeon, Ohjoon Kwon, Nojun Kwak
arXiv 2022. [Paper]
12 Oct 2022

Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidance
Chen Henry Wu, Fernando De la Torre
arXiv 2022. [Paper] [Github-1] [Github-2]
11 Oct 2022

Imagen Video: High Definition Video Generation with Diffusion Models
Jonathan Ho1, William Chan1, Chitwan Saharia1, Jay Whang1, Ruiqi Gao, Alexey Gritsenko, Diederik P. Kingma, Ben Poole, Mohammad Norouzi, David J. Fleet, Tim Salimans
arXiv 2022. [Paper]
5 Oct 2022

DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics
Ivan Kapelyukh, Vitalis Vosylius, Edward Johns
arXiv 2022. [Paper]
5 Oct 2022

LDEdit: Towards Generalized Text Guided Image Manipulation via Latent Diffusion Models
Paramanand Chandramouli, Kanchana Vaishnavi Gandikota
arXiv 2022. [Paper]
5 Oct 2022

clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIP
Justin N. M. Pinkney, Chuan Li
BMVC 2022. [Paper] [Github]
5 Oct 2022

Membership Inference Attacks Against Text-to-image Generation Models
Yixin Wu, Ning Yu, Zheng Li, Michael Backes, Yang Zhang
arXiv 2022. [Paper]
3 Oct 2022

Make-A-Video: Text-to-Video Generation without Text-Video Data
Uriel Singer, Adam Polyak, Thomas Hayes, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry Yang, Oron Ashual, Oran Gafni, Devi Parikh, Sonal Gupta, Yaniv Taigman
arXiv 2022. [Paper]
29 Sep 2022

DreamFusion: Text-to-3D using 2D Diffusion
Ben Poole, Ajay Jain, Jonathan T. Barron, Ben Mildenhall
arXiv 2022. [Paper] [Github]
29 Sep 2022

Re-Imagen: Retrieval-Augmented Text-to-Image Generator
Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen
arXiv 2022. [Paper]
29 Sep 2022

Creative Painting with Latent Diffusion Models
Xianchao Wu
arXiv 2022. [Paper]
29 Sep 2022

Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusion
Nisha Huang, Fan Tang, Weiming Dong, Changsheng Xu
arXiv 2022. [Paper] [Github]
27 Sep 2022

Personalizing Text-to-Image Generation via Aesthetic Gradients
Victor Gallego
NeurIPS 2022. [Paper] [Github]
25 Sep 2022

Best Prompts for Text-to-Image Models and How to Find Them
Nikita Pavlichenko, Dmitry Ustalov
arXiv 2022. [Paper]
23 Sep 2022

The Biased Artist: Exploiting Cultural Biases via Homoglyphs in Text-Guided Image Generation Models
Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
arXiv 2022. [Paper] [Github]
19 Sep 2022

Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Models
Chen Henry Wu, Saman Motamed, Shaunak Srivastava, Fernando De la Torre
NeurIPS 2022. [Paper] [Github]
14 Sep 2022

ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation
Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu
ICLR 2023. [Paper] [Github]
9 Sep 2022

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, Kfir Aberman
arXiv 2022. [Paper] [Project] [Github]
25 Aug 2022

Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models
Robin Rombach1, Andreas Blattmann1, Björn Ommer
arXiv 2022. [Paper] [Github]
26 Jul 2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Ye Zhu, Yu Wu, Kyle Olszewski, Jian Ren, Sergey Tulyakov, Yan Yan
arXiv 2022. [Paper] [Github]
15 Jun 2022

Blended Latent Diffusion
Omri Avrahami, Ohad Fried, Dani Lischinski
ACM 2022. [Paper] [Project] [Github]
6 Jun 2022

Compositional Visual Generation with Composable Diffusion Models
Nan Liu1, Shuang Li1, Yilun Du1, Antonio Torralba, Joshua B. Tenenbaum
ECCV 2022. [Paper] [Project] [Github]
3 Jun 2022

DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder
Jie Shi1, Chenfei Wu1, Jian Liang, Xiang Liu, Nan Duan
arXiv 2022. [Paper]
1 Jun 2022

Improved Vector Quantized Diffusion Models
Zhicong Tang, Shuyang Gu, Jianmin Bao, Dong Chen, Fang Wen
arXiv 2022. [Paper] [Github]
31 May 2022

Text2Human: Text-Driven Controllable Human Image Generation
Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, Ziwei Liu
ACM 2022. [Paper] [Github]
31 May 2022

Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Chitwan Saharia1, William Chan1, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, Mohammad Norouzi
NeurIPS 2022. [Paper] [Github]
23 May 2022

Retrieval-Augmented Diffusion Models
Andreas Blattmann1, Robin Rombach1, Kaan Oktay, Björn Ommer
arXiv 2022. [Paper] [Github]
25 Apr 2022

Hierarchical Text-Conditional Image Generation with CLIP Latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, Mark Chen
arXiv 2022. [Paper] [Github]
13 Apr 2022

KNN-Diffusion: Image Generation via Large-Scale Retrieval
Oron Ashual, Shelly Sheynin, Adam Polyak, Uriel Singer, Oran Gafni, Eliya Nachmani, Yaniv Taigman
arXiv 2022. [Paper]
6 Apr 2022

High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach1, Andreas Blattmann1, Dominik Lorenz, Patrick Esser, Björn Ommer
CVPR 2022. [Paper] [Github]
20 Dec 2021

More Control for Free! Image Synthesis with Semantic Diffusion Guidance
Xihui Liu, Dong Huk Park, Samaneh Azadi, Gong Zhang, Arman Chopikyan, Yuxiao Hu, Humphrey Shi, Anna Rohrbach, Trevor Darrell
arXiv 2021. [Paper] [Project]
10 Dec 2021

Vector Quantized Diffusion Model for Text-to-Image Synthesis
Shuyang Gu, Dong Chen, Jianmin Bao, Fang Wen, Bo Zhang, Dongdong Chen, Lu Yuan, Baining Guo
CVPR 2022. [Paper] [Github]
29 Nov 2021

Blended Diffusion for Text-driven Editing of Natural Images
Omri Avrahami, Dani Lischinski, Ohad Fried
CVPR 2022. [Paper] [Project] [Github]
29 Nov 2021

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
Zhisheng Xiao, Karsten Kreis, Arash Vahdat
ICLR 2022 (Spotlight). [Paper] [Project]
15 Dec 2021

DiffusionCLIP: Text-guided Image Manipulation Using Diffusion Models
Gwanghyun Kim, Jong Chul Ye
CVPR 2022. [Paper]
6 Oct 2021

Medical Imaging

A Multi-Institutional Open-Source Benchmark Dataset for Breast Cancer Clinical Decision Support using Synthetic Correlated Diffusion Imaging Data
Chi-en Amy Tai, Hayden Gunraj, Alexander Wong
arXiv 2023. [Paper]
12 Apr 2023

Cancer-Net BCa-S: Breast Cancer Grade Prediction using Volumetric Deep Radiomic Features from Synthetic Correlated Diffusion Imaging
Chi-en Amy Tai, Hayden Gunraj, Alexander Wong
arXiv 2023. [Paper]
12 Apr 2023

SPIRiT-Diffusion: Self-Consistency Driven Diffusion Model for Accelerated MRI
Zhuo-Xu Cui, Chentao Cao, Jing Cheng, Sen Jia, Hairong Zheng, Dong Liang, Yanjie Zhu
arXiv 2023. [Paper]
11 Apr 2023

Mask-conditioned latent diffusion for generating gastrointestinal polyp images
Roman Macháček1, Leila Mozaffari1, Zahra Sepasdar, Sravanthi Parasa, Pål Halvorsen, Michael A. Riegler, Vajira Thambawita
arXiv 2023. [Paper]
11 Apr 2023

BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentation
Tao Chen, Chenhui Wang, Hongming Shan
arXiv 2023. [Paper]
10 Apr 2023

Ambiguous Medical Image Segmentation using Diffusion Models
Aimon Rahman, Jeya Maria Jose Valanarasu, Ilker Hacihaliloglu, Vishal M Patel
CVPR 2023. [Paper] [Github]
10 Apr 2023

MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generation
Kun Han, Yifeng Xiong, Chenyu You, Pooya Khosravi, Shanlin Sun, Xiangyi Yan, James Duncan, Xiaohui Xie
arxiv 2023. [Paper] [Project]
8 Apr 2023

Towards Realistic Ultrasound Fetal Brain Imaging Synthesis
Michelle Iskandar, Harvey Mannering, Zhanxiang Sun, Jacqueline Matthew, Hamideh Kerdegari, Laura Peralta, Miguel Xochicale
arXiv 2023. [Paper] [Gitub]
8 Apr 2023

Zero-shot CT Field-of-view Completion with Unconditional Generative Diffusion Prior
Kaiwen Xu, Aravind R. Krishnan, Thomas Z. Li, Yuankai Huo, Kim L. Sandler, Fabien Maldonado, Bennett A. Landman
arXiv 2023. [Paper]
7 Apr 2023

Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models
Yunxiang Li, Hua-Chieh Shao, Xiao Liang, Liyuan Chen, Ruiqi Li, Steve Jiang, Jing Wang, You Zhang
arXiv 2023. [Paper]
5 Apr 2023

CoreDiff: Contextual Error-Modulated Generalized Diffusion Model for Low-Dose CT Denoising and Generalization
Qi Gao, Zilong Li, Junping Zhang, Yi Zhang, Hongming Shan
arXiv 2023. [Paper]
4 Apr 2023

ViT-DAE: Transformer-driven Diffusion Autoencoder for Histopathology Image Analysis
Xuan Xu, Saarthak Kapse, Rajarsi Gupta, Prateek Prasanna
MICCAI 2023. [Paper]
3 Apr 2023

Pay Attention: Accuracy Versus Interpretability Trade-off in Fine-tuned Diffusion Models
Mischa Dombrowski, Hadrien Reynaud, Johanna P. Müller, Matthew Baugh, Bernhard Kainz
arXiv 2023. [Paper]
31 Mar 2023

DDMM-Synth: A Denoising Diffusion Model for Cross-modal Medical Image Synthesis with Sparse-view Measurement Embedding
Xiaoyue Li, Kai Shang, Gaoang Wang, Mark D. Butala
arXiv 2023. [Paper]
28 Mar 2023

Diffusion Models for Memory-efficient Processing of 3D Medical Images
Florentin Bieder, Julia Wolleb, Alicia Durrer, Robin Sandkühler, Philippe C. Cattin
MIDL 2023. [Paper]
27 Mar 2023

Multi-task Learning of Histology and Molecular Markers for Classifying Diffuse Glioma
Xiaofei Wang, Stephen Price, Chao Li
arXiv 2023. [Paper]
26 Mar 2023

CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesis
Lan Jiang, Ye Mao, Xi Chen, Xiangfeng Wang, Chao Li
arXiv 2023. [Paper]
24 Mar 2023

DisC-Diff: Disentangled Conditional Diffusion Model for Multi-Contrast MRI Super-Resolution
Ye Mao1, Lan Jiang1, Xi Chen, Chao Li
arXiv 2023. [Paper]
23 Mar 2023

Medical diffusion on a budget: textual inversion for medical image generation
Bram de Wilde, Anindo Saha, Richard P.G. ten Broek, Henkjan Huisman
arXiv 2023. [Paper]
23 Mar 2023

Sub-volume-based Denoising Diffusion Probabilistic Model for Cone-beam CT Reconstruction from Incomplete Data
Wenjun Xia, Chuang Niu, Wenxiang Cong, Ge Wang
arXiv 2023. [Paper]
22 Mar 2023

Feature-Conditioned Cascaded Video Diffusion Models for Precise Echocardiogram Synthesis
Hadrien Reynaud, Mengyun Qiao, Mischa Dombrowski, Thomas Day, Reza Razavi, Alberto Gomez, Paul Leeson, Bernhard Kainz
arXiv 2023. [Paper]
22 Mar 2023

Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentation
Haipeng Zhou, Lei Zhu, Yuyin Zhou
arXiv 2023. [Paper]
22 Mar 2023

Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Grading
Matthias Keicher, Matan Atad, David Schinz, Alexandra S. Gersing, Sarah C. Foreman, Sophia S. Goller, Juergen Weissinger, Jon Rischewski, Anna-Sophia Dietrich, Benedikt Wiestler, Jan S. Kirschke, Nassir Navab
arXiv 2023. [Paper]
21 Mar 2023

NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Models
Aman Shrivastava, P. Thomas Fletcher
arXiv 2023. [Paper]
20 Mar 2023

Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesis
Tobias Weber, Michael Ingrisch, Bernd Bischl, David Rügamer
arXiv 2023. [Paper]
20 Mar 2023

DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classification
Yijun Yang, Huazhu Fu, Angelica Aviles-Rivero, Carola-Bibiane Schönlieb, Lei Zhu
arXiv 2023. [Paper]
19 Mar 2023

Diff-UNet: A Diffusion Embedded Network for Volumetric Segmentation
Zhaohu Xing, Liang Wan, Huazhu Fu, Guang Yang, Lei Zhu
arXiv 2023. [Paper] [Github]
18 Mar 2023

Reversing the Abnormal: Pseudo-Healthy Generative Networks for Anomaly Detection
Cosmin I Bercea, Benedikt Wiestler, Daniel Rueckert, Julia A Schnabel
arXiv 2023. [Paper]
15 Mar 2023

Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models
Suhyeon Lee1, Hyungjin Chung1, Minyoung Park, Jonghyuk Park, Wi-Sun Ryu, Jong Chul Ye
arXiv 2023. [Paper]
15 Mar 2023

Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels
Jan Oscar Cross-Zamirski, Praveen Anand, Guy Williams, Elizabeth Mouchet, Yinhai Wang, Carola-Bibiane Schönlieb
arXiv 2023. [Paper] [Github]
15 Mar 2023

Stochastic Segmentation with Conditional Categorical Diffusion Models
Lukas Zbinden1, Lars Doorenbos1, Theodoros Pissas, Raphael Sznitman, Pablo Márquez-Neila
arXiv 2023. [Paper] [Github]
15 Mar 2023

Diffusion Models for Contrast Harmonization of Magnetic Resonance Images
Alicia Durrer, Julia Wolleb, Florentin Bieder, Tim Sinnecker, Matthias Weigel, Robin Sandkühler, Cristina Granziera, Özgür Yaldizli, Philippe C. Cattin
arXiv 2023. [Paper]
14 Mar 2023

Efficiently Training Vision Transformers on Structural MRI Scans for Alzheimer's Disease Detection
Nikhil J. Dhinagar, Sophia I. Thomopoulos, Emily Laltoo, Paul M. Thompson
arXiv 2023. [Paper]
14 Mar 2023

Diffusion-Based Hierarchical Multi-Label Object Detection to Analyze Panoramic Dental X-rays
Ibrahim Ethem Hamamci, Sezgin Er, Enis Simsar, Anjany Sekuboyina, Mustafa Gundogar, Bernd Stadlinger, Albert Mehl, Bjoern Menze
arXiv 2023. [Paper]
11 Mar 2023

AugDiff: Diffusion based Feature Augmentation for Multiple Instance Learning in Whole Slide Image
Zhuchen Shao, Liuxi Dai, Yifeng Wang, Haoqian Wang, Yongbing Zhang
arXiv 2023. [Paper]
11 Mar 2023

Brain Diffuser: An End-to-End Brain Image to Brain Network Pipeline
Xuhang Chen, Baiying Lei, Chi-Man Pun, Shuqiang Wang
arXiv 2023. [Paper]
11 Mar 2023

Fast Diffusion Sampler for Inverse Problems by Geometric Decomposition
Hyungjin Chung, Suhyeon Lee, Jong Chul Ye
arXiv 2023. [Paper]
10 Mar 2023

Generalized Diffusion MRI Denoising and Super-Resolution using Swin Transformers
Amir Sadikov, Jamie Wren-Jarvis, Xinlei Pan, Lanya T. Cai, Pratik Mukherjee
arXiv 2023. [Paper]
10 Mar 2023

Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation
Yunguan Fu, Yiwen Li, Shaheer U. Saeed, Matthew J. Clarkson, Yipeng Hu
arXiv 2023. [Paper] [Github]
10 Mar 2023

Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI
Finn Behrendt, Debayan Bhattacharya, Julia Krüger, Roland Opfer, Alexander Schlaefer
MIDL 2023. [Paper]
7 Mar 2023

Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusion
Shaheer U. Saeed, Tom Syer, Wen Yan, Qianye Yang, Mark Emberton, Shonit Punwani, Matthew J. Clarkson, Dean C. Barratt, Yipeng Hu
arXiv 2023. [Paper]
3 Mar 2023

Dissolving Is Amplifying: Towards Fine-Grained Anomaly Detection
Jian Shi, Pengyi Zhang, Ni Zhang, Hakim Ghazzai, Yehia Massoud
arXiv 2023. [Paper]
28 Feb 2023

DDM2: Self-Supervised Diffusion MRI Denoising with Generative Diffusion Models
Tiange Xiang, Mahmut Yurt, Ali B Syed, Kawin Setsompop, Akshay Chaudhari
ICLR 2023. [Paper] [Github]
6 Feb 2023

Zero-shot-Learning Cross-Modality Data Translation Through Mutual Information Guided Stochastic Diffusion
Zihao Wang, Yingyu Yang, Maxime Sermesant, Hervé Delingette, Ona Wu
arXiv 2023. [Paper]
31 Jan 2023

Diffusion Denoising for Low-Dose-CT Model
Runyi Li
arXiv 2023. [Paper]
27 Jan 2023

DiffusionCT: Latent Diffusion Model for CT Image Standardization
Md Selim, Jie Zhang, Michael A. Brooks, Ge Wang, Jin Chen
arXiv 2023. [Paper]
20 Jan 2023

MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformer
Junde Wu, Rao Fu, Huihui Fang, Yu Zhang, Yanwu Xu
arXiv 2023. [Paper]
19 Jan 2023

The role of noise in denoising models for anomaly detection in medical images
Antanas Kascenas, Pedro Sanchez, Patrick Schrempf, Chaoyang Wang, William Clackett, Shadia S. Mikhael, Jeremy P. Voisey, Keith Goatman, Alexander Weir, Nicolas Pugeault, Sotirios A. Tsaftaris, Alison Q. O'Neil
arXiv 2023. [Paper] [Github]
19 Jan 2023

Annealed Score-Based Diffusion Model for MR Motion Artifact Reduction
Gyutaek Oh, Jeong Eun Lee, Jong Chul Ye
arXiv 2023. [Paper]
8 Jan 2023

Denoising Diffusion Probabilistic Models for Generation of Realistic Fully-Annotated Microscopy Image Data Sets
Dennis Eschweiler, Johannes Stegmaier
arXiv 2023. [Paper]
2 Jan 2023

Diffusion Model based Semi-supervised Learning on Brain Hemorrhage Images for Efficient Midline Shift Quantification
Shizhan Gong, Cheng Chen, Yuqi Gong, Nga Yan Chan, Wenao Ma, Calvin Hoi-Kwan Mak, Jill Abrigo, Qi Dou
arXiv 2023. [Paper]
1 Jan 2023

SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generation
Jee Seok Yoon, Chenghao Zhang, Heung-Il Suk, Jia Guo, Xiaoxiao Li
arXiv 2022. [Paper]
16 Dec 2022

Universal Generative Modeling in Dual-domain for Dynamic MR Imaging
Chuanming Yu, Yu Guan, Ziwen Ke, Dong Liang, Qiegen Liu
arXiv 2022. [Paper]
15 Dec 2022

SPIRiT-Diffusion: SPIRiT-driven Score-Based Generative Modeling for Vessel Wall imaging
Chentao Cao, Zhuo-Xu Cui, Jing Cheng, Sen Jia, Hairong Zheng, Dong Liang, Yanjie Zhu
arXiv 2022. [Paper]
14 Dec 2022

Diffusion Probabilistic Models beat GANs on Medical Images
Gustav Müller-Franzes, Jan Moritz Niehues, Firas Khader, Soroosh Tayebi Arasteh, Christoph Haarburger, Christiane Kuhl, Tianci Wang, Tianyu Han, Sven Nebelung, Jakob Nikolas Kather, Daniel Truhn
arXiv 2022. [Paper]
14 Dec 2022

One Sample Diffusion Model in Projection Domain for Low-Dose CT Imaging
Bin Huang, Liu Zhang, Shiyu Lu, Boyu Lin, Weiwen Wu, Qiegen Liu
arXiv 2022. [Paper]
7 Dec 2022

Improving dermatology classifiers across populations using images generated by large diffusion models
Luke W. Sagers1, James A. Diao1, Matthew Groh, Pranav Rajpurkar, Adewole S. Adamson, Arjun K. Manrai
NeurIPS Workshop 2022. [Paper]
23 Nov 2022

RoentGen: Vision-Language Foundation Model for Chest X-ray Generation
Pierre Chambon1, Christian Bluethgen1, Jean-Benoit Delbrouck, Rogier Van der Sluijs, Małgorzata Połacin, Juan Manuel Zambrano Chaves, Tanishq Mathew Abraham, Shivanshu Purohit, Curtis P. Langlotz, Akshay Chaudhari
arXiv 2022. [Paper]
23 Nov 2022

DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstruction
Jiaming Liu, Rushil Anirudh, Jayaraman J. Thiagarajan, Stewart He, K. Aditya Mohan, Ulugbek S. Kamilov, Hyojin Kim
arXiv 2022. [Paper]
22 Nov 2022

Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models
Hyungjin Chung1, Dohoon Ryu1, Michael T. McCann, Marc L. Klasky, Jong Chul Ye
arXiv 2022. [Paper]
19 Nov 2022

Patch-Based Denoising Diffusion Probabilistic Model for Sparse-View CT Reconstruction
Wenjun Xia, Wenxiang Cong, Ge Wang
arXiv 2022. [Paper]
18 Nov 2022

Brain PET Synthesis from MRI Using Joint Probability Distribution of Diffusion Model at Ultrahigh Fields
Xie Taofeng1, Cao Chentao1, Cui Zhuoxu, Li Fanshi, Wei Zidong, Zhu Yanjie, Li Ye, Liang Dong, Jin Qiyu, Chen Guoqing, Wang Haifeng
arXiv 2022. [Paper]
16 Nov 2022

Improved HER2 Tumor Segmentation with Subtype Balancing using Deep Generative Networks
Mathias Öttl, Jana Mönius, Matthias Rübner, Carol I. Geppert, Jingna Qiu, Frauke Wilm, Arndt Hartmann, Matthias W. Beckmann, Peter A. Fasching, Andreas Maier, Ramona Erber, Katharina Breininger
arXiv 2022. [Paper]
11 Nov 2022

An unobtrusive quality supervision approach for medical image annotation
Sonja Kunzmann, Mathias Öttl, Prathmesh Madhu, Felix Denzinger, Andreas Maier
arXiv 2022. [Paper]
11 Nov 2022

Medical Diffusion -- Denoising Diffusion Probabilistic Models for 3D Medical Image Generation
Firas Khader, Gustav Mueller-Franzes, Soroosh Tayebi Arasteh, Tianyu Han, Christoph Haarburger, Maximilian Schulze-Hagen, Philipp Schad, Sandy Engelhardt, Bettina Baessler, Sebastian Foersch, Johannes Stegmaier, Christiane Kuhl, Sven Nebelung, Jakob Nikolas Kather, Daniel Truhn
arXiv 2022. [Paper]
7 Nov 2022

Generation of Anonymous Chest Radiographs Using Latent Diffusion Models for Training Thoracic Abnormality Classification Systems
Kai Packhäuser, Lukas Folle, Florian Thamm, Andreas Maier
arXiv 2022. [Paper]
2 Nov 2022

Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models
Hazrat Ali, Shafaq Murad, Zubair Shah
arXiv 2022. [Paper] [Project]
2 Nov 2022

MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model
Junde Wu, Huihui Fang, Yu Zhang, Yehui Yang, Yanwu Xu
arXiv 2022. [Paper]
1 Nov 2022

Accelerating Diffusion Models via Pre-segmentation Diffusion Sampling for Medical Image Segmentation
Xutao Guo, Yanwu Yang, Chenfei Ye, Shang Lu, Yang Xiang, Ting Ma
arXiv 2022. [Paper]
27 Oct 2022

Multitask Brain Tumor Inpainting with Diffusion Models: A Methodological Report
Pouria Rouzrokh1, Bardia Khosravi1, Shahriar Faghani, Mana Moassefi, Sanaz Vahdati, Bradley J. Erickson
arXiv 2022. [Paper] [Github]
21 Oct 2022

Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains
Pierre Chambon1, Christian Bluethgen1, Curtis P. Langlotz, Akshay Chaudhari
arXiv 2022. [Paper]
9 Oct 2022

Anatomically constrained CT image translation for heterogeneous blood vessel segmentation
Giammarco La Barbera, Haithem Boussaid, Francesco Maso, Sabine Sarnacki, Laurence Rouet, Pietro Gori, Isabelle Bloch
BMVC 2022. [Paper]
4 Oct 2022

Low-Dose CT Using Denoising Diffusion Probabilistic Model for 20× Speedup
Wenjun Xia, Qing Lyu, Ge Wang
arXiv 2022. [Paper]
29 Sep 2022

Diffusion Adversarial Representation Learning for Self-supervised Vessel Segmentation
Boah Kim1, Yujin Oh1, Jong Chul Ye
arXiv 2022. [Paper]
29 Sep 2022

Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models
Qing Lyu, Ge Wang
arXiv 2022. [Paper]
24 Sep 2022

Brain Imaging Generation with Latent Diffusion Models
Walter H. L. Pinaya1, Petru-Daniel Tudosiu1, Jessica Dafflon, Pedro F da Costa, Virginia Fernandez, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso
arXiv 2022. [Paper]
15 Sep 2022

PET image denoising based on denoising diffusion probabilistic models
Kuang Gong, Keith A. Johnson, Georges El Fakhri, Quanzheng Li, Tinsu Pan
arXiv 2022. [Paper]
13 Sep 2022

Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction
Zhuo-Xu Cui, Chentao Cao, Shaonan Liu, Qingyong Zhu, Jing Cheng, Haifeng Wang, Yanjie Zhu, Dong Liang
IEEE TMI 2022. [Paper]
2 Sep 2022

High-Frequency Space Diffusion Models for Accelerated MRI
Chentao Cao, Zhuo-Xu Cui, Shaonan Liu, Dong Liang, Yanjie Zhu
arXiv 2022. [Paper]
10 Aug 2022

What is Healthy? Generative Counterfactual Diffusion for Lesion Localization
Pedro Sanchez, Antanas Kascenas, Xiao Liu, Alison Q. O'Neil, Sotirios A. Tsaftaris
MICCAI 2022. [Paper] [Github]
25 Jul 2022

Unsupervised Medical Image Translation with Adversarial Diffusion Models
Muzaffer Özbey, Salman UH Dar, Hasan A Bedel, Onat Dalmaz, Şaban Özturk, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
17 Jul 2022

Adaptive Diffusion Priors for Accelerated MRI Reconstruction
Salman UH Dar, Şaban Öztürk, Yilmaz Korkmaz, Gokberk Elmas, Muzaffer Özbey, Alper Güngör, Tolga Çukur
arXiv 2022. [Paper]
12 Jul 2022

A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion
Xiangxi Meng, Yuning Gu, Yongsheng Pan, Nizhuan Wang, Peng Xue, Mengkang Lu, Xuming He, Yiqiang Zhan, Dinggang Shen
arXiv 2022. [Paper]
7 Jul 2022

Cross-Modal Transformer GAN: A Brain Structure-Function Deep Fusing Framework for Alzheimer's Disease
Junren Pan, Shuqiang Wang
arXiv 2022. [Paper]
20 Jun 2022

Diffusion Deformable Model for 4D Temporal Medical Image Generation
Boah Kim, Jong Chul Ye
MICCAI 2022. [Paper] [Github]
27 Jun 2022

Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models
Walter H. L. Pinaya, Mark S. Graham, Robert Gray, Pedro F Da Costa, Petru-Daniel Tudosiu, Paul Wright, Yee H. Mah, Andrew D. MacKinnon, James T. Teo, Rolf Jager, David Werring, Geraint Rees, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardos
MICCAI 2022. [Paper]
7 Jun 2022

Improving Diffusion Models for Inverse Problems using Manifold Constraints
Hyungjin Chung1, Byeongsu Sim1, Dohoon Ryu, Jong Chul Ye
arXiv 2022. [Paper]
2 Jun 2022

AnoDDPM: Anomaly Detection with Denoising Diffusion Probabilistic Models using Simplex Noise
Julian Wyatt, Adam Leach, Sebastian M. Schmon, Chris G. Willcocks
CVPR Workshop 2022. [Paper] [Github]
1 Jun 2022

The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion Models
Julia Wolleb1, Robin Sandkühler1, Florentin Bieder, Philippe C. Cattin
arXiv 2022. [Paper]
6 Apr 2022

MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusion
Hyungjin Chung, Eun Sun Lee, Jong Chul Ye
arXiv 2022. [Paper]
23 Mar 2022

Diffusion Models for Medical Anomaly Detection
Julia Wolleb, Florentin Bieder, Robin Sandkühler, Philippe C. Cattin
MICCAI 2022. [Paper] [Github]
8 Mar 2022

Towards performant and reliable undersampled MR reconstruction via diffusion model sampling
Cheng Peng, Pengfei Guo, S. Kevin Zhou, Vishal Patel, Rama Chellappa
arXiv 2022. [Paper] [Github]
8 Mar 2022

Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction
Yutong Xie, Quanzheng Li
MICCAI 2022. [Paper] [Github]
5 Mar 2022

MRI Reconstruction via Data Driven Markov Chain with Joint Uncertainty Estimation
Guanxiong Luo, Martin Heide, Martin Uecker
arXiv 2022. [Paper] [Github]
3 Feb 2022

Unsupervised Denoising of Retinal OCT with Diffusion Probabilistic Model
Dewei Hu, Yuankai K. Tao, Ipek Oguz
arXiv 2022. [Paper] [Github]
27 Jan 2022

Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction
Hyungjin Chung, Byeongsu Sim, Jong Chul Ye
CVPR 2021. [Paper]
9 Dec 2021

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models
Yang Song1, Liyue Shen1, Lei Xing, Stefano Ermon
NeurIPS Workshop 2021. [Paper] [Github]
15 Nov 2021

Score-based diffusion models for accelerated MRI
Hyungjin Chung, Jong chul Ye
MIA 2021. [Paper] [Github]
8 Oct 2021

3D Vision

Learning Controllable 3D Diffusion Models from Single-view Images
Jiatao Gu, Qingzhe Gao, Shuangfei Zhai, Baoquan Chen, Lingjie Liu, Josh Susskind
arXiv 2023. [Paper] [Project]
13 Apr 2023

Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su
arXiv 2023. [Paper] [Project]
13 Apr 2023

InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions
Han Liang, Wenqian Zhang, Wenxuan Li, Jingyi Yu, Lan Xu
arXiv 2023. [Paper]
12 Apr 2023

Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views
Siwei Zhang, Qianli Ma, Yan Zhang, Sadegh Aliakbarian, Darren Cosker, Siyu Tang
arXiv 2023. [Paper] [Project]
12 Apr 2023

Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond
Mohammadreza Armandpour, Huangjie Zheng, Ali Sadeghian, Amir Sadeghian, Mingyuan Zhou
arXiv 2023. [Paper]
11 Apr 2023

DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model
Hoigi Seo1, Hayeon Kim1, Gwanghyun Kim, Se Young Chun
arXiv 2023. [Paper] [Project]
6 Apr 2023

Generative Novel View Synthesis with 3D-Aware Diffusion Models
Eric R. Chan1, Koki Nagano1, Matthew A. Chan, Alexander W. Bergman, Jeong Joon Park, Axel Levy, Miika Aittala, Shalini De Mello, Tero Karras, Gordon Wetzstein
arXiv 2023. [Paper] [Project]
5 Apr 2023

Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion
Davis Rempe, Zhengyi Luo, Xue Bin Peng, Ye Yuan, Kris Kitani, Karsten Kreis, Sanja Fidler, Or Litany
CVPR 2023. [Paper] [Github]
4 Apr 2023

PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusion
Gwanghyun Kim, Ji Ha Jang, Se Young Chun
arXiv 2023. [Paper] [Project]
4 Apr 2023

ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model
Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, Ziwei Liu
arXiv 2023. [Paper] [Project] [Github]
3 Apr 2023

Controllable Motion Synthesis and Reconstruction with Autoregressive Diffusion Models
Wenjie Yin, Ruibo Tu, Hang Yin, Danica Kragic, Hedvig Kjellström, Mårten Björkman
arXiv 2023. [Paper]
3 Apr 2023

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models
Yukang Cao, Yan-Pei Cao, Kai Han, Ying Shan, Kwan-Yee K. Wong
arXiv 2023. [Paper]
3 Apr 2023

DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance
Longwen Zhang1, Qiwei Qiu1, Hongyang Lin, Qixuan Zhang, Cheng Shi, Wei Yang, Ye Shi, Sibei Yang, Lan Xu, Jingyi Yu
arXiv 2023. [Paper] [Project]
1 Apr 2023

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control
Ruixiang Jiang, Can Wang, Jingbo Zhang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
arXiv 2023. [Paper] [Project] [Github]
30 Mar 2023

HOLODIFFUSION: Training a 3D Diffusion Model using 2D Images
Animesh Karnewar, Andrea Vedaldi, David Novotny, Niloy Mitra
CVPR 2023. [Paper] [Project]
29 Mar 2023

4D Facial Expression Diffusion Model
Kaifeng Zou, Sylvain Faisan, Boyang Yu, Sébastien Valette, Hyewon Seo
arXiv 2023. [Paper] [Github]
29 Mar 2023

Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversion
Hiromichi Kamata, Yuiko Sakuma, Akio Hayakawa, Masato Ishii, Takuya Narihira
arXiv 2023. [Paper] [Github]
28 Mar 2023

Novel View Synthesis of Humans using Differentiable Rendering
Guillaume Rochette, Chris Russell, Richard Bowden
IEEE T-BIOM 2023. [Paper] [Github]
28 Mar 2023

Debiasing Scores and Prompts of 2D Diffusion for Robust Text-to-3D Generation
Susung Hong1, Donghoon Ahn1, Seungryong Kim
arXiv 2023. [Paper]
27 Mar 2023

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
Junshu Tang, Tengfei Wang, Bo Zhang, Ting Zhang, Ran Yi, Lizhuang Ma, Dong Chen
arXiv 2023. [Paper] [Github]
24 Mar 2023

ISS++: Image as Stepping Stone for Text-Guided 3D Shape Generation
Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu
arXiv 2023. [Paper]
24 Mar 2023

CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout
Yiqi Lin1, Haotian Bai1, Sijia Li, Haonan Lu, Xiaodong Lin, Hui Xiong, Lin Wang
arXiv 2023. [Paper] [Project]
24 Mar 2023

Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation
Rui Chen, Yongwei Chen, Ningxin Jiao, Kui Jia
arXiv 2023. [Paper]
24 Mar 2023

DDT: A Diffusion-Driven Transformer-based Framework for Human Mesh Recovery from a Video
Ce Zheng, Guo-Jun Qi, Chen Chen
arXiv 2023. [Paper]
23 Mar 2023

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Ayaan Haque, Matthew Tancik, Alexei A. Efros, Aleksander Holynski, Angjoo Kanazawa
arXiv 2023. [Paper] [Project]
22 Mar 2023

FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Models
Jianglong Ye, Naiyan Wang, Xiaolong Wang
arXiv 2023. [Paper] [Project]
22 Mar 2023

Vox-E: Text-guided Voxel Editing of 3D Objects
Etai Sella, Gal Fiebelman, Peter Hedman, Hadar Averbuch-Elor
arXiv 2023. [Paper] [Project]
21 Mar 2023

Compositional 3D Scene Generation using Locally Conditioned Diffusion
Ryan Po, Gordon Wetzstein
arXiv 2023. [Paper] [Github]
21 Mar 2023

Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregation
Wenkang Shan, Zhenhua Liu, Xinfeng Zhang, Zhao Wang, Kai Han, Shanshe Wang, Siwei Ma, Wen Gao
arXiv 2023. [Paper] [Github]
21 Mar 2023

3D-CLFusion: Fast Text-to-3D Rendering with Contrastive Latent Diffusion
Yu-Jhe Li, Kris Kitani
arXiv 2023. [Paper]
21 Mar 2023

Affordance Diffusion: Synthesizing Hand-Object Interactions
Yufei Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, Sifei Liu
CVPR 2023. [Paper] [Project]
21 Mar 2023

SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation
Juil Koo1, Seungwoo Yoo1, Minh Hieu Nguyen1, Minhyuk Sung
arXiv 2023. [Paper] [Project]
21 Mar 2023

Learning a 3D Morphable Face Reflectance Model from Low-cost Data
Yuxuan Han, Zhibo Wang, Feng Xu
CVPR 2023. [Paper] [Project]
21 Mar 2023

Text2Tex: Text-driven Texture Synthesis via Diffusion Models
Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, Matthias Nießner
arXiv 2023. [Paper] [Project]
20 Mar 2023

Zero-1-to-3: Zero-shot One Image to 3D Object
Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, Carl Vondrick
arXiv 2023. [Paper] [Project] [Github]
20 Mar 2023

SKED: Sketch-guided Text-based 3D Editing
Aryan Mikaeili, Or Perel, Daniel Cohen-Or, Ali Mahdavi-Amiri
arxiv 2023. [Paper]
19 Mar 2023

3DQD: Generalized Deep 3D Shape Prior via Part-Discretized Diffusion Process
Yuhan Li, Yishun Dou, Xuanhong Chen, Bingbing Ni, Yilin Sun, Yutian Liu, Fuzhen Wang
CVPR 2023. [Paper] [Github]
18 Mar 2023

Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation
Lingting Zhu1, Xian Liu1, Xuanyu Liu, Rui Qian, Ziwei Liu, Lequan Yu
CVPR 2023. [Paper] [Github]
16 Mar 2023

Diffusion-HPC: Generating Synthetic Images with Realistic Humans
Zhenzhen Weng, Laura Bravo-Sánchez, Serena Yeung
arXiv 2023. [Paper] [Github]
16 Mar 2023

DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars
David Svitov, Dmitrii Gudkov, Renat Bashirov, Victor Lempitsky
arXiv 2023. [Paper]
16 Mar 2023

Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models
Suhyeon Lee1, Hyungjin Chung1, Minyoung Park, Jonghyuk Park, Wi-Sun Ryu, Jong Chul Ye
arXiv 2023. [Paper]
15 Mar 2023

Controllable Mesh Generation Through Sparse Latent Point Diffusion Models
Zhaoyang Lyu, Jinyi Wang, Yuwei An, Ya Zhang, Dahua Lin, Bo Dai
CVPR 2023. [Paper] [Project]
14 Mar 2023

MeshDiffusion: Score-based Generative 3D Mesh Modeling
Zhen Liu, Yao Feng, Michael J. Black, Derek Nowrouzezahrai, Liam Paull, Weiyang Liu
ICLR 2023. [Paper] [Project] [Github]
14 Mar 2023

Point Cloud Diffusion Models for Automatic Implant Generation
Paul Friedrich, Julia Wolleb, Florentin Bieder, Florian M. Thieringer, Philippe C. Cattin
arXiv 2023. [Paper]
14 Mar 2023

Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation
Junyoung Seo1, Wooseok Jang1, Min-Seop Kwak1, Jaehoon Ko, Hyeonsu Kim, Junho Kim, Jin-Hwa Kim, Jiyoung Lee, Seungryong Kim
arXiv 2023. [Paper]
14 Mar 2023

GECCO: Geometrically-Conditioned Point Diffusion Models
Michał J. Tyszkiewicz, Pascal Fua, Eduard Trulls
arXiv 2023. [Paper]
10 Mar 2023

3DGen: Triplane Latent Diffusion for Textured Mesh Generation
Anchit Gupta, Wenhan Xiong, Yixin Nie, Ian Jones, Barlas Oğuz
arXiv 2023. [Paper]
9 Mar 2023

Human Motion Diffusion as a Generative Prior
Yonatan Shafir1, Guy Tevet1, Roy Kapon, Amit H. Bermano
arXiv 2023. [Paper]
2 Mar 2023

Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?
Hyemin Ahn, Esteve Valls Mascaro, Dongheui Lee
arXiv 2023. [Paper] [Project] [Github]
28 Feb 2023

DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models
Jamie Wynn, Daniyar Turmukhambetov
arXiv 2023. [Paper] [Github]
23 Feb 2023

PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstruction
Luke Melas-Kyriazi, Christian Rupprecht, Andrea Vedaldi
arXiv 2023. [Paper] Project]
23 Feb 2023

NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
Jiatao Gu, Alex Trevithick, Kai-En Lin, Josh Susskind, Christian Theobalt, Lingjie Liu, Ravi Ramamoorthi
arXiv 2023. [Paper] [Github]
20 Feb 2023

SinMDM: Single Motion Diffusion
Sigal Raab1, Inbal Leibovitch1, Guy Tevet, Moab Arar, Amit H. Bermano, Daniel Cohen-Or
arXiv 2023. [Paper] [Project]
12 Feb 2023

3D Colored Shape Reconstruction from a Single RGB Image through Diffusion
Bo Li, Xiaolin Wei, Fengwei Chen, Bin Liu
arXiv 2023. [Paper]
11 Feb 2023

HumanMAC: Masked Motion Completion for Human Motion Prediction
Ling-Hao Chen, Jiawei Zhang, Yewen Li, Yiren Pang, Xiaobo Xia, Tongliang Liu
arXiv 2023. [Paper] [Project] [Github]
7 Feb 2023

TEXTure: Text-Guided Texturing of 3D Shapes
Elad Richardson1, Gal Metzer1, Yuval Alaluf, Raja Giryes, Daniel Cohen-Or
arXiv 2023. [Paper] [Project] [Github]
3 Feb 2023

Zero3D: Semantic-Driven Multi-Category 3D Shape Generation
Bo Han, Yitong Liu, Yixuan Shen
arXiv 2023. [Paper]
31 Jan 2023

Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation
Jingyu Hu1, Ka-Hei Hui1, Zhengzhe Liu, Ruihui Li, Chi-Wing Fu
arXiv 2023. [Paper]
1 Feb 2023

3DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models
Biao Zhang, Jiapeng Tang, Matthias Niessner, Peter Wonka
arXiv 2023. [Paper]
26 Jan 2023

DiffMotion: Speech-Driven Gesture Synthesis Using Denoising Diffusion Model
Fan Zhang, Naye Ji, Fuxing Gao, Yongping Li
arXiv 2023. [Paper]
24 Jan 2023

Bipartite Graph Diffusion Model for Human Interaction Generation
Baptiste Chopin, Hao Tang, Mohamed Daoudi
arXiv 2023. [Paper]
24 Jan 2023

Diffusion-based Generation, Optimization, and Planning in 3D Scenes
Siyuan Huang1, Zan Wang1, Puhao Li, Baoxiong Jia, Tengyu Liu, Yixin Zhu, Wei Liang, Song-Chun Zhu
arXiv 2023. [Paper] [Project]
15 Jan 2023

Modiff: Action-Conditioned 3D Motion Generation with Denoising Diffusion Probabilistic Models
Mengyi Zhao, Mengyuan Liu, Bin Ren, Shuling Dai, Nicu Sebe
arXiv 2023. [Paper]
10 Jan 2023

Diffusion Probabilistic Models for Scene-Scale 3D Categorical Data
Jumin Lee, Woobin Im, Sebin Lee, Sung-Eui Yoon
arXiv 2023. [Paper] [Github]
2 Jan 2023

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models
Jiale Xu, Xintao Wang, Weihao Cheng, Yan-Pei Cao, Ying Shan, Xiaohu Qie, Shenghua Gao
arXiv 2022. [Paper] [Project]
28 Dec 2022

Point-E: A System for Generating 3D Point Clouds from Complex Prompts
Alex Nichol1, Heewoo Jun1, Prafulla Dhariwal, Pamela Mishkin, Mark Chen
arXiv 2022. [Paper] [Github]
16 Dec 2022

Real-Time Rendering of Arbitrary Surface Geometries using Learnt Transfer
Sirikonda Dhawal, Aakash KT, P.J. Narayanan
arXiv 2022. [Paper]
19 Dec 2022

Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models
Ziyi Chang, Edmund J. C. Findlay, Haozheng Zhang, Hubert P. H. Shum
arXiv 2022. [Paper]
16 Dec 2022

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion
Tengfei Wang1, Bo Zhang1, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo
arXiv 2022. [Paper] [Project]
12 Dec 2022

Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Models
Jiabao Lei, Jiapeng Tang, Kui Jia
arXiv 2022. [Paper] [Project]
12 Dec 2022

Ego-Body Pose Estimation via Ego-Head Pose Estimation
Jiaman Li, C. Karen Liu, Jiajun Wu
arXiv 2022. [Paper]
9 Dec 2022

MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis
Rishabh Dabral, Muhammad Hamza Mughal, Vladislav Golyanik, Christian Theobalt
arXiv 2022. [Paper] [Project]
8 Dec 2022

SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation
Yen-Chi Cheng, Hsin-Ying Lee, Sergey Tulyakov, Alexander Schwing, Liangyan Gui
arXiv 2022. [Paper] [Project]
8 Dec 2022

Executing your Commands via Motion Diffusion in Latent Space
Xin Chen, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, Jingyi Yu, Gang Yu
arXiv 2022. [Paper] [Project]
8 Dec 2022

Magic: Multi Art Genre Intelligent Choreography Dataset and Network for 3D Dance Generation
Ronghui Li, Junfan Zhao, Yachao Zhang, Mingyang Su, Zeping Ren, Han Zhang, Xiu Li
arXiv 2022. [Paper]
7 Dec 2022

NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors
Congyue Deng, Chiyu "Max'' Jiang, Charles R. Qi, Xinchen Yan, Yin Zhou, Leonidas Guibas, Dragomir Anguelov
arXiv 2022. [Paper]
6 Dec 2022

Diffusion-SDF: Text-to-Shape via Voxelized Diffusion
Muheng Li, Yueqi Duan, Jie Zhou, Jiwen Lu
arXiv 2022. [Paper]
6 Dec 2022

Pretrained Diffusion Models for Unified Human Motion Synthesis
Jianxin Ma, Shuai Bai, Chang Zhou
arXiv 2022. [Paper] [Project]
6 Dec 2022

DiffuPose: Monocular 3D Human Pose Estimation via Denoising Diffusion Probabilistic Model
Jeongjun Choi, Dongseok Shim, H. Jin Kim
arXiv 2022. [Paper]
6 Dec 2022

PhysDiff: Physics-Guided Human Motion Diffusion Model
Ye Yuan, Jiaming Song, Umar Iqbal, Arash Vahdat, Jan Kautz
arXiv 2022. [Paper] [Project]
5 Dec 2022

Fast Point Cloud Generation with Straight Flows
Lemeng Wu, Dilin Wang, Chengyue Gong, Xingchao Liu, Yunyang Xiong, Rakesh Ranjan, Raghuraman Krishnamoorthi, Vikas Chandra, Qiang Liu
arXiv 2022. [Paper]
4 Dec 2022

DiffRF: Rendering-Guided 3D Radiance Field Diffusion
Norman Müller, Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder, Matthias Nießner
arXiv 2022. [Paper] [Project]
2 Dec 2022

3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models
Gimin Nam, Mariem Khlifi, Andrew Rodriguez, Alberto Tono, Linqi Zhou, Paul Guerrero
arXiv 2022. [Paper]
1 Dec 2022

Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation
Haochen Wang1, Xiaodan Du1, Jiahao Li1, Raymond A. Yeh, Greg Shakhnarovich
arXiv 2022. [Paper]
1 Dec 2022

SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction
Zhizhuo Zhou, Shubham Tulsiani
arXiv 2022. [Paper] [Github]
1 Dec 2022

3D Neural Field Generation using Triplane Diffusion
J. Ryan Shue, Eric Ryan Chan, Ryan Po, Zachary Ankner, Jiajun Wu, Gordon Wetzstein
arXiv 2022. [Paper] [Project]
30 Nov 2022

DiffPose: Toward More Reliable 3D Pose Estimation
Jia Gong1, Lin Geng Foo1, Zhipeng Fan, Qiuhong Ke, Hossein Rahmani, Jun Liu
arXiv 2022. [Paper]
30 Nov 2022

DiffPose: Multi-hypothesis Human Pose Estimation using Diffusion models
Karl Holmquist, Bastian Wandt
arXiv 2022. [Paper]
29 Nov 2022

DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model
Gwanghyun Kim, Se Young Chun
arXiv 2022. [Paper] [Github]
29 Nov 2022

NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views
Dejia Xu, Yifan Jiang, Peihao Wang, Zhiwen Fan, Yi Wang, Zhangyang Wang
arXiv 2022. [Paper] [Project]
29 Nov 2022

Ada3Diff: Defending against 3D Adversarial Point Clouds via Adaptive Diffusion
Kui Zhang, Hang Zhou, Jie Zhang, Qidong Huang, Weiming Zhang, Nenghai Yu
arXiv 2022. [Paper]
29 Nov 2022

UDE: A Unified Driving Engine for Human Motion Generation
Zixiang Zhou, Baoyuan Wang
arXiv 2022. [Paper] [Project] [Github]
29 Nov 2022

3DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models
Gang Li, Heliang Zheng, Chaoyue Wang, Chang Li, Changwen Zheng, Dacheng Tao
arXiv 2022. [Paper]
25 Nov 2022

DiffusionSDF: Conditional Generative Modeling of Signed Distance Functions
Gene Chou, Yuval Bahat, Felix Heide
arXiv 2022. [Paper]
24 Nov 2022

Tetrahedral Diffusion Models for 3D Shape Generation
Nikolai Kalischek, Torben Peters, Jan D. Wegner, Konrad Schindler
arXiv 2022. [Paper]
23 Nov 2022

IC3D: Image-Conditioned 3D Diffusion for Shape Generation
Cristian Sbrolli, Paolo Cudrano, Matteo Frosi, Matteo Matteucci
arXiv 2022. [Paper]
20 Nov 2022

Listen, denoise, action! Audio-driven motion synthesis with diffusion models
Simon Alexanderson, Rajmund Nagy, Jonas Beskow, Gustav Eje Henter
arXiv 2022. [Paper]
17 Nov 2022

RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
Titas Anciukevičius, Zexiang Xu, Matthew Fisher, Paul Henderson, Hakan Bilen, Niloy J. Mitra, Paul Guerrero
arXiv 2022. [Paper] [Github]
17 Nov 2022

Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures
Gal Metzer1, Elad Richardson1, Or Patashnik, Raja Giryes, Daniel Cohen-Or
arXiv 2022. [Paper] [Github]
14 Nov 2022

ReFu: Refine and Fuse the Unobserved View for Detail-Preserving Single-Image 3D Human Reconstruction
Gyumin Shim1, Minsoo Lee1, Jaegul Choo
ACM 2022. [Paper]
9 Nov 2022

StructDiffusion: Object-Centric Diffusion for Semantic Rearrangement of Novel Objects
Weiyu Liu, Tucker Hermans, Sonia Chernova, Chris Paxton
arXiv 2022. [Paper]
8 Nov 2022

Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model
Zhiyuan Ren, Zhihong Pan, Xin Zhou, Le Kang
ICASSP 2023. [Paper]
22 Oct 2022

LION: Latent Point Diffusion Models for 3D Shape Generation
Xiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic, Or Litany, Sanja Fidler, Karsten Kreis
NeurIPS 2022. [Paper] [Project]
12 Oct 2022

Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Prediction
Dong Wei, Huaijiang Sun, Bin Li, Jianfeng Lu, Weiqing Li, Xiaoning Sun, Shengxiang Hu
arXiv 2022. [Paper]
12 Oct 2022

A generic diffusion-based approach for 3D human pose prediction in the wild
Saeed Saadatnejad, Ali Rasekh, Mohammadreza Mofayezi, Yasamin Medghalchi, Sara Rajabzadeh, Taylor Mordan, Alexandre Alahi
arXiv 2022. [Paper]
11 Oct 2022

Novel View Synthesis with Diffusion Models
Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, Mohammad Norouzi
arXiv 2022. [Paper]
6 Oct 2022

Neural Volumetric Mesh Generator
Yan Zheng, Lemeng Wu, Xingchao Liu, Zhen Chen, Qiang Liu, Qixing Huang
arXiv 2022. [Paper]
6 Oct 2022

Denoising Diffusion Probabilistic Models for Styled Walking Synthesis
Edmund J. C. Findlay, Haozheng Zhang, Ziyi Chang, Hubert P. H. Shum
arXiv 2022. [Paper]
29 Sep 2022

Human Motion Diffusion Model
Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Amit H. Bermano, Daniel Cohen-Or
arXiv 2022. [Paper] [Project]
29 Sep 2022

ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation
Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu
ICLR 2023. [Paper] [Github]
9 Sep 2022

SE(3)-DiffusionFields: Learning cost functions for joint grasp and motion optimization through diffusion
Julen Urain, Niklas Funk, Georgia Chalvatzaki, Jan Peters
arXiv 2022. [Paper] [Github]
8 Sep 2022

First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Data
Mao Ye, Lemeng Wu, Qiang Liu
NeruIPS 2022. [Paper]
2 Sep 2022

FLAME: Free-form Language-based Motion Synthesis & Editing
Jihoon Kim, Jiseob Kim, Sungjoon Choi
arXiv 2022. [Paper]
1 Sep 2022

Let us Build Bridges: Understanding and Extending Diffusion Generative Models
Xingchao Liu, Lemeng Wu, Mao Ye, Qiang Liu
arXiv 2022. [Paper]
31 Aug 2022

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu
arXiv 2022. [Paper] [Project]
31 Aug 2022

A Diffusion Model Predicts 3D Shapes from 2D Microscopy Images
Dominik J. E. Waibel, Ernst Röell, Bastian Rieck, Raja Giryes, Carsten Marr
arXiv 2022. [Paper]
30 Aug 2022

PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition
Jiachen Sun, Weili Nie, Zhiding Yu, Z. Morley Mao, Chaowei Xiao
arXiv 2022. [Paper]
21 Aug 2022

A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion
Zhaoyang Lyu, Zhifeng Kong, Xudong Xu, Liang Pan, Dahua Lin
ICLR 2022. [Paper] [Github]
7 Dec 2021

Score-Based Point Cloud Denoising
Shitong Luo, Wei Hu
ICCV 2021. [Paper] [Github]
23 Jul 2021

DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Cameras
Ruizhi Shao, Zerong Zheng, Hongwen Zhang, Jingxiang Sun, Yebin Liu
ECCV 2022. [Paper] [Project] [Github]
16 Jul 2022

3D Shape Generation and Completion through Point-Voxel Diffusion
Linqi Zhou, Yilun Du, Jiajun Wu
ICCV 2021. [Paper] [Project]
8 Apr 2021

Diffusion Probabilistic Models for 3D Point Cloud Generation
Shitong Luo, Wei Hu
CVPR 2021. [Paper] [Github]
2 Mar 2021

Adversarial Attack

A Pilot Study of Query-Free Adversarial Attack against Stable Diffusion
Haomin Zhuang, Yihua Zhang, Sijia Liu
arXiv 2023. [Paper]
3 Apr 2023

Black-box Backdoor Defense via Zero-shot Image Purification
Yucheng Shi, Mengnan Du, Xuansheng Wu, Zihan Guan, Ninghao Liu
arXiv 2023. [Paper]
21 Mar 2023

Adversarial Counterfactual Visual Explanations
Guillaume Jeanneret, Loïc Simon, Frédéric Jurie
arXiv 2023. [Paper]
17 Mar 2023

Robust Evaluation of Diffusion-Based Adversarial Purification
Minjong Lee, Dongwoo Kim
arXiv 2023. [Paper]
16 Mar 2023

The Devil's Advocate: Shattering the Illusion of Unexploitable Data using Diffusion Models
Hadi M. Dolatabadi, Sarah Erfani, Christopher Leckie
arXiv 2023. [Paper]
15 Mar 2023

TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets
Weixin Chen, Dawn Song, Bo Li
arXiv 2023. [Paper] [Github]
10 Mar 2023

Generative Model-Based Attack on Learnable Image Encryption for Privacy-Preserving Deep Learning
AprilPyone MaungMaung, Hitoshi Kiya
arXiv 2023. [Paper]
9 Mar 2023

Differentially Private Diffusion Models Generate Useful Synthetic Images
Sahra Ghalebikesabi, Leonard Berrada, Sven Gowal, Ira Ktena, Robert Stanforth, Jamie Hayes, Soham De, Samuel L. Smith, Olivia Wiles, Borja Balle
arXiv 2023. [Paper]
27 Feb 2023

Data Forensics in Diffusion Models: A Systematic Analysis of Membership Privacy
Derui Zhu1, Dingfan Chen1, Jens Grossklags, Mario Fritz
arXiv 2023. [Paper]
15 Feb 2023

Raising the Cost of Malicious AI-Powered Image Editing
Hadi Salman, Alaa Khaddaj, Guillaume Leclerc, Andrew Ilyas, Aleksander Madry
arXiv 2023. [Paper]
13 Feb 2023

Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples
Chumeng Liang1, Xiaoyu Wu1, Yang Hua, Jiaru Zhang, Yiming Xue, Tao Song, Zhengui Xue, Ruhui Ma, Haibing Guan
arXiv 2023. [Paper]
9 Feb 2023

Better Diffusion Models Further Improve Adversarial Training
Zekai Wang1, Tianyu Pang1, Chao Du, Min Lin, Weiwei Liu, Shuicheng Yan
arXiv 2023. [Paper] [Github]
9 Feb 2023

Membership Inference Attacks against Diffusion Models
Tomoya Matsumoto, Takayuki Miura, Naoto Yanai
arXiv 2023. [Paper]
7 Feb 2023

MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoders
Naser Damer, Meiling Fang, Patrick Siebke, Jan Niklas Kolf, Marco Huber, Fadi Boutros
arXiv 2023. [Paper]
3 Feb 2023

Extracting Training Data from Diffusion Models
Nicholas Carlini1, Jamie Hayes1, Milad Nasr1, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace
arXiv 2023. [Paper]
2 Feb 2023

Are Diffusion Models Vulnerable to Membership Inference Attacks?
Jinhao Duan, Fei Kong, Shiqi Wang, Xiaoshuang Shi, Kaidi Xu
arXiv 2023. [Paper]
2 Feb 2023

Salient Conditional Diffusion for Defending Against Backdoor Attacks
Brandon B. May1, N. Joseph Tatro1, Piyush Kumar, Nathan Shnidman
arXiv 2023. [Paper]
31 Jan 2023

Extracting Training Data from Diffusion Models
Nicholas Carlini1, Jamie Hayes1, Milad Nasr1, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace
arXiv 2023. [Paper]
30 Jan 2023

Membership Inference of Diffusion Models
Hailong Hu, Jun Pang
arXiv 2023. [Paper]
24 Jan 2023

Denoising Diffusion Probabilistic Models as a Defense against Adversarial Attacks
Lars Lien Ankile, Anna Midgley, Sebastian Weisshaar
arXiv 2023. [Paper] [Github]
17 Jan 2023

Fight Fire With Fire: Reversing Skin Adversarial Examples by Multiscale Diffusive and Denoising Aggregation Mechanism
Yongwei Wang1, Yuan Li1, Zhiqi Shen
arXiv 2022. [Paper]
22 Aug 2022

DensePure: Understanding Diffusion Models towards Adversarial Robustness
Chaowei Xiao1, Zhongzhu Chen1, Kun Jin1, Jiongxiao Wang1, Weili Nie, Mingyan Liu, Anima Anandkumar, Bo Li, Dawn Song
NeurIPS 2022. [Paper]
1 Nov 2022

Improving Adversarial Robustness by Contrastive Guided Diffusion Process
Yidong Ouyang, Liyan Xie, Guang Cheng
arXiv 2022. [Paper]
18 Oct 2022

Differentially Private Diffusion Models
Tim Dockhorn, Tianshi Cao, Arash Vahdat, Karsten Kreis
arXiv 2022. [Paper] [Project]
18 Oct 2022

PointDP: Diffusion-driven Purification against Adversarial Attacks on 3D Point Cloud Recognition
Jiachen Sun, Weili Nie, Zhiding Yu, Z. Morley Mao, Chaowei Xiao
arXiv 2022. [Paper]
21 Aug 2022

Threat Model-Agnostic Adversarial Defense using Diffusion Models
Tsachi Blau, Roy Ganz, Bahjat Kawar, Alex Bronstein, Michael Elad
arXiv 2022. [Paper]
17 Jul 2022

Back to the Source: Diffusion-Driven Test-Time Adaptation
Jin Gao1, Jialing Zhang1, Xihui Liu, Trevor Darrell, Evan Shelhamer, Dequan Wang
arXiv 2022. [Paper]
7 Jul 2022

Guided Diffusion Model for Adversarial Purification from Random Noise
Quanlin Wu, Hang Ye, Yuntian Gu
arXiv 2022. [Paper]
17 Jun 2022

(Certified!!) Adversarial Robustness for Free!
Nicholas Carlini, Florian Tramer, Krishnamurthy (Dj)Dvijotham, J. Zico Kolter
arXiv 2022. [Paper]
21 Jun 2022

Guided Diffusion Model for Adversarial Purification
Jinyi Wang1, Zhaoyang Lyu1, Dahua Lin, Bo Dai, Hongfei Fu
ICML 2022. [Paper] [Github]
30 May 2022

Diffusion Models for Adversarial Purification
Weili Nie, Brandon Guo, Yujia Huang, Chaowei Xiao, Arash Vahdat, Anima Anandkumar
ICML 2022. [Paper] [Project] [Github]
16 May 2022

TFDPM: Attack detection for cyber-physical systems with diffusion probabilistic models
Tijin Yan, Tong Zhou, Yufeng Zhan, Yuanqing Xia
arXiv 2021. [Paper]
20 Dec 2021

Adversarial purification with Score-based generative models
Jongmin Yoon, Sung Ju Hwang, Juho Lee
ICML 2021. [Paper] [Github]
11 Jun 2021

Miscellaneous

Exploring Diffusion Models for Unsupervised Video Anomaly Detection
Anil Osman Tur, Nicola Dall'Asen, Cigdem Beyan, Elisa Ricci
arXiv 2023. [Paper]
12 Apr 2023

Improving Diffusion Models for Scene Text Editing with Dual Encoders
Jiabao Ji, Guanhua Zhang, Zhaowen Wang, Bairu Hou, Zhifei Zhang, Brian Price, Shiyu Chang
arXiv 2023. [Paper] [Github]
12 Apr 2023

CamDiff: Camouflage Image Augmentation via Diffusion Model
Xue-Jing Luo, Shuo Wang, Zongwei Wu, Christos Sakaridis, Yun Cheng, Deng-Ping Fan, Luc Van Gool
arXiv 2023. [Paper] [Github]
11 Apr 2023

DDRF: Denoising Diffusion Model for Remote Sensing Image Fusion
ZiHan Cao, ShiQi Cao, Xiao Wu, JunMing Hou, Ran Ran, Liang-Jian Deng
arXiv 2023. [Paper]
10 Apr 2023

NeRF applied to satellite imagery for surface reconstruction
Federico Semeraro1, Yi Zhang1, Wenying Wu1, Patrick Carroll1
arXiv 2023. [Paper] [Github]
9 Apr 2023

CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Model
Zhongqi Wang, Jie Zhang, Zhilong Ji, Jinfeng Bai, Shiguang Shan
arXiv 2023. [Paper]
9 Apr 2023

ChiroDiff: Modelling chirographic data with Diffusion Models
Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song
arXiv 2023. [Paper] [Project]
7 Apr 2023

RoSteALS: Robust Steganography using Autoencoder Latent Space
Tu Bui, Shruti Agarwal, Ning Yu, John Collomosse
arXiv 2023. [Paper] [Github]
6 Apr 2023

JPEG Compressed Images Can Bypass Protections Against AI Editing
Pedro Sandoval-Segura, Jonas Geiping, Tom Goldstein
arXiv 2023. [Paper]
5 Apr 2023

Learning to Read Braille: Bridging the Tactile Reality Gap with Diffusion Models
Carolina Higuera, Byron Boots, Mustafa Mukadam
arXiv 2023. [Paper]
3 Apr 2023

Textile Pattern Generation Using Diffusion Models
Halil Faruk Karagoz, Gulcin Baykal, Irem Arikan Eksi, Gozde Unal
ITFC 2023. [Paper]
2 Apr 2023

Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images
Roberto Amoroso1, Davide Morelli1, Marcella Cornia, Lorenzo Baraldi, Alberto Del Bimbo, Rita Cucchiara
ACM 2023. [Paper]
2 Apr 2023

NeuroDAVIS: A neural network model for data visualization
Chayan Maitra, Dibyendu B. Seal, Rajat K. De
arXiv 2023. [Paper]
1 Apr 2023

Diffusion Action Segmentation
Daochang Liu, Qiyue Li, AnhDung Dinh, Tingting Jiang, Mubarak Shah, Chang Xu
arXiv 2023. [Paper]
31 Mar 2023

One-shot Unsupervised Domain Adaptation with Personalized Diffusion Models
Yasser Benigmim, Subhankar Roy, Slim Essid, Vicky Kalogeiton, Stéphane Lathuilière
arXiv 2023. [Paper]
31 Mar 2023

DDP: Diffusion Model for Dense Visual Prediction
Yuanfeng Ji, Zhe Chen, Enze Xie, Lanqing Hong, Xihui Liu, Zhaoqiang Liu, Tong Lu, Zhenguo Li, Ping Luo
arXiv 2023. [Paper]
30 Mar 2023

DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder
Chenpng Du, Qi Chen, Tianyu He, Xu Tan, Xie Chen, Kai Yu, Sheng Zhao, Jiang Bian
arXiv 2023. [Paper]
30 Mar 2023

WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion Models
Konstantina Nikolaidou, George Retsinas, Vincent Christlein, Mathias Seuret, Giorgos Sfikas, Elisa Barney Smith, Hamam Mokayed, Marcus Liwicki
arXiv 2023. [Paper]
29 Mar 2023

Visual Chain-of-Thought Diffusion Models
William Harvey, Frank Wood
arXiv 2023. [Paper]
28 Mar 2023

Your Diffusion Model is Secretly a Zero-Shot Classifier
Alexander C. Li, Mihir Prabhudesai, Shivam Duggal, Ellis Brown, Deepak Pathak
arXiv 2023. [Paper] [Project]
28 Mar 2023

Diffusion Denoised Smoothing for Certified and Adversarial Robust Out-Of-Distribution Detection
Nicola Franco, Daniel Korth, Jeanette Miriam Lorenz, Karsten Roscher, Stephan Guennemann
arXiv 2023. [Paper]
27 Mar 2023

Text-to-Image Diffusion Models are Zero-Shot Classifiers
Kevin Clark, Priyank Jaini
arXiv 2023. [Paper]
27 Mar 2023

DiffTAD: Temporal Action Detection with Proposal Denoising Diffusion
Sauradip Nag, Xiatian Zhu, Jiankang Deng, Yi-Zhe Song, Tao Xiang
arXiv 2023. [Paper]
27 Mar 2023

The Stable Signature: Rooting Watermarks in Latent Diffusion Models
Pierre Fernandez, Guillaume Couairon, Hervé Jégou, Matthijs Douze, Teddy Furon
arXiv 2023. [Paper] [Project]
27 Mar 2023

Exploring Continual Learning of Diffusion Models
Michał Zając, Kamil Deja, Anna Kuzina, Jakub M. Tomczak, Tomasz Trzciński, Florian Shkurti, Piotr Miłoś
arXiv 2023. [Paper]
27 Mar 2023

PDPP:Projected Diffusion for Procedure Planning in Instructional Videos
Hanlin Wang, Yilu Wu, Sheng Guo, Limin Wang
CVPR 2023. [Paper]
26 Mar 2023

Freestyle Layout-to-Image Synthesis
Han Xue, Zhiwu Huang, Qianru Sun, Li Song, Wenjun Zhang
arXiv 2023. [Paper]
25 Mar 2023

CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Jordan J. Bird, Ahmad Lotfi
arXiv 2023. [Paper]
24 Mar 2023

Controllable Inversion of Black-Box Face-Recognition Models via Diffusion
Manuel Kansy, Anton Raël, Graziana Mignone, Jacek Naruniec, Christopher Schroers, Markus Gross, Romann M. Weber
arXiv 2023. [Paper]
23 Mar 2023

End-to-End Diffusion Latent Optimization Improves Classifier Guidance
Bram Wallace, Akash Gokul, Stefano Ermon, Nikhil Naik
arXiv 2023. [Paper]
23 Mar 2023

DiffPattern: Layout Pattern Generation via Discrete Diffusion
Zixiao Wang, Yunheng Shen, Wenqian Zhao, Yang Bai, Guojin Chen, Farzan Farnia, Bei Yu
DAC 2023. [Paper]
23 Mar 2023

Diffuse-Denoise-Count: Accurate Crowd-Counting with Diffusion Models
Yasiru Ranasinghe, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel
arXiv 2023. [Paper]
22 Mar 2023

LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
Junyi Zhang1, Jiaqi Guo1, Shizhao Sun, Jian-Guang Lou, Dongmei Zhang
arXiv 2023. [Paper]
21 Mar 2023

Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic Models
Francesco Giuliari, Gianluca Scarpellini, Stuart James, Yiming Wang, Alessio Del Bue
arXiv 2023. [Paper] [Project]
20 Mar 2023

Leapfrog Diffusion Model for Stochastic Trajectory Prediction
Weibo Mao, Chenxin Xu, Qi Zhu, Siheng Chen, Yanfeng Wang
arxiv 2023. [Paper] [Github]
20 Mar 2023

Pluralistic Aging Diffusion Autoencoder
Peipei Li, Rui Wang, Huaibo Huang, Ran He, Zhaofeng He
arXiv 2023. [Paper]
20 Mar 2023

AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models
Yu Cao, Xiangqiao Meng, P.Y. Mok, Xueting Liu, Tong-Yee Lee, Ping Li
arxiv 2023. [Paper]
20 Mar 2023

Diffusion-based Document Layout Generation
Liu He, Yijuan Lu, John Corring, Dinei Florencio, Cha Zhang
arXiv 2023. [Paper]
19 Mar 2023

On the De-duplication of LAION-2B
Ryan Webster, Julien Rabin, Loic Simon, Frederic Jurie
arXiv 2023. [Paper]
17 Mar 2023

A Recipe for Watermarking Diffusion Models
Yunqing Zhao, Tianyu Pang, Chao Du, Xiao Yang, Ngai-Man Cheung, Min Lin
arXiv 2023. [Paper]
17 Mar 2023

Denoising Diffusion Autoencoders are Unified Self-supervised Learners
Weilai Xiang, Hongyu Yang, Di Huang, Yunhong Wang
arXiv 2023. [Paper] )]
17 Mar 2023

DIRE for Diffusion-Generated Image Detection
Zhendong Wang, Jianmin Bao, Wengang Zhou, Weilun Wang, Hezhen Hu, Hong Chen, Houqiang Li
arXiv 2023. [Paper] [Github]
16 Mar 2023

DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
Maham Tanveer, Yizhi Wang, Ali Mahdavi-Amiri, Hao Zhang
arXiv 2023. [Paper] [Project]
16 Mar 2023

DiffusionAD: Denoising Diffusion for Anomaly Detection
Hui Zhang, Zheng Wang, Zuxuan Wu, Yu-Gang Jiang
arXiv 2023. [Paper]
15 Mar 2023

LayoutDM: Discrete Diffusion Model for Controllable Layout Generation
Naoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota Yamaguchi
CVPR 2023. [Paper] [Project] [Github]
14 Mar 2023

Parallel Vertex Diffusion for Unified Visual Grounding
Zesen Cheng, Kehan Li, Peng Jin, Xiangyang Ji, Li Yuan, Chang Liu, Jie Chen
arXiv 2023. [Paper]
13 Mar 2023

DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion
Zixiang Zhao, Haowen Bai, Yuanzhi Zhu, Jiangshe Zhang, Shuang Xu, Yulun Zhang, Kai Zhang, Deyu Meng, Radu Timofte, Luc Van Gool
arXiv 2023. [Paper]
13 Mar 2023

Detecting Images Generated by Diffusers
Davide Alessandro Coccomini, Andrea Esuli, Fabrizio Falchi, Claudio Gennaro, Giuseppe Amato
arXiv 2023. [Paper]
9 Mar 2023

Unifying Layout Generation with a Decoupled Diffusion Model
Mude Hui, Zhizheng Zhang, Xiaoyi Zhang, Wenxuan Xie, Yuwang Wang, Yan Lu
arXiv 2023. [Paper]
9 Mar 2023

DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
Elad Levi, Eli Brosh, Mykola Mykhailych, Meir Perez
arXiv 2023. [Paper]
7 Mar 2023

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition
Cindy M. Nguyen, Eric R. Chan, Alexander W. Bergman, Gordon Wetzstein
arXiv 2023. [Paper] [Project]
7 Mar 2023

Word-As-Image for Semantic Typography
Shir Iluz1, Yael Vinker1, Amir Hertz, Daniel Berio, Daniel Cohen-Or, Ariel Shamir
arXiv 2023. [Paper]
3 Mar 2023

Makeup Extraction of 3D Representation via Illumination-Aware Image Decomposition
Xingchao Yang, Takafumi Taketomi, Yoshihiro Kanamori
arXiv 2023. [Paper]
26 Feb 2023

Monocular Depth Estimation using Diffusion Models
Saurabh Saxena, Abhishek Kar, Mohammad Norouzi, David J. Fleet
arXiv 2023. [Paper]
28 Feb 2023

Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition
Yifan Jiang, Han Chen, Hanseok Ko
arXiv 2023. [Paper] [Github]
26 Feb 2023

LDFA: Latent Diffusion Face Anonymization for Self-driving Applications
Marvin Klemp, Kevin Rösch, Royden Wagner, Jannik Quehl, Martin Lauer
arXiv 2023. [Paper]
17 Feb 2023

Road Redesign Technique Achieving Enhanced Road Safety by Inpainting with a Diffusion Model
Sumit Mishra, Medhavi Mishra, Taeyoung Kim, Dongsoo Har
arXiv 2023. [Paper]
15 Feb 2023

Effective Data Augmentation With Diffusion Models
Brandon Trabucco, Kyle Doherty, Max Gurinas, Ruslan Salakhutdinov
arXiv 2023. [Paper] [Project]
7 Feb 2023

Boosting Zero-shot Classification with Synthetic Data Diversity via Stable Diffusion
Jordan Shipard, Arnold Wiliem, Kien Nguyen Thanh, Wei Xiang, Clinton Fookes
arXiv 2023. [Paper]
7 Feb 2023

Learning End-to-End Channel Coding with Diffusion Models
Muah Kim, Rick Fritschek, Rafael F. Schaefer
arXiv 2023. [Paper]
3 Feb 2023

Extracting Training Data from Diffusion Models
Nicholas Carlini1, Jamie Hayes1, Milad Nasr1, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace
arXiv 2023. [Paper]
2 Feb 2023

Diffusion Models for High-Resolution Solar Forecasts
Yusuke Hatanaka, Yannik Glaser, Geoff Galgon, Giuseppe Torri, Peter Sadowski
arxiv 2023. [Paper]
1 Feb 2023

A Denoising Diffusion Model for Fluid Field Prediction
Gefan Yang1, Stefan Sommer1
arXiv 2023. [Paper]
27 Jan 2023

Diffusion Models as Artists: Are we Closing the Gap between Humans and Machines?
Victor Boutin, Thomas Fel, Lakshya Singhal, Rishav Mukherji, Akash Nagaraj, Julien Colin, Thomas Serre
arXiv 2023. [Paper]
27 Jan 2023

PLay: Parametrically Conditioned Layout Generation using Latent Diffusion
Chin-Yi Cheng, Forrest Huang, Gang Li, Yang Li
arXiv 2023. [Paper]
27 Jan 2023

Screen Space Indirect Lighting with Visibility Bitmask
Olivier Therrien, Yannick Levesque, Guillaume Gilet
arXiv 2023. [Paper]
26 Jan 2023

On the Importance of Noise Scheduling for Diffusion Models
Ting Chen
arXiv 2023. [Paper]
26 Jan 2023

LEGO-Net: Learning Regular Rearrangements of Objects in Rooms
Qiuhong Anna Wei, Sijie Ding, Jeong Joon Park, Rahul Sajnani, Adrien Poulenard, Srinath Sridhar, Leonidas Guibas
arXiv 2023. [Paper] [Project]
23 Jan 2023

Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models
Jun Yue, Leyuan Fang, Shaobo Xia, Yue Deng, Jiayi Ma
arXiv 2023. [Paper]
19 Jan 2023

Neural Image Compression with a Diffusion-Based Decoder
Noor Fathima Goose1, Jens Petersen1, Auke Wiggers1, Tianlin Xu, Guillaume Sautière
arXiv 2023. [Paper]
13 Jan 2023

Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images
Mohamed Akrout1, Bálint Gyepesi1, Péter Holló, Adrienn Poór, Blága Kincső, Stephen Solis, Katrina Cirone, Jeremy Kawahara, Dekker Slade, Latif Abid, Máté Kovács, István Fazekas
arXiv 2023. [Paper]
12 Jan 2023

Speech Driven Video Editing via an Audio-Conditioned Diffusion Model
Dan Bigioi, Shubhajit Basak, Hugh Jordan, Rachel McDonnell, Peter Corcoran
arXiv 2023. [Paper] [Project] [Github]
10 Jan 2023

Diffusion Models For Stronger Face Morphing Attacks
Zander Blasingame, Chen Liu
arXiv 2023. [Paper]
10 Jan 2023

DiffTalk: Crafting Diffusion Models for Generalized Talking Head Synthesis
Shuai Shen, Wenliang Zhao, Zibin Meng, Wanhua Li, Zheng Zhu, Jie Zhou, Jiwen Lu
arXiv 2023. [Paper]
10 Jan 2023

Speech Driven Video Editing via an Audio-Conditioned Diffusion Model
Dan Bigioi, Shubhajit Basak, Hugh Jordan, Rachel McDonnell, Peter Corcoran
arXiv 2023. [Paper]
10 Jan 2023

Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation
Michał Stypułkowski, Konstantinos Vougioukas, Sen He, Maciej Zięba, Stavros Petridis, Maja Pantic
arXiv 2023. [Paper] [Project]
6 Jan 2023

Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias
Robert Wolfe, Yiwei Yang, Bill Howe, Aylin Caliskan
arXiv 2022. [Paper]
21 Dec 2022

AI Art in Architecture
Joern Ploennigs, Markus Berger
arXiv 2022. [Paper]
19 Dec 2022

Diffusing Surrogate Dreams of Video Scenes to Predict Video Memorability
Lorin Sweeney, Graham Healy, Alan F. Smeaton
arXiv 2022. [Paper]
19 Dec 2022

Fake it till you make it: Learning(s) from a synthetic ImageNet clone
Mert Bulent Sariyildiz, Karteek Alahari, Diane Larlus, Yannis Kalantidis
arXiv 2022. [Paper]
16 Dec 2022

The Infinite Index: Information Retrieval on Generative Text-To-Image Models
Niklas Deckers, Maik Fröbe, Johannes Kiesel, Gianluca Pandolfo, Christopher Schröder, Benno Stein, Martin Potthast
arXiv 2022. [Paper]
14 Dec 2022

LidarCLIP or: How I Learned to Talk to Point Clouds
Georg Hess, Adam Tonderski, Christoffer Petersson, Lennart Svensson, Kalle Åström
arXiv 2022. [Paper] [Github]
13 Dec 2022

Diff-Font: Diffusion Model for Robust One-Shot Font Generation
Haibin He, Xinyuan Chen, Chaoyue Wang, Juhua Liu, Bo Du, Dacheng Tao, Yu Qiao
arXiv 2022. [Paper]
12 Dec 2022

DiffAlign : Few-shot learning using diffusion based synthesis and alignment
Aniket Roy, Anshul Shah, Ketul Shah, Anirban Roy, Rama Chellappa
arXiv 2022. [Paper]
11 Dec 2022

How to Backdoor Diffusion Models?
Sheng-Yen Chou, Pin-Yu Chen, Tsung-Yi Ho
arXiv 2022. [Paper]
11 Dec 2022

Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priors
Zhentao Yu, Zixin Yin, Deyu Zhou, Duomin Wang, Finn Wong, Baoyuan Wang
arXiv 2022. [Paper] [Project]
7 Dec 2022

Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models
Gowthami Somepalli, Vasu Singla, Micah Goldblum, Jonas Geiping, Tom Goldstein
arXiv 2022. [Paper]
7 Dec 2022

Neural Cell Video Synthesis via Optical-Flow Diffusion
Manuel Serna-Aguilera, Khoa Luu, Nathaniel Harris, Min Zou
arXiv 2022. [Paper]
6 Dec 2022

Semantic-Conditional Diffusion Networks for Image Captioning
Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Jianlin Feng, Hongyang Chao, Tao Mei
arXiv 2022. [Paper] [Github]
6 Dec 2022

ObjectStitch: Generative Object Compositing
Yizhi Song, Zhifei Zhang, Zhe Lin, Scott Cohen, Brian Price, Jianming Zhang, Soo Ye Kim, Daniel Aliaga
arXiv 2022. [Paper]
2 Dec 2022

Post-training Quantization on Diffusion Models
Yuzhang Shang1, Zhihang Yuan1, Bin Xie1, Bingzhe Wu, Yan Yan
arXiv 2022. [Paper]
28 Nov 2022

Refined Semantic Enhancement towards Frequency Diffusion for Video Captioning
Xian Zhong, Zipeng Li, Shuqin Chen, Kui Jiang, Chen Chen, Mang Ye
arXiv 2022. [Paper] [Github]
28 Nov 2022

Diffusion Probabilistic Model Made Slim
Xingyi Yang, Daquan Zhou, Jiashi Feng, Xinchao Wang
arXiv 2022. [Paper]
27 Nov 2022

BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction
German Barquero, Sergio Escalera, Cristina Palmero
arXiv 2022. [Paper]
25 Nov 2022

JigsawPlan: Room Layout Jigsaw Puzzle Extreme Structure from Motion using Diffusion Models
Sepidehsadat Hosseini, Mohammad Amin Shabani, Saghar Irandoust, Yasutaka Furukawa
arXiv 2022. [Paper] [Project]
24 Nov 2022

HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoising
Mohammad Amin Shabani, Sepidehsadat Hosseini, Yasutaka Furukawa
arXiv 2022. [Paper] [Project]
23 Nov 2022

Make-A-Story: Visual Memory Conditioned Consistent Story Generation
Tanzila Rahman, Hsin-Ying Lee, Jian Ren, Sergey Tulyakov, Shweta Mahajan, Leonid Sigal
arXiv 2022. [Paper]
23 Nov 2022

Inversion-Based Creativity Transfer with Diffusion Models
Yuxin Zhang, Nisha Huang, Fan Tang, Haibin Huang, Chongyang Ma, Weiming Dong, Changsheng Xu
arXiv 2022. [Paper]
23 Nov 2022

Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition
Jennifer C. White, Ryan Cotterell
arXiv 2022. [Paper]
23 Nov 2022

Can denoising diffusion probabilistic models generate realistic astrophysical fields?
Nayantara Mudur, Douglas P. Finkbeiner
NeurIPS Workshop 2022. [Paper]
22 Nov 2022

DiffDreamer: Consistent Single-view Perpetual View Generation with Conditional Diffusion Models
Shengqu Cai, Eric Ryan Chan, Songyou Peng, Mohamad Shahbazi, Anton Obukhov, Luc Van Gool, Gordon Wetzstein
arXiv 2022. [Paper] [Project]
22 Nov 2022

Person Image Synthesis via Denoising Diffusion Model
Ankan Kumar Bhunia, Salman Khan, Hisham Cholakkal, Rao Muhammad Anwer, Jorma Laaksonen, Mubarak Shah, Fahad Shahbaz Khan
arXiv 2022. [Paper]
22 Nov 2022

Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection
Luping Liu, Yi Ren, Xize Cheng, Zhou Zhao
arXiv 2022. [Paper] [Github]
21 Nov 2022

Exploring Discrete Diffusion Models for Image Captioning
Zixin Zhu, Yixuan Wei, Jianfeng Wang, Zhe Gan, Zheng Zhang, Le Wang, Gang Hua, Lijuan Wang, Zicheng Liu, Han Hu
arXiv 2022. [Paper] [Github]
21 Nov 2022

Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models
Xichen Pan, Pengda Qin, Yuhong Li, Hui Xue, Wenhu Chen
arXiv 2022. [Paper]
20 Nov 2022

DiffusionDet: Diffusion Model for Object Detection
Shoufa Chen, Peize Sun, Yibing Song, Ping Luo
arXiv 2022. [Paper] [Github]
17 Nov 2022

Learning to Kindle the Starlight
Yu Yuan, Jiaqi Wu, Lindong Wang, Zhongliang Jing, Henry Leung, Shuyuan Zhu, Han Pan
arXiv 2022. [Paper]
16 Nov 2022

CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streaming
Qihua Zhou, Ruibin Li, Song Guo, Yi Liu, Jingcai Guo, Zhenda Xu
arXiv 2022. [Paper]
15 Nov 2022

ShadowDiffusion: Diffusion-based Shadow Removal using Classifier-driven Attention and Structure Preservation
Yeying Jin, Wenhan Yang, Wei Ye, Yuan Yuan, Robby T. Tan
arXiv 2022. [Paper]
15 Nov 2022

Extreme Generative Image Compression by Learning Text Embedding from Diffusion Models
Zhihong Pan, Xin Zhou, Hao Tian
arXiv 2022. [Paper]
14 Nov 2022

Denoising Diffusion Models for Out-of-Distribution Detection
Mark S. Graham, Walter H.L. Pinaya, Petru-Daniel Tudosiu, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso
arXiv 2022. [Paper]
14 Nov 2022

Evaluating a Synthetic Image Dataset Generated with Stable Diffusion
Andreas Stöckl
arXiv 2022. [Paper]
3 Nov 2022

Quantized Compressed Sensing with Score-Based Generative Models
Xiangming Meng, Yoshiyuki Kabashima
arXiv 2022. [Paper] [Github]
2 Nov 2022

On the detection of synthetic images generated by diffusion models
Riccardo Corvi, Davide Cozzolino, Giada Zingarini, Giovanni Poggi, Koki Nagano, Luisa Verdoliva
arXiv 2022. [Paper]
1 Nov 2022

DOLPH: Diffusion Models for Phase Retrieval
Shirin Shoushtari1, Jiaming Liu1, Ulugbek S. Kamilov
arXiv 2022. [Paper]
1 Nov 2022

A simple, efficient and scalable contrastive masked autoencoder for learning visual representations
Shlok Mishra, Joshua Robinson, Huiwen Chang, David Jacobs, Aaron Sarna, Aaron Maschinot, Dilip Krishnan
arXiv 2022. [Paper]
30 Oct 2022

Towards the Detection of Diffusion Model Deepfakes
Jonas Ricker, Simon Damm, Thorsten Holz, Asja Fischer
arXiv 2022. [Paper]
26 Oct 2022

From Points to Functions: Infinite-dimensional Representations in Diffusion Models
Sarthak Mittal, Guillaume Lajoie, Stefan Bauer, Arash Mehrjou
arXiv 2022. [Paper] [Github]
25 Oct 2022

Boomerang: Local sampling on image manifolds using diffusion models
Lorenzo Luzi, Ali Siahkoohi, Paul M Mayer, Josue Casco-Rodriguez, Richard Baraniuk
arXiv 2022. [Paper] [Colab]
21 Oct 2022

Deep Data Augmentation for Weed Recognition Enhancement: A Diffusion Probabilistic Model and Transfer Learning Based Approach
Dong Chen, Xinda Qi, Yu Zheng, Yuzhen Lu, Zhaojian Li
arXiv 2022. [Paper] [Github]
18 Oct 2022

Meta-Learning via Classifier(-free) Guidance
Elvis Nava1, Seijin Kobayashi1, Yifei Yin, Robert K. Katzschmann, Benjamin F. Grewe
arXiv 2022. [Paper]
17 Oct 2022

DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Diffusion Models
Zeyang Sha, Zheng Li, Ning Yu, Yang Zhang
arXiv 2022. [Paper]
13 Oct 2022

Markup-to-Image Diffusion Models with Scheduled Sampling
Yuntian Deng, Noriyuki Kojima, Alexander M. Rush
arXiv 2022. [Paper]
11 Oct 2022

What the DAAM: Interpreting Stable Diffusion Using Cross Attention
Raphael Tang, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Jimmy Lin, Ferhan Ture
arXiv 2022. [Paper] [Github]
10 Oct 2022

CLIP-Diffusion-LM: Apply Diffusion Model on Image Captioning
Shitong Xu
arXiv 2022. [Paper] [Github]
10 Oct 2022

TopoDiff: A Performance and Constraint-Guided Diffusion Model for Topology Optimization
François Mazé, Faez Ahmed
arXiv 2022. [Paper]
20 Aug 2022

Diffusion Models Beat GANs on Topology Optimization
François Mazé, Faez Ahmed
arXiv 2022. [Paper] [Project] [Github]
20 Aug 2022

Vector Quantized Diffusion Model with CodeUnet for Text-to-Sign Pose Sequences Generation
Pan Xie, Qipeng Zhang, Zexian Li, Hao Tang, Yao Du, Xiaohui Hu
arXiv 2022. [Paper]
19 Aug 2022

Deep Diffusion Models for Seismic Processing
Ricard Durall, Ammar Ghanim, Mario Fernandez, Norman Ettrich, Janis Keuper
arXiv 2022. [Paper]
21 Jul 2022

Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion
Tianpei Gu1, Guangyi Chen1, Junlong Li, Chunze Lin, Yongming Rao, Jie Zhou, Jiwen Lu
CVPR 2022. [Paper] [Github]
25 Mar 2022

Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions
Emiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré, Max Welling
arXiv 2021. [Paper]
10 Feb 2021

Audio

Generation

Generating symbolic music using diffusion models
Lilac Atassi
arXiv 2023. [Paper]
15 Mar 2023

DiffuseRoll: Multi-track multi-category music generation based on diffusion model
Hongfei Wang
arXiv 2023. [Paper]
14 Mar 2023

Multi-Source Diffusion Models for Simultaneous Music Generation and Separation
Giorgio Mariani1, Irene Tallini1, Emilian Postolache1, Michele Mancusi1, Luca Cosmo, Emanuele Rodolà
arXiv 2023. [Paper] [Project]
4 Feb 2023

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv 2022. [Paper] [Github]
19 Dec 2022

SDMuse: Stochastic Differential Music Editing and Generation via Hybrid Representation
Chen Zhang, Yi Ren, Kejun Zhang, Shuicheng Yan
arXiv 2022. [Paper] [Project]
1 Nov 2022

Full-band General Audio Synthesis with Score-based Diffusion
Santiago Pascual, Gautam Bhattacharya, Chunghsin Yeh, Jordi Pons, Joan Serrà
arXiv 2022. [Paper]
26 Oct 2022

Hierarchical Diffusion Models for Singing Voice Neural Vocoder
Naoya Takahashi, Mayank Kumar, Singh, Yuki Mitsufuji
arXiv 2022. [Paper]
14 Oct 2022

Mandarin Singing Voice Synthesis with Denoising Diffusion Probabilistic Wasserstein GAN
Yin-Ping Cho, Yu Tsao, Hsin-Min Wang, Yi-Wen Liu
arXiv 2022. [Paper] [Project]
21 Sep 2022

DDSP-based Singing Vocoders: A New Subtractive-based Synthesizer and A Comprehensive Evaluation
Da-Yi Wu1, Wen-Yi Hsiao1, Fu-Rong Yang, Oscar Friedman, Warren Jackson, Scott Bruzenak, Yi-Wen Liu, Yi-Hsuan Yang
ISMIR 2022. [Paper] [Github]
9 Aug 2022

ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech
Rongjie Huang1, Zhou Zhao, Huadai Liu1, Jinglin Liu, Chenye Cui, Yi Ren
arXiv 2022. [Paper] [Project]
13 Jul 2022

CARD: Classification and Regression Diffusion Models
Xizewen Han1, Huangjie Zheng1, Mingyuan Zhou
NeurIPS 2022. [Paper]
15 Jun 2022

Adversarial Audio Synthesis with Complex-valued Polynomial Networks
Yongtao Wu, Grigorios G Chrysos, Volkan Cevher
arXiv 2022. [Paper]
14 Jun 2022

Multi-instrument Music Synthesis with Spectrogram Diffusion
Curtis Hawthorne, Ian Simon, Adam Roberts, Neil Zeghidour, Josh Gardner, Ethan Manilow, Jesse Engel
ISMIR 2022. [Paper]
11 Jun 2022

BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis
Yichong Leng, Zehua Chen, Junliang Guo, Haohe Liu, Jiawei Chen, Xu Tan, Danilo Mandic, Lei He, Xiang-Yang Li, Tao Qin, Sheng Zhao, Tie-Yan Liu
NeurIPS 2022. [Paper] [Github]
30 May 2022

FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis
Rongjie Huang1, Max W. Y. Lam1, Jun Wang, Dan Su, Dong Yu, Yi Ren, Zhou Zhao
IJCAI 2022. [Paper] [Project] [Github]
21 Apr 2022

SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shaping
Yuma Koizumi, Heiga Zen, Kohei Yatabe, Nanxin Chen, Michiel Bacchiani
arXiv 2022. [Paper]
31 Mar 2022

BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesis
Max W. Y. Lam, Jun Wang, Dan Su, Dong Yu
ICLR 2022. [Paper] [Github]
25 Mar 2022

ItôWave: Itô Stochastic Differential Equation Is All You Need For Wave Generation
Shoule Wu1, Ziqiang Shi1
CoRR 2022. [Paper] [Project]
29 Jan 2022

Itô-Taylor Sampling Scheme for Denoising Diffusion Probabilistic Models using Ideal Derivatives
Hideyuki Tachibana, Mocho Go, Muneyoshi Inahara, Yotaro Katayama, Yotaro Watanabe
arXiv 2021. [Paper]
26 Dec 2021

Denoising Diffusion Gamma Models
Eliya Nachmani1, Robin San Roman1, Lior Wolf
arXiv 2021. [Paper]
10 Oct 2021

Variational Diffusion Models
Diederik P. Kingma, Tim Salimans, Ben Poole, Jonathan Ho
NeurIPS 2021. [Paper] [Github]
1 Jul 2021

CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesis
Simon Rouard1, Gaëtan Hadjeres1
ISMIR 2021. [Paper] [Project]
14 Jun 2021

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior
Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu
ICLR 2022. [Paper] [Project]
11 Jun 2021

ItôTTS and ItôWave: Linear Stochastic Differential Equation Is All You Need For Audio Generation
Shoule Wu1, Ziqiang Shi1
arXiv 2022. [Paper] [Project]
17 May 2021

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
Jinglin Liu1, Chengxi Li1, Yi Ren1, Feiyang Chen, Peng Liu, Zhou Zhao
AAAI 2022. [Paper] [Project] [Github]
6 May 2021

Symbolic Music Generation with Diffusion Models
Gautam Mittal, Jesse Engel, Curtis Hawthorne, Ian Simon
ISMIR 2021. [Paper] [Github]
30 Mar 2021

DiffWave: A Versatile Diffusion Model for Audio Synthesis
Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, Bryan Catanzaro
ICLR 2021. [Paper] [Github]
21 Sep 2020

WaveGrad: Estimating Gradients for Waveform Generation
Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mohammad Norouzi, William Chan
ICLR 2021. [Paper] [Project] [Github]
2 Sep 2020

Conversion

DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversion
Songxiang Liu1, Yuewen Cao1, Dan Su, Helen Meng
IEEE 2021. [Paper] [Github]
28 May 2021

Diffusion-Based Voice Conversion with Fast Maximum Likelihood Sampling Scheme
Vadim Popov, Ivan Vovk, Vladimir Gogoryan, Tasnima Sadekova, Mikhail Kudinov, Jiansheng Wei
ICLR 2022. [Paper] [Project]
28 Sep 2021

Enhancement

Speech Signal Improvement Using Causal Generative Diffusion Models
Julius Richter, Simon Welker, Jean-Marie Lemercier, Bunlong Lay, Tal Peer, Timo Gerkmann
ICASSP 2023. [Paper]
15 Mar 2023

Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement
Bunlong Lay, Simon Welker, Julius Richter, Timo Gerkmann
arXiv 2023. [Paper]
28 Feb 2023

Metric-oriented Speech Enhancement using Diffusion Probabilistic Model
Chen Chen, Yuchen Hu, Weiwei Weng, Eng Siong Chng
arXiv 2023. [Paper]
23 Feb 2023

StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation
Jean-Marie Lemercier, Julius Richter, Simon Welker, Timo Gerkmann
arXiv 2022. [Paper]
22 Dec 2022

Unsupervised vocal dereverberation with diffusion-based generative models
Koichi Saito, Naoki Murata, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuhta Takida, Takao Fukui, Yuki Mitsufuji
arXiv 2022. [Paper]
8 Nov 2022

DiffPhase: Generative Diffusion-based STFT Phase Retrieval
Tal Peer, Simon Welker, Timo Gerkmann
arXiv 2022. [Paper]
8 Nov 2022

Cold Diffusion for Speech Enhancement
Hao Yen, François G. Germain, Gordon Wichern, Jonathan Le Roux
arXiv 2022. [Paper]
4 Nov 2022

Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration
Jean-Marie Lemercier, Julius Richter, Simon Welker, Timo Gerkmann
ICASSP. [Paper] [Project] [Github]
4 Nov 2022

SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement
Zhibin Qiu, Mengfan Fu, Yinfeng Yu, LiLi Yin, Fuchun Sun, Hao Huang
ICASSP 2022. [Paper] [Github]
30 Oct 2022

A Versatile Diffusion-based Generative Refiner for Speech Enhancement
Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
arXiv 2022. [Paper]
27 Oct 2022

Conditioning and Sampling in Variational Diffusion Models for Speech Super-resolution
Chin-Yun Yu, Sung-Lin Yeh, György Fazekas, Hao Tang
arXiv 2022. [Paper] [Project] [Github]
27 Oct 2022

Solving Audio Inverse Problems with a Diffusion Model
Eloi Moliner, Jaakko Lehtinen, Vesa Välimäki
arXiv 2022. [Paper]
27 Oct 2022

Speech Enhancement and Dereverberation with Diffusion-based Generative Models
Julius Richter, Simon Welker, Jean-Marie Lemercier, Bunlong Lay, Timo Gerkmann
arXiv 2022. [Paper] [Project] [Github]
11 Aug 2022

NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates
Seungu Han, Junhyeok Lee
arXiv 2022. [Paper] [Project]
17 Jun 2022

Universal Speech Enhancement with Score-based Diffusion
Joan Serrà, Santiago Pascual, Jordi Pons, R. Oguz Araz, Davide Scaini
arXiv 2022. [Paper]
7 Jun 2022

Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain
Simon Welker, Julius Richter, Timo Gerkmann
InterSpeech 2022. [Paper] [Github]
31 Mar 2022

Conditional Diffusion Probabilistic Model for Speech Enhancement
Yen-Ju Lu, Zhong-Qiu Wang, Shinji Watanabe, Alexander Richard, Cheng Yu, Yu Tsao
IEEE 2022. [Paper] [Github]
10 Feb 2022

A Study on Speech Enhancement Based on Diffusion Probabilistic Model
Yen-Ju Lu1, Yu Tsao1, Shinji Watanabe
arXiv 2021. [Paper]
25 Jul 2021

Restoring degraded speech via a modified diffusion model
Jianwei Zhang, Suren Jayasuriya, Visar Berisha
Interspeech 2021. [Paper]
22 Apr 2021

NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling
Junhyeok Lee, Seungu Han
Interspeech 2021. [Paper] [Project] [Github]
6 Apr 2021

Separation

Multi-Source Diffusion Models for Simultaneous Music Generation and Separation
Giorgio Mariani1, Irene Tallini1, Emilian Postolache1, Michele Mancusi1, Luca Cosmo, Emanuele Rodolà
arXiv 2023. [Paper] [Project]
4 Feb 2023

Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separation
Shahar Lutati, Eliya Nachmani, Lior Wolf
arXiv 2023. [Paper]
25 Jan 2023

StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation
Jean-Marie Lemercier, Julius Richter, Simon Welker, Timo Gerkmann
arXiv 2022. [Paper]
22 Dec 2022

Diffusion-based Generative Speech Source Separation
Robin Scheibler, Youna Ji, Soo-Whan Chung, Jaeuk Byun, Soyeon Choe, Min-Seok Choi
arXiv 2022. [Paper]
31 Oct 2022

Instrument Separation of Symbolic Music by Explicitly Guided Diffusion Model
Sangjun Han, Hyeongrae Ihm, DaeHan Ahn, Woohyung Lim
arXiv 2022. [Paper]
5 Sep 2022

Text-to-Speech

An investigation into the adaptability of a diffusion-based TTS model
Haolin Chen, Philip N. Garner
arXiv 2023. [Paper]
3 Mar 2023

Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
Jiyoung Lee, Joon Son Chung, Soo-Whan Chung
arXiv 2023. [Paper]
27 Feb 2023

ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Models
Pengfei Zhu, Chao Pang, Shuohuan Wang, Yekun Chai, Yu Sun, Hao Tian, Hua Wu
arXiv 2023. [Paper]
9 Feb 2023

Noise2Music: Text-conditioned Music Generation with Diffusion Models
Qingqing Huang1, Daniel S. Park1, Tao Wang, Timo I. Denk, Andy Ly, Nanxin Chen, Zhengdong Zhang, Zhishuai Zhang, Jiahui Yu, Christian Frank, Jesse Engel, Quoc V. Le, William Chan, Wei Han
arXiv 2023. [Paper] [Project]
8 Feb 2023

Moûsai: Text-to-Music Generation with Long-Context Latent Diffusion
Flavio Schneider, Zhijing Jin, Bernhard Schölkopf
arXiv 2023. [Paper] [Project] [Github]
27 Jan 2023

InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Prompt
Dongchao Yang1, Songxiang Liu1, Rongjie Huang, Guangzhi Lei, Chao Weng, Helen Meng, Dong Yu
arXiv 2023. [Paper] [Project]
31 Jan 2023

Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models
Rongjie Huang1, Jiawei Huang1, Dongchao Yang1, Yi Ren, Luping Liu, Mingze Li, Zhenhui Ye, Jinglin Liu, Xiang Yin, Zhou Zhao
arXiv 2023. [Paper] [Project]
30 Jan 2023

AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
Haohe Liu1, Zehua Chen1, Yi Yuan, Xinhao Mei, Xubo Liu, Danilo Mandic, Wenwu Wang, Mark D. Plumbley
arXiv 2023. [Paper] [Project] [Github]
29 Jan 2023

ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speech
Zehua Chen, Yihan Wu, Yichong Leng, Jiawei Chen, Haohe Liu, Xu Tan, Yang Cui, Ke Wang, Lei He, Sheng Zhao, Jiang Bian, Danilo Mandic
arXiv 2022. [Paper] [Project]
30 Dec 2022

Text-to-speech synthesis based on latent variable conversion using diffusion probabilistic model and variational autoencoder
Yusuke Yasuda, Tomoki Toda
arXiv 2022. [Paper]
16 Dec 2022

Any-speaker Adaptive Text-To-Speech Synthesis with Diffusion Models
Minki Kang, Dongchan Min, Sung Ju Hwang
arXiv 2022. [Paper] [Project]
17 Nov 2022

EmoDiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidance
Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu
arXiv 2022. [Paper] [Project]
17 Nov 2022

NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS
Dongchao Yang, Songxiang Liu, Jianwei Yu, Helin Wang, Chao Weng, Yuexian Zou
arXiv 2022. [Paper]
4 Nov 2022

WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iteration
Yuma Koizumi, Kohei Yatabe, Heiga Zen, Michiel Bacchiani
arXiv 2022. [Paper] [Project]
3 Oct 2022

Diffsound: Discrete Diffusion Model for Text-to-sound Generation
Dongchao Yang, Jianwei Yu, Helin Wang, Wen Wang, Chao Weng, Yuexian Zou, Dong Yu
arXiv 2022. [Paper] [Project]
20 Jul 2022

Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models
Alon Levkovitch, Eliya Nachmani, Lior Wolf
arXiv 2022. [Paper] [Project]
5 Jun 2022

Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Data
Sungwon Kim1, Heeseung Kim1, Sungroh Yoon
arXiv 2022. [Paper] [Project]
30 May 2022

InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Training
Zehua Chen, Xu Tan, Ke Wang, Shifeng Pan, Danilo Mandic, Lei He, Sheng Zhao
ICASSP 2022. [Paper]
8 Feb 2022

DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs
Songxiang Liu, Dan Su, Dong Yu
arXiv 2022. [Paper] [Github]
28 Jan 2022

Guided-TTS:Text-to-Speech with Untranscribed Speech
Heeseung Kim, Sungwon Kim, Sungroh Yoon
ICML 2021. [Paper]
30 Nov 2021

EdiTTS: Score-based Editing for Controllable Text-to-Speech
Jaesung Tae1, Hyeongju Kim1, Taesu Kim
arXiv 2021. [Paper] [Project] [Github]
6 Oct 2021

WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesis
Nanxin Chen, Yu Zhang, Heiga Zen, Ron J. Weiss, Mohammad Norouzi, Najim Dehak, William Chan
arXiv 2021. [Paper] [Project] [Github] [Github2]
17 Jun 2021

Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech
Vadim Popov1, Ivan Vovk1, Vladimir Gogoryan, Tasnima Sadekova, Mikhail Kudinov
ICML 2021. [Paper] [Project] [Github]
13 May 2021

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
Jinglin Liu1, Chengxi Li1, Yi Ren1, Feiyang Chen, Peng Liu, Zhou Zhao
arXiv 2021. [Paper] [Project] [Github]
6 May 2021

Diff-TTS: A Denoising Diffusion Model for Text-to-Speech
Myeonghun Jeong, Hyeongju Kim, Sung Jun Cheon, Byoung Jin Choi, Nam Soo Kim
Interspeech 2021. [Paper]
3 Apr 2021

Miscellaneous

AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models
Yuancheng Wang, Zeqian Ju, Xu Tan, Lei He, Zhizheng Wu, Jiang Bian, Sheng Zhao
arXiv 2023. [Paper] [Project]
3 Apr 2023

Data Augmentation for Environmental Sound Classification Using Diffusion Probabilistic Model with Top-k Selection Discriminator
Yunhao Chen, Yunjie Zhu, Zihui Yan, Jianlu Shen, Zhen Ren, Yifan Huang
arXiv 2023. [Paper]
27 Mar 2023

Enhancing Unsupervised Speech Recognition with Diffusion GANs
Xianchao Wu
arXiv 2023. [Paper]
23 Mar 2023

Defending against Adversarial Audio via Diffusion Model
Shutong Wu, Jiongxiao Wang, Wei Ping, Weili Nie, Chaowei Xiao
ICLR 2023. [Paper] [Github]
2 Mar 2023

TransFusion: Transcribing Speech with Multinomial Diffusion
Matthew Baas, Kevin Eloff, Herman Kamper
SACAIR 2022. [Paper] [Github]
14 Oct 2022

Natural Language

Generation

A Cheaper and Better Diffusion Language Model with Soft-Masked Noise
Jiaao Chen, Aston Zhang, Mu Li, Alex Smola, Diyi Yang
arXiv 2023. [Paper] [Github]
10 Apr 2023

DINOISER: Diffused Conditional Sequence Learning by Manipulating Noises
Jiasheng Ye, Zaixiang Zheng, Yu Bao, Lihua Qian, Mingxuan Wang
arXiv 2023. [Paper]
20 Feb 2023

A Reparameterized Discrete Diffusion Model for Text Generation
Lin Zheng, Jianbo Yuan, Lei Yu, Lingpeng Kong
arXiv 2023. [Paper]
11 Feb 2023

Long Horizon Temperature Scaling
Andy Shih, Dorsa Sadigh, Stefano Ermon
arXiv 2023. [Paper]
7 Feb 2023

DiffusER: Diffusion via Edit-based Reconstruction
Machel Reid, Vincent Josua Hellendoorn, Graham Neubig
ICLR 2023. [Paper]
2 Feb 2023

GENIE: Large Scale Pre-training for Text Generation with Diffusion Model
Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Weizhu Chen, Nan Duan
arXiv 2022. [Paper]
22 Dec 2022

Diff-Glat: Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning
Lihua Qian, Mingxuan Wang, Yang Liu, Hao Zhou
arXiv 2022. [Paper]
20 Dec 2022

SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers
Hongyi Yuan, Zheng Yuan, Chuanqi Tan, Fei Huang, Songfang Huang
arXiv 2022. [Paper]
20 Dec 2022

Latent Diffusion for Language Generation
Justin Lovelace, Varsha Kishore, Chao Wan, Eliot Shekhtman, Kilian Weinberger
arXiv 2022. [Paper]
19 Dec 2022

Difformer: Empowering Diffusion Model on Embedding Space for Text Generation
Zhujin Gao1, Junliang Guo1, Xu Tan, Yongxin Zhu, Fang Zhang, Jiang Bian, Linli Xu
arXiv 2022. [Paper]
19 Dec 2022

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
Zhengfu He1, Tianxiang Sun1, Kuanning Wang, Xuanjing Huang, Xipeng Qiu
arXiv 2022. [Paper] [Github]
28 Nov 2022

Continuous diffusion for categorical data
Sander Dieleman, Laurent Sartran, Arman Roshannai, Nikolay Savinov, Yaroslav Ganin, Pierre H. Richemond, Arnaud Doucet, Robin Strudel, Chris Dyer, Conor Durkan, Curtis Hawthorne, Rémi Leblond, Will Grathwohl, Jonas Adler
arXiv 2022. [Paper]
28 Nov 2022

Self-conditioned Embedding Diffusion for Text Generation
Robin Strudel, Corentin Tallec, Florent Altché, Yilun Du, Yaroslav Ganin, Arthur Mensch, Will Grathwohl, Nikolay Savinov, Sander Dieleman, Laurent Sifre, Rémi Leblond
arXiv 2022. [Paper]
8 Nov 2022

DiffusER: Discrete Diffusion via Edit-based Reconstruction
Machel Reid, Vincent J. Hellendoorn, Graham Neubig
arXiv 2022. [Paper]
30 Oct 2022

SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control
Xiaochuang Han, Sachin Kumar, Yulia Tsvetkov
arXiv 2022. [Paper]
31 Oct 2022

DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models
Shansan Gong1, Mukai Li1, Jiangtao Feng, Zhiyong Wu, LingPeng Kong
arXiv 2022. [Paper]
17 Oct 2022

Composable Text Controls in Latent Space with ODEs
Guangyi Liu, Zeyu Feng, Yuan Gao, Zichao Yang, Xiaodan Liang, Junwei Bao, Xiaodong He, Shuguang Cui, Zhen Li, Zhiting Hu
arXiv 2022. [Paper] [Github]
1 Aug 2022

Structured Denoising Diffusion Models in Discrete State-Spaces
Jacob Austin1, Daniel D. Johnson1, Jonathan Ho, Daniel Tarlow, Rianne van den Berg
NeurIPS 2021. [Paper]
7 Jul 2021

Latent Diffusion Energy-Based Model for Interpretable Text Modeling
Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruigi Gao, Yixin Zhu, Song-Chun Zhu, Ying Nian Wu
ICML 2022. [Paper] [Github]
13 Jun 2022

Diffusion-LM Improves Controllable Text Generation
Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, Tatsunori B. Hashimoto
NeurIPS 2022. [Paper] [Github]
27 May 2022

Step-unrolled Denoising Autoencoders for Text Generation
Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aaron van den Oord
ICLR 2022. [Paper] [Github]
13 Dec 2021

Zero-Shot Translation using Diffusion Models
Eliya Nachmani1, Shaked Dovrat1
arXiv 2021. [Paper]
2 Nov 2021

Tabular and Time Series

Generation

Synthetic Health-related Longitudinal Data with Mixed-type Variables Generated using Diffusion Models
Nicholas I-Hsien Kuo, Louisa Jorm, Sebastiano Barbieri
arXiv 2023. [Paper]
22 Mar 2023

Diffusing Gaussian Mixtures for Generating Categorical Data
Florence Regol, Mark Coates
arXiv 2023. [Paper]
8 Mar 2023

EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models
Hongyi Yuan1, Songchi Zhou1, Sheng Yu
arXiv 2023. [Paper] [Github]
10 Mar 2023

Synthesizing Mixed-type Electronic Health Records using Diffusion Models
Taha Ceritli, Ghadeer O. Ghosheh, Vinod Kumar Chauhan, Tingting Zhu, Andrew P. Creagh, David A. Clifton
arXiv 2023. [Paper]
28 Feb 2023

MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Model
Huan He, Shifan Zhao, Yuanzhe Xi, Joyce C Ho
arXiv 2023. [Paper]
8 Feb 2023

Diffusion-based Conditional ECG Generation with Structured State Space Models
Juan Miguel Lopez Alcaraz, Nils Strodthoff
arXiv 2023. [Paper]
19 Jan 2023

TabDDPM: Modelling Tabular Data with Diffusion Models
Akim Kotelnikov, Dmitry Baranchuk, Ivan Rubachev, Artem Babenko
arXiv 2022. [Paper] [Github]
30 Sep 2022

Forecasting

TDSTF: Transformer-based Diffusion probabilistic model for Sparse Time series Forecasting
Ping Chang, Huayu Li, Stuart F. Quan, Janet Roveda, Ao Li
arXiv 2023. [Paper] [Github]
16 Jan 2023

Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement
Yan Li, Xinjiang Lu, Yaqing Wang, Dejing Dou
NeurIPS 2022. [Paper] [Github]
8 Jan 2023

Denoising diffusion probabilistic models for probabilistic energy forecasting
Esteban Hernandez, Jonathan Dumas
arXiv 2022. [Paper]
6 Dec 2022

Modeling Temporal Data as Continuous Functions with Process Diffusion
Marin Biloš, Kashif Rasul, Anderson Schneider, Yuriy Nevmyvaka, Stephan Günnemann
arXiv 2022. [Paper]
4 Nov 2022

Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models
Juan Miguel Lopez Alcaraz, Nils Strodthoff
arXiv 2022. [Paper] [Github]
19 Aug 2022

CARD: Classification and Regression Diffusion Models
Xizewen Han1, Huangjie Zheng1, Mingyuan Zhou
NeurIPS 2022. [Paper]
15 Jun 2022

ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Models
Tijin Yan, Hongwei Zhang, Tong Zhou, Yufeng Zhan, Yuanqing Xia
arXiv 2021. [Paper] [Github]
18 Jun 2021

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
Kashif Rasul, Calvin Seward, Ingmar Schuster, Roland Vollgraf
ICLR 2021. [Paper] [Github]
2 Feb 2021

Imputation

PriSTI: A Conditional Diffusion Framework for Spatiotemporal Imputation
Mingzhe Liu, Han Huang, Hao Feng, Leilei Sun, Bowen Du, Yanjie Fu
arXiv 2023. [Paper] [Github]
20 Feb 2023

Modeling Temporal Data as Continuous Functions with Process Diffusion
Marin Biloš, Kashif Rasul, Anderson Schneider, Yuriy Nevmyvaka, Stephan Günnemann
arXiv 2022. [Paper]
4 Nov 2022

Diffusion models for missing value imputation in tabular data
Shuhan Zheng, Nontawat Charoenphakdee
NeurIPS 2022. [Paper]
31 Oct 2022

Neural Markov Controlled SDE: Stochastic Optimization for Continuous-Time Data
Sung Woo Park, Kyungjae Lee, Junseok Kwon
ICLR 2022. [Paper]
29 Sep 2021

Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models
Juan Miguel Lopez Alcaraz, Nils Strodthoff
arXiv 2022. [Paper] [Github]
19 Aug 2022

CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation
Yusuke Tashiro, Jiaming Song, Yang Song, Stefano Ermon
NeurIPS 2021. [Paper] [Github]
7 Jul 2021

Miscellaneous

Sequential Recommendation with Diffusion Models
Hanwen Du, Huanhuan Yuan, Zhen Huang, Pengpeng Zhao, Xiaofang Zhou
arXiv 2023. [Paper]
10 Apr 2023

DiffuRec: A Diffusion Model for Sequential Recommendation
Zihao Li, Aixin Sun, Chenliang Li
arXiv 2023. [Paper]
3 Apr 2023

EEG Synthetic Data Generation Using Probabilistic Diffusion Models
Giulio Tosato, Cesare M. Dalbagno, Francesco Fumagalli
arXiv 2023. [Paper]
6 Mar 2023

DeScoD-ECG: Deep Score-Based Diffusion Model for ECG Baseline Wander and Noise Removal
Huayu Li, Gregory Ditzler, Janet Roveda, Ao Li
arXiv 2022. [Paper]
31 Jul 2022

Graph

Generation

Diffusion Probabilistic Models for Graph-Structured Prediction
Hyosoon Jang, Sangwoo Mo, Sungsoo Ahn
arXiv 2023. [Paper]
21 Feb 2023

GraphGUIDE: interpretable and controllable conditional graph generation with discrete Bernoulli diffusion
Alex M. Tseng, Nathaniel Diamant, Tommaso Biancalani, Gabriele Scalia
arXiv 2023. [Paper]
7 Feb 2023

Graph Generation with Destination-Driven Diffusion Mixture
Jaehyeong Jo1, Dongki Kim1, Sung Ju Hwang
arXiv 2023. [Paper]
7 Feb 2023

DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models
Haomin Wen, Youfang Lin, Yutong Xia, Huaiyu Wan, Roger Zimmermann, Yuxuan Liang
arXiv 2023. [Paper]
31 Jan 2023

DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion
Qitian Wu, Chenxiao Yang, Wentao Zhao, Yixuan He, David Wipf, Junchi Yan
arXiv 2023. [Paper]
23 Jan 2023

GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generation
Han Huang, Leilei Sun, Bowen Du, Yanjie Fu, Weifeng Lv
arXiv 2022. [Paper]
4 Dec 2022

NVDiff: Graph Generation through the Diffusion of Node Vectors
Cristian Sbrolli, Paolo Cudrano, Matteo Frosi, Matteo Matteucci
arXiv 2022. [Paper]
20 Nov 2022

Fast Graph Generative Model via Spectral Diffusion
Tianze Luo, Zhanfeng Mo, Sinno Jialin Pan
arXiv 2022. [Paper]
16 Nov 2022

Diffusion Models for Graphs Benefit From Discrete State Spaces
Kilian Konstantin Haefeli, Karolis Martinkus, Nathanaël Perraudin, Roger Wattenhofer
NeurIPS 2022. [Paper]
4 Oct 2022

DiGress: Discrete Denoising diffusion for graph generation
Clement Vignac1, Igor Krawczuk1, Antoine Siraudin, Bohan Wang, Volkan Cevher, Pascal Frossard
arXiv 2022. [Paper]
29 Sep 2022

Permutation Invariant Graph Generation via Score-Based Generative Modeling
Chenhao Niu, Yang Song, Jiaming Song, Shengjia Zhao, Aditya Grover, Stefano Ermon
AISTATS 2021. [Paper] [Github]
2 Mar 2020

Molecular and Material Generation

Accurate transition state generation with an object-aware equivariant elementary reaction diffusion model
Chenru Duan, Yuanqi Du, Haojun Jia, Heather J. Kulik
arXiv 2023. [Paper]
12 Apr 2023

DiffDock-PP: Rigid Protein-Protein Docking with Diffusion Models
Mohamed Amine Ketata, Cedrik Laue, Ruslan Mammadov, Hannes Stärk, Menghua Wu, Gabriele Corso, Céline Marquet, Regina Barzilay, Tommi S. Jaakkola
ICLR 2023. [Paper]
8 Apr 2023

3D Equivariant Diffusion for Target-Aware Molecule Generation and Affinity Prediction
Jiaqi Guan, Wesley Wei Qian, Xingang Peng, Yufeng Su, Jian Peng, Jianzhu Ma
ICLR 2023. [Paper]
6 Mar 2023

EigenFold: Generative Protein Structure Prediction with Diffusion Models
Bowen Jing, Ezra Erives, Peter Pao-Huang, Gabriele Corso, Bonnie Berger, Tommi Jaakkola
ICLR Workshop 2023. [Paper] [Github]
5 Apr 2023

Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties
Nikolaos N. Vlassis, WaiChing Sun
arXiv 2023. [Paper]
24 Feb 2023

Aligned Diffusion Schrödinger Bridges
Vignesh Ram Somnath1, Matteo Pariset1, Ya-Ping Hsieh, Maria Rodriguez Martinez, Andreas Krause, Charlotte Bunne
arXiv 2023. [Paper]
22 Feb 2023

MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation
Clement Vignac, Nagham Osman, Laura Toni, Pascal Frossard
arXiv 2023. [Paper]
17 Feb 2023

Geometry-Complete Diffusion for 3D Molecule Generation
Alex Morehead, Jianlin Cheng
arXiv 2023. [Paper] [Github]
8 Feb 2023

SE(3) diffusion model with application to protein backbone generation
Jason Yim1, Brian L. Trippe1, Valentin De Bortoli1, Emile Mathieu1, Arnaud Doucet, Regina Barzilay, Tommi Jaakkola
arXiv 2023. [Paper]
5 Feb 2023

Data-Efficient Protein 3D Geometric Pretraining via Refinement of Diffused Protein Structure Decoy
Yufei Huang, Lirong Wu, Haitao Lin, Jiangbin Zheng, Ge Wang, Stan Z. Li
arXiv 2023. [Paper]
5 Feb 2023

Two for One: Diffusion Models and Force Fields for Coarse-Grained Molecular Dynamics
Marloes Arts, Victor Garcia Satorras, Chin-Wei Huang, Daniel Zuegner, Marco Federici, Cecilia Clementi, Frank Noé, Robert Pinsler, Rianne van den Berg
arXiv 2023. [Paper]
1 Feb 2023

Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds
Yeqing Lin, Mohammed AlQuraishi
arXiv 2023. [Paper]
29 Jan 2023

Physics-Inspired Protein Encoder Pre-Training via Siamese Sequence-Structure Diffusion Trajectory Prediction
Zuobai Zhang1, Minghao Xu1, Aurélie Lozano, Vijil Chenthamarakshan, Payel Das, Jian Tang
arXiv 2023. [Paper]
28 Jan 2023

DiffSDS: A language diffusion model for protein backbone inpainting under geometric conditions and constraints
Zhangyang Gao, Cheng Tan, Stan Z. Li
arXiv 2023. [Paper]
22 Jan 2023

DiffBP: Generative Diffusion of 3D Molecules for Target Protein Binding
Haitao Lin1, Yufei Huang1, Meng Liu, Xuanjing Li, Shuiwang Ji, Stan Z. Li
arXiv 2022. [Paper]
21 Nov 2022

ParticleGrid: Enabling Deep Learning using 3D Representation of Materials
Shehtab Zaman, Ethan Ferguson, Cecile Pereira, Denis Akhiyarov, Mauricio Araya-Polo, Kenneth Chiu
arXiv 2022. [Paper]
15 Nov 2022

Structure-based Drug Design with Equivariant Diffusion Models
Arne Schneuing1, Yuanqi Du1, Charles Harris, Arian Jamasb, Ilia Igashov, Weitao Du, Tom Blundell, Pietro Lió, Carla Gomes, Max Welling, Michael Bronstein, Bruno Correia
arXiv 2022. [Paper]
24 Oct 2022

Protein Sequence and Structure Co-Design with Equivariant Translation
Chence Shi, Chuanrui Wang, Jiarui Lu, Bozitao Zhong, Jian Tang
arXiv 2022. [Paper]
17 Oct 2022

Equivariant 3D-Conditional Diffusion Models for Molecular Linker Design
Ilia Igashov, Hannes Stärk, Clément Vignac, Victor Garcia Satorras, Pascal Frossard, Max Welling, Michael Bronstein, Bruno Correia
arXiv 2022. [Paper]
11 Oct 2022

Dynamic-Backbone Protein-Ligand Structure Prediction with Multiscale Generative Diffusion Models
Zhuoran Qiao, Weili Nie, Arash Vahdat, Thomas F. Miller III, Anima Anandkumar
arXiv 2022. [Paper]
30 Sep 2022

Equivariant Energy-Guided SDE for Inverse Molecular Design
Fan Bao1, Min Zhao1, Zhongkai Hao, Peiyao Li, Chongxuan Li, Jun Zhu
arXiv 2022. [Paper]
30 Sep 2022

Protein structure generation via folding diffusion
Kevin E. Wu, Kevin K. Yang, Rianne van den Berg, James Y. Zou, Alex X. Lu, Ava P. Amini
arXiv 2022. [Paper]
30 Sep 2022

MDM: Molecular Diffusion Model for 3D Molecule Generation
Lei Huang, Hengtong Zhang, Tingyang Xu, Ka-Chun Wong
arXiv 2022. [Paper]
13 Sep 2022

Diffusion-based Molecule Generation with Informative Prior Bridges
Lemeng Wu1, Chengyue Gong1, Xingchao Liu, Mao Ye, Qiang Liu
NeurIPS 2022. [Paper]
2 Sep 2022

Antigen-Specific Antibody Design and Optimization with Diffusion-Based Generative Models
Shitong Luo1, Yufeng Su1, Xingang Peng, Sheng Wang, Jian Peng, Jianzhu Ma
BioRXiv 2022. [Paper]
11 Jul 2022

Data-driven discovery of novel 2D materials by deep generative models
Peder Lyngby, Kristian Sommer Thygesen
arXiv 2022. [Paper]
24 Jun 2022

Score-based Generative Models for Calorimeter Shower Simulation
Vinicius Mikuni, Benjamin Nachman
arXiv 2022. [Paper]
17 Jun 2022

Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem
Brian L. Trippe1, Jason Yim1, Doug Tischer, Tamara Broderick, David Baker, Regina Barzilay, Tommi Jaakkola
CoRR 2022. [Paper]
8 Jun 2022

Torsional Diffusion for Molecular Conformer Generation
Bowen Jing, Gabriele Corso, Regina Barzilay, Tommi S. Jaakkola
ICLR Workshop 2022. [Paper] [Github]
1 Jun 2022

Protein Structure and Sequence Generation with Equivariant Denoising Diffusion Probabilistic Models
Namrata Anand, Tudor Achim
arXiv 2022. [Paper] [Project] [Github]
26 May 2022

A Score-based Geometric Model for Molecular Dynamics Simulations
Fang Wu1, Qiang Zhang1, Xurui Jin, Yinghui Jiang, Stan Z. Li
CoRR 2022. [Paper]
19 Apr 2022

Equivariant Diffusion for Molecule Generation in 3D
Emiel Hoogeboom1, Victor Garcia Satorras1, Clément Vignac, Max Welling
ICML 2022. [Paper] [Github]
31 Mar 2022

GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation
Minkai Xu, Lantao Yu, Yang Song, Chence Shi, Stefano Ermon, Jian Tang
ICLR 2022. [Paper] [Github]
6 Mar 2022

Crystal Diffusion Variational Autoencoder for Periodic Material Generation
Tian Xie1, Xiang Fu1, Octavian-Eugen Ganea1, Regina Barzilay, Tommi Jaakkola
NeurIPS 2021. [Paper] [Github]
12 Oct 2021

Predicting Molecular Conformation via Dynamic Graph Score Matching
Shitong Luo, Chence Shi, Minkai Xu, Jian Tang
NeurIPS 2021. [Paper]
22 May 2021

Reinforcement Learning

Goal-Conditioned Imitation Learning using Score-based Diffusion Policies
Moritz Reuss, Maximilian Li, Xiaogang Jia, Rudolf Lioutikov
arXiv 2023. [Paper]
5 Apr 2023

EDGI: Equivariant Diffusion for Planning with Embodied Agents
Johann Brehmer, Joey Bose, Pim de Haan, Taco Cohen
ICLR Workshop 2023. [Paper]
22 Mar 2023

Multi-Agent Adversarial Training Using Diffusion Learning
Ying Cao, Elsa Rizk, Stefan Vlaski, Ali H. Sayed
arXiv 2023. [Paper]
3 Mar 2023

Diffusion Model-Augmented Behavioral Cloning
Hsiang-Chun Wang, Shang-Fu Chen, Shao-Hua Sun
arXiv 2023. [Paper]
26 Feb 2023

To the Noise and Back: Diffusion for Shared Autonomy
Takuma Yoneda, Luzhe Sun, Bradly Stadie, Ge Yang, Matthew Walter
arXiv 2023. [Paper] [Github]
23 Feb 2023

AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners
Zhixuan Liang, Yao Mu, Mingyu Ding, Fei Ni, Masayoshi Tomizuka, Ping Luo
arXiv 2023. [Paper]
3 Feb 2023

Imitating Human Behaviour with Diffusion Models
Tim Pearce, Tabish Rashid, Anssi Kanervisto, Dave Bignell, Mingfei Sun, Raluca Georgescu, Sergio Valcarcel Macua, Shan Zheng Tan, Ida Momennejad, Katja Hofmann, Sam Devlin
ICLR 2023. [Paper]
25 Jan 2023

Is Conditional Generative Modeling all you need for Decision-Making?
Anurag Ajay1, Yilun Du1, Abhi Gupta1, Joshua Tenenbaum, Tommi Jaakkola, Pulkit Agrawal
arXiv 2022. [Paper]
28 Nov 2022

LAD: Language Augmented Diffusion for Reinforcement Learning
Edwin Zhang, Yujie Lu, William Wang, Amy Zhang
NeurIPS Workshop 2022. [Paper]
27 Oct 2022

Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning
Zhendong Wang, Jonathan J Hunt, Mingyuan Zhou
arXiv 2022. [Paper] [Github]
12 Oct 2022

Offline Reinforcement Learning via High-Fidelity Generative Behavior Modeling
Huayu Chen, Cheng Lu, Chengyang Ying, Hang Su, Jun Zhu
arXiv 2022. [Paper]
29 Sep 2022

Planning with Diffusion for Flexible Behavior Synthesis
Michael Janner, Yilun Du, Joshua B. Tenenbaum, Sergey Levine
ICML 2022. [Paper] [Github]
20 May 2022

Theory

Diffusion Models for Constrained Domains
Nic Fishman, Leo Klarner, Valentin De Bortoli, Emile Mathieu, Michael Hutchinson
arXiv 2023. [Paper]
11 Apr 2023

Diffusion Bridge Mixture Transports, Schrödinger Bridge Problems and Generative Modeling
Stefano Peluchetti
arXiv 2023. [Paper] 3 Apr 2023

Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models \ Anant Raj, Umut Şimşekli, Alessandro Rudi
arXiv 2023. [Paper]
30 Mar 2023

Diffusion Schrödinger Bridge Matching
Yuyang Shi, Valentin De Bortoli, Andrew Campbell, Arnaud Doucet
arXiv 2023. [[Paper(https://arxiv.org/abs/2303.16852)]
29 Mar 2023

Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers
Sitan Chen, Giannis Daras, Alexandros G. Dimakis
arXiv 2023. [Paper]
6 Mar 2023

Diffusion Models are Minimax Optimal Distribution Estimators
Kazusato Oko, Shunta Akiyama, Taiji Suzuki
arXiv 2023. [Paper]
3 Mar 2023

Understanding the Diffusion Objective as a Weighted Integral of ELBOs
Diederik P. Kingma, Ruiqi Gao
arXiv 2023. [Paper]
1 Mar 2023

Continuous-Time Functional Diffusion Processes
Giulio Franzese, Simone Rossi, Dario Rossi, Markus Heinonen, Maurizio Filippone, Pietro Michiardi
arXiv 2023. [Paper]
1 Mar 2023

Denoising Diffusion Samplers
Francisco Vargas, Will Grathwohl, Arnaud Doucet
arXiv 2023. [Paper]
27 Feb 2023

Infinite-Dimensional Diffusion Models for Function Spaces
Jakiw Pidstrigach, Youssef Marzouk, Sebastian Reich, Sven Wang
arXiv 2023. [Paper]
20 Feb 2023

Score-based Diffusion Models in Function Space
Jae Hyun Lim1, Nikola B. Kovachki1, Ricardo Baptista1, Christopher Beckham, Kamyar Azizzadenesheli, Jean Kossaifi, Vikram Voleti, Jiaming Song, Karsten Kreis, Jan Kautz, Christopher Pal, Arash Vahdat, Anima Anandkumar
arXiv 2023. [Paper]
14 Feb 2023

Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data
Minshuo Chen1, Kaixuan Huang1, Tuo Zhao, Mengdi Wang
arXiv 2023. [Paper]
14 Feb 2023

Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent
Benjamin Gess1, Sebastian Kassing1, Vitalii Konarovskyi
arXiv 2023. [Paper]
14 Feb 2023

Monte Carlo Neural Operator for Learning PDEs via Probabilistic Representation
Rui Zhang, Qi Meng, Rongchan Zhu, Yue Wang, Wenlei Shi, Shihua Zhang, Zhi-Ming Ma, Tie-Yan Liu
arXiv 2023. [Paper]
10 Feb 2023

Example-Based Sampling with Diffusion Models
Bastien Doignies, Nicolas Bonneel, David Coeurjolly, Julie Digne, Loïs Paulin, Jean-Claude Iehl, Victor Ostromoukhov
arXiv 2023. [Paper]
10 Feb 2023

Information-Theoretic Diffusion
Xianghao Kong, Rob Brekelmans, Greg Ver Steeg
ICLR 2023. [Paper] [Github]
7 Feb 2023

Conditional Flow Matching: Simulation-Free Dynamic Optimal Transport
Alexander Tong, Nikolay Malkin, Guillaume Huguet, Yanlei Zhang, Jarrid Rector-Brooks, Kilian Fatras, Guy Wolf, Yoshua Bengio
arXiv 2023. [Paper] [Github]
1 Feb 2023

Transport with Support: Data-Conditional Diffusion Bridges
Ella Tamir, Martin Trapp, Arno Solin
arXiv 2023. [Paper]
31 Jan 2023

Understanding and contextualising diffusion models
Stefano Scotta, Alberto Messina
arXiv 2023. [Paper]
26 Jan 2023

On the Mathematics of Diffusion Models
David McAllester
arXiv 2023. [Paper]
25 Jan 2023

Understanding the diffusion models by conditional expectations
Yubin Lu, Zhongjian Wang, Guillaume Bal
arXiv 2023. [Paper]
19 Jan 2023

Thompson Sampling with Diffusion Generative Prior
Yu-Guan Hsieh, Shiva Prasad Kasiviswanathan, Branislav Kveton, Patrick Blöbaum
arXiv 2023. [Paper]
12 Jan 2023

Your diffusion model secretly knows the dimension of the data manifold
Georgios Batzolis1, Jan Stanczuk1, Carola-Bibiane Schönlieb
arXiv 2022. [Paper]
23 Dec 2022

Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance
Dohyun Kwon, Ying Fan, Kangwook Lee
NeurIPS 2022. [Paper] [Github]
13 Dec 2022

Nonlinear controllability and function representation by neural stochastic differential equations
Tanya Veeravalli, Maxim Raginsky
arXiv 2022. [Paper]
1 Dec 2022

Diffusion Generative Models in Infinite Dimensions
Gavin Kerrigan, Justin Ley, Padhraic Smyth
arXiv 2022. [Paper]
1 Dec 2022

Neural Langevin Dynamics: towards interpretable Neural Stochastic Differential Equations
Simon M. Koop, Mark A. Peletier, Jacobus W. Portegies, Vlado Menkovski
arXiv 2022. [Paper]
17 Nov 2022

Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions
Hongrui Chen, Holden Lee, Jianfeng Lu
arXiv 2022. [Paper]
3 Nov 2022

Categorical SDEs with Simplex Diffusion
Pierre H. Richemond, Sander Dieleman, Arnaud Doucet
arXiv 2022. [Paper]
26 Oct 2022

Diffusion Models for Causal Discovery via Topological Ordering
Pedro Sanchez, Xiao Liu, Alison Q O'Neil, Sotirios A. Tsaftaris
arXiv 2022. [Paper] [Github]
12 Oct 2022

Regularizing Score-based Models with Score Fokker-Planck Equations
Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon
arXiv 2022. [Paper]
9 Oct 2022

Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models
Louis Sharrock, Jack Simons, Song Liu, Mark Beaumont
arXiv 2022. [Paper]
10 Oct 2022

Analyzing Diffusion as Serial Reproduction
Raja Marjieh, Ilia Sucholutsky, Thomas A. Langlois, Nori Jacoby, Thomas L. Griffiths
arXiv 2022. [Paper]
29 Sep 2022

Convergence of score-based generative modeling for general data distributions
Holden Lee, Jianfeng Lu, Yixin Tan
arXiv 2022. [Paper]
26 Sep 2022

Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
Sitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li, Adil Salim, Anru R. Zhang
arXiv 2022. [Paper]
22 Sep 2022

Riemannian Diffusion Models
Chin-Wei Huang, Milad Aghajohari, Avishek Joey Bose, Prakash Panangaden, Aaron Courville
NeurIPS 2022. [Paper]
16 Aug 2022

Convergence of denoising diffusion models under the manifold hypothesis
Valentin De Bortoli
arXiv 2022. [Paper]
10 Aug 2022

Neural Diffusion Processes
Vincent Dutordoir, Alan Saul, Zoubin Ghahramani, Fergus Simpson
arXiv 2022. [Paper]
8 Jun 2022

Theory and Algorithms for Diffusion Processes on Riemannian Manifolds
Bowen Jing, Gabriele Corso, Jeffrey Chang, Regina Barzilay, Tommi Jaakkola
arXiv 2022. [Paper] [Github]
1 Jun 2022

Riemannian Score-Based Generative Modeling
Valentin De Bortoli1, Emile Mathieu1, Michael Hutchinson, James Thornton, Yee Whye Teh, Arnaud Doucet
arXiv 2022. [Paper]
6 Feb 2022

Interpreting diffusion score matching using normalizing flow
Wenbo Gong1, Yingzhen Li1
ICML Workshop 2021. [Paper]
21 Jul 2021

A Connection Between Score Matching and Denoising Autoencoders
Pascal Vincent
Neural Computation 2011. [Paper]
7 Jul 2011

Bayesian Learning via Stochastic Gradient Langevin Dynamics
Max Welling, Yee Whye Teh
ICML 2011. [Paper] [Github]
20 Apr 2011

Applications

iPINNs: Incremental learning for Physics-informed neural networks
Aleksandr Dekhovich, Marcel H.F. Sluiter, David M.J. Tax, Miguel A. Bessa
arXiv 2023. [Paper]
10 Apr 2023

Denoising Diffusion Probabilistic Models to Predict the Density of Molecular Clouds
Duo Xu, Jonathan C. Tan, Chia-Jung Hsu, Ye Zhu
APJ 2023. [Paper]
4 Apr 2023

Deep Generative Model and Its Applications in Efficient Wireless Network Management: A Tutorial and Case Study
Yinqiu Liu, Hongyang Du, Dusit Niyato, Jiawen Kang, Zehui Xiong, Dong In Kim, Abbas Jamalipour
arXiv 2023. [Paper]
30 Mar 2023

AI-Generated 6G Internet Design: A Diffusion Model-based Learning Approach
Yudong Huang, Minrui Xu, Xinyuan Zhang, Dusit Niyato, Zehui Xiong, Shuo Wang, Tao Huang
arXiv 2023. [Paper]
24 Mar 2023

Generative AI-aided Optimization for AI-Generated Content (AIGC) Services in Edge Networks
Hongyang Du, Zonghang Li, Dusit Niyato, Jiawen Kang, Zehui Xiong, Huawei Huang, Shiwen Mao
arXiv 2023. [Paper] [Github]
23 Mar 2023

Stable Bias: Analyzing Societal Representations in Diffusion Models
Alexandra Sasha Luccioni, Christopher Akiki, Margaret Mitchell, Yacine Jernite
arXiv 2023. [Paper]
20 Mar 2023

PC-JeDi: Diffusion for Particle Cloud Generation in High Energy Physics
Matthew Leigh, Debajyoti Sengupta, Guillaume Quétant, John Andrew Raine, Knut Zoch, Tobias Golling
arXiv 2023. [Paper]
9 Mar 2023

Generating Initial Conditions for Ensemble Data Assimilation of Large-Eddy Simulations with Latent Diffusion Models
Alex Rybchuk, Malik Hassanaly, Nicholas Hamilton, Paula Doubrawa, Mitchell J. Fulton, Luis A. Martínez-Tossas
arXiv 2023. [Paper]
1 Mar 2023

ReorientDiff: Diffusion Model based Reorientation for Object Manipulation
Utkarsh A. Mishra, Yongxin Chen
arXiv 2023. [Paper] [Project]
28 Feb 2023

Interventional and Counterfactual Inference with Diffusion Models
Patrick Chao, Patrick Blöbaum, Shiva Prasad Kasiviswanathan
arXiv 2023. [Paper]
2 Feb 2023

Denoising Diffusion for Sampling SAT Solutions
Karlis Freivalds, Sergejs Kozlovics
NeurIPS Workshop 2022. [Paper]
30 Nov 2022

Generating astronomical spectra from photometry with conditional diffusion models
Lars Doorenbos, Stefano Cavuoti, Giuseppe Longo, Massimo Brescia, Raphael Sznitman, Pablo Márquez-Neila
NeurIPS Workshop 2022. [Paper] [Github]
10 Nov 2022

Graphically Structured Diffusion Models
Christian Weilbach, William Harvey, Frank Wood
arXiv 2022. [Paper]
20 Oct 2022

Denoising Diffusion Error Correction Codes
Yoni Choukroun, Lior Wolf
arXiv 2022. [Paper]
16 Sep 2022

Recommendation via Collaborative Diffusion Generative Model
Joojo Walker, Ting Zhong, Fengli Zhang, Qiang Gao, Fan Zhou
KSEM 2022. [Paper]
19 Jul 2022

Deep Diffusion Models for Robust Channel Estimation
Marius Arvinte, Jonathan I Tamir
arXiv 2021. [Paper] [Github]
16 Nov 2021

Diffusion models for Handwriting Generation
Troy Luhman1, Eric Luhman1
arXiv 2020. [Paper] [Github]
13 Nov 2020

About

A collection of resources and papers on Diffusion Models

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • HTML 45.8%
  • Python 42.5%
  • CSS 10.2%
  • JavaScript 1.2%
  • Shell 0.3%