Short Bio

Alex's research is centered around machine learning and computer vision. He is particularly interested in algorithms for prediction with and learning of non-linear (deep nets), multivariate and structured distributions, and their application in numerous tasks, e.g., for 3D scene understanding from a single image.

Alex Schwing is an assistant professor in the Department of Electrical and Computer Engineering at the University of Illinois in Urbana-Champaign and affiliated with the Coordinated Science Laboratory and the Computer Science Department. Prior to that he was a postdoctoral fellow in the Machine Learning Group at University of Toronto collaborating with Raquel Urtasun, Rich Zemel and Ruslan Salakhutdinov. He completed his PhD in computer science in the Computer Vision and Geometry Group at ETH Zurich working with Marc Pollefeys, Tamir Hazan and Raquel Urtasun, and graduated from Technical University of Munich (TUM) with a diploma in Electrical Engineering and Information Technology.

Recent Research (in layman's terms)

Here are some of the recent research projects that I was working on with an amazing set of students. We conduct reproducible and open research and release code whenever possible.

People

This research wouldn't be possible without an amazing set of team members and collaborators. I'm extremely grateful and thankful for their support.
Former team members and collaborators: Aditya Deshpande (Amazon - ), Idan Schwartz (Microsoft - ), Ishan Deshpande (Vicarious - ), Kexin Hui (), Liwei Wang (Tencent - ), Medhini Narasimhan (UC Berkeley - ), Moitreya Chatterjee (UIUC - ), Youjie Li (UIUC - ), Ziyu Zhang (Startup - )

Acknowledgements

This research also wouldn't be possible without funding and support from many people in the research community. Thank you so much.

• Samsung SAIT for supporting our research 2019
• 3M for supporting our work with a Non-Tenured Faculty Award 2019
• Cisco Systems for supporting our research 2019
• Adobe for supporting our research 2019
• The 2019 UIUC fellowship committee for recognizing Yuan-Ting Hu with the Yi-Min Wang and Pi-Yu Chung Endowed Research Award
• The 2019 CSL student conference organization for recognizing Unnat Jain's talk with the best student presentation award
• Samsung for supporting our research 2019
• The 2018 Google PhD Fellowship Committee for awarding Raymond Yeh
• The UIUC Scholarship Committee 2018 for choosing Medhini Narasimhan as a Siebel scholar
• The NIPS foundation for awarding Medhini Narasimhan and Youjie Li with a NIPS 2018 travel grant
• The SNAP 2018 fellowship committee for awarding Medhini Narasimhan and Harsh Agrawal
• Samsung SAIT for supporting our research 2018
• 3M for supporting our work with a Non-Tenured Faculty Award 2018
• Samsung for supporting our research 2018
• The UIUC College of Engineering for supporting our research
• All fall 2017 ECE 544 students for putting the new class on the excellent teacher list
• The NIPS foundation for awarding Yuan-Ting Hu with a NIPS 2017 travel grant
• The UIUC Scholarship Committee 2017 for choosing Unnat Jain as a Siebel scholar
• The National Science Foundation (NSF IIS RI) and the panel for supporting our research
• The CVPR 2017 area chairs supporting our CVPR 2017 reviewer award
• All spring 2017 ECE 547 students for putting the new class on the excellent teacher list
• The 2017 CSL student conference organization for recognizing Yuan-Ting Hu's talk with the best student presentation award
• NVIDIA Corp. donating a Titan X for our research
• The NIPS foundation for providing a NIPS 2015 travel grant
• The anonymous ICML area chairs supporting my ICML 2015 reviewer award
• Re.Work providing the opportunity to talk at the Deep Learning Summit:
  
  
  
  
• The CVPR 2015 organization committee for granting the CVPR 2015 Young Researcher Support
• My thesis Committee, external referees and ETH Zurich for awarding my PhD thesis with an ETH medal
• The NIPS foundation for providing a NIPS 2014 travel grant
• The Fields Institute for awarding a Fields Postdoctoral Fellowship
• NVIDIA Corp. donating a Tesla K40 GPU for our research

Teaching

University of Illinois

• Spring 2020: Machine Learning (CS 446/ECE 449)
• Fall 2019: Pattern Recognition (ECE 544)
• Spring 2019: Machine Learning (CS 446/ECE 449)
• Fall 2018: Pattern Recognition (ECE 544)
• Spring 2018: Machine Learning (CS 446/ECE 449)
• Fall 2017: Pattern Recognition (ECE 544)
• Spring 2017: Topics in Image Processing (ECE 547/CSE 543)
• Fall 2016: Programming and Systems (ECE 220)

University of Toronto (PostDoc)

• Winter 2016: Gaussian Processes (Guest Lecture in: Probabilistic Graphical Models)
• Fall 2015: Structured Prediction (Guest Lecture in: Intro to Machine Learning)
• Fall 2015: Neural Networks (Guest Lecture in: Intro to Image Understanding)
• Winter 2015: Deep Learning and Structured Prediction (Guest Lecture in: Intro to Machine Learning)
• Winter 2015: Continuous Latent Variable Models (Guest Lecture in: Intro to Machine Learning)
• Fall 2014: All you wanted to know about Neural Networks (Guest Lecture in: Intro to Image Understanding)

ETH Zurich (PhD student)

• Fall 2010: Linear Algebra for Computer Science (Tutorial)
• Spring 2010: Computer Science 1 - D-MaVt (Tutorial)

TU Munich (Diploma studies)

• Fall 2007: Digital Signal Processing (Lab)
• Fall 2007: Theory of Electromagnetic Fields 1 (Tutorial)
• Spring 2006: Circuit Theory 2 (Tutorial)
• Fall 2005: Circuit Theory 1 (Tutorial)
• Fall 2005: Principles of Electricity (Tutorial)
• Spring 2005: Circuit Theory 2 (Tutorial)
• Fall 2004: Circuit Theory 1 (Tutorial)

Other

• ICCV 2015 Tutorial on Learning Deep Structured Models

Publications

• C. Graber and A.G. Schwing; Graph Structured Prediction Energy Networks; Neural Information Processing Systems (NeurIPS); 2019


@inproceedings{GraberNeurIPS2019,   author = {C. Graber and A.~G. Schwing},   title = {{Graph Structured Prediction Energy Networks}},   booktitle = {Proc. NeurIPS},   year = {2019}, }

• T. Fang and A.G. Schwing; Co-Generation with GANs using AIS based HMC; Neural Information Processing Systems (NeurIPS); 2019


@inproceedings{FangNeurIPS2019,   author = {T. Fang and A.~G. Schwing},   title = {{Co-Generation with GANs using AIS based HMC}},   booktitle = {Proc. NeurIPS},   year = {2019}, }

• R.A. Yeh*, Y.-T. Hu* and A.G. Schwing; Chirality Nets for Human Pose Regression; Neural Information Processing Systems (NeurIPS); 2019
(*equal contribution)

@inproceedings{YehHuNeurIPS2019,   author = {R.~A. Yeh$^\ast$ and Y.-T. Hu$^\ast$ and A.~G. Schwing},   title = {{Chirality Nets for Human Pose Regression}},   booktitle = {Proc. NeurIPS},   year = {2019},   note = {$^\ast$ equal contribution}, }

• J. Lin, U. Jain and A.G. Schwing; TAB-VCR: Tags and Attributes based VCR Baselines; Neural Information Processing Systems (NeurIPS); 2019


@inproceedings{LinNeurIPS2019,   author = {J. Lin and U. Jain and A.~G. Schwing},   title = {{TAB-VCR: Tags and Attributes based VCR Baselines}},   booktitle = {Proc. NeurIPS},   year = {2019}, }

• J. Aneja*, H. Agrawal*, D. Batra and A.G. Schwing; Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning; Int.'l Conf. on Computer Vision (ICCV); 2019
(*equal contribution)

@inproceedings{AnejaICCV2019,   author = {J. Aneja$^\ast$ and H. Agrawal$^\ast$ and D. Batra and A.~G. Schwing},   title = {{Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning}},   booktitle = {Proc. ICCV},   year = {2019},   note = {$^\ast$ equal contribution}, }

• T. Gupta, A.G. Schwing and D. Hoiem; ViCo: Word Embeddings from Visual Co-occurrences; Int.'l Conf. on Computer Vision (ICCV); 2019


@inproceedings{GuptaICCV2019A,   author = {T. Gupta and A.~G. Schwing and D. Hoiem},   title = {{ViCo: Word Embeddings from Visual Co-occurrences}},   booktitle = {Proc. ICCV},   year = {2019}, }

• T. Gupta, A.G. Schwing and D. Hoiem; No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training Techniques; Int.'l Conf. on Computer Vision (ICCV); 2019


@inproceedings{GuptaICCV2019B,   author = {T. Gupta and A.~G. Schwing and D. Hoiem},   title = {{No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training Techniques}},   booktitle = {Proc. ICCV},   year = {2019}, }

• I.-J. Liu*, R. Yeh* and A.G. Schwing; PIC: Permutation Invariant Critic for Multi-Agent Deep Reinforcement Learning; Conf. on Robot Learning (CORL); 2019
(*equal contribution)

@inproceedings{LiuCORL2019,   author = {I.-J. Liu$^\ast$ and R. Yeh$^\ast$ and A.~G. Schwing},   title = {{PIC: Permutation Invariant Critic for Multi-Agent Deep Reinforcement Learning}},   booktitle = {Proc. CORL},   year = {2019},   note = {$^\ast$ equal contribution}, }

• I. Deshpande, Y.-T. Hu, R. Sun, A. Pyrros, N. Siddiqui, S. Koyejo, Z. Zhao, D. Forsyth and A.G. Schwing; Max-Sliced Wasserstein Distance and its use for GANs; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019
(oral)

@inproceedings{IDeshpandeCVPR2019,   author = {I. Deshpande and Y.-T. Hu and R. Sun and A. Pyrros and N. Siddiqui and S. Koyejo and Z. Zhao and D. Forsyth and A.~G. Schwing},   title = {{Max-Sliced Wasserstein Distance and its use for GANs}},   booktitle = {Proc. CVPR},   year = {2019}, }

• U. Jain*, L. Weihs*, E. Kolve, M. Rastegrari, S. Lazebnik, A. Farhadi, A.G. Schwing and A. Kembhavi; Two Body Problem: Collaborative Visual Task Completion; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019
(*equal contribution)(oral)

@inproceedings{JainCVPR2019,   author = {U. Jain$^\ast$ and L. Weihs$^\ast$ and E. Kolve and M. Rastegrari and S. Lazebnik and A. Farhadi and A.~G. Schwing and A. Kembhavi},   title = {{Two Body Problem: Collaborative Visual Task Completion}},   booktitle = {Proc. CVPR},   year = {2019},   note = {$^\ast$ equal contribution}, }

• R. Yeh, A.G. Schwing, J. Huang and K. Murphy; Diverse Generation for Multi-agent Sports Games; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019


@inproceedings{YehCVPR2019,   author = {R. Yeh and A.~G. Schwing and J. Huang and K. Murphy},   title = {{Diverse Generation for Multi-agent Sports Games}},   booktitle = {Proc. CVPR},   year = {2019}, }

• A. Deshpande*, J. Aneja*, L. Wang, A.G. Schwing and D. Forsyth; Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speech; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019
(*equal contribution)(oral)

@inproceedings{ADeshpandeCVPR2019,   author = {A. Deshpande$^\ast$ and J. Aneja$^\ast$ and L. Wang and A.~G. Schwing and D. Forsyth},   title = {{Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speech}},   booktitle = {Proc. CVPR},   year = {2019},   note = {$^\ast$ equal contribution}, }

• Y.-T. Hu, H.-S. Chen, K. Hui, J.-B. Huang and A.G. Schwing; SAIL-VOS: Semantic Amodal Instance Level Video Object Segmentation - A Synthetic Dataset and Baselines; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019


@inproceedings{HuCVPR2019,   author = {Y.-T. Hu and H.-S. Chen and K. Hui and J.-B. Huang and A.~G. Schwing},   title = {{SAIL-VOS: Semantic Amodal Instance Level Video Object Segmentation - A Synthetic Dataset and Baselines}},   booktitle = {Proc. CVPR},   year = {2019}, }

• I. Schwartz, S. Yu, T. Hazan and A.G. Schwing; Factor Graph Attention; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019


@inproceedings{SchwartzCVPR2019a,   author = {I. Schwartz and S. Yu and T. Hazan and A.~G. Schwing},   title = {{Factor Graph Attention}},   booktitle = {Proc. CVPR},   year = {2019}, }

• I. Schwartz, A.G. Schwing and T. Hazan; A Simple Baseline for Audio-Visual Scene-Aware Dialog; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2019


@inproceedings{SchwartzCVPR2019b,   author = {I. Schwartz and A.~G. Schwing and T. Hazan},   title = {{A Simple Baseline for Audio-Visual Scene-Aware Dialog}},   booktitle = {Proc. CVPR},   year = {2019}, }

• I.-J. Liu, J. Peng and A.G. Schwing; Knowledge Flow: Improve Upon your Teachers; Int.'l Conf. on Learning Representations (ICLR); 2019


@inproceedings{LiuICLR2019,   author = {I.-J. Liu and J. Peng and A.~G. Schwing},   title = {{Knowledge Flow: Improve Upon your Teachers}},   booktitle = {Proc. ICLR},   year = {2019}, }

• Y. Li, I.-J. Liu, D. Chen, A.G. Schwing and J. Huang; Accelerating Distributed Reinforcement Learning with In-Switch Computing; Int.'l Symposium on Computer Architecture (ISCA); 2019


@inproceedings{LiISCA2019,   author = {Y. Li and I.-J. Liu and D. Chen and A.~G. Schwing and J. Huang},   title = {{Accelerating Distributed Reinforcement Learning with In-Switch Computing}},   booktitle = {Proc. ISCA},   year = {2019}, }

• P. Zhuang, A.G. Schwing and S. Kojeyo; fMRI Data Augmentation via Synthesis; IEEE Int.'l Symposium on Biomedical Imaging (ISBI); 2019


@inproceedings{ZhuangISBI2019,   author = {P. Zhuang and A.~G. Schwing and S. Kojeyo},   title = {{fMRI Data Augmentation via Synthesis}},   booktitle = {Proc. ISBI},   year = {2019}, }

• C. Graber, O. Meshi and A.G. Schwing; Deep Structured Prediction with Nonlinear Output Transformations; Neural Information Processing Systems (NeurIPS); 2018


@inproceedings{GraberNIPS2018,   author = {C. Graber and O. Meshi and A.~G. Schwing},   title = {{Deep Structured Prediction with Nonlinear Output Transformations}},   booktitle = {Proc. NeurIPS},   year = {2018}, }

• M. Narasimhan, S. Lazebnik and A.G. Schwing; Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering; Neural Information Processing Systems (NeurIPS); 2018


@inproceedings{NarasimhanNeurIPS2018,   author = {M. Narasimhan and S. Lazebnik and A.~G. Schwing},   title = {{Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering}},   booktitle = {Proc. NeurIPS},   year = {2018}, }

• Y. Li, M. Yu, S. Li, S. Avestimehr, N.S. Kim and A.G. Schwing; Pipe-SGD: A Decentralized Pipelined SGD Framework for Distributed Deep Net Training; Neural Information Processing Systems (NeurIPS); 2018


@inproceedings{LiNIPS2018,   author = {Y. Li and M. Yu and S. Li and S. Avestimehr and N.~S. Kim and A.~G. Schwing},   title = {{Pipe-SGD: A Decentralized Pipelined SGD Framework for Distributed Deep Net Training}},   booktitle = {Proc. NeurIPS},   year = {2018}, }

• M. Yu, Z. Lin, K. Narra, S. Li, Y. Li, N.S. Kim, A.G. Schwing, M. Annavaram and S. Avestimehr; GradiVeQ: Vector Quantization for Bandwidth-Efficient Gradient Aggregation in Distributed CNN Training; Neural Information Processing Systems (NeurIPS); 2018


@inproceedings{YuNIPS2018,   author = {M. Yu and Z. Lin and K. Narra and S. Li and Y. Li and N.~S. Kim and A.~G. Schwing and M. Annavaram and S. Avestimehr},   title = {{GradiVeQ: Vector Quantization for Bandwidth-Efficient Gradient Aggregation in Distributed CNN Training}},   booktitle = {Proc. NeurIPS},   year = {2018}, }

• Y. Li, J. Park, M. Alian, Y. Yuan, Q. Zheng, P. Pan, R. Wang, A.G. Schwing, H. Esmaeilzadeh and N.S. Kim; A network-centric hardware/algorithm co-design to accelerate distributed training of deep neural networks; IEEE/ACM Int.'l Symposium on Microarchitecture (MICRO); 2018


@inproceedings{LiMICRO2018,   author = {Y. Li and J. Park and M. Alian and Y. Yuan and Q. Zheng and P. Pan and R. Wang and A.G. Schwing and H. Esmaeilzadeh and N.S. Kim},   title = {{A network-centric hardware/algorithm co-design to accelerate distributed training of deep neural networks}},   booktitle = {Proc. MICRO},   year = {2018}, }

• M. Narasimhan and A.G. Schwing; Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering; European Conference on Computer Vision (ECCV); 2018


@inproceedings{NarasimhanECCV2018,   author = {M. Narasimhan and A.~G. Schwing},   title = {{Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering}},   booktitle = {Proc. ECCV},   year = {2018}, }

• M. Chatterjee and A.G. Schwing; Diverse and Coherent Paragraph Generation from Images; European Conference on Computer Vision (ECCV); 2018


@inproceedings{ChatterjeeECCV2018,   author = {M. Chatterjee and A.~G. Schwing},   title = {{Diverse and Coherent Paragraph Generation from Images}},   booktitle = {Proc. ECCV},   year = {2018}, }

• Y.-T. Hu, J.-B. Huang and A.G. Schwing; VideoMatch: Matching based Video Object Segmentation; European Conference on Computer Vision (ECCV); 2018


@inproceedings{HuECCV2018a,   author = {Y.-T. Hu and J.-B. Huang and A.~G. Schwing},   title = {{VideoMatch: Matching based Video Object Segmentation}},   booktitle = {Proc. ECCV},   year = {2018}, }

• Y.-T. Hu, J.-B. Huang and A.G. Schwing; Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation; European Conference on Computer Vision (ECCV); 2018


@inproceedings{HuECCV2018b,   author = {Y.-T. Hu and J.-B. Huang and A.~G. Schwing},   title = {{Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation}},   booktitle = {Proc. ECCV},   year = {2018}, }

• S. Messaoud, D. Forsyth and A.G. Schwing; Structural Consistency and Controllability for Diverse Colorization; European Conference on Computer Vision (ECCV); 2018


@inproceedings{MessaoudECCV2018,   author = {S. Messaoud and D. Forsyth and A.~G. Schwing},   title = {{Structural Consistency and Controllability for Diverse Colorization}},   booktitle = {Proc. ECCV},   year = {2018}, }

• I. Deshpande, Z. Zhang and A.G. Schwing; Generative Modeling using the Sliced Wasserstein Distance; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2018


@inproceedings{DeshpandeCVPR2018,   author = {I. Deshpande and Z. Zhang and A.~G. Schwing},   title = {{Generative Modeling using the Sliced Wasserstein Distance}},   booktitle = {Proc. CVPR},   year = {2018}, }

• J. Aneja, A. Deshpande and A.G. Schwing; Convolutional Image Captioning; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2018


@inproceedings{AnejaCVPR2018,   author = {J. Aneja and A. Deshpande and A.~G. Schwing},   title = {{Convolutional Image Captioning}},   booktitle = {Proc. CVPR},   year = {2018}, }

• U. Jain, S. Lazebnik and A.G. Schwing; Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2018


@inproceedings{JainCVPR2018,   author = {U. Jain and S. Lazebnik and A.~G. Schwing},   title = {{Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering}},   booktitle = {Proc. CVPR},   year = {2018}, }

• R.A. Yeh, M. Do and A.G. Schwing; Unsupervised Textual Grounding: Linking Words to Image Concepts; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2018
(spotlight)

@inproceedings{YehCVPR2018,   author = {R.~A. Yeh and M. Do and A.~G. Schwing},   title = {{Unsupervised Textual Grounding: Linking Words to Image Concepts}},   booktitle = {Proc. CVPR},   year = {2018}, }

• R.A. Yeh, J. Xiong, W.-M. Hwu, M. Do and A.G. Schwing; Interpretable and Globally Optimal Prediction for Textual Grounding using Image Concepts; Neural Information Processing Systems (NIPS); 2017
(oral)

@inproceedings{YehNIPS2017,   author = {R.~A. Yeh and J. Xiong and W.-M. Hwu and M. Do and A.~G. Schwing},   title = {{Interpretable and Globally Optimal Prediction for Textual Grounding using Image Concepts}},   booktitle = {Proc. NIPS},   year = {2017}, }

• Y.-T. Hu, J.-B. Huang and A.G. Schwing; MaskRNN: Instance Level Video Object Segmentation; Neural Information Processing Systems (NIPS); 2017


@inproceedings{HuNIPS2017,   author = {Y.-T. Hu and J.-B. Huang and A.~G. Schwing},   title = {{MaskRNN: Instance Level Video Object Segmentation}},   booktitle = {Proc. NIPS},   year = {2017}, }

• Y. Li, A.G. Schwing, K.-C. Wang and R. Zemel; Dualing GANs; Neural Information Processing Systems (NIPS); 2017


@inproceedings{LiNIPS2017,   author = {Y. Li and A.~G. Schwing and K.-C. Wang and R. Zemel},   title = {{Dualing GANs}},   booktitle = {Proc. NIPS},   year = {2017}, }

• O. Meshi and A.G. Schwing; Asynchronous Parallel Coordinate Minimization for MAP Inference; Neural Information Processing Systems (NIPS); 2017


@inproceedings{MeshiNIPS2017,   author = {O. Meshi and A.~G. Schwing},   title = {{Asynchronous Parallel Coordinate Minimization for MAP Inference}},   booktitle = {Proc. NIPS},   year = {2017}, }

• L. Wang, A.G. Schwing, and S. Lazebnik; Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space; Neural Information Processing Systems (NIPS); 2017


@inproceedings{WangNIPS2017,   author = {L. Wang and A.~G. Schwing and S. Lazebnik},   title = {{Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space}},   booktitle = {Proc. NIPS},   year = {2017}, }

• I. Schwartz, A.G. Schwing and T. Hazan; High-Order Attention Models for Visual Question Answering; Neural Information Processing Systems (NIPS); 2017


@inproceedings{SchwartzNIPS2017,   author = {I. Schwartz and A.~G. Schwing and T. Hazan},   title = {{High-Order Attention Models for Visual Question Answering}},   booktitle = {Proc. NIPS},   year = {2017}, }

• Y.-T. Hu and A.G. Schwing; An Elevator Pitch on Deep Learning; ACM GetMobile; 2017


@inproceedings{HuGetMobile2017,   author = {Y.-T. Hu and A.~G. Schwing},   title = {{An Elevator Pitch on Deep Learning}},   booktitle = {ACM GetMobile},   year = {2017}, }

• U. Jain*, Z. Zhang* and A.G. Schwing; Creativity: Generating Diverse Questions using Variational Autoencoders; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2017
(*equal contribution)(spotlight)

@inproceedings{JainZhangCVPR2017,   author = {U. Jain$^\ast$ and Z. Zhang$^\ast$ and A.~G. Schwing},   title = {{Creativity: Generating Diverse Questions using Variational Autoencoders}},   booktitle = {Proc. CVPR},   year = {2017},   note = {$^\ast$ equal contribution}, }

• R.A. Yeh*, C. Chen*, T.Y. Lim, A.G. Schwing, M. Hasegawa-Johnson, M.N. Do; Semantic Image Inpainting with Deep Generative Models; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2017
(*equal contribution)

@inproceedings{YehChenCVPR2017,   author = {R.~A. Yeh$^\ast$ and C. Chen$^\ast$ and T.~Y. Lim and A.~G. Schwing and M. Hasegawa-Johnson and M.~N. Do},   title = {{Semantic Image Inpainting with Deep Generative Models}},   booktitle = {Proc. CVPR},   year = {2017},   note = {$^\ast$ equal contribution}, }

• T. Käser, S. Klingler, A.G. Schwing and M. Gross; Dynamic Bayesian Networks for Student Modeling; Trans. on Learning Technologies; 2017


@article{KaeserTLT2017,   author = {T. K\"{a}ser and S. Klingler and A.~G. Schwing and M. Gross},   title = {{Dynamic Bayesian Networks for Student Modeling}},   journal = {Trans. Learning Technologies},   year = {2017}, }

• F.S. He, Y. Liu, A.G. Schwing and J. Peng; Learning to Play in a Day: Faster Deep Reinforcement Learning by Optimality Tightening; Int.'l Conf. on Learning Representations (ICLR); 2017


@inproceedings{HeICLR2017,   author = {F.~S. He, Y. Liu, A.~G. Schwing and J. Peng},   title = {{Learning to Play in a Day: Faster Deep Reinforcement Learning by Optimality Tightening}},   booktitle = {Proc. ICLR},   year = {2017}, }

• B. London* and A.G. Schwing*; Generative Adversarial Structured Networks; Neural Information Processing Systems (NIPS) Workshop on nAdversarial Training; 2016
(*equal contribution)

@inproceedings{LondonNIPS2016,   author = {B. London$^\ast$ and A.~G. Schwing$^\ast$},   title = {{Generative Adversarial Structured Networks}},   booktitle = {Proc. NIPS Workshop on Adversarial Training},   year = {2016},   note = {$^\ast$ equal contribution}, }

• Y. Tenzer, A.G. Schwing, K. Gimpel and T. Hazan; Constraints Based Convex Belief Propagation; Neural Information Processing Systems (NIPS); 2016


@inproceedings{TenzerNIPS2016,   author = {Y. Tenzer and A.~G. Schwing and K. Gimpel and T. Hazan},   title = {{Constraints Based Convex Belief Propagation}},   booktitle = {Proc. NIPS},   year = {2016}, }

• R. Liao, A.G. Schwing, R. Zemel and R. Urtasun; Learning Deep Parsimonious Representations; Neural Information Processing Systems (NIPS); 2016


@inproceedings{LiaoNIPS2016,   author = {R. Liao and A.~G. Schwing and R. Zemel and R. Urtasun},   title = {{Learning Deep Parsimonious Representations}},   booktitle = {Proc. NIPS},   year = {2016}, }

• B. Franke, J.-F. Plante, R. Roscher, E.A. Lee, C. Smyth, A. Hatefi, F. Chen, E. Gil, A.G. Schwing, A. Selvitella, M.M. Hoffman, R. Grosse, D. Hendricks and N. Reid; Statistical Inference, Learning and Models in Big Data; Int.'l Statistical Review; 2016


@article{FrankeStatRev2016,   author = {B. Franke and J.-F. Plante and R. Roscher and E.A. Lee and C. Smyth and A. Hatefi and F. Chen and E. Gil and A.G. Schwing and A. Selvitella and M.M. Hoffman and R. Grosse and D. Hendricks and N. Reid},   title = {{Statistical Inference, Learning and Models in Big Data}},   journal = {International Statistical Review},   year = {2016}, }

• Y. Song, A.G. Schwing, R. Zemel and R. Urtasun; Training Deep Neural Networks via Direct Loss Minimization; Int.'l Conf. on Machine Learning (ICML); 2016


@inproceedings{SongICML2016,   author = {Y. Song and A.~G. Schwing and R. Zemel and R. Urtasun},   title = {{Training Deep Neural Networks via Direct Loss Minimization}},   booktitle = {Proc. ICML},   year = {2016}, }

• W. Luo, A.G. Schwing and R. Urtasun; Efficient Deep Learning for Stereo Matching; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2016


@inproceedings{LuoCVPR2016,   author = {W. Luo and A.~G. Schwing and R. Urtasun},   title = {{Efficient Deep Learning for Stereo Matching}},   booktitle = {Proc. CVPR},   year = {2016}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Distributed Algorithms for Large Scale Learning and Inference in Graphical Models; Trans. on Pattern Analysis and Machine Intelligence (PAMI); accepted for publication;


@inproceedings{SchwingPAMI,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Distributed Algorithms for Large Scale Learning and Inference in Graphical Models}},   booktitle = {PAMI},   year = {}, }

• O. Meshi, M. Mahdavi and A.G. Schwing; Smooth and Strong: MAP Inference with Linear Convergence; Neural Information Processing Systems (NIPS); 2015


@inproceedings{MeshiNIPS2015,   author = {O. Meshi and M. Mahdavi and A.~G. Schwing},   title = {{Smooth and Strong: MAP Inference with Linear Convergence}},   booktitle = {Proc. NIPS},   year = {2015}, }

• Z. Zhang*, A.G. Schwing*, S. Fidler and R. Urtasun; Monocular Object Instance Segmentation and Depth Ordering with CNNs; Int.'l Conf. on Computer Vision (ICCV); 2015
(*equal contribution)

@inproceedings{ZhangSchwingICCV2015,   author = {Z. Zhang$^\ast$ and A.~G. Schwing$^\ast$ and S. Fidler and R. Urtasun},   title = {{Monocular Object Instance Segmentation and Depth Ordering with CNNs}},   booktitle = {Proc. ICCV},   year = {2015},   note = {$^\ast$ equal contribution}, }

• L.-C. Chen*, A.G. Schwing*, A.L. Yuille and R. Urtasun; Learning Deep Structured Models; Int.'l Conf. on Machine Learning (ICML); 2015
(*equal contribution)

@inproceedings{ChenSchwingICML2015,   author = {L.-C. Chen$^\ast$ and A.~G. Schwing$^\ast$ and A.~L. Yuille and R. Urtasun},   title = {{Learning Deep Structured Models}},   booktitle = {Proc. ICML},   year = {2015},   note = {$^\ast$ equal contribution}, }

• C. Liu*, A.G. Schwing*, K. Kundu, R. Urtasun and S. Fidler; Rent3D: Floor-Plan Priors for Monocular Layout Estimation; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2015
(*equal contribution)

@inproceedings{LiuSchwingCVPR2015,   author = {C. Liu$^\ast$ and A.~G. Schwing$^\ast$ and K. Kundu and R. Urtasun and S. Fidler},   title = {{Rent3D: Floor-Plan Priors for Monocular Layout Estimation}},   booktitle = {Proc. CVPR},   year = {2015},   note = {$^\ast$ equal contribution}, }

• J. Xu, A.G. Schwing and R. Urtasun; Learning to Segment under Various Forms of Weak Supervision; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2015


@inproceedings{XuCVPR2015,   author = {J. Xu and A.~G. Schwing and R. Urtasun},   title = {{Learning to Segment under Various Forms of Weak Supervision}},   booktitle = {Proc. CVPR},   year = {2015}, }

• S. Wang, A.G. Schwing and R. Urtasun; Efficient Inference of Continuous Markov Random Fields with Polynomial Potentials; Neural Information Processing Systems (NIPS); 2014


@inproceedings{WangNIPS2014,   author = {S. Wang and A.~G. Schwing and R. Urtasun},   title = {{Efficient Inference of Continuous Markov Random Fields with Polynomial Potentials}},   booktitle = {Proc. NIPS},   year = {2014}, }

• J. Zhang, A.G. Schwing and R. Urtasun; Message Passing Inference for Large Scale Graphical Models with High Order Potentials; Neural Information Processing Systems (NIPS); 2014


@inproceedings{ZhangNIPS2014,   author = {J. Zhang and A.~G. Schwing and R. Urtasun},   title = {{Message Passing Inference for Large Scale Graphical Models with High Order Potentials}},   booktitle = {Proc. NIPS},   year = {2014}, }

• F. Srajer, A.G. Schwing, M. Pollefeys and T. Pajdla; MatchBox: Indoor Image Matching via Box-like Scene Estimation; Int.'l Conf. on 3D Vision (3DV); 2014


@inproceedings{Srajer3DV2014,   author = {F. Srajer and A.~G. Schwing and M. Pollefeys and T. Pajdla},   title = {{MatchBox: Indoor Image Matching via Box-like Scene Estimation}},   booktitle = {Proc. 3DV},   year = {2014}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Globally Convergent Parallel MAP LP Relaxation Solver using the Frank-Wolfe Algorithm; Int.'l Conf. on Machine Learning (ICML); 2014


@inproceedings{SchwingICML2014,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Globally Convergent Parallel MAP LP Relaxation Solver using the Frank-Wolfe Algorithm}},   booktitle = {Proc. ICML},   year = {2014}, }

• A. Cohen, A.G. Schwing and M. Pollefeys; Efficient Structured Parsing of Facades Using Dynamic Programming; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2014


@inproceedings{CohenCVPR2014,   author = {A. Cohen and A.~G. Schwing and M. Pollefeys},   title = {{Efficient Structured Parsing of Facades Using Dynamic Programming}},   booktitle = {Proc. CVPR},   year = {2014}, }

• J. Xu, A.G. Schwing and R. Urtasun; Tell Me What You See and I will Show You Where It Is; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2014


@inproceedings{XuCVPR2014,   author = {J. Xu and A.~G. Schwing and R. Urtasun},   title = {{Tell Me What You See and I will Show You Where It Is}},   booktitle = {Proc. CVPR},   year = {2014}, }

• T. Käser, S. Klingler, A.G. Schwing and M. Gross; Beyond Knowledge Tracing: Modeling Skill Topologies with Bayesian Networks; Int.'l Conf. on Intelligent Tutoring Systems (ITS); 2014
(Best paper award)

@inproceedings{KaeserITS2014,   author = {T. K\"{a}ser and S. Klingler and A.~G. Schwing and M. Gross},   title = {{Beyond Knowledge Tracing: Modeling Skill Topologies with Bayesian Networks}},   booktitle = {Proc. ITS},   year = {2014}, }

• T. Käser, A.G. Schwing, T. Hazan and M. Gross; Computational Education using Latent Structured Prediction; Int.'l Conf. on Artificial Intelligence and Statistics (AISTATS); 2014


@inproceedings{KaeserAISTATS2014,   author = {T. K\"{a}ser and A.~G. Schwing and T. Hazan and M. Gross},   title = {{Computational Education using Latent Structured Prediction}},   booktitle = {Proc. AISTATS},   year = {2014}, }

• A.G. Schwing and Y. Zheng; Reliable Extraction of the Mid-Sagittal Plane in 3D Brain MRI via Hierarchical Landmark Detection; IEEE Int.'l Symposium on Biomedical Imaging (ISBI); 2014


@inproceedings{SchwingZhengISBI2014,   author = {A.~G. Schwing and Y. Zheng},   title = {{Reliable Extraction of the Mid-Sagittal Plane in 3D Brain MRI via Hierarchical Landmark Detection}},   booktitle = {Proc. ISBI},   year = {2014}, }

• W. Luo, A.G. Schwing and R. Urtasun; Latent Structured Active Learning; Neural Information Processing Systems (NIPS); 2013


@inproceedings{LuoNIPS2013,   author = {W. Luo and A.~G. Schwing and R. Urtasun},   title = {{Latent Structured Active Learning}},   booktitle = {Proc. NIPS},   year = {2013}, }

• J. Zhang, C. Kan, A.G. Schwing and R. Urtasun; Estimating the 3D Layout of Indoor Scenes and its Clutter from Depth Sensors; Int.'l Conf. on Computer Vision (ICCV); 2013


@inproceedings{ZhangICCV2013,   author = {J. Zhang and K. Chen and A.~G. Schwing and R. Urtasun},   title = {{Estimating the 3D Layout of Indoor Scenes and its Clutter from Depth Sensors}},   booktitle = {Proc. ICCV},   year = {2013}, }

• A.G. Schwing, S. Fidler, M. Pollefeys and R. Urtasun; Box In the Box: Joint 3D Layout and Object Reasoning from Single Images; Int.'l Conf. on Computer Vision (ICCV); 2013


@inproceedings{SchwingICCV2013,   author = {A.~G. Schwing and S. Fidler and M. Pollefeys and R. Urtasun},   title = {{Box In the Box: Joint 3D Layout and Object Reasoning from Single Images}},   booktitle = {Proc. ICCV},   year = {2013}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Globally Convergent Dual MAP LP Relaxation Solvers using Fenchel-Young Margins; Neural Information Processing Systems (NIPS); 2012


@inproceedings{SchwingNIPS2012,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Globally Convergent Dual MAP LP Relaxation Solvers using Fenchel-Young Margins}},   booktitle = {Proc. NIPS},   year = {2012}, }

• A.G. Schwing and R. Urtasun; Efficient Exact Inference for 3D Indoor Scene Understanding; European Conference on Computer Vision (ECCV); 2012


@inproceedings{SchwingECCV2012,   author = {A.~G. Schwing and R. Urtasun},   title = {{Efficient Exact Inference for 3D Indoor Scene Understanding}},   booktitle = {Proc. ECCV},   year = {2012}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Distributed Structured Prediction for Big Data; Neural Information Processing Systems (NIPS) Workshop on Big Learning; 2012


@inproceedings{SchwingNIPSBigLearnWS2012,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Distributed Structured Prediction for Big Data}},   booktitle = {Proc. NIPS Workshop on Big Learning},   year = {2012}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Efficient Structured Prediction with Latent Variables for General Graphical Models; Int.'l Conf. on Machine Learning (ICML); 2012


@inproceedings{SchwingICML2012,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Efficient Structured Prediction with Latent Variables for General Graphical Models}},   booktitle = {Proc. ICML},   year = {2012}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Large Scale Structured Prediction with Hidden Variables; Snowbird Workshop; 2011


@inproceedings{SchwingSnowbird2011,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Large Scale Structured Prediction with Hidden Variables}},   booktitle = {Snowbird Workshop},   year = {2011}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Efficient Structured Prediction for 3D Indoor Scene Understanding; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2012


@inproceedings{SchwingCVPR2012,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Efficient Structured Prediction for 3D Indoor Scene Understanding}},   booktitle = {Proc. CVPR},   year = {2012}, }

• A.G. Schwing, T. Hazan, M. Pollefeys and R. Urtasun; Distributed Message Passing for Large Scale Graphical Models; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2011


@inproceedings{SchwingCVPR2011a,   author = {A.~G. Schwing and T. Hazan and M. Pollefeys and R. Urtasun},   title = {{Distributed Message Passing for Large Scale Graphical Models}},   booktitle = {Proc. CVPR},   year = {2011}, }

• A.G. Schwing, C. Zach, Y. Zheng and M. Pollefeys; Adaptive Random Forest - How many ``experts'' to ask before making a decision?; IEEE Conf. on Computer Vision and Pattern Recognition (CVPR); 2011


@inproceedings{SchwingCVPR2011b,   author = {A.~G. Schwing and C. Zach and Y. Zheng and M. Pollefeys},   title = {{Adaptive Random Forest - How many ``experts'' to ask before making a decision?}},   booktitle = {Proc. CVPR},   year = {2011}, }

• M. Koch, A.G. Schwing, D. Comaniciu and M. Pollefeys; Fully Automatic Segmentation of Wrist Bones for Arthritis Patients; IEEE Int.'l Symposium on Biomedical Imaging (ISBI); 2011


@inproceedings{SchwingISBI2011,   author = {M. Koch and A.~G. Schwing and D. Comaniciu and M. Pollefeys},   title = {{Fully Automatic Segmentation of Wrist Bones for Arthritis Patients}},   booktitle = {Proc. ISBI},   year = {2011}, }

• M. Sarkis, K. Diepold and A.G. Schwing; Enhancing the Motion Estimate in Bundle Adjustment Using Projective Newton-type Optimization on the Manifold; IS&T/SPIE Electronic Imaging - Image Processing: Machine Vision Applications II; 2009


@inproceedings{SarkisSPIE2009,   author = {M. Sarkis and K. Diepold and A.~G. Schwing},   title = {{Enhancing the Motion Estimate in Bundle Adjustment Using Projective Newton-type Optimization on the Manifold}},   booktitle = {Proc. SPIE},   year = {2009}, }

• R. Hunger, D. Schmidt, M. Joham, A.G. Schwing, and W. Utschick; Design of Single-Group Multicasting-Beamformers; IEEE Int.'l Conf. on Communications (ICC); 2007


@inproceedings{HungerICC2007,   author = {R. Hunger and D. Schmidt and M. Joham and A.~G. Schwing and W. Utschick},   title = {{Design of Single-Group Multicasting-Beamformers}},   booktitle = {Proc. ICC},   year = {2007}, }

Patent Applications

• A. Tsymbal, M. Kelm, M.J. Costa, S.K. Zhou, D. Comaniciu, Y. Zheng and A.G. Schwing; Image Processing Using Random Forest Classifiers; USPA 20120321174; Assignee: Siemens Corp.
• A.G. Schwing, Y. Zheng, M. Harder, and D. Comaniciu; Method and System for Anatomic Landmark Detection Using Constrained Marginal Space Learning and Geometric Inference; USPA 20100119137; Assignee: Siemens Corp.