Textbook
-
Adrian Barbu and Song-Chun Zhu, Monte Carlo Methods, Springer, 2019.
Preprints
-
Deep Hierarchical Human Semantic Parsing
[pdf]
W. Wang, T. Zhou, J. Shen, and S.-C. Zhu
Under review, by TPAMI, 2020
-
X-ToM: Explaining with Theory-of-Mind for Gaining Justified Human Trust
[pdf]
A. Akula, C. Liu, S. Sadiya, H. Lu, S. Todorovic, J.Y. Chai, and S.-C. Zhu
arXiv:1909.06907
-
Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Multi-Modal Conditional Learning
[pdf]
J. Xie, Z. Zheng, X. Fang, S.-C. Zhu, and Y.N. Wu
Under review, arXiv:1902.02812
-
Learning Pose Grammar for Monocular 3D Pose Estimation
[pdf]
Y. Xu, W. Wang, X. Liu, J. Xie, J. Shen, and S.-C. Zhu
Under review, by TPAMI, 2019.
-
A Restricted Visual Turing Test for Deep Scene and Event Understanding
[pdf]
[web]
H. Qi, T. Wu, M. Lee, and S.-C. Zhu
Under review, arXiv:1512.01715
-
Learning Energy-based Model with Flow-based Backbone by Neural Transport MCMC
[pdf]
E. Nijkamp*, R. Gao*, P. Sountsov, S. Vasudevan, B. Pang, S.-C. Zhu, and Y.N. Wu
*Equal contributors
Under review, arXiv:2006.06897
-
A Representational Model of Grid Cells Based on Matrix Lie Algebras
[pdf]
R. Gao, J. Xie, S.-C. Zhu, and Y.N. Wu
Under review, arXiv:2006.10259
-
Learning Vector Representation of Local Content and Matrix Representation of Local Motion, with Implications for V1
[pdf]
R. Gao, J. Xie, S. Huang, Y. Ren, S.-C. Zhu, and Y.N. Wu
Under review, arXiv:1902.03871
-
Learning Latent Space Energy-Based Prior Model
[pdf]
B. Pang*, T. Han*, E. Nijkamp*, S.-C. Zhu, and Y.N. Wu
*Equal contributors
Under review, arXiv:2006.08205
2021
-
Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation
[pdf]
J. Xie*, Z. Zheng*, X. Fang, S.-C. Zhu, and Y.N. Wu
* equal contributions
The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI) 2021
2020
-
Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis
[pdf] [web]
J. Xie*, Z. Zheng*, R. Gao, W. Wang, S.-C. Zhu, and Y.N. Wu
*Equal contributors
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
Cascaded Parsing of Human-Object Interaction Recognition
[pdf]
T. Zhou, S. Qi, W. Wang, J. Shen, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
Deformable Generator Networks: Unsupervised Disentanglement of Appearance and Geometry
[pdf]
[web]
X. Xing, R. Gao, T. Han, S.-C. Zhu, and Y.N. Wu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
A Massively Parallel and Scalable Multi-GPU Material Point Method
[pdf]
[web]
X. Wang*, Y. Qiu*, S. R. Slattery, Y. Fang, M. Li, S.-C. Zhu, Y. Zhu, M. Tang, D. Manocha, C. Jiang
*Equal contributors
ACM Transaction on Graphics (TOG) (SIGGRAPH), 2020
-
A Generalized Earley Parser for Human Activity Parsing and Prediction
[pdf]
S. Qi, B. Jia, S. Huang, P. Wei, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
Learning to infer human attention in daily activities
[pdf]
Z. Nan, T. Shu, R.Gong, S. Wang, P. Wei, S.-C. Zhu, and N. Zheng
Pattern Recognition, 2020
-
Mining Interpretable AOG Representations from Convolutional Networks via Active Question Answering
[pdf]
Q. Zhang, J. Ren, G. Huang, R. Cao, Y.N. Wu, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
Interpretable CNNs for Object Classification
[pdf]
Q. Zhang, X. Wang, Y.N. Wu, H. Zhou, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
Extraction of an Explanatory Graph to Interpret a CNN
[pdf]
Q. Zhang, X. Wang, R. Cao, Y. Wu, F. Shi and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020
-
Cooperative Learning of Descriptor and Generator Networks
[pdf]
[web]
J. Xie, Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 42(1): 27-45, 2020
-
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense
[pdf]
[web]
Y. Zhu, T. Gao, L. Fan, S. Huang, M. Edmonds, H. Liu, F. Gao, C. Zhang, S. Qi, Y.N. Wu, J.B. Tenenbaum, and S.-C. Zhu
Engineering, Special Issue on Artificial Intelligence, 2020
-
Representation Learning: A Statistical Perspective
[pdf]
J. Xie, R. Gao, R. Nijkamp, S.-C. Zhu, and Y.N. Wu
Annual Review of Statistics and Its Application, Vol. 7, March, 2020
-
Structured Attention for Unsupervised Dialogue Structure Induction
[pdf] [web]
L. Qiu, Y. Zhao, W. Shi, Y. Liang, F. Shi, T. Yuan, Z. Yu, and S.-C. Zhu
Empirical Methods in Natural Language Processing (EMNLP), 2020
-
Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks
[pdf]
X. Gao, R. Gong, Y. Zhao, S. Wang, T. Shu, S.-C. Zhu
International Conference on Robot & Human Interactive Communication (RO-MAN), 2020
-
Learning Multi-layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference
[pdf]
[web]
E. Nijkamp*, B. Pang*, T. Han, L. Zhou, S.-C. Zhu, Y.N. Wu
*Equal contributors
European Conference on Computer Vision (ECCV), 2020
-
A Competence-aware Curriculum for Visual Concepts Learning via Question Answering
[pdf]
Q. Li, S. Huang, Y. Hong, S.-C. Zhu
European Conference on Computer Vision (ECCV), 2020
-
LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities
[pdf]
[web]
B. Jia, Y. Chen, S. Huang, Y. Zhu, S.-C. Zhu
European Conference on Computer Vision (ECCV), 2020
-
Human-Robot Interaction in a Shared Augmented Reality Workspace
[pdf]
[web]
S. Qiu*, H. Liu*, Z. Zhang, Y. Zhu, S.-C. Zhu
*Equal contributors
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020
-
Graph-based Hierarchical Knowledge Representation for Robot Task Transfer from Virtual to Physical World
[pdf]
[web]
Z. Zhang, Y. Zhu, S.-C. Zhu
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020
-
Flow Contrastive Estimation of Energy-Based Models
[pdf]
R. Gao, E. Nijkamp, D. P. Kingma, Z. Xu, A. M. Dai, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2020
-
Joint Training of Variational Auto-Encoder and Latent Energy-Based Model
[pdf]
[web]
T. Han, E. Nijkamp, L. Zhou, B. Pang, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2020
-
Inducing Hierarchical Compositional Model by Sparsifying Generator Network
[pdf]
[web]
X. Xing, T. Wu, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2020
-
Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
[pdf]
[web]
Q. Li, S. Huang, Y. Hong, Y. Chen, Y.N. Wu, and S.-C. Zhu
International Conference on Machine Learning (ICML), 2020
-
Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions
[pdf]
[web]
A. R. Akula, S. Gella, Y. A. Onaizan, S.-C. Zhu, and S. Reddy
Association for Computational Linguistics (ACL), 2020
-
Joint Inference of States, Robot Knowledge, and Human (False)-Beliefs
[pdf]
[web]
T. Yuan, H. Liu, L. Fan, Z. Zheng, T. Gao, Y. Zhu, and S.-C. Zhu
International Conference on Robotics and Automation (ICRA), 2020
-
Congestion-aware Evacuation Routing using Augmented Reality Devices
[pdf]
[web]
[code]
Z. Zhang, H. Liu, Z. Jiao, Y. Zhu, and S.-C. Zhu
International Conference on Robotics and Automation (ICRA), 2020
-
Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning
[pdf]
[web]
M. Edmonds, X. Ma, S. Qi, Y. Zhu, H. Lu, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2020
-
Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning
[pdf]
[web]
W. Zhang, C. Zhang, Y. Zhu, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2020
-
Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns
[pdf]
[web]
J. Xie*, R. Gao*, Z. Zheng, S.-C. Zhu, Y.N. Wu
*Equal contributors
AAAI Conference on Artificial Intelligence (AAAI), 2020
-
On the Anatomy of MCMC-based Maximum Likelihood Learning of Energy-Based Models
[pdf]
[web]
E. Nijkamp*, M. Hill*, T. Han, S.-C. Zhu, and Y.N. Wu
*Equal contributors
AAAI Conference on Artificial Intelligence (AAAI), 2020
-
CoCoX: Generating Conceptual and Counterfactual Explanations via Fault-Lines
[pdf]
[web]
A. Akula, S. Wang, S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2020
2019
-
A tale of two explanations: Enhancing human trust by explaining robot behavior
[pdf]
M. Edmonds*, F. Gao*, H. Liu*, X. Xie*, S. Qi, B. Rothrock, Y. Zhu, Y.N. Wu, H. Lu, and S.-C. Zhu
*Equal contributors
Science Robotics, Vol. 4, No. 37, eaay4663, 2019
-
A Tale of Three Probabilistic Families: Discriminative, Descriptive and Generative Models
[pdf]
Y.N. Wu, R. Gao, T. Han, and S.-C. Zhu
Quarterly of Applied Mathematics, Vol. 77, No. 2, pp423-465, 2019
-
Building a Telescope to Look Into High-dimensional Image Spaces
[pdf]
M. Hill, E. Nijkamp, and S.-C. Zhu
Quarterly of Applied Mathematics, Vol. 77, No. 2, pp269-321, 2019
-
Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model
[pdf]
[web]
E. Nijkamp, M. Hill, S.-C. Zhu, and Y.N. Wu
Neural Information Processing Systems (NeurIPS), 2019
-
PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points
[pdf]
[web]
S. Huang, Y. Chen, T. Yuan, S. Qi, Y. Zhu, and S.-C. Zhu
Neural Information Processing Systems (NeurIPS), 2019
-
Learning Perceptual Inference by Contrasting
[pdf]
[web]
C. Zhang*, B. Jia*, F. Gao, Y. Zhu, H. Lu, and S.-C. Zhu
*Equal contributors
Neural Information Processing Systems (NeurIPS), 2019
-
Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense
[pdf]
[web]
Y. Chen*, S. Huang*, T. Yuan, S. Qi, Y. Zhu, and S.-C. Zhu
*Equal contributors
International Conference on Computer Vision (ICCV), 2019
-
Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning
[pdf]
[web]
L. Fan*, W. Wang*, S. Huang, X. Tang, and S.-C. Zhu
*Equal contributors
International Conference on Computer Vision (ICCV), 2019
-
DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Compare
[pdf]
Y. Xu, S.-C. Zhu, T. Tung
International Conference on Computer Vision (ICCV), 2019
-
Learning Virtual Grasp with Failed Demonstrations via Bayesian Inverse Reinforcement Learning
[pdf]
[web]
X. Xie*, C. Li*, C. Zhang, Y. Zhu, and S.-C. Zhu
*Equal contributors
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019
-
VRGym: A Virtual Testbed for Physical and Interactive AI
[pdf]
[web]
X. Xie, H. Liu, Z. Zhang, Y. Qiu, F. Gao, S. Qi, Y. Zhu, and S.-C. Zhu
Association for Computing Machinery Turing Celebration Conference (ACM TURC), 2019
-
VRKitchen: an Interactive 3D Environment for Learning Real Life Cooking Tasks
[pdf]
[web]
X. Gao, R. Gong, T. Shu, X. Xie, S. Wang, and S.-C. Zhu
ICML Workshop on Reinforcement Learning for Real Life (RL4RealLife), 2019
-
Decomposing Human Causal Learning: Bottom-up Associative Learning and Top-down Schema Reasoning
[pdf]
[web]
M. Edmonds, S. Qi, Y. Zhu, J. Kubricht, S.-C. Zhu, and H. Lu
Annual Meeting of the Cognitive Science Society (CogSci), 2019
-
Partitioning the Perception of Physical and Social Events Within a Unified Psychological Space
[pdf]
[web]
T. Shu, Y. Peng, H. Lu, and S.-C. Zhu
Annual Meeting of the Cognitive Science Society (CogSci), 2019
-
Learning Grid Cells as Vector Representation of Self-Position Coupled with Matrix Representation of Self-Motion
[pdf]
[web]
R. Gao*, J. Xie*, S.-C. Zhu, and Y.N. Wu
*Equal contributors
International Conference on Learning Representations (ICLR), 2019
-
Divergence Triangle for Joint Training of Generator Model, Energy-based Model, and Inference Model
[web]
[pdf]
T. Han*, E. Nijkamp*, X. Fang, M. Hill, S.-C. Zhu, Y.N. Wu
*Equal contributors
Computer Vision and Pattern Recognition (CVPR), 2019
-
Unsupervised Disentangling of Appearance and Geometry by Deformable Generator Network
[web]
[pdf]
X. Xing, T. Han, R. Gao, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2019
-
Reasoning Visual Dialogs with Structural and Partial Observations
[pdf]
[web]
Z. Zheng*, W. Wang*, S. Qi*, and S.-C. Zhu
*Equal contributors
Computer Vision and Pattern Recognition (CVPR), 2019
-
RAVEN: A Dataset for Relational and Analogical Visual rEasoNing
[pdf]
[web]
C. Zhang*, F. Gao*, B. Jia, Y. Zhu, and S.-C. Zhu
*Equal contributors
Computer Vision and Pattern Recognition (CVPR), 2019
-
High-Fidelity Grasping in Virtual Reality using a Glove-based System
[pdf]
[web]
H. Liu*, Z. Zhang*, X. Xie, Y. Zhu, Y. Liu, Y. Wang, and S.-C. Zhu
*Equal contributors
International Conference on Robotics and Automation (ICRA), 2019
-
Self-Supervised Incremental Learning for Sound Source Localization in Complex Indoor Environment
[pdf]
[web]
H. Liu*, Z. Zhang*, Y. Zhu, and S.-C. Zhu
*Equal contributors
International Conference on Robotics and Automation (ICRA), 2019
-
Mirroring without Overimitation: Learning Functionally Equivalent Manipulation Actions
[pdf]
[web]
H. Liu, C. Zhang, Y. Zhu, C. Jiang, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2019
-
Recognizing Unseen Attribute-Object Pair with Generative Model
[pdf]
Z. Nan*, Y. Liu*, N. Zheng, and S.-C. Zhu
*Equal contributors
AAAI Conference on Artificial Intelligence (AAAI), 2019
-
MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer
[pdf]
[web]
C. Zhang, Y. Zhu, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2019
-
Learning Dynamic Generator Model by Alternating Back-Propagation Through Time
[pdf]
[web]
J. Xie*, R. Gao*, Z. Zheng, S.-C. Zhu, and Y.N. Wu
*Equal contributors
AAAI Conference on Artificial Intelligence (AAAI), 2019
2018
-
Cooperative Learning of Descriptor and Generator Networks
[pdf]
[web]
J. Xie, Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2018.
-
Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patterns
[pdf]
J. Xie, S.-C. Zhu, and Y.N. Wu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2018
-
Exploring generative perspective of convolutional neural networks by learning random field models
[pdf]
Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
Statistics and Its Interface, Volume 11, 515–529, 2018
-
Configurable 3D Scene Synthesis and 2D Image Rendering with Per-Pixel Ground Truth using Stochastic Grammars
[pdf]
C. Jiang*, S. Qi*, Y. Zhu*, S. Huang*, J. Lin, L. Yu, D. Terzopoulos, and S.-C. Zhu
*Equal contributors
International Journal of Computer Vision (IJCV), 126(9): 920-941, 2018
-
Single-View 3D Scene Reconstruction and Parsing by Attribute Grammar
[pdf]
X. Liu, Y. Zhao, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(3): 710-725, 2018.
-
Mining deep And-Or object structures via cost-sensitive question-answer-based active annotations
[pdf]
Q.S. Zhang, Y.N. Wu, H. Zhang, and S.-C. Zhu
Computer Vision and Image Understanding (CVIU), vol. 176-177, pp 33-44, 2018
-
Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos
[pdf]
[web]
D. Xie, T. Shu, S. Todorovic, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(7): 1639-1652, 2018
-
Attributed And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes
[pdf]
[web]
S. Park, X. Nie, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(7): 1555-1569, 2018
-
Sparse and Deep Generalizations of the FRAME Model
[pdf]
Y.N. Wu, J. Xie, Y. Lu, and S.-C. Zhu
Annals of Mathematical Science and Applications, 3(1): 211-254, 2018.
-
Perception of Human Interaction Based on Motion Trajectories: from Aerial Videos to Decontextualized Animations
[pdf]
T. Shu*, Y. Peng*, L. Fan, H. Lu, and S.-C. Zhu
*Equal contributors
Topics in Cognitive Science, 10(1): 225 - 241, 2018
-
Visual Interpretability for Deep Learning: a Survey
[pdf]
Q. Zhang and S.-C. Zhu
Frontiers of Information Technology & Electronic Engineering, 19(1): 27-39, 2018
-
Cooperative Holistic Scene Understanding: Unifying 3DObject, Layout, and Camera Pose Estimation
[pdf]
[web]
S. Huang, S. Qi, Y. Xiao, Y. Zhu, Y.N. Wu, and S.-C. Zhu
Neural Information Processing Systems (NeurIPS), 2018
-
Learning Human-Object Interactions by Graph Parsing Neural Networks.
[pdf]
S. Qi*, W. Wang*, B. Jia, J. Shen, and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2018
-
Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image.
[pdf]
[web]
S. Huang, S. Qi, Y. Zhu, Y. Xiao, Y. Xu, and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2018
-
Deformable Generator Network: Unsupervised Disentanglement of Appearance and Geometry
[pdf]
X. Xing, R. Gao, T. Han, S.-C. Zhu, and Y.N. Wu
ICML workshop on Theoretical Foundations and Applications of Deep Generative Models (TADGM), 2018
-
Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction
[pdf]
[web]
S. Qi, B. Jia, and S.-C. Zhu
International Conference on Machine Learning (ICML), 2018
-
Human Causal Transfer: Challenges for Deep Reinforcement Learning
[pdf]
[web]
M. Edmonds*, J. Jubricht*, C. Summers, Y. Zhu, B. Rothrock, S.-C. Zhu, and Y. Lu
Annual Meeting of the Cognitive Science Society (CogSci), 2018
-
Learning Generative ConvNets via Multi-grid Modeling and Sampling
[pdf]
[web]
R. Gao*, Y. Lu*, J. Zhou, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks
[pdf]
[web]
P. Wei, Y. Liu, T. Shu, N.N. Zheng, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification
[pdf]
[web]
W. Wang*, Y. Xu*, J. Shen, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Interpretable Convolutional Neural Networks
[pdf]
[web]
Q. Zhang, Y.N. Wu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Inferring Shared Attention in Social Scene Videos
[pdf]
[web]
L. Fan*, Y. Chen*, P. Wei, W. Wang, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2018
-
A Causal And-Or Graph Model for Visibility Fluent Reasoning in Tracking Interacting Objects
[pdf]
[web]
Y. Xu*, L. Qin*, X. Liu, J. Xie, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Learning Descriptor Networks for 3D Shape Synthesis and Analysis
[pdf]
[web]
J. Xie*, Z. Zheng*, R. Gao, W. Wang, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Human-centric Indoor Scene Synthesis Using Stochastic Grammar
[pdf]
[web]
S. Qi, Y. Zhu, S. Huang, C. Jiang, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2018
-
Intent-aware Multi-agent Reinforcement Learning
[pdf]
S. Qi, and S.-C. Zhu
International Conference on Robotics and Automation (ICRA), 2018
-
Interactive Robot Knowledge Patching using Augmented Reality
[pdf]
[web]
H. Liu*, Y. Zhang*, W. Si, X. Xie, Y. Zhu, and S.-C. Zhu
*Equal contributors
International Conference on Robotics and Automation (ICRA), 2018
-
Unsupervised Learning of Hierarchical Models for Hand-Object Interactions
[pdf]
[web]
X. Xie*, H. Liu*, M. Edmonds, F. Gao, S. Qi, Y. Zhu, B. Rothroth, and S.-C. Zhu
*Equal contributors
International Conference on Robotics and Automation (ICRA), 2018
-
Spatially Perturbed Collision Sounds Attenuate Perceived Causality in 3D Launching Events
[pdf]
[web]
D. Wang*, J. Kubricht*, Y. Zhu*, W. Liang, S.-C. Zhu, C. Jiang, H. Lu
*Equal contributors
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), 2018
-
Scene-centric Joint Parsing of Cross-view Videos
[pdf]
[web]
H. Qi*, Y. Xu*, T. Yuan*, T.F. Wu, and S.-C. Zhu
*Equal contributors
AAAI Conference on Artificial Intelligence (AAAI), 2018
-
Tracking Occluded Objects and Recovering Incomplete Trajectories by Reasoning about Containment Relations and Human Actions
[pdf]
[web]
W. Liang, Y. Zhu, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2018
-
Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation
[pdf]
[web]
H.-S. Fang*, Yuanlu Xu*, W. Wang*, X.B. Liu, and S.-C. Zhu
*Equal contributors
AAAI Conference on Artificial Intelligence (AAAI), 2018
-
Examining CNN Representations With Respect To Dataset Bias
[pdf]
[web]
Q. Zhang, W. Wang, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2018
-
Interpreting CNN Knowledge Via An Explanatory Graph
[pdf]
[web]
Q. Zhang, R. Cao, F. Shi, Y.N. Wu, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2018
-
Cooperative Learning of Energy-based Model and Latent Variable Model via MCMC Teaching
[pdf]
[web]
J. Xie, Y. Lu, R. Gao, and Y.N. Wu
AAAI Conference on Artificial Intelligence (AAAI), 2018
2017
-
Online Object Tracking, Learning and Parsing with And-Or Graphs
[pdf]
[web]
T. Wu, Y. Lu, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 39(12): 2465-2480, 2017.
-
Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization
[pdf]
[web]
P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 39(6): 1165-1179, 2017
-
Learning Human Utility from Video Demonstrations for Deductive Planning in Robotics
[pdf]
[web]
N. Shukla, Y. He, F. Chen, S.-C. Zhu
Proceedings of Machine Learning Research, vol 78, pp448-457, 2017
-
The Martian: Examining Human Physical Judgments Across Virtual Gravity Fields
[pdf]
[web]
T. Ye*, S. Qi*, J. Kubricht, Y. Zhu, H. Lu, and S.-C. Zhu
*Equal contributors
IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.
-
Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph
[pdf]
[web]
W. Li, J. Joo, H. Qi, and S.-C. Zhu
IEEE Trans. on Multimedia, 19(2):367-381, 2017.
-
Predicting Human Activities Using Stochastic Grammar
[pdf]
[web]
S. Qi, S. Huang, P. Wei, and S.-C. Zhu
International Conference on Computer vision (ICCV), 2017
-
Monocular 3D Human Pose Estimation by Predicting Depth on Joints
[pdf]
[web]
X. Nie*, P. Wei*, and S.-C. Zhu
*Equal contributors
International Conference on Computer vision (ICCV), 2017
-
Jointly Recognizing Object Fluents and Tasks in Egocentric Videos
[pdf]
[web]
Y. Liu*, P. Wei*, and S.-C. Zhu
*Equal contributors
International Conference on Computer vision (ICCV), 2017
-
Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles
[pdf]
[web]
M. Edmonds*, F. Gao*, X. Xie, H. Liu, S. Qi, Y. Zhu, B. Rothrock, and S.-C. Zhu
*Equal contributors
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017
-
A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing
[pdf]
[web]
H. Liu*, X. Xie*, M. Millar*, M. Edmonds, F. Gao, Y. Zhu, V. J. Santos, B. Rothrock, and S.-C. Zhu
*Equal contributors
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017
-
Single-Image 3D Scene Parsing Using Geometric Commonsense
[pdf]
[web]
C. Yu, X. Liu, and S.-C. Zhu
International Joint Conference on Artificial Intelligence (IJCAI), 2017
-
Inferring Human Attention by Learning Latent Intentions
[pdf]
[web]
P. Wei, X. Dan, N. Zheng, and S.-C. Zhu
International Joint Conference on Artificial Intelligence (IJCAI), 2017
-
Inferring Hidden Statuses and Actions in Video by Causal Reasoning
[pdf]
[web]
A. Fire, and S.-C. Zhu
CVPR Workshop on Vision Meets Cognition: Functionality, Physics, Intentionality and Causality (FPIC), 2017.
-
CERN: Confidence-Energy Recurrent Network for Group Activity Recognition
[pdf]
T. Shu, S. Todorovic, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2017
-
Mining Object Parts from CNNs via Active Question-Answering
[pdf]
[web]
Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2017
-
Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet
[pdf]
[web]
J. Xie, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2017
-
Generative Hierarchical Learning of Sparse FRAME Models
[pdf]
[web]
J. Xie, Y. Xu, E. Nijkamp, Y.N. Wu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2017
-
Inferring Human Interaction from Motion Trajectories in Aerial Videos
[pdf][web]
T. Shu, Y. Peng, L. Fan, H. Lu, and S.-C. Zhu
Annual Meeting of the Cognitive Science Society (CogSci), 2017
-
Consistent Probabilistic Simulation Underlying Human Judgment in Substance Dynamics
[pdf]
[web]
J. Kubricht*, Y. Zhu*, C. Jiang*, D. Terzopoulos, S.-C. Zhu, and H. Lu
*Equal contributors
Annual Meeting of the Cognitive Science Society (CogSci), 2017
-
Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions
[pdf]
[web]
T. Shu, X. Gao, M. Ryoo, and S.-C. Zhu
International Conference on Robotics and Automation (ICRA), 2017
-
Alternating Back-Propagation for Generator Network
[pdf]
[web]
T. Han, Y. Lu, S.-C. Zhu, and Y.N. Wu
AAAI Conference on Artificial Intelligence (AAAI), 2017
-
Cross-view People Tracking by Scene-Centered Spatio-Temporal Parsing
[pdf]
Y. Xu, X. Liu, L. Qin, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2017
-
Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning
[pdf]
[web]
Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI), 2017
-
Inferring Context through Scene Understanding
[pdf]
M. Walton, D. Lange, and S.-C. Zhu
AAAI Conference on Artificial Intelligence (AAAI) Symposium on Computational Context, 2017
2016
-
Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation
[pdf]
T. Wu, B. Li, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 38(9): 1829-1843, 2016
-
Integrating Function, Geometry, Appearance for Scene Parsing
[pdf]
[web]
Y. Zhao and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 2016
-
A Reconfigurable Tangram Model for Scene Representation and Categorization
[pdf]
J. Zhu, T. Wu, B. Li, S.-C. Zhu, X. Yang, and W. Zhang
IEEE Trans. on Image Processing, 25(1): 150-166, 2016
-
Learning Perceptual Causality from Video
[pdf]
A. Fire and S.-C. Zhu
ACM Trans. on Intelligent Systems and Technology (Special Issue on Causal Discovery and Inference), 7(2): 23:1-23:22, 2016
-
Inducing Wavelets into Random Fields via Generative Boosting
[pdf]
[web]
J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
Applied and Computational Harmonic Analysis, 2016
-
A Virtual Reality Platform for Dynamic Human-Scene Interaction
[pdf]
[web]
J. Lin*, X. Guo*, J. Shao*, C. Jiang, Y. Zhu, and S.-C. Zhu
*Equal contributors
SIGGRAPH Asia, Virtual Reality Meets Physical Reality Workshop, 2016
-
Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration
[pdf]
C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S.-C. Zhu, and J. Chai
Empirical Methods in Natural Language Processing (iNLP), 2016
-
Inferring Human Intent from Video by Sampling Hierarchical Plans
[pdf]
S. Holtzen, Y. Zhao, T. Gao, J. Tenenbaum, and S.-C. Zhu
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016
-
What is Where: Inferring Containment Relations from Videos
[pdf]
[web]
W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
International Joint Conference on Artificial Intelligence (IJCAI), 2016
-
Learning Social Affordance for Human-Robot Interaction
[pdf]
[web]
T. Shu, M. Ryoo, and S.-C. Zhu
International Joint Conference on Artificial Intelligence (IJCAI), 2016
-
A Theory of Generative ConvNet
[pdf]
[web]
J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
International Conference on Machine Learning (ICML), 2016
-
Grounded Semantic Role Labeling
[pdf]
S. Yang, Q. Gao, C. Liu, C. Xiong, S.-C. Zhu, and J. Chai
North American Chapter of the Association for Computational Linguistics (NA-ACL), 2016
-
Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem
[pdf]
[web]
J. Kubricht*, C. Jiang*, Y. Zhu*, S.-C. Zhu, D. Terzopoulos, and H. Lu
*Equal contributors
Annual Meeting of the Cognitive Science Society (CogSci), 2016
-
Critical Features of Joint Actions that Signal Human Interaction
[pdf]
T. Shu, S. Thurman, D. Chen, S.-C. Zhu, and H. Lu
Annual Meeting of the Cognitive Science Society (CogSci), 2016
-
Multi-view People Tracking via Hierarchical Trajectory Composition
[pdf]
Y. Xu, X. Liu, Y. Liu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2016
-
Recognizing Car Fluents from Video
[pdf]
[web][Dataset]
B. Li, T. Wu, C. Xiong, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2016
-
Inferring Forces and Learning Human Utilities from Video
[pdf]
[web]
Y. Zhu*, C. Jiang*, Y. Zhao, D. terzopoulos and S.-C. Zhu
*Equal contributors
Computer Vision and Pattern Recognition (CVPR), 2016
-
Robot Learning with a Spatial, Temporal, and Causal And-Or Graph
[pdf]
[web]
C. Xiong, N. Shukla, W. Xiong, and S.-C. Zhu
International Conference on Robotics and Automation (ICRA), 2016
-
Learning FRAME Models Using CNN Filters
[pdf]
[web]
Y. Lu, S.-C. Zhu, and Y.N. Wu
AAAI Conference on Artificial Intelligence (AAAI), 2016
-
Task Learning through Visual Demonstration andSituated Dialogue
[pdf]
C. Liu, J. Chai, N. Shukla and S.C.Zhu
AAAI Workshop on Symbiotic Cognitive Systems, 2016
2015
-
Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging
[pdf]
[web]
S. Wang, Y.Z. Wang, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(12): 2478-2491, 2015
-
Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces
[pdf]
[web]
W. Hu and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(6): 1190-1205, 2015
-
Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection
[pdf]
[web]
T. Wu and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(5): 1013-1027, 2015
-
Scene Understanding by Reasoning Stability and Safety
[pdf]
[web]
B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 112(2): 221-238, 2015
-
Learning Sparse FRAME Models for Natural Image Patterns
[pdf]
[web]
J. Xie, W. Hu, S.-C. Zhu, and Y.N. Wu
International Journal urnal of Computer Vision (IJCV), 114(2-3): 91-112, 2015
-
Video Primal Sketch: A Unified Middel Level Representation of video
[pdf]
[web]
Z. Han, Z. Xu, and S.-C. Zhu
Journal of Mathematical Imaging and Vision, 53(2): 151-170, 2015
-
Mapping Energy Landscapes of Non-Convex Learning Problems
[pdf]
M. Pavlovskaia, K. Tu, and S.-C. Zhu
arXiv: 1410.0576, short version appears at EMMCVPR 2015
-
Attributed Grammars for Joint Estimation of Human Attributes, Parts and Poses
[pdf]
[web]
S. Park and S.-C. Zhu
International Conference on Computer vision (ICCV), 2015
-
Mining And-Or Graphs for Graph Matching and Object Discovery
[pdf]
Q. Zhang, Y.N. Wu, and S.-C. Zhu
International Conference on Computer vision (ICCV), 2015
-
Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face
[pdf]
J. Joo, F. Steen, and S.-C. Zhu
International Conference on Computer vision (ICCV), 2015
-
A Unified Framework for Human-Robot Knowledge Transfer
N. Shukla, C. Xiong, and S.-C. Zhu
AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015
-
Represent and Infer Human Theory of Mind for Human-Robot Interaction
[pdf]
Y. Zhao, S. Holtzen, T. Gao, and S.-C. Zhu
AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015
-
Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition
[pdf]
[web]
Y. Zhu*, Y. Zhao*, and S.-C. Zhu
*Equal contributors
Computer Vision and Pattern Recognition (CVPR), 2015
-
Joint Inference of Groups, Events and Human Roles in Aerial Videos
[pdf]
[web]
T. Shu, D. Xie, B. Rothrock, S. Todorovic, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2015
-
Joint Action Recognition and Pose Estimation From Video
[pdf]
X. Nie, C. Xiong, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2015
-
Evaluating Human Cognition of Containing Relations with Physical Simulation
[pdf]
[web]
W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
Annual Cognitive Science Conference (CogSci), 2015
-
Mapping Energy Landscapes of Non-Convex Learning Problems
[pdf]
M. Pavlovskaia, K. Tu, and S.-C. Zhu
Energy Minimization Method for Computer Vision and Pattern Recognition (EMMCVPR), 2015
2014
-
Animated Pose Templates for Modeling and Detecting Human Actions
[pdf]
[web]
B. Yao, B. Nie, Z. Liu, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 36(3): 436-452, 2014
-
Learning Mixtures of Bernoulli Templates by Two-Round i with Performance Guarantee
[pdf]
[slides]
A. Barbu, T. Wu, and Y.N. Wu
Electronic Journal of Statistics (EJS), 2014
-
Joint Video and Text Parsing for Understanding Events and Answering Queires
[pdf]
[web]
K. Tu, M. Meng, M. Lee, T. Choi, and S.-C. Zhu
IEEE MultiMedia, 21(2): 42-70, 2014
-
Unsupervised Learning ofCompositional Sparse Code for Natural Image Representation
[pdf]
[web]
Y. Hong, Z. Si, W. Hu, S.-C. Zhu, and Y.N. Wu
Quarterly of Applied Mathematics, 2014
-
Integrating Context and Occlusion forCar Detection by Hierarchical And-Or Model
[pdf]
[web]
B. Li, T. Wu, and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2014
-
Visual Persuasion: Inferring the Communicative Intents of Images
[pdf]
[web]
J. Joo, W. Li, F. Steen, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2014
-
Cross-View Action Modeling, Learning and Recognition
[pdf]
[web]
J. Wang, B. Nie, Y.N. Wu, and S.-C. Zhu
of Computer Vision and Pattern Recognition (CVPR), 2014.
-
Single-View 3D Scene Parsing by Attributed Grammar
[pdf]
[web]
X. Liu, Y. Zhao, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2014
-
Online Object Tracking, Learning and Parsing with And-Or Graphs
[pdf]
[web]
Y. Lu, T. Wu and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2014
-
Learning Inhomogeneous FRAME Modelsfor Object Patterns
[pdf]
[web]
J. Xie. W. Hu, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2014
-
Unsupervised Learning of Dictionaries of Hierarchical Compositional Models
[pdf]
[web]
J. Dai, Y. Hong, W. Hu, S.-C. Zhu, and Y.N. Wu
Computer Vision and Pattern Recognition (CVPR), 2014
-
Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance
[pdf]
[web]
B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
International Conference on Robotics and Automations (ICRA), 2014
2013
-
Learning And-Or Templatesfor Object Modeling and Recognition
[pdf]
[web with data and code]
Z. Si and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 35(9): 2189-2205, 2013
-
Video Event Parsingand Learning with Goal and Intent Prediction
[pdf]
[web]
M. Pei, Z. Si, B. Yao, and S.-C. Zhu
Computer Vision and Image Understanding (CVIU), 117(10): 1369-1383, 2013
-
Abstract Painting with Interactive Control of Perceptual Entropy
[pdf]
[web]
[reprint]
M. Zhao and S.-C. Zhu
ACM Trans. on Applied Perception, 10(1): 5:1-5:21, 2013
-
Video Stylization: Painterly Rendering and Optimization with Content Extraction
[pdf]
[web]
L. Lin, K. Zeng, Y. Wang, Y.-Q. Xu, and S.-C. Zhu
IEEE Trans. on Circuits and Systems for Video Technology, 23(4): 577-590, 2013
-
Unsupervised Structure Learning of Stochastic And-Or Grammars
[pdf]
[web]
K. Tu, M. Pavlovskaia, and S.-C. Zhu
Neural Information Processing Systems (NIPS), 2013
-
Inferring "Dark Matter" and "Dark Energy" from Videos
[pdf]
[web]
D. Xie, S. Todorovic, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection
[pdf]
[web]
T. Wu and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Monte Carlo Tree Search for Scheduling Activity Recognition
[pdf]
M. Amer, S. Todorovic, A. Fern, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Human Attribute Recognition by Rich Appearance Dictionary
[pdf]
[web]
J. Joo, S. Wang, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Cosegmentation and Cosketch by Unsupervised Learning
[pdf]
[web]
J. Dai, Y.N. Wu, J. Zhou, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Concurrent Action Detection with Structural Prediction
[pdf]
[web]
P. Wei, N. Zheng, Y. Zhao, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Modeling Occlusion by Discriminative AND-OR Structures
[pdf]
[web]
B. Li, W. Hu, T. Wu, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Modeling 4D Human-Object Interactions for Event and Object Recognition
[pdf]
[web]
P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
Int’l Conference on Computer Vision (ICCV), 2013
-
Rates for Inductive Learning of Compositional Models
[pdf]
A. Barbu, M. Pavlovskaia, and S.-C. Zhu
AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), 2013
-
Scene Parsing by Integrating Function, Geometry and Appearance Models
[pdf]
[web]
Y. Zhao and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2013
-
Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics
[pdf]
[web]
B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2013
-
Integrating Grammar and Segmentation forHuman Pose Estimation
[pdf]
[web]
B. Rothrock, S. Park, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2013
-
Discriminatively Trained And-Or Tree Models for Object Detection
[pdf]
[web]
X. Song, T. Wu, Y. Jia, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2013
-
Weakly Supervised Learning for Attribute Localization in Outdoor Scenes
[pdf]
[web]
S. Wang, J. Joo, Y. Wang, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2013
-
Using Causal Induction in Humans to Learn and Infer Causality from Video
[pdf]
[poster]
A. Fire and S.-C. Zhu
Annual Meeting of the Cognitive Science Society (CogSci), 2013
-
Learning Perceptual Causality from Video
[pdf]
[slides]
[poster]
A. Fire and S.-C. Zhu
AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), Bellvue, WA, 2013
2012
-
Learning Hybrid image Template (HiT) by Information Projection
[pdf]
[web]
Z. Si and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 34(7): 1354-1367, 2012
-
Intrackability: Characterizing Video Statistics and Pursuing Video Representations
[pdf]
[web]
H. Gong and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 97(3): 255-275, 2012
-
Background Modeling by Subspace Learning on Spatio-temporal Patches
[reprint]
Y. Zhao, H. Gong, Y. Jia, and S.-C. Zhu
Pattern Recognition Letter, 33(9): 1134-1147, 2012
-
Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition
[pdf]
[web]
M. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2012
-
Hierarchical Space Tiling for Scene Modelling
[pdf]
S. Wang, Y. Wang, and S.-C. Zhu
Asia Conference on Computer Vision (ACCV), 2012
-
Reconfigurable Templates for Robust Vehicle Detection and Classification
[pdf]
Y. Lu, B. Yao, Y. Wang, and S.-C. Zhu
Workshop on Application of Computer Vision (WACV), 2012
-
Learning Reconfigurable Scene Representation by Tangram Model
[pdf]
J. Zhu, T. Wu, S.-C. Zhu, X. Yang, and W. Zhang
Workshop on Application of Computer Vision (WACV), 2012
-
Artistic Rendering of Portraits
M. Zhao and S.-C. Zhu
Book Chapter in Image and Video based Artistic Stylization, Eds. J. Collomosse and P. Rossin, Springer, 2012
-
Hierarchical Organization by And-Or Tree
J. Joo, S. Wang, and S.-C. Zhu
Book Chapter in Handbook of Perceptual Organization, Eds. J. Wagemans, Springer, 2012
-
Structure v.s. Appearance and 3D v.s. 2D? A Numeric Answer
W. Hu, Z. Si, and S.-C. Zhu
Book Chapter in Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective, Eds. S. Dickinson and Z. Pizlo, Springer, 2012
-
Learning 3D Object Templates by Hierarchical Quantization of Geometry and Appearance Spaces
[pdf]
[web]
W. Hu and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2012
2011
-
C4: Computing Multiple Solutions in Graphical Models by Cluster Sampling
[pdf]
[web]
J. Porway and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 33(9): 1713-1727, 2011
-
A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs
[pdf]
[web]
T. Wu and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 93(2): 226-252, 2011
-
Image Parsing via Stochastic Scene Grammar
[pdf]
[web]
Y. Zhao and S.-C. Zhu
Neural Information Processing Systems (NIPS), 2011
-
Unsupervised Learning of Stochastic And-Or Templates for Object modeling
[pdf]
Z. Si and S.-C. Zhu
International Workshop on Stochastic Image Grammar (SIG), 2011
-
Human Parsing using Stochastic And-Or grammar and Rich Appearance
[pdf]
B. Rothrock and S.-C. Zhu
International Workshop on Stochastic Image Grammar (SIG), 2011
-
Parsing Video Events with Goal inference and Intent Prediction
[pdf]
[web]
M. Pei, Y. Jia, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2011
-
Unsupervised Learning of Event And-Or Grammar and Semantics from Video
[pdf]
[web]
Z. Si, M. Pei, Z. Yao, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2011
-
Image Representation by Active Curves
[pdf]
W. Hu, Y.N. Wu, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2011
-
Video Primal Sketch: A Generic Middle-Level Representation of Video
[pdf]
[web]
Z. Han, Z. Xu, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2011
-
Inferring Social Roles in Long Timespan Video Sequence
[pdf]
J. Zhang, W. Hu, B. Yao, Y. Wang, and S.-C. Zhu
International Workshop on Video Event Categorization, Tagging and Retrieval for Real World Applications, 2011
-
Customizing Painterly Rendering Styles Using Stroke Processes
[preprint]
[web]
M. Zhao and S.-C. Zhu
International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011
-
Portrait Painting Using Active Templates
[preprint]
[web]
M. Zhao and S.-C. Zhu
International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011
2010
-
A Compositional and Dynamic Model for Face Aging
[pdf]
[web]
J. Suo, S.-C. Zhu, S. Shan, and X. Chen
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 32(3): 385-401, 2010
-
Layered Graph Matching by Composite Cluster Sampling
L. Lin, X. Liu, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 32(8): 1426-1442, 2010
-
LearningActive Basis Model for Object Detection and Recognition
[pdf]
[reprint]
Y.N. Wu, Z. Si, H. Gong, and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 90(2): 198-235, 2010
-
Hierarchical and Contextual Model for Aerial Image Understanding
[pdf]
[web]
J. Porway, K. Wang, and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 88(2): 254-283, 2010
-
I2T: Image Parsing to Text Description
[pdf]
[web]
Z. Yao, X. Yang, L. Lin, M. Lee, and S.-C. Zhu
Proceedings of the IEEE (Special Issue on Internet Vision), 98(8): 1485-1508, 2010
-
Learning Active Basis Models by i-Type Algorithms
[pdf]
Z. Si, H. Gong, S.-C. Zhu, and Y.N. Wu
Statistical Science, 2010
-
CO3 for Ultra-fast and Accurate Interactive Segmentation
[pdf]
[web]
Y. Zhao, S.-C. Zhu, and S.W. Luo
ACM conference on Multimedia (MM), 2010
-
Artistic Paper-cut of Human Portraints
[pdf]
[web]
M. Meng, M. Zhao, and S.-C. Zhu
ACM conference on Multimedia (MM), 2010
-
Sisley the Abstract Painter
[pdf]
[web]
M. Zhao and S.-C. Zhu
International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010
-
Painterly Animation Using Video Semantics and Feature Correspondence
[pdf]
[web]
L. Lin K. Zeng, H. Lv, Y. Wang, Y. Xu, and S.-C. Zhu
International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010
-
Learning Artistic Lighting Template from Portrait Photographs
[preprint]
[web]
X. Jin, M. Zhao, X. Chen, Q. Zhao, S.-C. Zhu
European Conference on Computer Vision (ECCV), 2010
-
Learning a Probabilistic ModelMixing 3D and 2DPrimitives for View Invariant Object Recognition
[pdf]
[web]
W. Hu and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2010
-
Discovering Scene Categories by Information Projection and Cluster Sampling
[pdf]
D. Dai, T. Wu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2010
2009
-
Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
F. Han and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2009
[pdf]
[reprint]
-
From Image Parsing to Painterly Rendering
[reprint]
K. Zeng, M. Zhao, C. Xiong, and S.-C. Zhu
ACM Trans. on Graphics (TOG), 29(1): 2:1-2:11, 2009
-
Learning Explicit and Implicit Visual Manifolds by Information Projection
[pdf]
[reprint]
S.-C. Zhu, K. Shi, and Z. Si
Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009
-
An And-or Graph Model for Face Representation, Sketching and Aging
[pdf]
F. Min, J. Suo, and S.-C. Zhu
Book Chapter inEncyclopedia of Biometric Recognition, Springer, 2009
-
Learning Deformable Action Templates from Cluttered Videos
[pdf]
B. Yao and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2009
-
Evaluating Information Contributions of Bottom-up and Top-down Processes
[pdf]
X. Yang, T. Wu, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2009
-
Learning Mixed Templates for Object Recognition
[pdf]
Z. Si, H. Gong, Y.N. Wu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2009
-
Flow Mosaicking: Real-time Pedestrian Counting without Scene-Specific Learning
Y. Cong, H. Gong, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2009
-
Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph
[pdf]
X. Liu, L. Lin, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2009
-
Layered Graph Matching by Composite Clustering with Collaborative and Competitive Interactions
L. Lin, K. Zeng, X. Liu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2009
-
Learning Compositional Models for Object Categories from Small Sample Sets
[pdf]
J. Porway, B. Yao, and S.-C. Zhu
Book Chapter in Object Categorization: Computer and Human Vision Perspectives, Eds. Sven Dickinson et al., Cambridge University Press, 2009
2008
-
A Composite Template for Human Face Modeling and Sketch
[pdf]
[reprint]
Z. Xu, H. Chen, S.-C. Zhu, and J. Luo
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2008
-
Perceptual Scale Space and Its Applications
[pdf]
[reprint]
Y. Wang and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 80(1): 143-165, 2008
-
A Hierarchical and Contextual Model for Aerial Image Understanding
[pdf]
J. Porway, K. Wang, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2008
-
An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry
[pdf]
W. Hu, H. Gong, S.-C. Zhu, and Y. Wang
Computer Vision and Pattern Recognition (CVPR), 2008
-
Learning a Scene Contextual Model for Tracking and Abnormality Detection
[pdf]
B. Yao, L. Wang, and S.-C. Zhu
International Workshop on Semantic Learning and Applications in Multimedia, 2008
-
SAVE: A Framework for Semantic Annotation of Visual Events
[pdf]
M. Lee, A. Hakeem, N. Haering, and S.-C. Zhu
International Workshop on Internet Vision, 2008
2007
-
A Two-Level Generative Model for Cloth Representation and Shape-From-Shading
[pdf]
F. Han and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 29(7): 1230-1243, 2007
-
From Information Scaling of Natural Images to Regimes of Statistical Models
[preprint]
Y.N. Wu, C. Guo, and S.-C. Zhu
Quarterly of Applied Mathematics, 2007
-
Primal Sketch: Integrating Texture and Structure
[pdf]
[reprint]
C. Guo, S.-C. Zhu, and Y.N. Wu
Computer Vision and Image Understanding (CVIU), 106(1): 5-19, 2007
-
Generalizing Swendsen-Wang for Image Analysis
[long survey]
A. Barbu and S.-C. Zhu
Journal of Computational and Graphical Statistics, 2007
-
Statistical Principles in Image Modeling
[pdf]
Y.N. Wu, J. Li. Z. Liu, and S.-C. Zhu
Technometrics, 49(3): 249-261, 2007
-
Deformable Template as Active Basis
[pdf]
Y.N. Wu, Z. Si, C. Fleming, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2007
-
An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples
[pdf]
L. Lin, S. Peng, J. Porway, S.-C. Zhu, and Y. Wang
International Conference on Computer Vision (ICCV), 2007
-
Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation tool, and Benchmarks
[pdf]
Z. Yao, X. Yang, and S.-C. Zhu
International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007
-
Object Category Recognition using Generative Template Boosting
S. Peng, L. Lin, J. Porway, N. Sang, and S.-C. Zhu
International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007
-
An Automatic Portrait System Based on And-Or Graph Representation
[pdf]
F Min, J. Suo, S.-C. Zhu, and N. Sang
International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007
-
Dynamic Feature Cascade for Multiple Object Tracking with Trackability Analysis
Z. Li, H. Gong, S.-C. Zhu, and N. Sang
International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007
-
Bayesian Inference for Layer Representation with Mixed Markov Random Field
[pdf]
R. Gao, T. Wu, N. Sang, and S.-C. Zhu
International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007
-
Mapping the Ensemble of Natural Image Patches by iplicit and Implicit Manifolds
[pdf]
K, Shi and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2007
-
Compositional Boosting for Computing Hierarchical Image Structures
[pdf]
T. Wu, G. Xia, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2007
-
Layered Graph Matching with Graph Editing
[pdf]
L. Lin, S.-C. Zhu and Y. Wang
Computer Vision and Pattern Recognition (CVPR), 2007
-
A Multi-Resolution Dynamic Model for Face Aging Simulation
[pdf]
J. Suo, F. Min, S.-C. Zhu, S. Shan, and X. Chen
Computer Vision and Pattern Recognition (CVPR), 2007
2006
-
A Genrative Sketch Model for Human Hair Analysis and Synthesis
[pdf]
[reprint]
H. Chen and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 28(7): 1025-1040, 2006
-
Parsing Images into Regions, Curves, and Curve Groups
[pdf]
[reprint]
Z. Tu and S.-C. Zhu
International Journal urnal of Computer Vision (IJCV), 69(2): 223-249, 2006
-
First-hitting-time Analysis of Independence Metropolis Sampler
[pdf]
[reprint]
A version published at SCTV03 for Vision audience [pdf]
R. Maciuca and S.-C. Zhu
Journal of Theoretical Probability, 2006
-
A Stochastic Grammar of Images
[pdf]
[reprint]
S.-C. Zhu and D. Mumford
Foundations and Trends in Computer Graphics and Vision, 2(4): 259-362, 2006
-
Composite Templates for Cloth Modeling and Sketching
[pdf]
H. Chen, Z. Xu, Z. Liu, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2006
2005
-
Generalizing Swendsen-Wangto Sampling Arbitrary Posterior Probabilities
[pdf]
[reprint]
A. Barbu and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 27(8): 1239-1253, 2005
-
What are Textons?
[pdf]
[reprint]
S.-C. Zhu, C. Guo, Y. Wang, and Z. Xu
International Journal of Computer Vision (IJCV), 62(1-2): 121-143, 2005
-
Image parsing: Unifying Segmentation, Detection and Recognition
[pdf]
[reprint]
Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
International Journal of Computer Vision (IJCV), 63(2): 113-140, 2005
-
Incorporating Visual Knowledge Representation in Stereo Reconstruction
[pdf]
A. Barbu and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2005
-
Perceptual Scale Space and It Applications
[pdf]
Y. Z. Wang, S. Bahrami, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2005
-
Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar
[pdf]
F. Han and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2005
-
A generative model of human hair for hair sketching
[pdf]
H. Chen and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2005
-
A High Resolution Grammatical Model for Face Representation and Sketching
[pdf]
Z. Xu, H. Chen, and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2005
-
Cloth Representation by Shape from Shading with Shading Primitives
[pdf]
F. Han and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2005
2004
-
Range Image Segmentation by an Effective Jump-Diffusion Method
[pdf]
[reprint]
F. Han, Z. Tu, and S.-C. Zhu,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 26(9): 1138-1153, 2004
-
Analysis and Synthesis of Textured Motion: Particles and Waves
[pdf]
[reprint]
Y. Wang and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 26(10): 1348-1363, 2004
-
Perceptual Scaling
[pdf]
Y.N. Wu, C. Guo, and S.-C. Zhu
Book Chapter in Applied Bayesian Modeling and Causal Inference from an Incomplete Data Perspective, Eds. A. Gelman and X.L. Meng, John Wiley, 2004.
-
Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs
[pdf]
Y. Wang and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2004
-
Information Scaling Laws in Natural Scenes
[pdf]
C. Guo, Y.N. Wu, and S.-C. Zhu
Workshop on Generative Model Based Vision, 2004
-
Multigrid and Multi-level Swendsen-Wang Cuts for Hierarchic Graph Partition
[pdf]
A. Barbu and S.-C. Zhu
Computer Vision and Pattern Recognition (CVPR), 2004
-
On the Relationship between Image and Motion Segmentation
[pdf]
A. Barbu and S.-C. Zhu
Workshop on Spatial Coherence for Visual Motion Analysis, 2004
-
Automatic Single View Building Reconstruction by Integrating Segmentation
F. Han and S.-C. Zhu
Workshop on Perceptual Organization in Computer Vision, 2004
2003
-
Statistical Edge Detection: Learning and Evaluating Edge Cue
[ps.gz]
[reprint]
S. Kinishi, A. Yuille, J. Coughlan, and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 25(1): 57-74, 2003
-
Statistical Modeling and Conceptualization of Visual Patterns
[pdf]
[reprint]
S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 25(6): 691-712, 2003
-
Modeling Visual Patterns by Integrating Descriptive and Generative Models
[ps.gz]
[reprint]
C. Guo, S.-C. Zhu, and Y.N. Wu
International Journal of Computer Vision (IJCV), 53(1): 5-29, 2003
-
On Advances in Statistical Modeling of Natural Images
[pdf]
A. Srivastava, A. Lee, E. Simoncelli, and S.-C. Zhu
Journal of Math Imaging and Vision, 2003
-
A Mathematical Theory of Primal Sketch and Sketchability
[dio]
[pdf]
C. Guo, S.-C. Zhu, and Y.N. Wu
International Conference on Computer Vision (ICCV), 2003
-
Image Parsing: Segmentation, Detection, and Recognition
[dio]
[pdf]
Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2003
-
Modeling Textured Motion: Particles, Waves, and Cartoon Sketch
[dio]
[pdf]
Y. Wang and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2003
-
Graph Partition by Swendsen-Wang Cut
[dio]
[pdf]
A. Barbu and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2003
-
A Multiscale Generative Model for Animate Shape and Parts
[dio]
[pdf]
A. Dubinskiy and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2003
-
How do Heuristics Expedite Markov Chain Search?
[dio]
[pdf]
R. Maciuca and S.-C. Zhu
International Conference on Computer Vision (ICCV), 2003
-
Bayesian Reconstruction of 3D Shapes and Scenes from a Single Image
[dio]
[pdf]
F. Han and S.-C. Zhu
International Workshop on High Level Knowledge in 3D Modeling and Motion (HLK), 2003
2002
-
Image Segmentation by Data-Driven Markov Chain Monte Carlo
[ps.gz]
[reprint]
Z. Tu and S.-C. Zhu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 24(5): 657-673, 2002
-
Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?"
[ps.gz]
[reprint]
S.-C. Zhu and X. Liu
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 24(7): 1001-1006, 2002
-
A Generative Model for Textured Motion: Analysis and Synthesis
[pdf]
Y. Wang and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2002
-
Parsing Images into Region and Curve Processes
[pdf]
Z. Tu and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2002
-
What are Textons?
[pdf]
S.-C. Zhu, C. Guo, Y.N. Wu, and Y. Wang
European Conference on Computer Vision (ECCV), 2002
-
Statistical Modeling of Texture Sketch
[pdf]
Y.N. Wu, S.-C. Zhu, and C. Guo
European Conference on Computer Vision (ECCV), 2002
-
A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction
F. Han, Z. Tu, and S.-C. Zhu
European Conference on Computer Vision (ECCV), 2002