Textbook

  1. Adrian Barbu and Song-Chun Zhu, Monte Carlo Methods, Springer, 2019.

  2. Preprints

  3. Learning Energy-Based 3D Descriptor Networks for Volumetric Shape Synthesis and Analysis [pdf]
    J. Xie*, Z. Zheng*, R. Gao, W. Wang, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    Under review, by TPAMI, 2019

  4. Deep Hierarchical Human Semantic Parsing [pdf]
    W. Wang, T. Zhou, J. Shen, and S.-C. Zhu
    Under review, by TPAMI, 2020

  5. X-ToM: Explaining with Theory-of-Mind for Gaining Justified Human Trust [pdf]
    A. Akula, C. Liu, S. Sadiya, H. Lu, S. Todorovic, J.Y. Chai, and S.-C. Zhu
    arXiv:1909.06907

  6. Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Multi-Modal Conditional Learning [pdf]
    J. Xie, Z. Zheng, X. Fang, S.-C. Zhu, and Y.N. Wu
    Under review, arXiv:1902.02812

  7. Learning Pose Grammar for Monocular 3D Pose Estimation [pdf]
    Y. Xu, W. Wang, X. Liu, J. Xie, J. Shen, and S.-C. Zhu
    Under review, by TPAMI, 2019.

  8. A Restricted Visual Turing Test for Deep Scene and Event Understanding [pdf] [web]
    H. Qi, T. Wu, M. Lee, and S.-C. Zhu
    Under review, arXiv:1512.01715

  9. Learning Energy-based Model with Flow-based Backbone by Neural Transport MCMC [pdf]
    E. Nijkamp*, R. Gao*, P. Sountsov, S. Vasudevan, B. Pang, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    Under review, arXiv:2006.06897

  10. A Representational Model of Grid Cells Based on Matrix Lie Algebras [pdf]
    R. Gao, J. Xie, S.-C. Zhu, and Y.N. Wu
    Under review, arXiv:2006.10259

  11. Learning Vector Representation of Local Content and Matrix Representation of Local Motion, with Implications for V1 [pdf]
    R. Gao, J. Xie, S. Huang, Y. Ren, S.-C. Zhu, and Y.N. Wu
    Under review, arXiv:1902.03871

  12. Learning Latent Space Energy-Based Prior Model [pdf]
    B. Pang*, T. Han*, E. Nijkamp*, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    Under review, arXiv:2006.08205

  13. 2020

  14. Deformable Generator Networks: Unsupervised Disentanglement of Appearance and Geometry [pdf] [web]
    X. Xing, R. Gao, T. Han, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  15. A Massively Parallel and Scalable Multi-GPU Material Point Method [pdf] [web]
    X. Wang*, Y. Qiu*, S. R. Slattery, Y. Fang, M. Li, S.-C. Zhu, Y. Zhu, M. Tang, D. Manocha, C. Jiang
    *Equal contributors
    ACM Transaction on Graphics (TOG) (SIGGRAPH), 2020

  16. A Generalized Earley Parser for Human Activity Parsing and Prediction [pdf]
    S. Qi, B. Jia, S. Huang, P. Wei, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  17. Learning to infer human attention in daily activities [pdf]
    Z. Nan, T. Shu, R.Gong, S. Wang, P. Wei, S.-C. Zhu, and N. Zheng
    Pattern Recognition, 2020

  18. Mining Interpretable AOG Representations from Convolutional Networks via Active Question Answering [pdf]
    Q. Zhang, J. Ren, G. Huang, R. Cao, Y.N. Wu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  19. Interpretable CNNs for Object Classification [pdf]
    Q. Zhang, X. Wang, Y.N. Wu, H. Zhou, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  20. Extraction of an Explanatory Graph to Interpret a CNN [pdf]
    Q. Zhang, X. Wang, R. Cao, Y. Wu, F. Shi and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  21. Cooperative Learning of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 42(1): 27-45, 2020

  22. Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense [pdf] [web]
    Y. Zhu, T. Gao, L. Fan, S. Huang, M. Edmonds, H. Liu, F. Gao, C. Zhang, S. Qi, Y.N. Wu, J.B. Tenenbaum, and S.-C. Zhu
    Engineering, Special Issue on Artificial Intelligence, 2020

  23. Representation Learning: A Statistical Perspective [pdf]
    J. Xie, R. Gao, R. Nijkamp, S.-C. Zhu, and Y.N. Wu
    Annual Review of Statistics and Its Application, Vol. 7, March, 2020

  24. Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks [pdf]
    X. Gao, R. Gong, Y. Zhao, S. Wang, T. Shu, S.-C. Zhu
    International Conference on Robot & Human Interactive Communication (RO-MAN), 2020

  25. Learning Multi-layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference [pdf] [web]
    E. Nijkamp*, B. Pang*, T. Han, L. Zhou, S.-C. Zhu, Y.N. Wu
    *Equal contributors
    European Conference on Computer Vision (ECCV), 2020

  26. A Competence-aware Curriculum for Visual Concepts Learning via Question Answering [pdf]
    Q. Li, S. Huang, Y. Hong, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2020

  27. LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities [pdf] [web]
    B. Jia, Y. Chen, S. Huang, Y. Zhu, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2020

  28. Human-Robot Interaction in a Shared Augmented Reality Workspace [pdf] [web]
    S. Qiu*, H. Liu*, Z. Zhang, Y. Zhu, S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020

  29. Graph-based Hierarchical Knowledge Representation for Robot Task Transfer from Virtual to Physical World [pdf] [web]
    Z. Zhang, Y. Zhu, S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020

  30. Flow Contrastive Estimation of Energy-Based Models [pdf]
    R. Gao, E. Nijkamp, D. P. Kingma, Z. Xu, A. M. Dai, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2020

  31. Joint Training of Variational Auto-Encoder and Latent Energy-Based Model [pdf] [web]
    T. Han, E. Nijkamp, L. Zhou, B. Pang, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2020

  32. Inducing Hierarchical Compositional Model by Sparsifying Generator Network [pdf] [web]
    X. Xing, T. Wu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2020

  33. Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning [pdf] [web]
    Q. Li, S. Huang, Y. Hong, Y. Chen, Y.N. Wu, and S.-C. Zhu
    International Conference on Machine Learning (ICML), 2020

  34. Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions [pdf] [web]
    A. R. Akula, S. Gella, Y. A. Onaizan, S.-C. Zhu, and S. Reddy
    Association for Computational Linguistics (ACL), 2020

  35. Joint Inference of States, Robot Knowledge, and Human (False)-Beliefs [pdf] [web]
    T. Yuan, H. Liu, L. Fan, Z. Zheng, T. Gao, Y. Zhu, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2020

  36. Congestion-aware Evacuation Routing using Augmented Reality Devices [pdf] [web] [code]
    Z. Zhang, H. Liu, Z. Jiao, Y. Zhu, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2020

  37. Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning [pdf] [web]
    M. Edmonds, X. Ma, S. Qi, Y. Zhu, H. Lu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  38. Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning [pdf] [web]
    W. Zhang, C. Zhang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  39. Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns [pdf] [web]
    J. Xie*, R. Gao*, Z. Zheng, S.-C. Zhu, Y.N. Wu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  40. On the Anatomy of MCMC-based Maximum Likelihood Learning of Energy-Based Models [pdf] [web]
    E. Nijkamp*, M. Hill*, T. Han, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  41. CoCoX: Generating Conceptual and Counterfactual Explanations via Fault-Lines [pdf] [web]
    A. Akula, S. Wang, S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  42. 2019

  43. A tale of two explanations: Enhancing human trust by explaining robot behavior [pdf]
    M. Edmonds*, F. Gao*, H. Liu*, X. Xie*, S. Qi, B. Rothrock, Y. Zhu, Y.N. Wu, H. Lu, and S.-C. Zhu
    *Equal contributors
    Science Robotics, Vol. 4, No. 37, eaay4663, 2019

  44. A Tale of Three Probabilistic Families: Discriminative, Descriptive and Generative Models [pdf]
    Y.N. Wu, R. Gao, T. Han, and S.-C. Zhu
    Quarterly of Applied Mathematics, Vol. 77, No. 2, pp423-465, 2019

  45. Building a Telescope to Look Into High-dimensional Image Spaces [pdf]
    M. Hill, E. Nijkamp, and S.-C. Zhu
    Quarterly of Applied Mathematics, Vol. 77, No. 2, pp269-321, 2019

  46. Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model [pdf] [web]
    E. Nijkamp, M. Hill, S.-C. Zhu, and Y.N. Wu
    Neural Information Processing Systems (NeurIPS), 2019

  47. PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points [pdf] [web]
    S. Huang, Y. Chen, T. Yuan, S. Qi, Y. Zhu, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2019

  48. Learning Perceptual Inference by Contrasting [pdf] [web]
    C. Zhang*, B. Jia*, F. Gao, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    Neural Information Processing Systems (NeurIPS), 2019

  49. Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense [pdf] [web]
    Y. Chen*, S. Huang*, T. Yuan, S. Qi, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer Vision (ICCV), 2019

  50. Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning [pdf] [web]
    L. Fan*, W. Wang*, S. Huang, X. Tang, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer Vision (ICCV), 2019

  51. DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Compare [pdf]
    Y. Xu, S.-C. Zhu, T. Tung
    International Conference on Computer Vision (ICCV), 2019

  52. Learning Virtual Grasp with Failed Demonstrations via Bayesian Inverse Reinforcement Learning [pdf] [web]
    X. Xie*, C. Li*, C. Zhang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019

  53. VRGym: A Virtual Testbed for Physical and Interactive AI [pdf] [web]
    X. Xie, H. Liu, Z. Zhang, Y. Qiu, F. Gao, S. Qi, Y. Zhu, and S.-C. Zhu
    Association for Computing Machinery Turing Celebration Conference (ACM TURC), 2019

  54. VRKitchen: an Interactive 3D Environment for Learning Real Life Cooking Tasks [pdf] [web]
    X. Gao, R. Gong, T. Shu, X. Xie, S. Wang, and S.-C. Zhu
    ICML Workshop on Reinforcement Learning for Real Life (RL4RealLife), 2019

  55. Decomposing Human Causal Learning: Bottom-up Associative Learning and Top-down Schema Reasoning [pdf] [web]
    M. Edmonds, S. Qi, Y. Zhu, J. Kubricht, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2019

  56. Partitioning the Perception of Physical and Social Events Within a Unified Psychological Space [pdf] [web]
    T. Shu, Y. Peng, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2019

  57. Learning Grid Cells as Vector Representation of Self-Position Coupled with Matrix Representation of Self-Motion [pdf] [web]
    R. Gao*, J. Xie*, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    International Conference on Learning Representations (ICLR), 2019

  58. Divergence Triangle for Joint Training of Generator Model, Energy-based Model, and Inference Model [web] [pdf]
    T. Han*, E. Nijkamp*, X. Fang, M. Hill, S.-C. Zhu, Y.N. Wu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2019

  59. Unsupervised Disentangling of Appearance and Geometry by Deformable Generator Network [web] [pdf]
    X. Xing, T. Han, R. Gao, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2019

  60. Reasoning Visual Dialogs with Structural and Partial Observations [pdf] [web]
    Z. Zheng*, W. Wang*, S. Qi*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2019

  61. RAVEN: A Dataset for Relational and Analogical Visual rEasoNing [pdf] [web]
    C. Zhang*, F. Gao*, B. Jia, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2019

  62. High-Fidelity Grasping in Virtual Reality using a Glove-based System [pdf] [web]
    H. Liu*, Z. Zhang*, X. Xie, Y. Zhu, Y. Liu, Y. Wang, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2019

  63. Self-Supervised Incremental Learning for Sound Source Localization in Complex Indoor Environment [pdf] [web]
    H. Liu*, Z. Zhang*, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2019

  64. Mirroring without Overimitation: Learning Functionally Equivalent Manipulation Actions [pdf] [web]
    H. Liu, C. Zhang, Y. Zhu, C. Jiang, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  65. Recognizing Unseen Attribute-Object Pair with Generative Model [pdf]
    Z. Nan*, Y. Liu*, N. Zheng, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  66. MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer [pdf] [web]
    C. Zhang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  67. Learning Dynamic Generator Model by Alternating Back-Propagation Through Time [pdf] [web]
    J. Xie*, R. Gao*, Z. Zheng, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  68. 2018

  69. Cooperative Learning of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2018.

  70. Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patterns [pdf]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2018

  71. Exploring generative perspective of convolutional neural networks by learning random field models [pdf]
    Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
    Statistics and Its Interface, Volume 11, 515–529, 2018

  72. Configurable 3D Scene Synthesis and 2D Image Rendering with Per-Pixel Ground Truth using Stochastic Grammars [pdf]
    C. Jiang*, S. Qi*, Y. Zhu*, S. Huang*, J. Lin, L. Yu, D. Terzopoulos, and S.-C. Zhu
    *Equal contributors
    International Journal of Computer Vision (IJCV), 126(9): 920-941, 2018

  73. Single-View 3D Scene Reconstruction and Parsing by Attribute Grammar [pdf]
    X. Liu, Y. Zhao, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(3): 710-725, 2018.

  74. Mining deep And-Or object structures via cost-sensitive question-answer-based active annotations [pdf]
    Q.S. Zhang, Y.N. Wu, H. Zhang, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), vol. 176-177, pp 33-44, 2018

  75. Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos [pdf] [web]
    D. Xie, T. Shu, S. Todorovic, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(7): 1639-1652, 2018

  76. Attributed And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes [pdf] [web]
    S. Park, X. Nie, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(7): 1555-1569, 2018

  77. Sparse and Deep Generalizations of the FRAME Model [pdf]
    Y.N. Wu, J. Xie, Y. Lu, and S.-C. Zhu
    Annals of Mathematical Science and Applications, 3(1): 211-254, 2018.

  78. Perception of Human Interaction Based on Motion Trajectories: from Aerial Videos to Decontextualized Animations [pdf]
    T. Shu*, Y. Peng*, L. Fan, H. Lu, and S.-C. Zhu
    *Equal contributors
    Topics in Cognitive Science, 10(1): 225 - 241, 2018

  79. Visual Interpretability for Deep Learning: a Survey [pdf]
    Q. Zhang and S.-C. Zhu
    Frontiers of Information Technology & Electronic Engineering, 19(1): 27-39, 2018

  80. Cooperative Holistic Scene Understanding: Unifying 3DObject, Layout, and Camera Pose Estimation [pdf] [web]
    S. Huang, S. Qi, Y. Xiao, Y. Zhu, Y.N. Wu, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2018

  81. Learning Human-Object Interactions by Graph Parsing Neural Networks. [pdf]
    S. Qi*, W. Wang*, B. Jia, J. Shen, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2018

  82. Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image. [pdf] [web]
    S. Huang, S. Qi, Y. Zhu, Y. Xiao, Y. Xu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2018

  83. Deformable Generator Network: Unsupervised Disentanglement of Appearance and Geometry [pdf]
    X. Xing, R. Gao, T. Han, S.-C. Zhu, and Y.N. Wu
    ICML workshop on Theoretical Foundations and Applications of Deep Generative Models (TADGM), 2018

  84. Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction [pdf] [web]
    S. Qi, B. Jia, and S.-C. Zhu
    International Conference on Machine Learning (ICML), 2018

  85. Human Causal Transfer: Challenges for Deep Reinforcement Learning [pdf] [web]
    M. Edmonds*, J. Jubricht*, C. Summers, Y. Zhu, B. Rothrock, S.-C. Zhu, and Y. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2018

  86. Learning Generative ConvNets via Multi-grid Modeling and Sampling [pdf] [web]
    R. Gao*, Y. Lu*, J. Zhou, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2018

  87. Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks [pdf] [web]
    P. Wei, Y. Liu, T. Shu, N.N. Zheng, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  88. Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification [pdf] [web]
    W. Wang*, Y. Xu*, J. Shen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  89. Interpretable Convolutional Neural Networks [pdf] [web]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  90. Inferring Shared Attention in Social Scene Videos [pdf] [web]
    L. Fan*, Y. Chen*, P. Wei, W. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  91. A Causal And-Or Graph Model for Visibility Fluent Reasoning in Tracking Interacting Objects [pdf] [web]
    Y. Xu*, L. Qin*, X. Liu, J. Xie, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  92. Learning Descriptor Networks for 3D Shape Synthesis and Analysis [pdf] [web]
    J. Xie*, Z. Zheng*, R. Gao, W. Wang, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2018

  93. Human-centric Indoor Scene Synthesis Using Stochastic Grammar [pdf] [web]
    S. Qi, Y. Zhu, S. Huang, C. Jiang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  94. Intent-aware Multi-agent Reinforcement Learning [pdf]
    S. Qi, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2018

  95. Interactive Robot Knowledge Patching using Augmented Reality [pdf] [web]
    H. Liu*, Y. Zhang*, W. Si, X. Xie, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2018

  96. Unsupervised Learning of Hierarchical Models for Hand-Object Interactions [pdf] [web]
    X. Xie*, H. Liu*, M. Edmonds, F. Gao, S. Qi, Y. Zhu, B. Rothroth, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2018

  97. Spatially Perturbed Collision Sounds Attenuate Perceived Causality in 3D Launching Events [pdf] [web]
    D. Wang*, J. Kubricht*, Y. Zhu*, W. Liang, S.-C. Zhu, C. Jiang, H. Lu
    *Equal contributors
    IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), 2018

  98. Scene-centric Joint Parsing of Cross-view Videos [pdf] [web]
    H. Qi*, Y. Xu*, T. Yuan*, T.F. Wu, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  99. Tracking Occluded Objects and Recovering Incomplete Trajectories by Reasoning about Containment Relations and Human Actions [pdf] [web]
    W. Liang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  100. Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation [pdf] [web]
    H.-S. Fang*, Yuanlu Xu*, W. Wang*, X.B. Liu, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  101. Examining CNN Representations With Respect To Dataset Bias [pdf] [web]
    Q. Zhang, W. Wang, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  102. Interpreting CNN Knowledge Via An Explanatory Graph [pdf] [web]
    Q. Zhang, R. Cao, F. Shi, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  103. Cooperative Learning of Energy-based Model and Latent Variable Model via MCMC Teaching [pdf] [web]
    J. Xie, Y. Lu, R. Gao, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  104. 2017

  105. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    T. Wu, Y. Lu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 39(12): 2465-2480, 2017.

  106. Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 39(6): 1165-1179, 2017

  107. Learning Human Utility from Video Demonstrations for Deductive Planning in Robotics [pdf] [web]
    N. Shukla, Y. He, F. Chen, S.-C. Zhu
    Proceedings of Machine Learning Research, vol 78, pp448-457, 2017

  108. The Martian: Examining Human Physical Judgments Across Virtual Gravity Fields [pdf] [web]
    T. Ye*, S. Qi*, J. Kubricht, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.

  109. Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph [pdf] [web]
    W. Li, J. Joo, H. Qi, and S.-C. Zhu
    IEEE Trans. on Multimedia, 19(2):367-381, 2017.

  110. Predicting Human Activities Using Stochastic Grammar [pdf] [web]
    S. Qi, S. Huang, P. Wei, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2017

  111. Monocular 3D Human Pose Estimation by Predicting Depth on Joints [pdf] [web]
    X. Nie*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  112. Jointly Recognizing Object Fluents and Tasks in Egocentric Videos [pdf] [web]
    Y. Liu*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  113. Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles [pdf] [web]
    M. Edmonds*, F. Gao*, X. Xie, H. Liu, S. Qi, Y. Zhu, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  114. A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing [pdf] [web]
    H. Liu*, X. Xie*, M. Millar*, M. Edmonds, F. Gao, Y. Zhu, V. J. Santos, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  115. Single-Image 3D Scene Parsing Using Geometric Commonsense [pdf] [web]
    C. Yu, X. Liu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  116. Inferring Human Attention by Learning Latent Intentions [pdf] [web]
    P. Wei, X. Dan, N. Zheng, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  117. Inferring Hidden Statuses and Actions in Video by Causal Reasoning [pdf] [web]
    A. Fire, and S.-C. Zhu
    CVPR Workshop on Vision Meets Cognition: Functionality, Physics, Intentionality and Causality (FPIC), 2017.

  118. CERN: Confidence-Energy Recurrent Network for Group Activity Recognition [pdf]
    T. Shu, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  119. Mining Object Parts from CNNs via Active Question-Answering [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  120. Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet [pdf] [web]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2017

  121. Generative Hierarchical Learning of Sparse FRAME Models [pdf] [web]
    J. Xie, Y. Xu, E. Nijkamp, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  122. Inferring Human Interaction from Motion Trajectories in Aerial Videos [pdf][web]
    T. Shu, Y. Peng, L. Fan, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  123. Consistent Probabilistic Simulation Underlying Human Judgment in Substance Dynamics [pdf] [web]
    J. Kubricht*, Y. Zhu*, C. Jiang*, D. Terzopoulos, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  124. Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions [pdf] [web]
    T. Shu, X. Gao, M. Ryoo, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2017

  125. Alternating Back-Propagation for Generator Network [pdf] [web]
    T. Han, Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  126. Cross-view People Tracking by Scene-Centered Spatio-Temporal Parsing [pdf]
    Y. Xu, X. Liu, L. Qin, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  127. Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  128. Inferring Context through Scene Understanding [pdf]
    M. Walton, D. Lange, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI) Symposium on Computational Context, 2017

  129. 2016

  130. Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation [pdf]
    T. Wu, B. Li, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 38(9): 1829-1843, 2016

  131. Integrating Function, Geometry, Appearance for Scene Parsing [pdf] [web]
    Y. Zhao and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2016

  132. A Reconfigurable Tangram Model for Scene Representation and Categorization [pdf]
    J. Zhu, T. Wu, B. Li, S.-C. Zhu, X. Yang, and W. Zhang
    IEEE Trans. on Image Processing, 25(1): 150-166, 2016

  133. Learning Perceptual Causality from Video [pdf]
    A. Fire and S.-C. Zhu
    ACM Trans. on Intelligent Systems and Technology (Special Issue on Causal Discovery and Inference), 7(2): 23:1-23:22, 2016

  134. Inducing Wavelets into Random Fields via Generative Boosting [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    Applied and Computational Harmonic Analysis, 2016

  135. A Virtual Reality Platform for Dynamic Human-Scene Interaction [pdf] [web]
    J. Lin*, X. Guo*, J. Shao*, C. Jiang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    SIGGRAPH Asia, Virtual Reality Meets Physical Reality Workshop, 2016

  136. Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration [pdf]
    C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S.-C. Zhu, and J. Chai
    Empirical Methods in Natural Language Processing (iNLP), 2016

  137. Inferring Human Intent from Video by Sampling Hierarchical Plans [pdf]
    S. Holtzen, Y. Zhao, T. Gao, J. Tenenbaum, and S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016

  138. What is Where: Inferring Containment Relations from Videos [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  139. Learning Social Affordance for Human-Robot Interaction [pdf] [web]
    T. Shu, M. Ryoo, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  140. A Theory of Generative ConvNet [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    International Conference on Machine Learning (ICML), 2016

  141. Grounded Semantic Role Labeling [pdf]
    S. Yang, Q. Gao, C. Liu, C. Xiong, S.-C. Zhu, and J. Chai
    North American Chapter of the Association for Computational Linguistics (NA-ACL), 2016

  142. Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem [pdf] [web]
    J. Kubricht*, C. Jiang*, Y. Zhu*, S.-C. Zhu, D. Terzopoulos, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  143. Critical Features of Joint Actions that Signal Human Interaction [pdf]
    T. Shu, S. Thurman, D. Chen, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  144. Multi-view People Tracking via Hierarchical Trajectory Composition [pdf]
    Y. Xu, X. Liu, Y. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  145. Recognizing Car Fluents from Video [pdf] [web][Dataset]
    B. Li, T. Wu, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  146. Inferring Forces and Learning Human Utilities from Video [pdf] [web]
    Y. Zhu*, C. Jiang*, Y. Zhao, D. terzopoulos and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2016

  147. Robot Learning with a Spatial, Temporal, and Causal And-Or Graph [pdf] [web]
    C. Xiong, N. Shukla, W. Xiong, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2016

  148. Learning FRAME Models Using CNN Filters [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2016

  149. Task Learning through Visual Demonstration andSituated Dialogue [pdf]
    C. Liu, J. Chai, N. Shukla and S.C.Zhu
    AAAI Workshop on Symbiotic Cognitive Systems, 2016

  150. 2015

  151. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging [pdf] [web]
    S. Wang, Y.Z. Wang, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(12): 2478-2491, 2015

  152. Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(6): 1190-1205, 2015

  153. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(5): 1013-1027, 2015

  154. Scene Understanding by Reasoning Stability and Safety [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 112(2): 221-238, 2015

  155. Learning Sparse FRAME Models for Natural Image Patterns [pdf] [web]
    J. Xie, W. Hu, S.-C. Zhu, and Y.N. Wu
    International Journal urnal of Computer Vision (IJCV), 114(2-3): 91-112, 2015

  156. Video Primal Sketch: A Unified Middel Level Representation of video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    Journal of Mathematical Imaging and Vision, 53(2): 151-170, 2015

  157. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    arXiv: 1410.0576, short version appears at EMMCVPR 2015

  158. Attributed Grammars for Joint Estimation of Human Attributes, Parts and Poses [pdf] [web]
    S. Park and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  159. Mining And-Or Graphs for Graph Matching and Object Discovery [pdf]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  160. Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face [pdf]
    J. Joo, F. Steen, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  161. A Unified Framework for Human-Robot Knowledge Transfer
    N. Shukla, C. Xiong, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  162. Represent and Infer Human Theory of Mind for Human-Robot Interaction [pdf]
    Y. Zhao, S. Holtzen, T. Gao, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  163. Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition [pdf] [web]
    Y. Zhu*, Y. Zhao*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2015

  164. Joint Inference of Groups, Events and Human Roles in Aerial Videos [pdf] [web]
    T. Shu, D. Xie, B. Rothrock, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  165. Joint Action Recognition and Pose Estimation From Video [pdf]
    X. Nie, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  166. Evaluating Human Cognition of Containing Relations with Physical Simulation [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    Annual Cognitive Science Conference (CogSci), 2015

  167. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    Energy Minimization Method for Computer Vision and Pattern Recognition (EMMCVPR), 2015

  168. 2014

  169. Animated Pose Templates for Modeling and Detecting Human Actions [pdf] [web]
    B. Yao, B. Nie, Z. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 36(3): 436-452, 2014

  170. Learning Mixtures of Bernoulli Templates by Two-Round i with Performance Guarantee [pdf] [slides]
    A. Barbu, T. Wu, and Y.N. Wu
    Electronic Journal of Statistics (EJS), 2014

  171. Joint Video and Text Parsing for Understanding Events and Answering Queires [pdf] [web]
    K. Tu, M. Meng, M. Lee, T. Choi, and S.-C. Zhu
    IEEE MultiMedia, 21(2): 42-70, 2014

  172. Unsupervised Learning ofCompositional Sparse Code for Natural Image Representation [pdf] [web]
    Y. Hong, Z. Si, W. Hu, S.-C. Zhu, and Y.N. Wu
    Quarterly of Applied Mathematics, 2014

  173. Integrating Context and Occlusion forCar Detection by Hierarchical And-Or Model [pdf] [web]
    B. Li, T. Wu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2014

  174. Visual Persuasion: Inferring the Communicative Intents of Images [pdf] [web]
    J. Joo, W. Li, F. Steen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  175. Cross-View Action Modeling, Learning and Recognition [pdf] [web]
    J. Wang, B. Nie, Y.N. Wu, and S.-C. Zhu
    of Computer Vision and Pattern Recognition (CVPR), 2014.

  176. Single-View 3D Scene Parsing by Attributed Grammar [pdf] [web]
    X. Liu, Y. Zhao, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  177. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    Y. Lu, T. Wu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  178. Learning Inhomogeneous FRAME Modelsfor Object Patterns [pdf] [web]
    J. Xie. W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  179. Unsupervised Learning of Dictionaries of Hierarchical Compositional Models [pdf] [web]
    J. Dai, Y. Hong, W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  180. Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Conference on Robotics and Automations (ICRA), 2014

  181. 2013

  182. Learning And-Or Templatesfor Object Modeling and Recognition [pdf] [web with data and code]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 35(9): 2189-2205, 2013

  183. Video Event Parsingand Learning with Goal and Intent Prediction [pdf] [web]
    M. Pei, Z. Si, B. Yao, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), 117(10): 1369-1383, 2013

  184. Abstract Painting with Interactive Control of Perceptual Entropy [pdf] [web] [reprint]
    M. Zhao and S.-C. Zhu
    ACM Trans. on Applied Perception, 10(1): 5:1-5:21, 2013

  185. Video Stylization: Painterly Rendering and Optimization with Content Extraction [pdf] [web]
    L. Lin, K. Zeng, Y. Wang, Y.-Q. Xu, and S.-C. Zhu
    IEEE Trans. on Circuits and Systems for Video Technology, 23(4): 577-590, 2013

  186. Unsupervised Structure Learning of Stochastic And-Or Grammars [pdf] [web]
    K. Tu, M. Pavlovskaia, and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2013

  187. Inferring "Dark Matter" and "Dark Energy" from Videos [pdf] [web]
    D. Xie, S. Todorovic, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  188. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  189. Monte Carlo Tree Search for Scheduling Activity Recognition [pdf]
    M. Amer, S. Todorovic, A. Fern, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  190. Human Attribute Recognition by Rich Appearance Dictionary [pdf] [web]
    J. Joo, S. Wang, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  191. Cosegmentation and Cosketch by Unsupervised Learning [pdf] [web]
    J. Dai, Y.N. Wu, J. Zhou, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  192. Concurrent Action Detection with Structural Prediction [pdf] [web]
    P. Wei, N. Zheng, Y. Zhao, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  193. Modeling Occlusion by Discriminative AND-OR Structures [pdf] [web]
    B. Li, W. Hu, T. Wu, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  194. Modeling 4D Human-Object Interactions for Event and Object Recognition [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  195. Rates for Inductive Learning of Compositional Models [pdf]
    A. Barbu, M. Pavlovskaia, and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), 2013

  196. Scene Parsing by Integrating Function, Geometry and Appearance Models [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  197. Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  198. Integrating Grammar and Segmentation forHuman Pose Estimation [pdf] [web]
    B. Rothrock, S. Park, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  199. Discriminatively Trained And-Or Tree Models for Object Detection [pdf] [web]
    X. Song, T. Wu, Y. Jia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  200. Weakly Supervised Learning for Attribute Localization in Outdoor Scenes [pdf] [web]
    S. Wang, J. Joo, Y. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  201. Using Causal Induction in Humans to Learn and Infer Causality from Video [pdf] [poster]
    A. Fire and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2013

  202. Learning Perceptual Causality from Video [pdf] [slides] [poster]
    A. Fire and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), Bellvue, WA, 2013

  203. 2012

  204. Learning Hybrid image Template (HiT) by Information Projection [pdf] [web]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 34(7): 1354-1367, 2012

  205. Intrackability: Characterizing Video Statistics and Pursuing Video Representations [pdf] [web]
    H. Gong and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 97(3): 255-275, 2012

  206. Background Modeling by Subspace Learning on Spatio-temporal Patches [reprint]
    Y. Zhao, H. Gong, Y. Jia, and S.-C. Zhu
    Pattern Recognition Letter, 33(9): 1134-1147, 2012

  207. Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition [pdf] [web]
    M. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2012

  208. Hierarchical Space Tiling for Scene Modelling [pdf]
    S. Wang, Y. Wang, and S.-C. Zhu
    Asia Conference on Computer Vision (ACCV), 2012

  209. Reconfigurable Templates for Robust Vehicle Detection and Classification [pdf]
    Y. Lu, B. Yao, Y. Wang, and S.-C. Zhu
    Workshop on Application of Computer Vision (WACV), 2012

  210. Learning Reconfigurable Scene Representation by Tangram Model [pdf]
    J. Zhu, T. Wu, S.-C. Zhu, X. Yang, and W. Zhang
    Workshop on Application of Computer Vision (WACV), 2012

  211. Artistic Rendering of Portraits
    M. Zhao and S.-C. Zhu
    Book Chapter in Image and Video based Artistic Stylization, Eds. J. Collomosse and P. Rossin, Springer, 2012

  212. Hierarchical Organization by And-Or Tree
    J. Joo, S. Wang, and S.-C. Zhu
    Book Chapter in Handbook of Perceptual Organization, Eds. J. Wagemans, Springer, 2012

  213. Structure v.s. Appearance and 3D v.s. 2D? A Numeric Answer
    W. Hu, Z. Si, and S.-C. Zhu
    Book Chapter in Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective, Eds. S. Dickinson and Z. Pizlo, Springer, 2012

  214. Learning 3D Object Templates by Hierarchical Quantization of Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2012

  215. 2011

  216. C4: Computing Multiple Solutions in Graphical Models by Cluster Sampling [pdf] [web]
    J. Porway and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 33(9): 1713-1727, 2011

  217. A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs [pdf] [web]
    T. Wu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 93(2): 226-252, 2011

  218. Image Parsing via Stochastic Scene Grammar [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2011

  219. Unsupervised Learning of Stochastic And-Or Templates for Object modeling [pdf]
    Z. Si and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  220. Human Parsing using Stochastic And-Or grammar and Rich Appearance [pdf]
    B. Rothrock and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  221. Parsing Video Events with Goal inference and Intent Prediction [pdf] [web]
    M. Pei, Y. Jia, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  222. Unsupervised Learning of Event And-Or Grammar and Semantics from Video [pdf] [web]
    Z. Si, M. Pei, Z. Yao, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  223. Image Representation by Active Curves [pdf]
    W. Hu, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  224. Video Primal Sketch: A Generic Middle-Level Representation of Video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  225. Inferring Social Roles in Long Timespan Video Sequence [pdf]
    J. Zhang, W. Hu, B. Yao, Y. Wang, and S.-C. Zhu
    International Workshop on Video Event Categorization, Tagging and Retrieval for Real World Applications, 2011

  226. Customizing Painterly Rendering Styles Using Stroke Processes [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  227. Portrait Painting Using Active Templates [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  228. 2010

  229. A Compositional and Dynamic Model for Face Aging [pdf] [web]
    J. Suo, S.-C. Zhu, S. Shan, and X. Chen
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 32(3): 385-401, 2010

  230. Layered Graph Matching by Composite Cluster Sampling
    L. Lin, X. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 32(8): 1426-1442, 2010

  231. LearningActive Basis Model for Object Detection and Recognition [pdf] [reprint]
    Y.N. Wu, Z. Si, H. Gong, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 90(2): 198-235, 2010

  232. Hierarchical and Contextual Model for Aerial Image Understanding [pdf] [web]
    J. Porway, K. Wang, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 88(2): 254-283, 2010

  233. I2T: Image Parsing to Text Description [pdf] [web]
    Z. Yao, X. Yang, L. Lin, M. Lee, and S.-C. Zhu
    Proceedings of the IEEE (Special Issue on Internet Vision), 98(8): 1485-1508, 2010

  234. Learning Active Basis Models by i-Type Algorithms [pdf]
    Z. Si, H. Gong, S.-C. Zhu, and Y.N. Wu
    Statistical Science, 2010

  235. CO3 for Ultra-fast and Accurate Interactive Segmentation [pdf] [web]
    Y. Zhao, S.-C. Zhu, and S.W. Luo
    ACM conference on Multimedia (MM), 2010

  236. Artistic Paper-cut of Human Portraints [pdf] [web]
    M. Meng, M. Zhao, and S.-C. Zhu
    ACM conference on Multimedia (MM), 2010

  237. Sisley the Abstract Painter [pdf] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  238. Painterly Animation Using Video Semantics and Feature Correspondence [pdf] [web]
    L. Lin K. Zeng, H. Lv, Y. Wang, Y. Xu, and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  239. Learning Artistic Lighting Template from Portrait Photographs [preprint] [web]
    X. Jin, M. Zhao, X. Chen, Q. Zhao, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2010

  240. Learning a Probabilistic ModelMixing 3D and 2DPrimitives for View Invariant Object Recognition [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  241. Discovering Scene Categories by Information Projection and Cluster Sampling [pdf]
    D. Dai, T. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  242. 2009

  243. Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2009 [pdf] [reprint]

  244. From Image Parsing to Painterly Rendering [reprint]
    K. Zeng, M. Zhao, C. Xiong, and S.-C. Zhu
    ACM Trans. on Graphics (TOG), 29(1): 2:1-2:11, 2009

  245. Learning Explicit and Implicit Visual Manifolds by Information Projection [pdf] [reprint]
    S.-C. Zhu, K. Shi, and Z. Si
    Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009

  246. An And-or Graph Model for Face Representation, Sketching and Aging [pdf]
    F. Min, J. Suo, and S.-C. Zhu
    Book Chapter inEncyclopedia of Biometric Recognition, Springer, 2009

  247. Learning Deformable Action Templates from Cluttered Videos [pdf]
    B. Yao and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  248. Evaluating Information Contributions of Bottom-up and Top-down Processes [pdf]
    X. Yang, T. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  249. Learning Mixed Templates for Object Recognition [pdf]
    Z. Si, H. Gong, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  250. Flow Mosaicking: Real-time Pedestrian Counting without Scene-Specific Learning
    Y. Cong, H. Gong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  251. Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph [pdf]
    X. Liu, L. Lin, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  252. Layered Graph Matching by Composite Clustering with Collaborative and Competitive Interactions
    L. Lin, K. Zeng, X. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  253. Learning Compositional Models for Object Categories from Small Sample Sets [pdf]
    J. Porway, B. Yao, and S.-C. Zhu
    Book Chapter in Object Categorization: Computer and Human Vision Perspectives, Eds. Sven Dickinson et al., Cambridge University Press, 2009

  254. 2008

  255. A Composite Template for Human Face Modeling and Sketch [pdf] [reprint]
    Z. Xu, H. Chen, S.-C. Zhu, and J. Luo
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2008

  256. Perceptual Scale Space and Its Applications [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 80(1): 143-165, 2008

  257. A Hierarchical and Contextual Model for Aerial Image Understanding [pdf]
    J. Porway, K. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2008

  258. An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry [pdf]
    W. Hu, H. Gong, S.-C. Zhu, and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2008

  259. Learning a Scene Contextual Model for Tracking and Abnormality Detection [pdf]
    B. Yao, L. Wang, and S.-C. Zhu
    International Workshop on Semantic Learning and Applications in Multimedia, 2008

  260. SAVE: A Framework for Semantic Annotation of Visual Events [pdf]
    M. Lee, A. Hakeem, N. Haering, and S.-C. Zhu
    International Workshop on Internet Vision, 2008

  261. 2007

  262. A Two-Level Generative Model for Cloth Representation and Shape-From-Shading [pdf]
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 29(7): 1230-1243, 2007

  263. From Information Scaling of Natural Images to Regimes of Statistical Models [preprint]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Quarterly of Applied Mathematics, 2007

  264. Primal Sketch: Integrating Texture and Structure [pdf] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Image Understanding (CVIU), 106(1): 5-19, 2007

  265. Generalizing Swendsen-Wang for Image Analysis [long survey]
    A. Barbu and S.-C. Zhu
    Journal of Computational and Graphical Statistics, 2007

  266. Statistical Principles in Image Modeling [pdf]
    Y.N. Wu, J. Li. Z. Liu, and S.-C. Zhu
    Technometrics, 49(3): 249-261, 2007

  267. Deformable Template as Active Basis [pdf]
    Y.N. Wu, Z. Si, C. Fleming, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2007

  268. An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples [pdf]
    L. Lin, S. Peng, J. Porway, S.-C. Zhu, and Y. Wang
    International Conference on Computer Vision (ICCV), 2007

  269. Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation tool, and Benchmarks [pdf]
    Z. Yao, X. Yang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  270. Object Category Recognition using Generative Template Boosting
    S. Peng, L. Lin, J. Porway, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  271. An Automatic Portrait System Based on And-Or Graph Representation [pdf]
    F Min, J. Suo, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  272. Dynamic Feature Cascade for Multiple Object Tracking with Trackability Analysis
    Z. Li, H. Gong, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  273. Bayesian Inference for Layer Representation with Mixed Markov Random Field [pdf]
    R. Gao, T. Wu, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  274. Mapping the Ensemble of Natural Image Patches by iplicit and Implicit Manifolds [pdf]
    K, Shi and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  275. Compositional Boosting for Computing Hierarchical Image Structures [pdf]
    T. Wu, G. Xia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  276. Layered Graph Matching with Graph Editing [pdf]
    L. Lin, S.-C. Zhu and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2007

  277. A Multi-Resolution Dynamic Model for Face Aging Simulation [pdf]
    J. Suo, F. Min, S.-C. Zhu, S. Shan, and X. Chen
    Computer Vision and Pattern Recognition (CVPR), 2007

  278. 2006

  279. A Genrative Sketch Model for Human Hair Analysis and Synthesis [pdf] [reprint]
    H. Chen and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 28(7): 1025-1040, 2006

  280. Parsing Images into Regions, Curves, and Curve Groups [pdf] [reprint]
    Z. Tu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 69(2): 223-249, 2006

  281. First-hitting-time Analysis of Independence Metropolis Sampler [pdf] [reprint] A version published at SCTV03 for Vision audience [pdf]
    R. Maciuca and S.-C. Zhu
    Journal of Theoretical Probability, 2006

  282. A Stochastic Grammar of Images [pdf] [reprint]
    S.-C. Zhu and D. Mumford
    Foundations and Trends in Computer Graphics and Vision, 2(4): 259-362, 2006

  283. Composite Templates for Cloth Modeling and Sketching [pdf]
    H. Chen, Z. Xu, Z. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2006

  284. 2005

  285. Generalizing Swendsen-Wangto Sampling Arbitrary Posterior Probabilities [pdf] [reprint]
    A. Barbu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 27(8): 1239-1253, 2005

  286. What are Textons? [pdf] [reprint]
    S.-C. Zhu, C. Guo, Y. Wang, and Z. Xu
    International Journal of Computer Vision (IJCV), 62(1-2): 121-143, 2005

  287. Image parsing: Unifying Segmentation, Detection and Recognition [pdf] [reprint]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Journal of Computer Vision (IJCV), 63(2): 113-140, 2005

  288. Incorporating Visual Knowledge Representation in Stereo Reconstruction [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  289. Perceptual Scale Space and It Applications [pdf]
    Y. Z. Wang, S. Bahrami, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  290. Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar [pdf]
    F. Han and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  291. A generative model of human hair for hair sketching [pdf]
    H. Chen and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  292. A High Resolution Grammatical Model for Face Representation and Sketching [pdf]
    Z. Xu, H. Chen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  293. Cloth Representation by Shape from Shading with Shading Primitives [pdf]
    F. Han and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  294. 2004

  295. Range Image Segmentation by an Effective Jump-Diffusion Method [pdf] [reprint]
    F. Han, Z. Tu, and S.-C. Zhu,
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 26(9): 1138-1153, 2004

  296. Analysis and Synthesis of Textured Motion: Particles and Waves [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 26(10): 1348-1363, 2004

  297. Perceptual Scaling [pdf]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Book Chapter in Applied Bayesian Modeling and Causal Inference from an Incomplete Data Perspective, Eds. A. Gelman and X.L. Meng, John Wiley, 2004.

  298. Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs [pdf]
    Y. Wang and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  299. Information Scaling Laws in Natural Scenes [pdf]
    C. Guo, Y.N. Wu, and S.-C. Zhu
    Workshop on Generative Model Based Vision, 2004

  300. Multigrid and Multi-level Swendsen-Wang Cuts for Hierarchic Graph Partition [pdf]
    A. Barbu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  301. On the Relationship between Image and Motion Segmentation [pdf]
    A. Barbu and S.-C. Zhu
    Workshop on Spatial Coherence for Visual Motion Analysis, 2004

  302. Automatic Single View Building Reconstruction by Integrating Segmentation
    F. Han and S.-C. Zhu
    Workshop on Perceptual Organization in Computer Vision, 2004

  303. 2003

  304. Statistical Edge Detection: Learning and Evaluating Edge Cue [ps.gz] [reprint]
    S. Kinishi, A. Yuille, J. Coughlan, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 25(1): 57-74, 2003

  305. Statistical Modeling and Conceptualization of Visual Patterns [pdf] [reprint]
    S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 25(6): 691-712, 2003

  306. Modeling Visual Patterns by Integrating Descriptive and Generative Models [ps.gz] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Journal of Computer Vision (IJCV), 53(1): 5-29, 2003

  307. On Advances in Statistical Modeling of Natural Images [pdf]
    A. Srivastava, A. Lee, E. Simoncelli, and S.-C. Zhu
    Journal of Math Imaging and Vision, 2003

  308. A Mathematical Theory of Primal Sketch and Sketchability [dio] [pdf]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Conference on Computer Vision (ICCV), 2003

  309. Image Parsing: Segmentation, Detection, and Recognition [dio] [pdf]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  310. Modeling Textured Motion: Particles, Waves, and Cartoon Sketch [dio] [pdf]
    Y. Wang and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  311. Graph Partition by Swendsen-Wang Cut [dio] [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  312. A Multiscale Generative Model for Animate Shape and Parts [dio] [pdf]
    A. Dubinskiy and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  313. How do Heuristics Expedite Markov Chain Search? [dio] [pdf]
    R. Maciuca and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  314. Bayesian Reconstruction of 3D Shapes and Scenes from a Single Image [dio] [pdf]
    F. Han and S.-C. Zhu
    International Workshop on High Level Knowledge in 3D Modeling and Motion (HLK), 2003

  315. 2002

  316. Image Segmentation by Data-Driven Markov Chain Monte Carlo [ps.gz] [reprint]
    Z. Tu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 24(5): 657-673, 2002

  317. Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?" [ps.gz] [reprint]
    S.-C. Zhu and X. Liu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 24(7): 1001-1006, 2002

  318. A Generative Model for Textured Motion: Analysis and Synthesis [pdf]
    Y. Wang and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  319. Parsing Images into Region and Curve Processes [pdf]
    Z. Tu and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  320. What are Textons? [pdf]
    S.-C. Zhu, C. Guo, Y.N. Wu, and Y. Wang
    European Conference on Computer Vision (ECCV), 2002

  321. Statistical Modeling of Texture Sketch [pdf]
    Y.N. Wu, S.-C. Zhu, and C. Guo
    European Conference on Computer Vision (ECCV), 2002

  322. A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction
    F. Han, Z. Tu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002