Textbook

  1. Adrian Barbu and Song-Chun Zhu, Monte Carlo Methods, Springer, 2019.

  2. Preprints

  3. Generalized Inverse Planning: Learning Lifted non-Markovian Utility for Generalizable Task Representation [pdf]
    S. Xie*, F. Gao*, S.-C. Zhu
    *Equal contributiors
    Under review, arXiv:2011.09854

  4. A Restricted Visual Turing Test for Deep Scene and Event Understanding [pdf] [web]
    H. Qi, T. Wu, M. Lee, and S.-C. Zhu
    Under review, arXiv:1512.01715

  5. A HINT from Arithmetic: On Systematic Generalization of Perception, Syntax, and Semantics [pdf] [web]
    Q. Li, S. Huang, Y. Hong, Y. Zhu, Y.N. Wu, and S.-C. Zhu
    Under review, arXiv:2103.01403

  6. 2022

  7. Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis [pdf] [web]
    J. Xie*, Z. Zheng*, R. Gao, W. Wang, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 44(5): 2468-2484, 2022

  8. Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration [pdf]
    X. Gao, L. Yuan, T. Shu, H. Lu, and S.-C. Zhu
    IEEE Robotics and Automation Letters (RA-L), 7(2): 2644-2651, 2022

  9. MCMC Should Mix: Learning Energy-Based Model with Neural Transport Latent Space MCMC [pdf]
    E. Nijkamp*, R. Gao*, P. Sountsov, S. Vasudevan, B. Pang, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    International Conference on Learning Representations (ICLR), 2022

  10. Learning V1 Simple Cells with Vector Representation of Local Content and Matrix Representation of Local Motion [pdf]
    R. Gao, J. Xie, S. Huang, Y. Ren, S.-C. Zhu, and Y.N. Wu
    The Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI), 2022

  11. ValueNet: A New Dataset for Human Value Driven Dialogue System [pdf]
    L. Qiu, Y. Zhao, J. Li, P. Lu, B. Peng, J. Gao, and S.-C. Zhu
    The Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI), 2022

  12. 2021

  13. A unified psychological space for human perception of physical and social events [pdf]
    T. Shu, Y. Peng, S.-C. Zhu, and H. Lu
    Cognitive Psychology (Cogn. Psychol.), 2021

  14. Monocular 3D Pose Estimation via Pose Grammar and Data Augmentation [pdf]
    Y. Xu, W. Wang, T. Liu, X. Liu, J. Xie, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2021

  15. Cooperative Training of Fast Thinking Initializer and Slow Thinking Solver for Conditional Learning [pdf] [web]
    J. Xie*, Z. Zheng*, X. Fang, S.-C. Zhu, and Y.N. Wu
    * equal contributions
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2021

  16. Learning Energy-Based Spatial-Temporal Generative ConvNets for Dynamic Patterns [pdf]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2021

  17. Hierarchical Human Semantic Parsing with Comprehensive Part-Relation Modeling [pdf][supp]
    W. Wang, T. Zhou, S. Qi, J. Shen, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2021

  18. CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Models [pdf]
    A. Akula, K. Wang, C. Liu, S. Sadiya, H. Lu, S. Todorovic, J.Y. Chai, and S.-C. Zhu
    iScience Cell Press Journal (iScience), 2021

  19. CrossVQA: Scalably Generating Benchmarks for Systematically Testing VQA Generalization [pdf]
    A. Akula, S. Changpinyo, B. Gong, P. Sharma, S.-C. Zhu, and R. Soricut
    Empirical Methods in Natural Language Processing (EMNLP), 2021

  20. Mind the Context: The Impact of Contextualization in Neural Module Networks for Grounding Visual Referring Expressions [pdf]
    A. Akula, S. Gella, K. Wang, S.-C. Zhu, and S. Reddy
    Empirical Methods in Natural Language Processing (EMNLP), 2021

  21. Robust Visual Reasoning via Language Guided Neural Module Networks [pdf]
    A. Akula, V. Jampani, S. Changpinyo, and S.-C. Zhu.
    Neural Information Processing Systems (NeurIPS), 2021

  22. Unsupervised foreground extraction via deep region competition [pdf] [web]
    P. Yu, S. Xie, X. Ma, Y. Zhu, Y.N. Wu, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2021

  23. IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning [web]
    P. Lu, L. Qiu, J. Chen, T. Xia, Y. Zhao, W. Zhang, Z. Yu, X. Liang, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2021

  24. Iterative Teacher-Aware Learning [web]
    L. Yuan, D. Zhou, J. Shen, J. Gao, J.L. Chen, Q. Gu, Y.N. Wu, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2021

  25. On path integration of grid cells: group representation and isotropic scaling [pdf] [code]
    R. Gao, J. Xie, X. Wei, S.-C. Zhu, and Y.N. Wu
    Neural Information Processing Systems (NeurIPS), 2021

  26. Efficient Task Planning for Mobile Manipulation: a Virtual Kinematic Chain Perspective [pdf] [web]
    Z. Jiao*, Z. Zhang*, W. Wang, D. Han, S.-C. Zhu, Y. Zhu, and H. Liu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021

  27. Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations [pdf] [web]
    Z. Jiao*, Z. Zhang*, X. Jiang, D. Han, S.-C. Zhu, Y. Zhu, and H. Liu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021

  28. YouRefIt: Embodied Reference Understanding with Language and Gesture [pdf] [web] [code] [dataset]
    Y. Chen, Q. Li, D. Kong, Y. Kei, S.-C. Zhu, T. Gao, Y. Zhu and S. Huang
    The International Conference on Computer Vision (ICCV), 2021

  29. VLGrammar: Grounded Grammar Induction of Vision and Language [pdf]
    Y. Hong, Q. Li, S.-C. Zhu and S. Huang
    The International Conference on Computer Vision (ICCV), 2021

  30. Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning [pdf] [web]
    P. Lu*, R. Gong*, S. Jiang*, L. Qiu, S. Huang, X. Liang, S.-C. Zhu
    * equal contributions
    The Joint Conference of the Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (ACL-IJCNLP), 2021

  31. SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialogues [pdf]
    L. Qiu, Y. Liang, Y. Zhao, P. Lu, B. Peng, Z. Yu, Y.N. Wu and S.-C. Zhu
    The Joint Conference of the Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (ACL-IJCNLP), 2021

  32. GRICE: A Grammer-based Dataset for recovering Implicature and Conversational rEasoning
    Z. Zheng, S. Qiu, L. Fan, Y. Zhu, and S.C. Zhu
    The Joint Conference of the Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (ACL-IJCNLP), 2021

  33. Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis [pdf]
    Y. Zhu, R. Gao, S. Huang, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2021

  34. Reconstructing Interactive 3D Scene by Panoptic Mapping and CAD Model Alignments [pdf][web]
    M. Han*, Z. Zhang*, Z. Jiao, X. Xie, Y. Zhu, S.-C. Zhu, and H. Liu
    * equal contributions
    International Conference on Robotics and Automation (ICRA), 2021

  35. Congestion-aware Multi-agent Trajectory Prediction for Collision Avoidance [pdf][web]
    X. Xie, C. Zhang, Y. Zhu, Y.N Wu, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2021

  36. Learning Triadic Belief Dynamics in Nonverbal Communication from Videos [pdf]
    L. Fan*, S. Qiu*, Z. Zheng, T. Gao, S.-C. Zhu, and Y. Zhu
    * equal contributions
    Computer Vision and Pattern Recognition (CVPR), 2021

  37. ACRE: Abstract Causal Reasoning Beyond Covariation [pdf][web]
    C. Zhang, B. Jia, M. Edmonds, S.-C. Zhu, and Y. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2021

  38. Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution [pdf][web]
    C. Zhang*, B. Jia*, S.-C. Zhu, and Y. Zhu
    * equal contributions
    Computer Vision and Pattern Recognition (CVPR), 2021

  39. Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification [pdf][web]
    J. Xie*, Y. Xu*, Z. Zheng, S.-C. Zhu, and Y.N. Wu
    * equal contributions
    Computer Vision and Pattern Recognition (CVPR), 2021

  40. HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem Solving [pdf] [web]
    S. Xie, X. Ma, P. Yu, Y. Zhu, Y.N. Wu, S.-C. Zhu
    International Conference on Learning Representations Generalization Workshop (ICLR Workshop), 2021

  41. Stochastic Security: Adversarial Defense Using Long-Run Dynamics of Energy-Based Models [pdf]
    M. Hill*, J.C. Mitchell*, and S.-C. Zhu
    * equal contributions
    International Conference on Learning Representations (ICLR), 2021

  42. Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation [pdf] [web]
    J. Xie*, Z. Zheng*, X. Fang, S.-C. Zhu, and Y.N. Wu
    * equal contributions
    The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI) 2021

  43. Learning by Fixing: Solving Math Word Problems with Weak Supervision [pdf] [web]
    Y. Hong, Q. Li, D. Ciao, S. Huang, and S.-C. Zhu
    The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI) 2021

  44. SMART: A Situation Model for Algebra Story Problems via Attributed Grammar [pdf] [web]
    Y. Hong, Q. Li, R. Gong, D.Ciao, S. Huang, and S.-C. Zhu
    The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI) 2021

  45. 2020

  46. Cascaded Parsing of Human-Object Interaction Recognition [pdf]
    T. Zhou, S. Qi, W. Wang, J. Shen, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  47. Deformable Generator Networks: Unsupervised Disentanglement of Appearance and Geometry [pdf] [web]
    X. Xing, R. Gao, T. Han, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  48. A Massively Parallel and Scalable Multi-GPU Material Point Method [pdf] [web]
    X. Wang*, Y. Qiu*, S. R. Slattery, Y. Fang, M. Li, S.-C. Zhu, Y. Zhu, M. Tang, D. Manocha, C. Jiang
    *Equal contributors
    ACM Transaction on Graphics (TOG) (SIGGRAPH), 2020

  49. A Generalized Earley Parser for Human Activity Parsing and Prediction [pdf]
    S. Qi, B. Jia, S. Huang, P. Wei, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  50. Learning to infer human attention in daily activities [pdf]
    Z. Nan, T. Shu, R.Gong, S. Wang, P. Wei, S.-C. Zhu, and N. Zheng
    Pattern Recognition, 2020

  51. Mining Interpretable AOG Representations from Convolutional Networks via Active Question Answering [pdf]
    Q. Zhang, J. Ren, G. Huang, R. Cao, Y.N. Wu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  52. Interpretable CNNs for Object Classification [pdf]
    Q. Zhang, X. Wang, Y.N. Wu, H. Zhou, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  53. Extraction of an Explanatory Graph to Interpret a CNN [pdf]
    Q. Zhang, X. Wang, R. Cao, Y. Wu, F. Shi and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2020

  54. Cooperative Learning of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 42(1): 27-45, 2020

  55. Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense [pdf] [web]
    Y. Zhu, T. Gao, L. Fan, S. Huang, M. Edmonds, H. Liu, F. Gao, C. Zhang, S. Qi, Y.N. Wu, J.B. Tenenbaum, and S.-C. Zhu
    Engineering, Special Issue on Artificial Intelligence, 2020

  56. Representation Learning: A Statistical Perspective [pdf]
    J. Xie, R. Gao, R. Nijkamp, S.-C. Zhu, and Y.N. Wu
    Annual Review of Statistics and Its Application, Vol. 7, March, 2020

  57. Learning Latent Space Energy-based Prior Model [pdf] [web]
    B. Pang*, T. Han*, E. Nijkamp*, S.-C. Zhu, and Y.N. Wu
    * Equal contributors
    Neural Information Processing Systems (NeurIPS), 2020

  58. Structured Attention for Unsupervised Dialogue Structure Induction [pdf] [web]
    L. Qiu, Y. Zhao, W. Shi, Y. Liang, F. Shi, T. Yuan, Z. Yu, and S.-C. Zhu
    Empirical Methods in Natural Language Processing (EMNLP), 2020

  59. Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks [pdf]
    X. Gao, R. Gong, Y. Zhao, S. Wang, T. Shu, S.-C. Zhu
    International Conference on Robot & Human Interactive Communication (RO-MAN), 2020

  60. Learning Multi-layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference [pdf] [web]
    E. Nijkamp*, B. Pang*, T. Han, L. Zhou, S.-C. Zhu, Y.N. Wu
    *Equal contributors
    European Conference on Computer Vision (ECCV), 2020

  61. A Competence-aware Curriculum for Visual Concepts Learning via Question Answering [pdf]
    Q. Li, S. Huang, Y. Hong, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2020

  62. LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities [pdf] [web]
    B. Jia, Y. Chen, S. Huang, Y. Zhu, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2020

  63. Human-Robot Interaction in a Shared Augmented Reality Workspace [pdf] [web]
    S. Qiu*, H. Liu*, Z. Zhang, Y. Zhu, S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020

  64. Graph-based Hierarchical Knowledge Representation for Robot Task Transfer from Virtual to Physical World [pdf] [web]
    Z. Zhang, Y. Zhu, S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020

  65. Flow Contrastive Estimation of Energy-Based Models [pdf]
    R. Gao, E. Nijkamp, D. P. Kingma, Z. Xu, A. M. Dai, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2020

  66. Joint Training of Variational Auto-Encoder and Latent Energy-Based Model [pdf] [web]
    T. Han, E. Nijkamp, L. Zhou, B. Pang, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2020

  67. Inducing Hierarchical Compositional Model by Sparsifying Generator Network [pdf] [web]
    X. Xing, T. Wu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2020

  68. Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning [pdf] [web]
    Q. Li, S. Huang, Y. Hong, Y. Chen, Y.N. Wu, and S.-C. Zhu
    International Conference on Machine Learning (ICML), 2020

  69. Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions [pdf] [web]
    A. R. Akula, S. Gella, Y. A. Onaizan, S.-C. Zhu, and S. Reddy
    Association for Computational Linguistics (ACL), 2020

  70. Joint Inference of States, Robot Knowledge, and Human (False)-Beliefs [pdf] [web]
    T. Yuan, H. Liu, L. Fan, Z. Zheng, T. Gao, Y. Zhu, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2020

  71. Congestion-aware Evacuation Routing using Augmented Reality Devices [pdf] [web] [code]
    Z. Zhang, H. Liu, Z. Jiao, Y. Zhu, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2020

  72. Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning [pdf] [web]
    M. Edmonds, X. Ma, S. Qi, Y. Zhu, H. Lu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  73. Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning [pdf] [web]
    W. Zhang, C. Zhang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  74. Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns [pdf] [web]
    J. Xie*, R. Gao*, Z. Zheng, S.-C. Zhu, Y.N. Wu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  75. On the Anatomy of MCMC-based Maximum Likelihood Learning of Energy-Based Models [pdf] [web]
    E. Nijkamp*, M. Hill*, T. Han, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  76. CoCoX: Generating Conceptual and Counterfactual Explanations via Fault-Lines [pdf] [web]
    A. Akula, S. Wang, S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2020

  77. 2019

  78. A tale of two explanations: Enhancing human trust by explaining robot behavior [pdf]
    M. Edmonds*, F. Gao*, H. Liu*, X. Xie*, S. Qi, B. Rothrock, Y. Zhu, Y.N. Wu, H. Lu, and S.-C. Zhu
    *Equal contributors
    Science Robotics, Vol. 4, No. 37, eaay4663, 2019

  79. A Tale of Three Probabilistic Families: Discriminative, Descriptive and Generative Models [pdf]
    Y.N. Wu, R. Gao, T. Han, and S.-C. Zhu
    Quarterly of Applied Mathematics, Vol. 77, No. 2, pp423-465, 2019

  80. Building a Telescope to Look Into High-dimensional Image Spaces [pdf]
    M. Hill, E. Nijkamp, and S.-C. Zhu
    Quarterly of Applied Mathematics, Vol. 77, No. 2, pp269-321, 2019

  81. Emergence of Pragmatics from Referential Game between Theory of Mind Agents [pdf]
    L Yuan, Z. Fu, J. Shen, L. Xu, J. Shen, and S.-C. Zhu
    Neural Information Processing Systems Emergent Communication Workshop (NeurIPS Workshop), 2019

  82. Emergence of Theory of Mind Collaboration in Multiagent Systems [pdf]
    L Yuan, Z. Fu, L. Zhou, K. Yang, and S.-C. Zhu
    Neural Information Processing Systems Emergent Communication Workshop (NeurIPS Workshop), 2019

  83. Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model [pdf] [web]
    E. Nijkamp, M. Hill, S.-C. Zhu, and Y.N. Wu
    Neural Information Processing Systems (NeurIPS), 2019

  84. PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points [pdf] [web]
    S. Huang, Y. Chen, T. Yuan, S. Qi, Y. Zhu, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2019

  85. Learning Perceptual Inference by Contrasting [pdf] [web]
    C. Zhang*, B. Jia*, F. Gao, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    Neural Information Processing Systems (NeurIPS), 2019

  86. Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense [pdf] [web]
    Y. Chen*, S. Huang*, T. Yuan, S. Qi, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer Vision (ICCV), 2019

  87. Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning [pdf] [web]
    L. Fan*, W. Wang*, S. Huang, X. Tang, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer Vision (ICCV), 2019

  88. DenseRaC: Joint 3D Pose and Shape Estimation by Dense Render-and-Compare [pdf]
    Y. Xu, S.-C. Zhu, T. Tung
    International Conference on Computer Vision (ICCV), 2019

  89. Learning Virtual Grasp with Failed Demonstrations via Bayesian Inverse Reinforcement Learning [pdf] [web]
    X. Xie*, C. Li*, C. Zhang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019

  90. VRGym: A Virtual Testbed for Physical and Interactive AI [pdf] [web]
    X. Xie, H. Liu, Z. Zhang, Y. Qiu, F. Gao, S. Qi, Y. Zhu, and S.-C. Zhu
    Association for Computing Machinery Turing Celebration Conference (ACM TURC), 2019

  91. VRKitchen: an Interactive 3D Environment for Learning Real Life Cooking Tasks [pdf] [web]
    X. Gao, R. Gong, T. Shu, X. Xie, S. Wang, and S.-C. Zhu
    ICML Workshop on Reinforcement Learning for Real Life (RL4RealLife), 2019

  92. Decomposing Human Causal Learning: Bottom-up Associative Learning and Top-down Schema Reasoning [pdf] [web]
    M. Edmonds, S. Qi, Y. Zhu, J. Kubricht, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2019

  93. Partitioning the Perception of Physical and Social Events Within a Unified Psychological Space [pdf] [web]
    T. Shu, Y. Peng, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2019

  94. Learning Grid Cells as Vector Representation of Self-Position Coupled with Matrix Representation of Self-Motion [pdf] [web]
    R. Gao*, J. Xie*, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    International Conference on Learning Representations (ICLR), 2019

  95. Divergence Triangle for Joint Training of Generator Model, Energy-based Model, and Inference Model [web] [pdf]
    T. Han*, E. Nijkamp*, X. Fang, M. Hill, S.-C. Zhu, Y.N. Wu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2019

  96. Unsupervised Disentangling of Appearance and Geometry by Deformable Generator Network [web] [pdf]
    X. Xing, T. Han, R. Gao, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2019

  97. Reasoning Visual Dialogs with Structural and Partial Observations [pdf] [web]
    Z. Zheng*, W. Wang*, S. Qi*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2019

  98. RAVEN: A Dataset for Relational and Analogical Visual rEasoNing [pdf] [web]
    C. Zhang*, F. Gao*, B. Jia, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2019

  99. High-Fidelity Grasping in Virtual Reality using a Glove-based System [pdf] [web]
    H. Liu*, Z. Zhang*, X. Xie, Y. Zhu, Y. Liu, Y. Wang, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2019

  100. Self-Supervised Incremental Learning for Sound Source Localization in Complex Indoor Environment [pdf] [web]
    H. Liu*, Z. Zhang*, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2019

  101. Mirroring without Overimitation: Learning Functionally Equivalent Manipulation Actions [pdf] [web]
    H. Liu, C. Zhang, Y. Zhu, C. Jiang, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  102. Recognizing Unseen Attribute-Object Pair with Generative Model [pdf]
    Z. Nan*, Y. Liu*, N. Zheng, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  103. MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer [pdf] [web]
    C. Zhang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  104. Learning Dynamic Generator Model by Alternating Back-Propagation Through Time [pdf] [web]
    J. Xie*, R. Gao*, Z. Zheng, S.-C. Zhu, and Y.N. Wu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2019

  105. 2018

  106. Cooperative Learning of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2018.

  107. Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patterns [pdf]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2018

  108. Exploring generative perspective of convolutional neural networks by learning random field models [pdf]
    Y. Lu, R. Gao, S.-C. Zhu, and Y.N. Wu
    Statistics and Its Interface, Volume 11, 515–529, 2018

  109. Configurable 3D Scene Synthesis and 2D Image Rendering with Per-Pixel Ground Truth using Stochastic Grammars [pdf]
    C. Jiang*, S. Qi*, Y. Zhu*, S. Huang*, J. Lin, L. Yu, D. Terzopoulos, and S.-C. Zhu
    *Equal contributors
    International Journal of Computer Vision (IJCV), 126(9): 920-941, 2018

  110. Single-View 3D Scene Reconstruction and Parsing by Attribute Grammar [pdf]
    X. Liu, Y. Zhao, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(3): 710-725, 2018.

  111. Mining deep And-Or object structures via cost-sensitive question-answer-based active annotations [pdf]
    Q.S. Zhang, Y.N. Wu, H. Zhang, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), vol. 176-177, pp 33-44, 2018

  112. Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos [pdf] [web]
    D. Xie, T. Shu, S. Todorovic, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(7): 1639-1652, 2018

  113. Attributed And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes [pdf] [web]
    S. Park, X. Nie, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 40(7): 1555-1569, 2018

  114. Sparse and Deep Generalizations of the FRAME Model [pdf]
    Y.N. Wu, J. Xie, Y. Lu, and S.-C. Zhu
    Annals of Mathematical Science and Applications, 3(1): 211-254, 2018.

  115. Perception of Human Interaction Based on Motion Trajectories: from Aerial Videos to Decontextualized Animations [pdf]
    T. Shu*, Y. Peng*, L. Fan, H. Lu, and S.-C. Zhu
    *Equal contributors
    Topics in Cognitive Science, 10(1): 225 - 241, 2018

  116. Visual Interpretability for Deep Learning: a Survey [pdf]
    Q. Zhang and S.-C. Zhu
    Frontiers of Information Technology & Electronic Engineering, 19(1): 27-39, 2018

  117. Cooperative Holistic Scene Understanding: Unifying 3DObject, Layout, and Camera Pose Estimation [pdf] [web]
    S. Huang, S. Qi, Y. Xiao, Y. Zhu, Y.N. Wu, and S.-C. Zhu
    Neural Information Processing Systems (NeurIPS), 2018

  118. Learning Human-Object Interactions by Graph Parsing Neural Networks. [pdf]
    S. Qi*, W. Wang*, B. Jia, J. Shen, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2018

  119. Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image. [pdf] [web]
    S. Huang, S. Qi, Y. Zhu, Y. Xiao, Y. Xu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2018

  120. Deformable Generator Network: Unsupervised Disentanglement of Appearance and Geometry [pdf]
    X. Xing, R. Gao, T. Han, S.-C. Zhu, and Y.N. Wu
    ICML workshop on Theoretical Foundations and Applications of Deep Generative Models (TADGM), 2018

  121. Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction [pdf] [web]
    S. Qi, B. Jia, and S.-C. Zhu
    International Conference on Machine Learning (ICML), 2018

  122. Human Causal Transfer: Challenges for Deep Reinforcement Learning [pdf] [web]
    M. Edmonds*, J. Jubricht*, C. Summers, Y. Zhu, B. Rothrock, S.-C. Zhu, and Y. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2018

  123. Learning Generative ConvNets via Multi-grid Modeling and Sampling [pdf] [web]
    R. Gao*, Y. Lu*, J. Zhou, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2018

  124. Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks [pdf] [web]
    P. Wei, Y. Liu, T. Shu, N.N. Zheng, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  125. Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification [pdf] [web]
    W. Wang*, Y. Xu*, J. Shen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  126. Interpretable Convolutional Neural Networks [pdf] [web]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  127. Inferring Shared Attention in Social Scene Videos [pdf] [web]
    L. Fan*, Y. Chen*, P. Wei, W. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  128. A Causal And-Or Graph Model for Visibility Fluent Reasoning in Tracking Interacting Objects [pdf] [web]
    Y. Xu*, L. Qin*, X. Liu, J. Xie, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  129. Learning Descriptor Networks for 3D Shape Synthesis and Analysis [pdf] [web]
    J. Xie*, Z. Zheng*, R. Gao, W. Wang, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2018

  130. Human-centric Indoor Scene Synthesis Using Stochastic Grammar [pdf] [web]
    S. Qi, Y. Zhu, S. Huang, C. Jiang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2018

  131. Intent-aware Multi-agent Reinforcement Learning [pdf]
    S. Qi, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2018

  132. Interactive Robot Knowledge Patching using Augmented Reality [pdf] [web]
    H. Liu*, Y. Zhang*, W. Si, X. Xie, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2018

  133. Unsupervised Learning of Hierarchical Models for Hand-Object Interactions [pdf] [web]
    X. Xie*, H. Liu*, M. Edmonds, F. Gao, S. Qi, Y. Zhu, B. Rothroth, and S.-C. Zhu
    *Equal contributors
    International Conference on Robotics and Automation (ICRA), 2018

  134. Spatially Perturbed Collision Sounds Attenuate Perceived Causality in 3D Launching Events [pdf] [web]
    D. Wang*, J. Kubricht*, Y. Zhu*, W. Liang, S.-C. Zhu, C. Jiang, H. Lu
    *Equal contributors
    IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), 2018

  135. Scene-centric Joint Parsing of Cross-view Videos [pdf] [web]
    H. Qi*, Y. Xu*, T. Yuan*, T.F. Wu, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  136. Tracking Occluded Objects and Recovering Incomplete Trajectories by Reasoning about Containment Relations and Human Actions [pdf] [web]
    W. Liang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  137. Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation [pdf] [web]
    H.-S. Fang*, Yuanlu Xu*, W. Wang*, X.B. Liu, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  138. Examining CNN Representations With Respect To Dataset Bias [pdf] [web]
    Q. Zhang, W. Wang, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  139. Interpreting CNN Knowledge Via An Explanatory Graph [pdf] [web]
    Q. Zhang, R. Cao, F. Shi, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  140. Cooperative Learning of Energy-based Model and Latent Variable Model via MCMC Teaching [pdf] [web]
    J. Xie, Y. Lu, R. Gao, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  141. 2017

  142. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    T. Wu, Y. Lu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 39(12): 2465-2480, 2017.

  143. Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 39(6): 1165-1179, 2017

  144. Learning Human Utility from Video Demonstrations for Deductive Planning in Robotics [pdf] [web]
    N. Shukla, Y. He, F. Chen, S.-C. Zhu
    Proceedings of Machine Learning Research, vol 78, pp448-457, 2017

  145. The Martian: Examining Human Physical Judgments Across Virtual Gravity Fields [pdf] [web]
    T. Ye*, S. Qi*, J. Kubricht, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.

  146. Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph [pdf] [web]
    W. Li, J. Joo, H. Qi, and S.-C. Zhu
    IEEE Trans. on Multimedia, 19(2):367-381, 2017.

  147. Predicting Human Activities Using Stochastic Grammar [pdf] [web]
    S. Qi, S. Huang, P. Wei, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2017

  148. Monocular 3D Human Pose Estimation by Predicting Depth on Joints [pdf] [web]
    X. Nie*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  149. Jointly Recognizing Object Fluents and Tasks in Egocentric Videos [pdf] [web]
    Y. Liu*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  150. Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles [pdf] [web]
    M. Edmonds*, F. Gao*, X. Xie, H. Liu, S. Qi, Y. Zhu, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  151. A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing [pdf] [web]
    H. Liu*, X. Xie*, M. Millar*, M. Edmonds, F. Gao, Y. Zhu, V. J. Santos, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  152. Single-Image 3D Scene Parsing Using Geometric Commonsense [pdf] [web]
    C. Yu, X. Liu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  153. Inferring Human Attention by Learning Latent Intentions [pdf] [web]
    P. Wei, X. Dan, N. Zheng, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  154. Inferring Hidden Statuses and Actions in Video by Causal Reasoning [pdf] [web]
    A. Fire, and S.-C. Zhu
    CVPR Workshop on Vision Meets Cognition: Functionality, Physics, Intentionality and Causality (FPIC), 2017.

  155. CERN: Confidence-Energy Recurrent Network for Group Activity Recognition [pdf]
    T. Shu, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  156. Mining Object Parts from CNNs via Active Question-Answering [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  157. Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet [pdf] [web]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2017

  158. Generative Hierarchical Learning of Sparse FRAME Models [pdf] [web]
    J. Xie, Y. Xu, E. Nijkamp, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  159. Inferring Human Interaction from Motion Trajectories in Aerial Videos [pdf][web]
    T. Shu, Y. Peng, L. Fan, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  160. Consistent Probabilistic Simulation Underlying Human Judgment in Substance Dynamics [pdf] [web]
    J. Kubricht*, Y. Zhu*, C. Jiang*, D. Terzopoulos, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  161. Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions [pdf] [web]
    T. Shu, X. Gao, M. Ryoo, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2017

  162. Alternating Back-Propagation for Generator Network [pdf] [web]
    T. Han, Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  163. Cross-view People Tracking by Scene-Centered Spatio-Temporal Parsing [pdf]
    Y. Xu, X. Liu, L. Qin, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  164. Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  165. Inferring Context through Scene Understanding [pdf]
    M. Walton, D. Lange, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI) Symposium on Computational Context, 2017

  166. 2016

  167. Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation [pdf]
    T. Wu, B. Li, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 38(9): 1829-1843, 2016

  168. Integrating Function, Geometry, Appearance for Scene Parsing [pdf] [web]
    Y. Zhao and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2016

  169. A Reconfigurable Tangram Model for Scene Representation and Categorization [pdf]
    J. Zhu, T. Wu, B. Li, S.-C. Zhu, X. Yang, and W. Zhang
    IEEE Trans. on Image Processing, 25(1): 150-166, 2016

  170. Learning Perceptual Causality from Video [pdf]
    A. Fire and S.-C. Zhu
    ACM Trans. on Intelligent Systems and Technology (Special Issue on Causal Discovery and Inference), 7(2): 23:1-23:22, 2016

  171. Inducing Wavelets into Random Fields via Generative Boosting [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    Applied and Computational Harmonic Analysis, 2016

  172. A Virtual Reality Platform for Dynamic Human-Scene Interaction [pdf] [web]
    J. Lin*, X. Guo*, J. Shao*, C. Jiang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    SIGGRAPH Asia, Virtual Reality Meets Physical Reality Workshop, 2016

  173. Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration [pdf]
    C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S.-C. Zhu, and J. Chai
    Empirical Methods in Natural Language Processing (iNLP), 2016

  174. Inferring Human Intent from Video by Sampling Hierarchical Plans [pdf]
    S. Holtzen, Y. Zhao, T. Gao, J. Tenenbaum, and S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016

  175. What is Where: Inferring Containment Relations from Videos [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  176. Learning Social Affordance for Human-Robot Interaction [pdf] [web]
    T. Shu, M. Ryoo, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  177. A Theory of Generative ConvNet [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    International Conference on Machine Learning (ICML), 2016

  178. Grounded Semantic Role Labeling [pdf]
    S. Yang, Q. Gao, C. Liu, C. Xiong, S.-C. Zhu, and J. Chai
    North American Chapter of the Association for Computational Linguistics (NA-ACL), 2016

  179. Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem [pdf] [web]
    J. Kubricht*, C. Jiang*, Y. Zhu*, S.-C. Zhu, D. Terzopoulos, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  180. Critical Features of Joint Actions that Signal Human Interaction [pdf]
    T. Shu, S. Thurman, D. Chen, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  181. Multi-view People Tracking via Hierarchical Trajectory Composition [pdf]
    Y. Xu, X. Liu, Y. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  182. Recognizing Car Fluents from Video [pdf] [web][Dataset]
    B. Li, T. Wu, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  183. Inferring Forces and Learning Human Utilities from Video [pdf] [web]
    Y. Zhu*, C. Jiang*, Y. Zhao, D. terzopoulos and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2016

  184. Robot Learning with a Spatial, Temporal, and Causal And-Or Graph [pdf] [web]
    C. Xiong, N. Shukla, W. Xiong, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2016

  185. Learning FRAME Models Using CNN Filters [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2016

  186. Task Learning through Visual Demonstration andSituated Dialogue [pdf]
    C. Liu, J. Chai, N. Shukla and S.C.Zhu
    AAAI Workshop on Symbiotic Cognitive Systems, 2016

  187. 2015

  188. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging [pdf] [web]
    S. Wang, Y.Z. Wang, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(12): 2478-2491, 2015

  189. Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(6): 1190-1205, 2015

  190. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 37(5): 1013-1027, 2015

  191. Scene Understanding by Reasoning Stability and Safety [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 112(2): 221-238, 2015

  192. Learning Sparse FRAME Models for Natural Image Patterns [pdf] [web]
    J. Xie, W. Hu, S.-C. Zhu, and Y.N. Wu
    International Journal urnal of Computer Vision (IJCV), 114(2-3): 91-112, 2015

  193. Video Primal Sketch: A Unified Middel Level Representation of video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    Journal of Mathematical Imaging and Vision, 53(2): 151-170, 2015

  194. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    arXiv: 1410.0576, short version appears at EMMCVPR 2015

  195. Attributed Grammars for Joint Estimation of Human Attributes, Parts and Poses [pdf] [web]
    S. Park and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  196. Mining And-Or Graphs for Graph Matching and Object Discovery [pdf]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  197. Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face [pdf]
    J. Joo, F. Steen, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  198. A Unified Framework for Human-Robot Knowledge Transfer
    N. Shukla, C. Xiong, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  199. Represent and Infer Human Theory of Mind for Human-Robot Interaction [pdf]
    Y. Zhao, S. Holtzen, T. Gao, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  200. Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition [pdf] [web]
    Y. Zhu*, Y. Zhao*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2015

  201. Joint Inference of Groups, Events and Human Roles in Aerial Videos [pdf] [web]
    T. Shu, D. Xie, B. Rothrock, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  202. Joint Action Recognition and Pose Estimation From Video [pdf]
    X. Nie, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  203. Evaluating Human Cognition of Containing Relations with Physical Simulation [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    Annual Cognitive Science Conference (CogSci), 2015

  204. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    Energy Minimization Method for Computer Vision and Pattern Recognition (EMMCVPR), 2015

  205. 2014

  206. Animated Pose Templates for Modeling and Detecting Human Actions [pdf] [web]
    B. Yao, B. Nie, Z. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 36(3): 436-452, 2014

  207. Learning Mixtures of Bernoulli Templates by Two-Round i with Performance Guarantee [pdf] [slides]
    A. Barbu, T. Wu, and Y.N. Wu
    Electronic Journal of Statistics (EJS), 2014

  208. Joint Video and Text Parsing for Understanding Events and Answering Queires [pdf] [web]
    K. Tu, M. Meng, M. Lee, T. Choi, and S.-C. Zhu
    IEEE MultiMedia, 21(2): 42-70, 2014

  209. Unsupervised Learning ofCompositional Sparse Code for Natural Image Representation [pdf] [web]
    Y. Hong, Z. Si, W. Hu, S.-C. Zhu, and Y.N. Wu
    Quarterly of Applied Mathematics, 2014

  210. Integrating Context and Occlusion forCar Detection by Hierarchical And-Or Model [pdf] [web]
    B. Li, T. Wu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2014

  211. Visual Persuasion: Inferring the Communicative Intents of Images [pdf] [web]
    J. Joo, W. Li, F. Steen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  212. Cross-View Action Modeling, Learning and Recognition [pdf] [web]
    J. Wang, B. Nie, Y.N. Wu, and S.-C. Zhu
    of Computer Vision and Pattern Recognition (CVPR), 2014.

  213. Single-View 3D Scene Parsing by Attributed Grammar [pdf] [web]
    X. Liu, Y. Zhao, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  214. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    Y. Lu, T. Wu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  215. Learning Inhomogeneous FRAME Modelsfor Object Patterns [pdf] [web]
    J. Xie. W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  216. Unsupervised Learning of Dictionaries of Hierarchical Compositional Models [pdf] [web]
    J. Dai, Y. Hong, W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  217. Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Conference on Robotics and Automations (ICRA), 2014

  218. 2013

  219. Learning And-Or Templatesfor Object Modeling and Recognition [pdf] [web with data and code]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 35(9): 2189-2205, 2013

  220. Video Event Parsingand Learning with Goal and Intent Prediction [pdf] [web]
    M. Pei, Z. Si, B. Yao, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), 117(10): 1369-1383, 2013

  221. Abstract Painting with Interactive Control of Perceptual Entropy [pdf] [web] [reprint]
    M. Zhao and S.-C. Zhu
    ACM Trans. on Applied Perception, 10(1): 5:1-5:21, 2013

  222. Video Stylization: Painterly Rendering and Optimization with Content Extraction [pdf] [web]
    L. Lin, K. Zeng, Y. Wang, Y.-Q. Xu, and S.-C. Zhu
    IEEE Trans. on Circuits and Systems for Video Technology, 23(4): 577-590, 2013

  223. Unsupervised Structure Learning of Stochastic And-Or Grammars [pdf] [web]
    K. Tu, M. Pavlovskaia, and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2013

  224. Inferring "Dark Matter" and "Dark Energy" from Videos [pdf] [web]
    D. Xie, S. Todorovic, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  225. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  226. Monte Carlo Tree Search for Scheduling Activity Recognition [pdf]
    M. Amer, S. Todorovic, A. Fern, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  227. Human Attribute Recognition by Rich Appearance Dictionary [pdf] [web]
    J. Joo, S. Wang, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  228. Cosegmentation and Cosketch by Unsupervised Learning [pdf] [web]
    J. Dai, Y.N. Wu, J. Zhou, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  229. Concurrent Action Detection with Structural Prediction [pdf] [web]
    P. Wei, N. Zheng, Y. Zhao, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  230. Modeling Occlusion by Discriminative AND-OR Structures [pdf] [web]
    B. Li, W. Hu, T. Wu, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  231. Modeling 4D Human-Object Interactions for Event and Object Recognition [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  232. Rates for Inductive Learning of Compositional Models [pdf]
    A. Barbu, M. Pavlovskaia, and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), 2013

  233. Scene Parsing by Integrating Function, Geometry and Appearance Models [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  234. Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  235. Integrating Grammar and Segmentation forHuman Pose Estimation [pdf] [web]
    B. Rothrock, S. Park, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  236. Discriminatively Trained And-Or Tree Models for Object Detection [pdf] [web]
    X. Song, T. Wu, Y. Jia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  237. Weakly Supervised Learning for Attribute Localization in Outdoor Scenes [pdf] [web]
    S. Wang, J. Joo, Y. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  238. Using Causal Induction in Humans to Learn and Infer Causality from Video [pdf] [poster]
    A. Fire and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2013

  239. Learning Perceptual Causality from Video [pdf] [slides] [poster]
    A. Fire and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), Bellvue, WA, 2013

  240. 2012

  241. Learning Hybrid image Template (HiT) by Information Projection [pdf] [web]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 34(7): 1354-1367, 2012

  242. Intrackability: Characterizing Video Statistics and Pursuing Video Representations [pdf] [web]
    H. Gong and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 97(3): 255-275, 2012

  243. Background Modeling by Subspace Learning on Spatio-temporal Patches [reprint]
    Y. Zhao, H. Gong, Y. Jia, and S.-C. Zhu
    Pattern Recognition Letter, 33(9): 1134-1147, 2012

  244. Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition [pdf] [web]
    M. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2012

  245. Hierarchical Space Tiling for Scene Modelling [pdf]
    S. Wang, Y. Wang, and S.-C. Zhu
    Asia Conference on Computer Vision (ACCV), 2012

  246. Reconfigurable Templates for Robust Vehicle Detection and Classification [pdf]
    Y. Lu, B. Yao, Y. Wang, and S.-C. Zhu
    Workshop on Application of Computer Vision (WACV), 2012

  247. Learning Reconfigurable Scene Representation by Tangram Model [pdf]
    J. Zhu, T. Wu, S.-C. Zhu, X. Yang, and W. Zhang
    Workshop on Application of Computer Vision (WACV), 2012

  248. Artistic Rendering of Portraits
    M. Zhao and S.-C. Zhu
    Book Chapter in Image and Video based Artistic Stylization, Eds. J. Collomosse and P. Rossin, Springer, 2012

  249. Hierarchical Organization by And-Or Tree
    J. Joo, S. Wang, and S.-C. Zhu
    Book Chapter in Handbook of Perceptual Organization, Eds. J. Wagemans, Springer, 2012

  250. Structure v.s. Appearance and 3D v.s. 2D? A Numeric Answer
    W. Hu, Z. Si, and S.-C. Zhu
    Book Chapter in Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective, Eds. S. Dickinson and Z. Pizlo, Springer, 2012

  251. Learning 3D Object Templates by Hierarchical Quantization of Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2012

  252. 2011

  253. C4: Computing Multiple Solutions in Graphical Models by Cluster Sampling [pdf] [web]
    J. Porway and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 33(9): 1713-1727, 2011

  254. A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs [pdf] [web]
    T. Wu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 93(2): 226-252, 2011

  255. Image Parsing via Stochastic Scene Grammar [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2011

  256. Unsupervised Learning of Stochastic And-Or Templates for Object modeling [pdf]
    Z. Si and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  257. Human Parsing using Stochastic And-Or grammar and Rich Appearance [pdf]
    B. Rothrock and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  258. Parsing Video Events with Goal inference and Intent Prediction [pdf] [web]
    M. Pei, Y. Jia, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  259. Unsupervised Learning of Event And-Or Grammar and Semantics from Video [pdf] [web]
    Z. Si, M. Pei, Z. Yao, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  260. Image Representation by Active Curves [pdf]
    W. Hu, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  261. Video Primal Sketch: A Generic Middle-Level Representation of Video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  262. Inferring Social Roles in Long Timespan Video Sequence [pdf]
    J. Zhang, W. Hu, B. Yao, Y. Wang, and S.-C. Zhu
    International Workshop on Video Event Categorization, Tagging and Retrieval for Real World Applications, 2011

  263. Customizing Painterly Rendering Styles Using Stroke Processes [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  264. Portrait Painting Using Active Templates [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  265. 2010

  266. A Compositional and Dynamic Model for Face Aging [pdf] [web]
    J. Suo, S.-C. Zhu, S. Shan, and X. Chen
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 32(3): 385-401, 2010

  267. Layered Graph Matching by Composite Cluster Sampling
    L. Lin, X. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 32(8): 1426-1442, 2010

  268. LearningActive Basis Model for Object Detection and Recognition [pdf] [reprint]
    Y.N. Wu, Z. Si, H. Gong, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 90(2): 198-235, 2010

  269. Hierarchical and Contextual Model for Aerial Image Understanding [pdf] [web]
    J. Porway, K. Wang, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 88(2): 254-283, 2010

  270. I2T: Image Parsing to Text Description [pdf] [web]
    Z. Yao, X. Yang, L. Lin, M. Lee, and S.-C. Zhu
    Proceedings of the IEEE (Special Issue on Internet Vision), 98(8): 1485-1508, 2010

  271. Learning Active Basis Models by i-Type Algorithms [pdf]
    Z. Si, H. Gong, S.-C. Zhu, and Y.N. Wu
    Statistical Science, 2010

  272. CO3 for Ultra-fast and Accurate Interactive Segmentation [pdf] [web]
    Y. Zhao, S.-C. Zhu, and S.W. Luo
    ACM conference on Multimedia (MM), 2010

  273. Artistic Paper-cut of Human Portraints [pdf] [web]
    M. Meng, M. Zhao, and S.-C. Zhu
    ACM conference on Multimedia (MM), 2010

  274. Sisley the Abstract Painter [pdf] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  275. Painterly Animation Using Video Semantics and Feature Correspondence [pdf] [web]
    L. Lin K. Zeng, H. Lv, Y. Wang, Y. Xu, and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  276. Learning Artistic Lighting Template from Portrait Photographs [preprint] [web]
    X. Jin, M. Zhao, X. Chen, Q. Zhao, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2010

  277. Learning a Probabilistic ModelMixing 3D and 2DPrimitives for View Invariant Object Recognition [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  278. Discovering Scene Categories by Information Projection and Cluster Sampling [pdf]
    D. Dai, T. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  279. 2009

  280. Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2009 [pdf] [reprint]

  281. From Image Parsing to Painterly Rendering [reprint]
    K. Zeng, M. Zhao, C. Xiong, and S.-C. Zhu
    ACM Trans. on Graphics (TOG), 29(1): 2:1-2:11, 2009

  282. Learning Explicit and Implicit Visual Manifolds by Information Projection [pdf] [reprint]
    S.-C. Zhu, K. Shi, and Z. Si
    Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009

  283. An And-or Graph Model for Face Representation, Sketching and Aging [pdf]
    F. Min, J. Suo, and S.-C. Zhu
    Book Chapter inEncyclopedia of Biometric Recognition, Springer, 2009

  284. Learning Deformable Action Templates from Cluttered Videos [pdf]
    B. Yao and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  285. Evaluating Information Contributions of Bottom-up and Top-down Processes [pdf]
    X. Yang, T. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  286. Learning Mixed Templates for Object Recognition [pdf]
    Z. Si, H. Gong, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  287. Flow Mosaicking: Real-time Pedestrian Counting without Scene-Specific Learning
    Y. Cong, H. Gong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  288. Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph [pdf]
    X. Liu, L. Lin, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  289. Layered Graph Matching by Composite Clustering with Collaborative and Competitive Interactions
    L. Lin, K. Zeng, X. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  290. Learning Compositional Models for Object Categories from Small Sample Sets [pdf]
    J. Porway, B. Yao, and S.-C. Zhu
    Book Chapter in Object Categorization: Computer and Human Vision Perspectives, Eds. Sven Dickinson et al., Cambridge University Press, 2009

  291. 2008

  292. A Composite Template for Human Face Modeling and Sketch [pdf] [reprint]
    Z. Xu, H. Chen, S.-C. Zhu, and J. Luo
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2008

  293. Perceptual Scale Space and Its Applications [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 80(1): 143-165, 2008

  294. A Hierarchical and Contextual Model for Aerial Image Understanding [pdf]
    J. Porway, K. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2008

  295. An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry [pdf]
    W. Hu, H. Gong, S.-C. Zhu, and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2008

  296. Learning a Scene Contextual Model for Tracking and Abnormality Detection [pdf]
    B. Yao, L. Wang, and S.-C. Zhu
    International Workshop on Semantic Learning and Applications in Multimedia, 2008

  297. SAVE: A Framework for Semantic Annotation of Visual Events [pdf]
    M. Lee, A. Hakeem, N. Haering, and S.-C. Zhu
    International Workshop on Internet Vision, 2008

  298. 2007

  299. A Two-Level Generative Model for Cloth Representation and Shape-From-Shading [pdf]
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 29(7): 1230-1243, 2007

  300. From Information Scaling of Natural Images to Regimes of Statistical Models [preprint]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Quarterly of Applied Mathematics, 2007

  301. Primal Sketch: Integrating Texture and Structure [pdf] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Image Understanding (CVIU), 106(1): 5-19, 2007

  302. Generalizing Swendsen-Wang for Image Analysis [long survey]
    A. Barbu and S.-C. Zhu
    Journal of Computational and Graphical Statistics, 2007

  303. Statistical Principles in Image Modeling [pdf]
    Y.N. Wu, J. Li. Z. Liu, and S.-C. Zhu
    Technometrics, 49(3): 249-261, 2007

  304. Deformable Template as Active Basis [pdf]
    Y.N. Wu, Z. Si, C. Fleming, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2007

  305. An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples [pdf]
    L. Lin, S. Peng, J. Porway, S.-C. Zhu, and Y. Wang
    International Conference on Computer Vision (ICCV), 2007

  306. Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation tool, and Benchmarks [pdf]
    Z. Yao, X. Yang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  307. Object Category Recognition using Generative Template Boosting
    S. Peng, L. Lin, J. Porway, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  308. An Automatic Portrait System Based on And-Or Graph Representation [pdf]
    F Min, J. Suo, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  309. Dynamic Feature Cascade for Multiple Object Tracking with Trackability Analysis
    Z. Li, H. Gong, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  310. Bayesian Inference for Layer Representation with Mixed Markov Random Field [pdf]
    R. Gao, T. Wu, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  311. Mapping the Ensemble of Natural Image Patches by iplicit and Implicit Manifolds [pdf]
    K, Shi and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  312. Compositional Boosting for Computing Hierarchical Image Structures [pdf]
    T. Wu, G. Xia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  313. Layered Graph Matching with Graph Editing [pdf]
    L. Lin, S.-C. Zhu and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2007

  314. A Multi-Resolution Dynamic Model for Face Aging Simulation [pdf]
    J. Suo, F. Min, S.-C. Zhu, S. Shan, and X. Chen
    Computer Vision and Pattern Recognition (CVPR), 2007

  315. 2006

  316. A Genrative Sketch Model for Human Hair Analysis and Synthesis [pdf] [reprint]
    H. Chen and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 28(7): 1025-1040, 2006

  317. Parsing Images into Regions, Curves, and Curve Groups [pdf] [reprint]
    Z. Tu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 69(2): 223-249, 2006

  318. First-hitting-time Analysis of Independence Metropolis Sampler [pdf] [reprint] A version published at SCTV03 for Vision audience [pdf]
    R. Maciuca and S.-C. Zhu
    Journal of Theoretical Probability, 2006

  319. A Stochastic Grammar of Images [pdf] [reprint]
    S.-C. Zhu and D. Mumford
    Foundations and Trends in Computer Graphics and Vision, 2(4): 259-362, 2006

  320. Composite Templates for Cloth Modeling and Sketching [pdf]
    H. Chen, Z. Xu, Z. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2006

  321. 2005

  322. Generalizing Swendsen-Wangto Sampling Arbitrary Posterior Probabilities [pdf] [reprint]
    A. Barbu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 27(8): 1239-1253, 2005

  323. What are Textons? [pdf] [reprint]
    S.-C. Zhu, C. Guo, Y. Wang, and Z. Xu
    International Journal of Computer Vision (IJCV), 62(1-2): 121-143, 2005

  324. Image parsing: Unifying Segmentation, Detection and Recognition [pdf] [reprint]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Journal of Computer Vision (IJCV), 63(2): 113-140, 2005

  325. Incorporating Visual Knowledge Representation in Stereo Reconstruction [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  326. Perceptual Scale Space and It Applications [pdf]
    Y. Z. Wang, S. Bahrami, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  327. Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar [pdf]
    F. Han and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  328. A generative model of human hair for hair sketching [pdf]
    H. Chen and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  329. A High Resolution Grammatical Model for Face Representation and Sketching [pdf]
    Z. Xu, H. Chen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  330. Cloth Representation by Shape from Shading with Shading Primitives [pdf]
    F. Han and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  331. 2004

  332. Range Image Segmentation by an Effective Jump-Diffusion Method [pdf] [reprint]
    F. Han, Z. Tu, and S.-C. Zhu,
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 26(9): 1138-1153, 2004

  333. Analysis and Synthesis of Textured Motion: Particles and Waves [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 26(10): 1348-1363, 2004

  334. Perceptual Scaling [pdf]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Book Chapter in Applied Bayesian Modeling and Causal Inference from an Incomplete Data Perspective, Eds. A. Gelman and X.L. Meng, John Wiley, 2004.

  335. Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs [pdf]
    Y. Wang and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  336. Information Scaling Laws in Natural Scenes [pdf]
    C. Guo, Y.N. Wu, and S.-C. Zhu
    Workshop on Generative Model Based Vision, 2004

  337. Multigrid and Multi-level Swendsen-Wang Cuts for Hierarchic Graph Partition [pdf]
    A. Barbu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  338. On the Relationship between Image and Motion Segmentation [pdf]
    A. Barbu and S.-C. Zhu
    Workshop on Spatial Coherence for Visual Motion Analysis, 2004

  339. Automatic Single View Building Reconstruction by Integrating Segmentation
    F. Han and S.-C. Zhu
    Workshop on Perceptual Organization in Computer Vision, 2004

  340. 2003

  341. Statistical Edge Detection: Learning and Evaluating Edge Cue [ps.gz] [reprint]
    S. Kinishi, A. Yuille, J. Coughlan, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 25(1): 57-74, 2003

  342. Statistical Modeling and Conceptualization of Visual Patterns [pdf] [reprint]
    S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 25(6): 691-712, 2003

  343. Modeling Visual Patterns by Integrating Descriptive and Generative Models [ps.gz] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Journal of Computer Vision (IJCV), 53(1): 5-29, 2003

  344. On Advances in Statistical Modeling of Natural Images [pdf]
    A. Srivastava, A. Lee, E. Simoncelli, and S.-C. Zhu
    Journal of Math Imaging and Vision, 2003

  345. A Mathematical Theory of Primal Sketch and Sketchability [dio] [pdf]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Conference on Computer Vision (ICCV), 2003

  346. Image Parsing: Segmentation, Detection, and Recognition [dio] [pdf]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  347. Modeling Textured Motion: Particles, Waves, and Cartoon Sketch [dio] [pdf]
    Y. Wang and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  348. Graph Partition by Swendsen-Wang Cut [dio] [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  349. A Multiscale Generative Model for Animate Shape and Parts [dio] [pdf]
    A. Dubinskiy and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  350. How do Heuristics Expedite Markov Chain Search? [dio] [pdf]
    R. Maciuca and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  351. Bayesian Reconstruction of 3D Shapes and Scenes from a Single Image [dio] [pdf]
    F. Han and S.-C. Zhu
    International Workshop on High Level Knowledge in 3D Modeling and Motion (HLK), 2003

  352. 2002

  353. Image Segmentation by Data-Driven Markov Chain Monte Carlo [ps.gz] [reprint]
    Z. Tu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 24(5): 657-673, 2002

  354. Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?" [ps.gz] [reprint]
    S.-C. Zhu and X. Liu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 24(7): 1001-1006, 2002

  355. A Generative Model for Textured Motion: Analysis and Synthesis [pdf]
    Y. Wang and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  356. Parsing Images into Region and Curve Processes [pdf]
    Z. Tu and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  357. What are Textons? [pdf]
    S.-C. Zhu, C. Guo, Y.N. Wu, and Y. Wang
    European Conference on Computer Vision (ECCV), 2002

  358. Statistical Modeling of Texture Sketch [pdf]
    Y.N. Wu, S.-C. Zhu, and C. Guo
    European Conference on Computer Vision (ECCV), 2002

  359. A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction
    F. Han, Z. Tu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002