Preprints

  1. Configurable, Photorealistic Image Rendering and Ground Truth Synthesis
    by Sampling Stochastic Grammars Representing Indoor Scenes [pdf] [web]
    C. Jiang*, Y. Zhu*, S. Qi*, H. Qi*, J. Lin, X. Guo, L. Yu, D. Terzopoulos, and S.-C. Zhu
    *Equal contributors
    under review, arXiv: 1704.00112

  2. Cooperative Training of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    under review, arXiv: 1609.09408

  3. Exploring Generative Perspective of Convolutional Neural Networks by Learning Random Field Models [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    under review, 2016

  4. A Restricted Visual Turing Test for Deep Scene and Event Understanding [pdf] [web]
    H. Qi, T. Wu, M. Lee, and S.-C. Zhu
    under review, arXiv:1512.01715

  5. 2018

  6. Scene-centric Joint Parsing of Cross-view Videos [pdf] [web]
    H. Qi*, Y. Xu*, T. Yuan*, T.F. Wu, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  7. Tracking Occluded Objects and Recovering Incomplete Trajectories by Reasoning about Containment Relations and Human Actions [pdf] [web]
    W. Liang, Y. Zhu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  8. Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation [pdf] [web]
    H.-S. Fang*, Yuanlu Xu*, W.G. Wang*, X.B. Liu, and S.-C. Zhu
    *Equal contributors
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  9. Examining CNN Representations With Respect To Dataset Bias [pdf] [web]
    Q.S. Zhang, W.G. Wang, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  10. Interpreting CNN Knowledge Via An Explanatory Graph [pdf] [web]
    Q.S. Zhang, R. Cao, F. Shi, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2018

  11. 2017

  12. Learning Human Utility from Video Demonstrations for Deductive Planning in Robotics [pdf] [web]
    N. Shukla, Y. He, F. Chen, S.-C. Zhu
    Proceedings of Machine Learning Research, vol 78, pp448-457, 2017

  13. Predicting Human Activities Using Stochastic Grammar [pdf] [web]
    S. Qi, S. Huang, P. Wei, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2017

  14. Monocular 3D Human Pose Estimation by Predicting Depth on Joints [pdf] [web]
    X. Nie*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  15. Jointly Recognizing Object Fluents and Tasks in Egocentric Videos [pdf] [web]
    Y. Liu*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  16. Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos [pdf] [web]
    D. Xie, T. Shu, S. Todorovic, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv: 1606.07827, 2017

  17. Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles [pdf] [web]
    M. Edmonds*, F. Gao*, X. Xie, H. Liu, S. Qi, Y. Zhu, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  18. A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing [pdf] [web]
    H. Liu*, X. Xie*, M. Millar*, M. Edmonds, F. Gao, Y. Zhu, V. J. Santos, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  19. Attributed And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes [pdf] [web]
    S. Park, X. Nie, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv: 1605.02112, 2017

  20. Single-Image 3D Scene Parsing Using Geometric Commonsense [pdf] [web]
    C. Yu, X. Liu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  21. Inferring Human Attention by Learning Latent Intentions [pdf] [web]
    P. Wei, X. Dan, N. Zheng, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  22. Inferring Hidden Statuses and Actions in Video by Causal Reasoning [pdf] [web]
    A. Fire, and S.-C. Zhu
    CVPR Workshop on Vision Meets Cognition: Functionality, Physics, Intentionality and Causality (FPIC), 2017.

  23. CERN: Confidence-Energy Recurrent Network for Group Activity Recognition [pdf]
    T. Shu, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  24. Mining Object Parts from CNNs via Active Question-Answering [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  25. Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet [pdf] [web]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2017

  26. Generative Hierarchical Learning of Sparse FRAME Models [pdf] [web]
    J. Xie, Y. Xu, E. Nijkamp, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  27. Inferring Human Interaction from Motion Trajectories in Aerial Videos [pdf][web]
    T. Shu, Y. Peng, L. Fan, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  28. Consistent Probabilistic Simulation Underlying Human Judgment in Substance Dynamics [pdf] [web]
    J. Kubricht*, Y. Zhu*, C. Jiang*, D. Terzopoulos, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  29. Visuomotor Adaptation and Sensory Recalibration in Reversed Hand Movement Task [pdf] [web]
    J. Lin*, Y. Zhu*, J. Kubricht*, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  30. Single-View 3D Scene Reconstruction and Parsing by Attributed Grammar [pdf]
    X. Liu, Y. Zhao, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), 2017

  31. Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph [pdf] [web]
    W. Li, J. Joo, H. Qi, and S.-C. Zhu
    IEEE Trans. on Multimedia, 19(2):367-381, 2017.

  32. Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions [pdf] [web]
    T. Shu, X. Gao, M. Ryoo, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2017

  33. The Martian: Examining Human Physical Judgments Across Virtual Gravity Fields [pdf] [web]
    T. Ye*, S. Qi*, J. Kubricht, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.

  34. Alternating Back-Propagation for Generator Network [pdf] [web]
    T. Han, Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  35. Cross-view People Tracking by Scene-Centered Spatio-Temporal Parsing [pdf]
    Y. Xu, X. Liu, L. Qin, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  36. Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  37. Inferring Context through Scene Understanding [pdf]
    M. Walton, D. Lange, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI) Symposium on Computational Context, 2017

  38. 2016

  39. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    T. Wu, Y. Lu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv 1509.08067, 2016

  40. Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016

  41. Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation [pdf]
    T. Wu, B. Li, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016

  42. Inducing Wavelets into Random Fields via Generative Boosting [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    Applied and Computational Harmonic Analysis, 2016

  43. A Virtual Reality Platform for Dynamic Human-Scene Interaction [pdf] [web]
    J. Lin*, X. Guo*, J. Shao*, C. Jiang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    SIGGRAPH Asia, Virtual Reality Meets Physical Reality Workshop, 2016

  44. Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration [pdf]
    C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S.-C. Zhu, and J. Chai
    Empirical Methods in Natural Language Processing (emNLP), 2016

  45. Inferring Human Intent from Video by Sampling Hierarchical Plans [pdf]
    S. Holtzen, Y. Zhao, T. Gao, J. Tenenbaum, and S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016

  46. Integrating Function, Geometry, Appearance for Scene Parsing [pdf] [web]
    Y. Zhao and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2016

  47. A Reconfigurable Tangram Model for Scene Representation and Categorization [pdf]
    J. Zhu, T. Wu, B. Li, S.-C. Zhu, X. Yang, and W. Zhang
    IEEE Trans. on Image Processing, 2016

  48. Learning Perceptual Causality from Video [pdf]
    A. Fire and S.-C. Zhu
    ACM Trans. on Intelligent Systems and Technology (Special Issue on Causal Discovery and Inference), 2016

  49. What is Where: Inferring Containment Relations from Videos [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  50. Learning Social Affordance for Human-Robot Interaction [pdf] [web]
    T. Shu, M. Ryoo, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  51. A Theory of Generative ConvNet [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    International Conference on Machine Learning (ICML), 2016

  52. Grounded Semantic Role Labeling [pdf]
    S. Yang, Q. Gao, C. Liu, C. Xiong, S.-C. Zhu, and J. Chai
    North American Chapter of the Association for Computational Linguistics (NA-ACL), 2016

  53. Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem [pdf] [web]
    J. Kubricht*, C. Jiang*, Y. Zhu*, S.-C. Zhu, D. Terzopoulos, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  54. Critical Features of Joint Actions that Signal Human Interaction [pdf]
    T. Shu, S. Thurman, D. Chen, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  55. Multi-view People Tracking via Hierarchical Trajectory Composition [pdf]
    Y. Xu, X. Liu, Y. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  56. Recognizing Car Fluents from Video [pdf] [web][Dataset]
    B. Li, T. Wu, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  57. Inferring Forces and Learning Human Utilities from Video [pdf] [web]
    Y. Zhu*, C. Jiang*, Y. Zhao, D. terzopoulos and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2016

  58. Robot Learning with a Spatial, Temporal, and Causal And-Or Graph [pdf] [web]
    C. Xiong, N. Shukla, W. Xiong, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2016

  59. Learning FRAME Models Using CNN Filters [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2016

  60. Task Learning through Visual Demonstration andSituated Dialogue [pdf]
    C. Liu, J. Chai, N. Shukla and S.C.Zhu
    AAAI Workshop on Symbiotic Cognitive Systems, 2016

  61. 2015

  62. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging [pdf] [web]
    S. Wang, Y.Z. Wang, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2015

  63. Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),2015

  64. Scene Understanding by Reasoning Stability and Safety [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2015

  65. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2015

  66. Video Primal Sketch: A Unified Middel Level Representation of video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    Journal of Mathematical Imaging and Vision, 2015

  67. Learning Sparse FRAME Models for Natural Image Patterns [pdf] [web]
    J. Xie, W. Hu, S.-C. Zhu, and Y.N. Wu
    International Journal urnal of Computer Vision (IJCV), 2015

  68. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    arXiv: 1410.0576, short version appears at EMMCVPR 2015

  69. Attributed Grammars for Joint Estimation of Human Attributes, Parts and Poses [pdf] [web]
    S. Park and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  70. Mining And-Or Graphs for Graph Matching and Object Discovery [pdf]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  71. Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face [pdf]
    J. Joo, F. Steen, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  72. A Unified Framework for Human-Robot Knowledge Transfer
    N. Shukla, C. Xiong, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  73. Represent and Infer Human Theory of Mind for Human-Robot Interaction [pdf]
    Y. Zhao, S. Holtzen, T. Gao, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  74. Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition [pdf] [web]
    Y. Zhu*, Y. Zhao*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2015

  75. Joint Inference of Groups, Events and Human Roles in Aerial Videos [pdf] [web]
    T. Shu, D. Xie, B. Rothrock, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  76. Joint Action Recognition and Pose Estimation From Video [pdf]
    X. Nie, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  77. Evaluating Human Cognition of Containing Relations with Physical Simulation [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    Annual Cognitive Science Conference (CogSci), 2015

  78. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    Energy Minimization Method for Computer Vision and Pattern Recognition (EMMCVPR), 2015

  79. 2014

  80. Learning Mixtures of Bernoulli Templates by Two-Round em with Performance Guarantee [pdf] [slides]
    A. Barbu, T. Wu, and Y.N. Wu
    Electronic Journal of Statistics (EJS), 2014

  81. Joint Video and Text Parsing for Understanding Events and Answering Queires [pdf] [web]
    K. Tu, M. Meng, M. Lee, T. Choi, and S.-C. Zhu
    IEEE MultiMedia, 2014

  82. Unsupervised Learning ofCompositional Sparse Code for Natural Image Representation [pdf] [web]
    Y. Hong, Z. Si, W. Hu, S.-C. Zhu, and Y.N. Wu
    Quarterly of Applied Mathematics, 2014

  83. Animated Pose Templates for Modeling and Detecting Human Actions
    B. Yao, B. Nie, Z. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2014 [pdf] [web]

  84. Integrating Context and Occlusion forCar Detection by Hierarchical And-Or Model [pdf] [web]
    B. Li, T. Wu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2014

  85. Visual Persuasion: Inferring the Communicative Intents of Images [pdf] [web]
    J. Joo, W. Li, F. Steen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  86. Cross-View Action Modeling, Learning and Recognition [pdf] [web]
    J. Wang, B. Nie, Y.N. Wu, and S.-C. Zhu
    of Computer Vision and Pattern Recognition (CVPR), 2014.

  87. Single-View 3D Scene Parsing by Attributed Grammar [pdf] [web]
    X. Liu, Y. Zhao, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  88. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    Y. Lu, T. Wu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  89. Learning Inhomogeneous FRAME Modelsfor Object Patterns [pdf] [web]
    J. Xie. W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  90. Unsupervised Learning of Dictionaries of Hierarchical Compositional Models [pdf] [web]
    J. Dai, Y. Hong, W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  91. Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Conference on Robotics and Automations (ICRA), 2014

  92. 2013

  93. Video Event Parsingand Learning with Goal and Intent Prediction [pdf] [web]
    M. Pei, Z. Si, B. Yao, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), 2013

  94. Learning And-Or Templatesfor Object Modeling and Recognition [pdf] [web with data and code]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2013

  95. Abstract Painting with Interactive Control of Perceptual Entropy [pdf] [web] [reprint]
    M. Zhao and S.-C. Zhu
    ACM Trans. on Applied Perception, 2013

  96. Video Stylization: Painterly Rendering and Optimization with Content Extraction [pdf] [web]
    L. Lin, K. Zeng, Y. Wang, Y.-Q. Xu, and S.-C. Zhu
    IEEE Trans. on Circuits and Systems for Video Technology, 2013

  97. Unsupervised Structure Learning of Stochastic And-Or Grammars [pdf] [web]
    K. Tu, M. Pavlovskaia, and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2013

  98. Inferring "Dark Matter" and "Dark Energy" from Videos [pdf] [web]
    D. Xie, S. Todorovic, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  99. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  100. Monte Carlo Tree Search for Scheduling Activity Recognition [pdf]
    M. Amer, S. Todorovic, A. Fern, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  101. Human Attribute Recognition by Rich Appearance Dictionary [pdf] [web]
    J. Joo, S. Wang, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  102. Cosegmentation and Cosketch by Unsupervised Learning [pdf] [web]
    J. Dai, Y.N. Wu, J. Zhou, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  103. Concurrent Action Detection with Structural Prediction [pdf] [web]
    P. Wei, N. Zheng, Y. Zhao, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  104. Modeling Occlusion by Discriminative AND-OR Structures [pdf] [web]
    B. Li, W. Hu, T. Wu, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  105. Modeling 4D Human-Object Interactions for Event and Object Recognition [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  106. Rates for Inductive Learning of Compositional Models [pdf]
    A. Barbu, M. Pavlovskaia, and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), 2013

  107. Scene Parsing by Integrating Function, Geometry and Appearance Models [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  108. Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  109. Integrating Grammar and Segmentation forHuman Pose Estimation [pdf] [web]
    B. Rothrock, S. Park, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  110. Discriminatively Trained And-Or Tree Models for Object Detection [pdf] [web]
    X. Song, T. Wu, Y. Jia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  111. Weakly Supervised Learning for Attribute Localization in Outdoor Scenes [pdf] [web]
    S. Wang, J. Joo, Y. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  112. Using Causal Induction in Humans to Learn and Infer Causality from Video [pdf] [poster]
    A. Fire and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2013

  113. Learning Perceptual Causality from Video [pdf] [slides] [poster]
    A. Fire and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), Bellvue, WA, 2013

  114. 2012

  115. Intrackability: Characterizing Video Statistics and Pursuing Video Representations [pdf] [web]
    H. Gong and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2012

  116. Learning Hybrid image Template (HiT) by Information Projection [pdf] [web]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2012

  117. Background Modeling by Subspace Learning on Spatio-temporal Patches [reprint]
    Y. Zhao, H. Gong, Y. Jia, and S.-C. Zhu
    Pattern Recognition Letter, 2012

  118. Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition [pdf] [web]
    M. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2012

  119. Hierarchical Space Tiling for Scene Modelling [pdf]
    S. Wang, Y. Wang, and S.-C. Zhu
    Asia Conference on Computer Vision (ACCV), 2012

  120. Reconfigurable Templates for Robust Vehicle Detection and Classification [pdf]
    Y. Lu, B. Yao, Y. Wang, and S.-C. Zhu
    Workshop on Application of Computer Vision (WACV), 2012

  121. Learning Reconfigurable Scene Representation by Tangram Model [pdf]
    J. Zhu, T. Wu, S.-C. Zhu, X. Yang, and W. Zhang
    Workshop on Application of Computer Vision (WACV), 2012

  122. Artistic Rendering of Portraits
    M. Zhao and S.-C. Zhu
    Book Chapter in Image and Video based Artistic Stylization, Eds. J. Collomosse and P. Rossin, Springer, 2012

  123. Hierarchical Organization by And-Or Tree
    J. Joo, S. Wang, and S.-C. Zhu
    Book Chapter in Handbook of Perceptual Organization, Eds. J. Wagemans, Springer, 2012

  124. Structure v.s. Appearance and 3D v.s. 2D? A Numeric Answer
    W. Hu, Z. Si, and S.-C. Zhu
    Book Chapter in Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective, Eds. S. Dickinson and Z. Pizlo, Springer, 2012

  125. Learning 3D Object Templates by Hierarchical Quantization of Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2012

  126. 2011

  127. A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs [pdf] [web]
    T. Wu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2011

  128. C4: Computing Multiple Solutions in Graphical Models by Cluster Sampling [pdf] [web]
    J. Porway and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2011

  129. Image Parsing via Stochastic Scene Grammar [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2011

  130. Unsupervised Learning of Stochastic And-Or Templates for Object modeling [pdf]
    Z. Si and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  131. Human Parsing using Stochastic And-Or grammar and Rich Appearance [pdf]
    B. Rothrock and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  132. Parsing Video Events with Goal inference and Intent Prediction [pdf] [web]
    M. Pei, Y. Jia, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  133. Unsupervised Learning of Event And-Or Grammar and Semantics from Video [pdf] [web]
    Z. Si, M. Pei, Z. Yao, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  134. Image Representation by Active Curves [pdf]
    W. Hu, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  135. Video Primal Sketch: A Generic Middle-Level Representation of Video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  136. Inferring Social Roles in Long Timespan Video Sequence [pdf]
    J. Zhang, W. Hu, B. Yao, Y. Wang, and S.-C. Zhu
    International Workshop on Video Event Categorization, Tagging and Retrieval for Real World Applications, 2011

  137. Customizing Painterly Rendering Styles Using Stroke Processes [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  138. Portrait Painting Using Active Templates [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  139. 2010

  140. LearningActive Basis Model for Object Detection and Recognition [pdf] [reprint]
    Y.N. Wu, Z. Si, H. Gong, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2010

  141. A Compositional and Dynamic Model for Face Aging [pdf] [web]
    J. Suo, S.-C. Zhu, S. Shan, and X. Chen
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2010

  142. Layered Graph Matching by Composite Cluster Sampling
    L. Lin, X. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2010

  143. Hierarchical and Contextual Model for Aerial Image Understanding [pdf] [web]
    J. Porway, K. Wang, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2010

  144. I2T: Image Parsing to Text Description [pdf] [web]
    Z. Yao, X. Yang, L. Lin, M. Lee, and S.-C. Zhu
    Proceedings of the IEEE (Special Issue on Internet Vision), 2010

  145. Learning Active Basis Models by em-Type Algorithms [pdf]
    Z. Si, H. Gong, S.-C. Zhu, and Y.N. Wu
    Statistical Science, 2010

  146. CO3 for Ultra-fast and Accurate Interactive Segmentation [pdf] [web]
    Y. Zhao, S.-C. Zhu, and S.W. Luo
    ACM conference on Multimedia (MM), 2010

  147. Artistic Paper-cut of Human Portraints [pdf] [web]
    M. Meng, M. Zhao, and S.-C. Zhu
    ACM conference on Multimedia (MM), 2010

  148. Sisley the Abstract Painter [pdf] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  149. Painterly Animation Using Video Semantics and Feature Correspondence [pdf] [web]
    L. Lin K. Zeng, H. Lv, Y. Wang, Y. Xu, and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  150. Learning Artistic Lighting Template from Portrait Photographs [preprint] [web]
    X. Jin, M. Zhao, X. Chen, Q. Zhao, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2010

  151. Learning a Probabilistic ModelMixing 3D and 2DPrimitives for View Invariant Object Recognition [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  152. Discovering Scene Categories by Information Projection and Cluster Sampling [pdf]
    D. Dai, T. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  153. 2009

  154. Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2009 [pdf] [reprint]

  155. From Image Parsing to Painterly Rendering [reprint]
    K. Zeng, M. Zhao, C. Xiong, and S.-C. Zhu
    ACM Trans. on Graphics (TOG), 2009

  156. Learning Explicit and Implicit Visual Manifolds by Information Projection [pdf] [reprint]
    S.-C. Zhu, K. Shi, and Z. Si
    Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009

  157. An And-or Graph Model for Face Representation, Sketching and Aging [pdf]
    F. Min, J. Suo, and S.-C. Zhu
    Book Chapter inEncyclopedia of Biometric Recognition, Springer, 2009

  158. Learning Deformable Action Templates from Cluttered Videos [pdf]
    B. Yao and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  159. Evaluating Information Contributions of Bottom-up and Top-down Processes [pdf]
    X. Yang, T. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  160. Learning Mixed Templates for Object Recognition [pdf]
    Z. Si, H. Gong, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  161. Flow Mosaicking: Real-time Pedestrian Counting without Scene-Specific Learning
    Y. Cong, H. Gong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  162. Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph [pdf]
    X. Liu, L. Lin, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  163. Layered Graph Matching by Composite Clustering with Collaborative and Competitive Interactions
    L. Lin, K. Zeng, X. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  164. Learning Compositional Models for Object Categories from Small Sample Sets [pdf]
    J. Porway, B. Yao, and S.-C. Zhu
    Book Chapter in Object Categorization: Computer and Human Vision Perspectives, Eds. Sven Dickinson et al., Cambridge University Press, 2009

  165. 2008

  166. A Composite Template for Human Face Modeling and Sketch [pdf] [reprint]
    Z. Xu, H. Chen, S.-C. Zhu, and J. Luo
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2008

  167. Perceptual Scale Space and Its Applications [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2008

  168. A Hierarchical and Contextual Model for Aerial Image Understanding [pdf]
    J. Porway, K. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2008

  169. An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry [pdf]
    W. Hu, H. Gong, S.-C. Zhu, and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2008

  170. Learning a Scene Contextual Model for Tracking and Abnormality Detection [pdf]
    B. Yao, L. Wang, and S.-C. Zhu
    International Workshop on Semantic Learning and Applications in Multimedia, 2008

  171. SAVE: A Framework for Semantic Annotation of Visual Events [pdf]
    M. Lee, A. Hakeem, N. Haering, and S.-C. Zhu
    International Workshop on Internet Vision, 2008

  172. 2007

  173. From Information Scaling of Natural Images to Regimes of Statistical Models [preprint]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Quarterly of Applied Mathematics, 2007

  174. Primal Sketch: Integrating Texture and Structure [pdf] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Image Understanding (CVIU), 2007

  175. Generalizing Swendsen-Wang for Image Analysis [long survey]
    A. Barbu and S.-C. Zhu
    Journal of Computational and Graphical Statistics, 2007

  176. A Two-Level Generative Model for Cloth Representation and Shape-From-Shading [pdf]
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2007

  177. Statistical Principles in Image Modeling [pdf]
    Y.N. Wu, J. Li. Z. Liu, and S.-C. Zhu
    Technometrics, 2007

  178. Deformable Template as Active Basis [pdf]
    Y.N. Wu, Z. Si, C. Fleming, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2007

  179. An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples [pdf]
    L. Lin, S. Peng, J. Porway, S.-C. Zhu, and Y. Wang
    International Conference on Computer Vision (ICCV), 2007

  180. Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation tool, and Benchmarks [pdf]
    Z. Yao, X. Yang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  181. Object Category Recognition using Generative Template Boosting
    S. Peng, L. Lin, J. Porway, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  182. An Automatic Portrait System Based on And-Or Graph Representation [pdf]
    F Min, J. Suo, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  183. Dynamic Feature Cascade for Multiple Object Tracking with Trackability Analysis
    Z. Li, H. Gong, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  184. Bayesian Inference for Layer Representation with Mixed Markov Random Field [pdf]
    R. Gao, T. Wu, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  185. Mapping the Ensemble of Natural Image Patches by Emplicit and Implicit Manifolds [pdf]
    K, Shi and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  186. Compositional Boosting for Computing Hierarchical Image Structures [pdf]
    T. Wu, G. Xia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  187. Layered Graph Matching with Graph Editing [pdf]
    L. Lin, S.-C. Zhu and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2007

  188. A Multi-Resolution Dynamic Model for Face Aging Simulation [pdf]
    J. Suo, F. Min, S.-C. Zhu, S. Shan, and X. Chen
    Computer Vision and Pattern Recognition (CVPR), 2007

  189. 2006

  190. Parsing Images into Regions, Curves, and Curve Groups [pdf] [reprint]
    Z. Tu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2006

  191. First-hitting-time Analysis of Independence Metropolis Sampler [pdf] [reprint] A version published at SCTV03 for Vision audience [pdf]
    R. Maciuca and S.-C. Zhu
    Journal of Theoretical Probability, 2006

  192. A Stochastic Grammar of Images [pdf] [reprint]
    S.-C. Zhu and D. Mumford
    Foundations and Trends in Computer Graphics and Vision, 2006

  193. A Genrative Sketch Model for Human Hair Analysis and Synthesis [pdf] [reprint]
    H. Chen and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2006

  194. Composite Templates for Cloth Modeling and Sketching [pdf]
    H. Chen, Z. Xu, Z. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2006

  195. 2005

  196. What are Textons? [pdf] [reprint]
    S.-C. Zhu, C. Guo, Y. Wang, and Z. Xu
    International Journal of Computer Vision (IJCV), 2005

  197. Image parsing: Unifying Segmentation, Detection and Recognition [pdf] [reprint]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Journal of Computer Vision (IJCV), 2005

  198. Generalizing Swendsen-Wangto Sampling Arbitrary Posterior Probabilities [pdf] [reprint]
    A. Barbu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2005

  199. Incorporating Visual Knowledge Representation in Stereo Reconstruction [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  200. Perceptual Scale Space and It Applications [pdf]
    Y. Z. Wang, S. Bahrami, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  201. Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar [pdf]
    F. Han and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  202. A generative model of human hair for hair sketching [pdf]
    H. Chen and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  203. A High Resolution Grammatical Model for Face Representation and Sketching [pdf]
    Z. Xu, H. Chen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  204. Cloth Representation by Shape from Shading with Shading Primitives [pdf]
    F. Han and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  205. 2004

  206. Range Image Segmentation by an Effective Jump-Diffusion Method [pdf] [reprint]
    F. Han, Z. Tu, and S.-C. Zhu,
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2004

  207. Analysis and Synthesis of Textured Motion: Particles and Waves [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2004

  208. Perceptual Scaling [pdf]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Book Chapter in Applied Bayesian Modeling and Causal Inference from an Incomplete Data Perspective, Eds. A. Gelman and X.L. Meng, John Wiley, 2004.

  209. Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs [pdf]
    Y. Wang and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  210. Information Scaling Laws in Natural Scenes [pdf]
    C. Guo, Y.N. Wu, and S.-C. Zhu
    Workshop on Generative Model Based Vision, 2004

  211. Multigrid and Multi-level Swendsen-Wang Cuts for Hierarchic Graph Partition [pdf]
    A. Barbu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  212. On the Relationship between Image and Motion Segmentation [pdf]
    A. Barbu and S.-C. Zhu
    Workshop on Spatial Coherence for Visual Motion Analysis, 2004

  213. Automatic Single View Building Reconstruction by Integrating Segmentation
    F. Han and S.-C. Zhu
    Workshop on Perceptual Organization in Computer Vision, 2004

  214. 2003

  215. Statistical Edge Detection: Learning and Evaluating Edge Cue [ps.gz] [reprint]
    S. Kinishi, A. Yuille, J. Coughlan, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2003

  216. Modeling Visual Patterns by Integrating Descriptive and Generative Models [ps.gz] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Journal of Computer Vision (IJCV), 2003

  217. Statistical Modeling and Conceptualization of Visual Patterns [pdf] [reprint]
    S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2003

  218. On Advances in Statistical Modeling of Natural Images [pdf]
    A. Srivastava, A. Lee, E. Simoncelli, and S.-C. Zhu
    Journal of Math Imaging and Vision, 2003

  219. A Mathematical Theory of Primal Sketch and Sketchability [demo] [pdf]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Conference on Computer Vision (ICCV), 2003

  220. Image Parsing: Segmentation, Detection, and Recognition [demo] [pdf]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  221. Modeling Textured Motion: Particles, Waves, and Cartoon Sketch [demo] [pdf]
    Y. Wang and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  222. Graph Partition by Swendsen-Wang Cut [demo] [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  223. A Multiscale Generative Model for Animate Shape and Parts [demo] [pdf]
    A. Dubinskiy and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  224. How do Heuristics Expedite Markov Chain Search? [demo] [pdf]
    R. Maciuca and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  225. Bayesian Reconstruction of 3D Shapes and Scenes from a Single Image [demo] [pdf]
    F. Han and S.-C. Zhu
    International Workshop on High Level Knowledge in 3D Modeling and Motion (HLK), 2003

  226. 2002

  227. Image Segmentation by Data-Driven Markov Chain Monte Carlo [ps.gz] [reprint]
    Z. Tu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2002

  228. Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?" [ps.gz] [reprint]
    S.-C. Zhu and X. Liu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2002

  229. A Generative Model for Textured Motion: Analysis and Synthesis [pdf]
    Y. Wang and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  230. Parsing Images into Region and Curve Processes [pdf]
    Z. Tu and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  231. What are Textons? [pdf]
    S.-C. Zhu, C. Guo, Y.N. Wu, and Y. Wang
    European Conference on Computer Vision (ECCV), 2002

  232. Statistical Modeling of Texture Sketch [pdf]
    Y.N. Wu, S.-C. Zhu, and C. Guo
    European Conference on Computer Vision (ECCV), 2002

  233. A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction
    F. Han, Z. Tu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002