Preprints

  1. Configurable, Photorealistic Image Rendering and Ground Truth Synthesis
    by Sampling Stochastic Grammars Representing Indoor Scenes [pdf] [web]
    C. Jiang*, Y. Zhu*, S. Qi*, H. Qi*, J. Lin, X. Guo, L. Yu, D. Terzopoulos, and S.-C. Zhu
    *Equal contributors
    under review, arXiv: 1704.00112

  2. Cooperative Training of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    under review, arXiv: 1609.09408

  3. Exploring Generative Perspective of Convolutional Neural Networks by Learning Random Field Models [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    under review, 2016

  4. A Restricted Visual Turing Test for Deep Scene and Event Understanding [pdf] [web]
    H. Qi, T. Wu, M. Lee, and S.-C. Zhu
    under review, arXiv:1512.01715

  5. 2017

  6. Predicting Human Activities Using Stochastic Grammar [pdf] [web]
    S. Qi, S. Huang, P. Wei, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2017

  7. Monocular 3D Human Pose Estimation by Predicting Depth on Joints [pdf] [web]
    X. Nie*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  8. Jointly Recognizing Object Fluents and Tasks in Egocentric Videos [pdf] [web]
    Y. Liu*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  9. Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos [pdf] [web]
    D. Xie, T. Shu, S. Todorovic, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv: 1606.07827, 2017

  10. Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles [pdf] [web]
    M. Edmonds*, F. Gao*, X. Xie, H. Liu, S. Qi, Y. Zhu, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  11. A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing [pdf] [web]
    H. Liu*, X. Xie*, M. Millar*, M. Edmonds, F. Gao, Y. Zhu, V. J. Santos, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  12. Attributed And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes [pdf] [web]
    S. Park, X. Nie, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv: 1605.02112, 2017

  13. Single-Image 3D Scene Parsing Using Geometric Commonsense [pdf] [web]
    C. Yu, X. Liu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  14. Inferring Human Attention by Learning Latent Intentions [pdf] [web]
    P. Wei, X. Dan, N. Zheng, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  15. Inferring Hidden Statuses and Actions in Video by Causal Reasoning [pdf] [web]
    A. Fire, and S.-C. Zhu
    CVPR Workshop on Vision Meets Cognition: Functionality, Physics, Intentionality and Causality (FPIC), 2017.

  16. CERN: Confidence-Energy Recurrent Network for Group Activity Recognition [pdf]
    T. Shu, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  17. Mining Object Parts from CNNs via Active Question-Answering [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  18. Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet [pdf] [web]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2017

  19. Generative Hierarchical Learning of Sparse FRAME Models [pdf] [web]
    J. Xie, Y. Xu, E. Nijkamp, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  20. Inferring Human Interaction from Motion Trajectories in Aerial Videos [pdf][web]
    T. Shu, Y. Peng, L. Fan, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  21. Consistent Probabilistic Simulation Underlying Human Judgment in Substance Dynamics [pdf] [web]
    J. Kubricht*, Y. Zhu*, C. Jiang*, D. Terzopoulos, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  22. Visuomotor Adaptation and Sensory Recalibration in Reversed Hand Movement Task [pdf] [web]
    J. Lin*, Y. Zhu*, J. Kubricht*, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  23. Single-View 3D Scene Reconstruction and Parsing by Attributed Grammar [pdf]
    X. Liu, Y. Zhao, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), 2017

  24. Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph [pdf] [web]
    W. Li, J. Joo, H. Qi, and S.-C. Zhu
    IEEE Trans. on Multimedia, 19(2):367-381, 2017.

  25. Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions [pdf] [web]
    T. Shu, X. Gao, M. Ryoo, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2017

  26. The Martian: Examining Human Physical Judgments Across Virtual Gravity Fields [pdf] [web]
    T. Ye*, S. Qi*, J. Kubricht, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.

  27. Alternating Back-Propagation for Generator Network [pdf] [web]
    T. Han, Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  28. Cross-view People Tracking by Scene-Centered Spatio-Temporal Parsing [pdf]
    Y. Xu, X. Liu, L. Qin, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  29. Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  30. Inferring Context through Scene Understanding [pdf]
    M. Walton, D. Lange, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI) Symposium on Computational Context, 2017

  31. 2016

  32. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    T. Wu, Y. Lu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv 1509.08067, 2016

  33. Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016

  34. Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation [pdf]
    T. Wu, B. Li, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016

  35. Inducing Wavelets into Random Fields via Generative Boosting [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    Applied and Computational Harmonic Analysis, 2016

  36. A Virtual Reality Platform for Dynamic Human-Scene Interaction [pdf] [web]
    J. Lin*, X. Guo*, J. Shao*, C. Jiang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    SIGGRAPH Asia, Virtual Reality Meets Physical Reality Workshop, 2016

  37. Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration [pdf]
    C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S.-C. Zhu, and J. Chai
    Empirical Methods in Natural Language Processing (emNLP), 2016

  38. Inferring Human Intent from Video by Sampling Hierarchical Plans [pdf]
    S. Holtzen, Y. Zhao, T. Gao, J. Tenenbaum, and S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016

  39. Integrating Function, Geometry, Appearance for Scene Parsing [pdf] [web]
    Y. Zhao and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2016

  40. A Reconfigurable Tangram Model for Scene Representation and Categorization [pdf]
    J. Zhu, T. Wu, B. Li, S.-C. Zhu, X. Yang, and W. Zhang
    IEEE Trans. on Image Processing, 2016

  41. Learning Perceptual Causality from Video [pdf]
    A. Fire and S.-C. Zhu
    ACM Trans. on Intelligent Systems and Technology (Special Issue on Causal Discovery and Inference), 2016

  42. What is Where: Inferring Containment Relations from Videos [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  43. Learning Social Affordance for Human-Robot Interaction [pdf] [web]
    T. Shu, M. Ryoo, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  44. A Theory of Generative ConvNet [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    International Conference on Machine Learning (ICML), 2016

  45. Grounded Semantic Role Labeling [pdf]
    S. Yang, Q. Gao, C. Liu, C. Xiong, S.-C. Zhu, and J. Chai
    North American Chapter of the Association for Computational Linguistics (NA-ACL), 2016

  46. Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem [pdf] [web]
    J. Kubricht*, C. Jiang*, Y. Zhu*, S.-C. Zhu, D. Terzopoulos, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  47. Critical Features of Joint Actions that Signal Human Interaction [pdf]
    T. Shu, S. Thurman, D. Chen, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  48. Multi-view People Tracking via Hierarchical Trajectory Composition [pdf]
    Y. Xu, X. Liu, Y. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  49. Recognizing Car Fluents from Video [pdf] [web][Dataset]
    B. Li, T. Wu, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  50. Inferring Forces and Learning Human Utilities from Video [pdf] [web]
    Y. Zhu*, C. Jiang*, Y. Zhao, D. terzopoulos and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2016

  51. Robot Learning with a Spatial, Temporal, and Causal And-Or Graph [pdf] [web]
    C. Xiong, N. Shukla, W. Xiong, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2016

  52. Learning FRAME Models Using CNN Filters [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2016

  53. Task Learning through Visual Demonstration andSituated Dialogue [pdf]
    C. Liu, J. Chai, N. Shukla and S.C.Zhu
    AAAI Workshop on Symbiotic Cognitive Systems, 2016

  54. 2015

  55. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging [pdf] [web]
    S. Wang, Y.Z. Wang, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2015

  56. Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),2015

  57. Scene Understanding by Reasoning Stability and Safety [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2015

  58. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2015

  59. Video Primal Sketch: A Unified Middel Level Representation of video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    Journal of Mathematical Imaging and Vision, 2015

  60. Learning Sparse FRAME Models for Natural Image Patterns [pdf] [web]
    J. Xie, W. Hu, S.-C. Zhu, and Y.N. Wu
    International Journal urnal of Computer Vision (IJCV), 2015

  61. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    arXiv: 1410.0576, short version appears at EMMCVPR 2015

  62. Attributed Grammars for Joint Estimation of Human Attributes, Parts and Poses [pdf] [web]
    S. Park and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  63. Mining And-Or Graphs for Graph Matching and Object Discovery [pdf]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  64. Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face [pdf]
    J. Joo, F. Steen, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  65. A Unified Framework for Human-Robot Knowledge Transfer
    N. Shukla, C. Xiong, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  66. Represent and Infer Human Theory of Mind for Human-Robot Interaction [pdf]
    Y. Zhao, S. Holtzen, T. Gao, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  67. Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition [pdf] [web]
    Y. Zhu*, Y. Zhao*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2015

  68. Joint Inference of Groups, Events and Human Roles in Aerial Videos [pdf] [web]
    T. Shu, D. Xie, B. Rothrock, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  69. Joint Action Recognition and Pose Estimation From Video [pdf]
    X. Nie, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  70. Evaluating Human Cognition of Containing Relations with Physical Simulation [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    Annual Cognitive Science Conference (CogSci), 2015

  71. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    Energy Minimization Method for Computer Vision and Pattern Recognition (EMMCVPR), 2015

  72. 2014

  73. Learning Mixtures of Bernoulli Templates by Two-Round em with Performance Guarantee [pdf] [slides]
    A. Barbu, T. Wu, and Y.N. Wu
    Electronic Journal of Statistics (EJS), 2014

  74. Joint Video and Text Parsing for Understanding Events and Answering Queires [pdf] [web]
    K. Tu, M. Meng, M. Lee, T. Choi, and S.-C. Zhu
    IEEE MultiMedia, 2014

  75. Unsupervised Learning ofCompositional Sparse Code for Natural Image Representation [pdf] [web]
    Y. Hong, Z. Si, W. Hu, S.-C. Zhu, and Y.N. Wu
    Quarterly of Applied Mathematics, 2014

  76. Animated Pose Templates for Modeling and Detecting Human Actions
    B. Yao, B. Nie, Z. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2014 [pdf] [web]

  77. Integrating Context and Occlusion forCar Detection by Hierarchical And-Or Model [pdf] [web]
    B. Li, T. Wu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2014

  78. Visual Persuasion: Inferring the Communicative Intents of Images [pdf] [web]
    J. Joo, W. Li, F. Steen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  79. Cross-View Action Modeling, Learning and Recognition [pdf] [web]
    J. Wang, B. Nie, Y.N. Wu, and S.-C. Zhu
    of Computer Vision and Pattern Recognition (CVPR), 2014.

  80. Single-View 3D Scene Parsing by Attributed Grammar [pdf] [web]
    X. Liu, Y. Zhao, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  81. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    Y. Lu, T. Wu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  82. Learning Inhomogeneous FRAME Modelsfor Object Patterns [pdf] [web]
    J. Xie. W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  83. Unsupervised Learning of Dictionaries of Hierarchical Compositional Models [pdf] [web]
    J. Dai, Y. Hong, W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  84. Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Conference on Robotics and Automations (ICRA), 2014

  85. 2013

  86. Video Event Parsingand Learning with Goal and Intent Prediction [pdf] [web]
    M. Pei, Z. Si, B. Yao, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), 2013

  87. Learning And-Or Templatesfor Object Modeling and Recognition [pdf] [web with data and code]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2013

  88. Abstract Painting with Interactive Control of Perceptual Entropy [pdf] [web] [reprint]
    M. Zhao and S.-C. Zhu
    ACM Trans. on Applied Perception, 2013

  89. Video Stylization: Painterly Rendering and Optimization with Content Extraction [pdf] [web]
    L. Lin, K. Zeng, Y. Wang, Y.-Q. Xu, and S.-C. Zhu
    IEEE Trans. on Circuits and Systems for Video Technology, 2013

  90. Unsupervised Structure Learning of Stochastic And-Or Grammars [pdf] [web]
    K. Tu, M. Pavlovskaia, and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2013

  91. Inferring "Dark Matter" and "Dark Energy" from Videos [pdf] [web]
    D. Xie, S. Todorovic, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  92. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  93. Monte Carlo Tree Search for Scheduling Activity Recognition [pdf]
    M. Amer, S. Todorovic, A. Fern, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  94. Human Attribute Recognition by Rich Appearance Dictionary [pdf] [web]
    J. Joo, S. Wang, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  95. Cosegmentation and Cosketch by Unsupervised Learning [pdf] [web]
    J. Dai, Y.N. Wu, J. Zhou, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  96. Concurrent Action Detection with Structural Prediction [pdf] [web]
    P. Wei, N. Zheng, Y. Zhao, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  97. Modeling Occlusion by Discriminative AND-OR Structures [pdf] [web]
    B. Li, W. Hu, T. Wu, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  98. Modeling 4D Human-Object Interactions for Event and Object Recognition [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  99. Rates for Inductive Learning of Compositional Models [pdf]
    A. Barbu, M. Pavlovskaia, and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), 2013

  100. Scene Parsing by Integrating Function, Geometry and Appearance Models [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  101. Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  102. Integrating Grammar and Segmentation forHuman Pose Estimation [pdf] [web]
    B. Rothrock, S. Park, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  103. Discriminatively Trained And-Or Tree Models for Object Detection [pdf] [web]
    X. Song, T. Wu, Y. Jia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  104. Weakly Supervised Learning for Attribute Localization in Outdoor Scenes [pdf] [web]
    S. Wang, J. Joo, Y. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  105. Using Causal Induction in Humans to Learn and Infer Causality from Video [pdf] [poster]
    A. Fire and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2013

  106. Learning Perceptual Causality from Video [pdf] [slides] [poster]
    A. Fire and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), Bellvue, WA, 2013

  107. 2012

  108. Intrackability: Characterizing Video Statistics and Pursuing Video Representations [pdf] [web]
    H. Gong and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2012

  109. Learning Hybrid image Template (HiT) by Information Projection [pdf] [web]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2012

  110. Background Modeling by Subspace Learning on Spatio-temporal Patches [reprint]
    Y. Zhao, H. Gong, Y. Jia, and S.-C. Zhu
    Pattern Recognition Letter, 2012

  111. Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition [pdf] [web]
    M. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2012

  112. Hierarchical Space Tiling for Scene Modelling [pdf]
    S. Wang, Y. Wang, and S.-C. Zhu
    Asia Conference on Computer Vision (ACCV), 2012

  113. Reconfigurable Templates for Robust Vehicle Detection and Classification [pdf]
    Y. Lu, B. Yao, Y. Wang, and S.-C. Zhu
    Workshop on Application of Computer Vision (WACV), 2012

  114. Learning Reconfigurable Scene Representation by Tangram Model [pdf]
    J. Zhu, T. Wu, S.-C. Zhu, X. Yang, and W. Zhang
    Workshop on Application of Computer Vision (WACV), 2012

  115. Artistic Rendering of Portraits
    M. Zhao and S.-C. Zhu
    Book Chapter in Image and Video based Artistic Stylization, Eds. J. Collomosse and P. Rossin, Springer, 2012

  116. Hierarchical Organization by And-Or Tree
    J. Joo, S. Wang, and S.-C. Zhu
    Book Chapter in Handbook of Perceptual Organization, Eds. J. Wagemans, Springer, 2012

  117. Structure v.s. Appearance and 3D v.s. 2D? A Numeric Answer
    W. Hu, Z. Si, and S.-C. Zhu
    Book Chapter in Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective, Eds. S. Dickinson and Z. Pizlo, Springer, 2012

  118. Learning 3D Object Templates by Hierarchical Quantization of Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2012

  119. 2011

  120. A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs [pdf] [web]
    T. Wu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2011

  121. C4: Computing Multiple Solutions in Graphical Models by Cluster Sampling [pdf] [web]
    J. Porway and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2011

  122. Image Parsing via Stochastic Scene Grammar [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2011

  123. Unsupervised Learning of Stochastic And-Or Templates for Object modeling [pdf]
    Z. Si and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  124. Human Parsing using Stochastic And-Or grammar and Rich Appearance [pdf]
    B. Rothrock and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  125. Parsing Video Events with Goal inference and Intent Prediction [pdf] [web]
    M. Pei, Y. Jia, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  126. Unsupervised Learning of Event And-Or Grammar and Semantics from Video [pdf] [web]
    Z. Si, M. Pei, Z. Yao, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  127. Image Representation by Active Curves [pdf]
    W. Hu, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  128. Video Primal Sketch: A Generic Middle-Level Representation of Video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  129. Inferring Social Roles in Long Timespan Video Sequence [pdf]
    J. Zhang, W. Hu, B. Yao, Y. Wang, and S.-C. Zhu
    International Workshop on Video Event Categorization, Tagging and Retrieval for Real World Applications, 2011

  130. Customizing Painterly Rendering Styles Using Stroke Processes [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  131. Portrait Painting Using Active Templates [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  132. 2010

  133. LearningActive Basis Model for Object Detection and Recognition [pdf] [reprint]
    Y.N. Wu, Z. Si, H. Gong, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2010

  134. A Compositional and Dynamic Model for Face Aging [pdf] [web]
    J. Suo, S.-C. Zhu, S. Shan, and X. Chen
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2010

  135. Layered Graph Matching by Composite Cluster Sampling
    L. Lin, X. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2010

  136. Hierarchical and Contextual Model for Aerial Image Understanding [pdf] [web]
    J. Porway, K. Wang, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2010

  137. I2T: Image Parsing to Text Description [pdf] [web]
    Z. Yao, X. Yang, L. Lin, M. Lee, and S.-C. Zhu
    Proceedings of the IEEE (Special Issue on Internet Vision), 2010

  138. Learning Active Basis Models by em-Type Algorithms [pdf]
    Z. Si, H. Gong, S.-C. Zhu, and Y.N. Wu
    Statistical Science, 2010

  139. CO3 for Ultra-fast and Accurate Interactive Segmentation [pdf] [web]
    Y. Zhao, S.-C. Zhu, and S.W. Luo
    ACM conference on Multimedia (MM), 2010

  140. Artistic Paper-cut of Human Portraints [pdf] [web]
    M. Meng, M. Zhao, and S.-C. Zhu
    ACM conference on Multimedia (MM), 2010

  141. Sisley the Abstract Painter [pdf] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  142. Painterly Animation Using Video Semantics and Feature Correspondence [pdf] [web]
    L. Lin K. Zeng, H. Lv, Y. Wang, Y. Xu, and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  143. Learning Artistic Lighting Template from Portrait Photographs [preprint] [web]
    X. Jin, M. Zhao, X. Chen, Q. Zhao, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2010

  144. Learning a Probabilistic ModelMixing 3D and 2DPrimitives for View Invariant Object Recognition [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  145. Discovering Scene Categories by Information Projection and Cluster Sampling [pdf]
    D. Dai, T. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  146. 2009

  147. Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2009 [pdf] [reprint]

  148. From Image Parsing to Painterly Rendering [reprint]
    K. Zeng, M. Zhao, C. Xiong, and S.-C. Zhu
    ACM Trans. on Graphics (TOG), 2009

  149. Learning Explicit and Implicit Visual Manifolds by Information Projection [pdf] [reprint]
    S.-C. Zhu, K. Shi, and Z. Si
    Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009

  150. An And-or Graph Model for Face Representation, Sketching and Aging [pdf]
    F. Min, J. Suo, and S.-C. Zhu
    Book Chapter inEncyclopedia of Biometric Recognition, Springer, 2009

  151. Learning Deformable Action Templates from Cluttered Videos [pdf]
    B. Yao and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  152. Evaluating Information Contributions of Bottom-up and Top-down Processes [pdf]
    X. Yang, T. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  153. Learning Mixed Templates for Object Recognition [pdf]
    Z. Si, H. Gong, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  154. Flow Mosaicking: Real-time Pedestrian Counting without Scene-Specific Learning
    Y. Cong, H. Gong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  155. Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph [pdf]
    X. Liu, L. Lin, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  156. Layered Graph Matching by Composite Clustering with Collaborative and Competitive Interactions
    L. Lin, K. Zeng, X. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  157. Learning Compositional Models for Object Categories from Small Sample Sets [pdf]
    J. Porway, B. Yao, and S.-C. Zhu
    Book Chapter in Object Categorization: Computer and Human Vision Perspectives, Eds. Sven Dickinson et al., Cambridge University Press, 2009

  158. 2008

  159. A Composite Template for Human Face Modeling and Sketch [pdf] [reprint]
    Z. Xu, H. Chen, S.-C. Zhu, and J. Luo
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2008

  160. Perceptual Scale Space and Its Applications [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2008

  161. A Hierarchical and Contextual Model for Aerial Image Understanding [pdf]
    J. Porway, K. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2008

  162. An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry [pdf]
    W. Hu, H. Gong, S.-C. Zhu, and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2008

  163. Learning a Scene Contextual Model for Tracking and Abnormality Detection [pdf]
    B. Yao, L. Wang, and S.-C. Zhu
    International Workshop on Semantic Learning and Applications in Multimedia, 2008

  164. SAVE: A Framework for Semantic Annotation of Visual Events [pdf]
    M. Lee, A. Hakeem, N. Haering, and S.-C. Zhu
    International Workshop on Internet Vision, 2008

  165. 2007

  166. From Information Scaling of Natural Images to Regimes of Statistical Models [preprint]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Quarterly of Applied Mathematics, 2007

  167. Primal Sketch: Integrating Texture and Structure [pdf] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Image Understanding (CVIU), 2007

  168. Generalizing Swendsen-Wang for Image Analysis [long survey]
    A. Barbu and S.-C. Zhu
    Journal of Computational and Graphical Statistics, 2007

  169. A Two-Level Generative Model for Cloth Representation and Shape-From-Shading [pdf]
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2007

  170. Statistical Principles in Image Modeling [pdf]
    Y.N. Wu, J. Li. Z. Liu, and S.-C. Zhu
    Technometrics, 2007

  171. Deformable Template as Active Basis [pdf]
    Y.N. Wu, Z. Si, C. Fleming, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2007

  172. An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples [pdf]
    L. Lin, S. Peng, J. Porway, S.-C. Zhu, and Y. Wang
    International Conference on Computer Vision (ICCV), 2007

  173. Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation tool, and Benchmarks [pdf]
    Z. Yao, X. Yang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  174. Object Category Recognition using Generative Template Boosting
    S. Peng, L. Lin, J. Porway, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  175. An Automatic Portrait System Based on And-Or Graph Representation [pdf]
    F Min, J. Suo, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  176. Dynamic Feature Cascade for Multiple Object Tracking with Trackability Analysis
    Z. Li, H. Gong, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  177. Bayesian Inference for Layer Representation with Mixed Markov Random Field [pdf]
    R. Gao, T. Wu, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  178. Mapping the Ensemble of Natural Image Patches by Emplicit and Implicit Manifolds [pdf]
    K, Shi and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  179. Compositional Boosting for Computing Hierarchical Image Structures [pdf]
    T. Wu, G. Xia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  180. Layered Graph Matching with Graph Editing [pdf]
    L. Lin, S.-C. Zhu and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2007

  181. A Multi-Resolution Dynamic Model for Face Aging Simulation [pdf]
    J. Suo, F. Min, S.-C. Zhu, S. Shan, and X. Chen
    Computer Vision and Pattern Recognition (CVPR), 2007

  182. 2006

  183. Parsing Images into Regions, Curves, and Curve Groups [pdf] [reprint]
    Z. Tu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2006

  184. First-hitting-time Analysis of Independence Metropolis Sampler [pdf] [reprint] A version published at SCTV03 for Vision audience [pdf]
    R. Maciuca and S.-C. Zhu
    Journal of Theoretical Probability, 2006

  185. A Stochastic Grammar of Images [pdf] [reprint]
    S.-C. Zhu and D. Mumford
    Foundations and Trends in Computer Graphics and Vision, 2006

  186. A Genrative Sketch Model for Human Hair Analysis and Synthesis [pdf] [reprint]
    H. Chen and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2006

  187. Composite Templates for Cloth Modeling and Sketching [pdf]
    H. Chen, Z. Xu, Z. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2006

  188. 2005

  189. What are Textons? [pdf] [reprint]
    S.-C. Zhu, C. Guo, Y. Wang, and Z. Xu
    International Journal of Computer Vision (IJCV), 2005

  190. Image parsing: Unifying Segmentation, Detection and Recognition [pdf] [reprint]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Journal of Computer Vision (IJCV), 2005

  191. Generalizing Swendsen-Wangto Sampling Arbitrary Posterior Probabilities [pdf] [reprint]
    A. Barbu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2005

  192. Incorporating Visual Knowledge Representation in Stereo Reconstruction [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  193. Perceptual Scale Space and It Applications [pdf]
    Y. Z. Wang, S. Bahrami, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  194. Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar [pdf]
    F. Han and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  195. A generative model of human hair for hair sketching [pdf]
    H. Chen and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  196. A High Resolution Grammatical Model for Face Representation and Sketching [pdf]
    Z. Xu, H. Chen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  197. Cloth Representation by Shape from Shading with Shading Primitives [pdf]
    F. Han and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  198. 2004

  199. Range Image Segmentation by an Effective Jump-Diffusion Method [pdf] [reprint]
    F. Han, Z. Tu, and S.-C. Zhu,
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2004

  200. Analysis and Synthesis of Textured Motion: Particles and Waves [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2004

  201. Perceptual Scaling [pdf]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Book Chapter in Applied Bayesian Modeling and Causal Inference from an Incomplete Data Perspective, Eds. A. Gelman and X.L. Meng, John Wiley, 2004.

  202. Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs [pdf]
    Y. Wang and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  203. Information Scaling Laws in Natural Scenes [pdf]
    C. Guo, Y.N. Wu, and S.-C. Zhu
    Workshop on Generative Model Based Vision, 2004

  204. Multigrid and Multi-level Swendsen-Wang Cuts for Hierarchic Graph Partition [pdf]
    A. Barbu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  205. On the Relationship between Image and Motion Segmentation [pdf]
    A. Barbu and S.-C. Zhu
    Workshop on Spatial Coherence for Visual Motion Analysis, 2004

  206. Automatic Single View Building Reconstruction by Integrating Segmentation
    F. Han and S.-C. Zhu
    Workshop on Perceptual Organization in Computer Vision, 2004

  207. 2003

  208. Statistical Edge Detection: Learning and Evaluating Edge Cue [ps.gz] [reprint]
    S. Kinishi, A. Yuille, J. Coughlan, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2003

  209. Modeling Visual Patterns by Integrating Descriptive and Generative Models [ps.gz] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Journal of Computer Vision (IJCV), 2003

  210. Statistical Modeling and Conceptualization of Visual Patterns [pdf] [reprint]
    S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2003

  211. On Advances in Statistical Modeling of Natural Images [pdf]
    A. Srivastava, A. Lee, E. Simoncelli, and S.-C. Zhu
    Journal of Math Imaging and Vision, 2003

  212. A Mathematical Theory of Primal Sketch and Sketchability [demo] [pdf]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Conference on Computer Vision (ICCV), 2003

  213. Image Parsing: Segmentation, Detection, and Recognition [demo] [pdf]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  214. Modeling Textured Motion: Particles, Waves, and Cartoon Sketch [demo] [pdf]
    Y. Wang and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  215. Graph Partition by Swendsen-Wang Cut [demo] [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  216. A Multiscale Generative Model for Animate Shape and Parts [demo] [pdf]
    A. Dubinskiy and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  217. How do Heuristics Expedite Markov Chain Search? [demo] [pdf]
    R. Maciuca and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  218. Bayesian Reconstruction of 3D Shapes and Scenes from a Single Image [demo] [pdf]
    F. Han and S.-C. Zhu
    International Workshop on High Level Knowledge in 3D Modeling and Motion (HLK), 2003

  219. 2002

  220. Image Segmentation by Data-Driven Markov Chain Monte Carlo [ps.gz] [reprint]
    Z. Tu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2002

  221. Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?" [ps.gz] [reprint]
    S.-C. Zhu and X. Liu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2002

  222. A Generative Model for Textured Motion: Analysis and Synthesis [pdf]
    Y. Wang and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  223. Parsing Images into Region and Curve Processes [pdf]
    Z. Tu and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  224. What are Textons? [pdf]
    S.-C. Zhu, C. Guo, Y.N. Wu, and Y. Wang
    European Conference on Computer Vision (ECCV), 2002

  225. Statistical Modeling of Texture Sketch [pdf]
    Y.N. Wu, S.-C. Zhu, and C. Guo
    European Conference on Computer Vision (ECCV), 2002

  226. A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction
    F. Han, Z. Tu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002