Preprints

  1. Configurable, Photorealistic Image Rendering and Ground Truth Synthesis
    by Sampling Stochastic Grammars Representing Indoor Scenes [pdf] [web]
    C. Jiang*, Y. Zhu*, S. Qi*, H. Qi*, J. Lin, X. Guo, L. Yu, D. Terzopoulos, and S.-C. Zhu
    *Equal contributors
    under review, arXiv: 1704.00112

  2. Cooperative Training of Descriptor and Generator Networks [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    under review, arXiv: 1609.09408

  3. Exploring Generative Perspective of Convolutional Neural Networks by Learning Random Field Models [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    under review, 2016

  4. A Restricted Visual Turing Test for Deep Scene and Event Understanding [pdf] [web]
    H. Qi, T. Wu, M. Lee, and S.-C. Zhu
    under review, arXiv:1512.01715

    5. 2017

  5. Predicting Human Activities Using Stochastic Grammar [pdf] [web]
    S. Qi, S. Huang, P. Wei, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2017

  6. Monocular 3D Human Pose Estimation by Predicting Depth on Joints [pdf] [web]
    X. Nie*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  7. Jointly Recognizing Object Fluents and Tasks in Egocentric Videos [pdf] [web]
    Y. Liu*, P. Wei*, and S.-C. Zhu
    *Equal contributors
    International Conference on Computer vision (ICCV), 2017

  8. Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos [pdf] [web]
    D. Xie, T. Shu, S. Todorovic, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv: 1606.07827, 2017

  9. Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles [pdf] [web]
    M. Edmonds*, F. Gao*, X. Xie, H. Liu, S. Qi, Y. Zhu, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  10. A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing [pdf] [web]
    H. Liu*, X. Xie*, M. Millar*, M. Edmonds, F. Gao, Y. Zhu, V. J. Santos, B. Rothrock, and S.-C. Zhu
    *Equal contributors
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017

  11. Attributed And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes [pdf] [web]
    S. Park, X. Nie, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv: 1605.02112, 2017

  12. Single-Image 3D Scene Parsing Using Geometric Commonsense [pdf] [web]
    C. Yu, X. Liu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  13. Inferring Human Attention by Learning Latent Intentions [pdf] [web]
    P. Wei, X. Dan, N. Zheng, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2017

  14. Inferring Hidden Statuses and Actions in Video by Causal Reasoning [pdf] [web]
    A. Fire, and S.-C. Zhu
    CVPR Workshop on Vision Meets Cognition: Functionality, Physics, Intentionality and Causality (FPIC), 2017.

  15. CERN: Confidence-Energy Recurrent Network for Group Activity Recognition [pdf]
    T. Shu, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  16. Mining Object Parts from CNNs via Active Question-Answering [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  17. Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet [pdf] [web]
    J. Xie, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2017

  18. Generative Hierarchical Learning of Sparse FRAME Models [pdf] [web]
    J. Xie, Y. Xu, E. Nijkamp, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2017

  19. Inferring Human Interaction from Motion Trajectories in Aerial Videos [pdf][web]
    T. Shu, Y. Peng, L. Fan, H. Lu, and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  20. Consistent Probabilistic Simulation Underlying Human Judgment in Substance Dynamics [pdf] [web]
    J. Kubricht*, Y. Zhu*, C. Jiang*, D. Terzopoulos, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  21. Visuomotor Adaptation and Sensory Recalibration in Reversed Hand Movement Task [pdf] [web]
    J. Lin*, Y. Zhu*, J. Kubricht*, S.-C. Zhu, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2017

  22. Single-View 3D Scene Reconstruction and Parsing by Attributed Grammar [pdf]
    X. Liu, Y. Zhao, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), 2017

  23. Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph [pdf] [web]
    W. Li, J. Joo, H. Qi, and S.-C. Zhu
    IEEE Trans. on Multimedia, 19(2):367-381, 2017.

  24. Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions [pdf] [web]
    T. Shu, X. Gao, M. Ryoo, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2017

  25. The Martian: Examining Human Physical Judgments Across Virtual Gravity Fields [pdf] [web]
    T. Ye*, S. Qi*, J. Kubricht, Y. Zhu, H. Lu, and S.-C. Zhu
    *Equal contributors
    IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.

  26. Alternating Back-Propagation for Generator Network [pdf] [web]
    T. Han, Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  27. Cross-view People Tracking by Scene-Centered Spatio-Temporal Parsing [pdf]
    Y. Xu, X. Liu, L. Qin, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  28. Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning [pdf] [web]
    Q. Zhang, R. Cao, Y.N. Wu, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI), 2017

  29. Inferring Context through Scene Understanding [pdf]
    M. Walton, D. Lange, and S.-C. Zhu
    AAAI Conference on Artificial Intelligence (AAAI) Symposium on Computational Context, 2017

    30. 2016

  30. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    T. Wu, Y. Lu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), (Accepted), arXiv 1509.08067, 2016

  31. Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016

  32. Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation [pdf]
    T. Wu, B. Li, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016

  33. Inducing Wavelets into Random Fields via Generative Boosting [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    Applied and Computational Harmonic Analysis, 2016

  34. A Virtual Reality Platform for Dynamic Human-Scene Interaction [pdf] [web]
    J. Lin*, X. Guo*, J. Shao*, C. Jiang, Y. Zhu, and S.-C. Zhu
    *Equal contributors
    SIGGRAPH Asia, Virtual Reality Meets Physical Reality Workshop, 2016

  35. Jointly Learning Grounded Task Structures from Language Instruction and Visual Demonstration [pdf]
    C. Liu, S. Yang, S. Saba-Sadiya, N. Shukla, Y. He, S.-C. Zhu, and J. Chai
    Empirical Methods in Natural Language Processing (emNLP), 2016

  36. Inferring Human Intent from Video by Sampling Hierarchical Plans [pdf]
    S. Holtzen, Y. Zhao, T. Gao, J. Tenenbaum, and S.-C. Zhu
    IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016

  37. Integrating Function, Geometry, Appearance for Scene Parsing [pdf] [web]
    Y. Zhao and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2016

  38. A Reconfigurable Tangram Model for Scene Representation and Categorization [pdf]
    J. Zhu, T. Wu, B. Li, S.-C. Zhu, X. Yang, and W. Zhang
    IEEE Trans. on Image Processing, 2016

  39. Learning Perceptual Causality from Video [pdf]
    A. Fire and S.-C. Zhu
    ACM Trans. on Intelligent Systems and Technology (Special Issue on Causal Discovery and Inference), 2016

  40. What is Where: Inferring Containment Relations from Videos [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  41. Learning Social Affordance for Human-Robot Interaction [pdf] [web]
    T. Shu, M. Ryoo, and S.-C. Zhu
    International Joint Conference on Artificial Intelligence (IJCAI), 2016

  42. A Theory of Generative ConvNet [pdf] [web]
    J. Xie, Y. Lu, S.-C. Zhu, and Y.N. Wu
    International Conference on Machine Learning (ICML), 2016

  43. Grounded Semantic Role Labeling [pdf]
    S. Yang, Q. Gao, C. Liu, C. Xiong, S.-C. Zhu, and J. Chai
    North American Chapter of the Association for Computational Linguistics (NA-ACL), 2016

  44. Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem [pdf] [web]
    J. Kubricht*, C. Jiang*, Y. Zhu*, S.-C. Zhu, D. Terzopoulos, and H. Lu
    *Equal contributors
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  45. Critical Features of Joint Actions that Signal Human Interaction [pdf]
    T. Shu, S. Thurman, D. Chen, S.-C. Zhu, and H. Lu
    Annual Meeting of the Cognitive Science Society (CogSci), 2016

  46. Multi-view People Tracking via Hierarchical Trajectory Composition [pdf]
    Y. Xu, X. Liu, Y. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  47. Recognizing Car Fluents from Video [pdf] [web][Dataset]
    B. Li, T. Wu, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2016

  48. Inferring Forces and Learning Human Utilities from Video [pdf] [web]
    Y. Zhu*, C. Jiang*, Y. Zhao, D. terzopoulos and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2016

  49. Robot Learning with a Spatial, Temporal, and Causal And-Or Graph [pdf] [web]
    C. Xiong, N. Shukla, W. Xiong, and S.-C. Zhu
    International Conference on Robotics and Automation (ICRA), 2016

  50. Learning FRAME Models Using CNN Filters [pdf] [web]
    Y. Lu, S.-C. Zhu, and Y.N. Wu
    AAAI Conference on Artificial Intelligence (AAAI), 2016

  51. Task Learning through Visual Demonstration andSituated Dialogue [pdf]
    C. Liu, J. Chai, N. Shukla and S.C.Zhu
    AAAI Workshop on Symbiotic Cognitive Systems, 2016

    52. 2015

  52. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging [pdf] [web]
    S. Wang, Y.Z. Wang, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2015

  53. Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),2015

  54. Scene Understanding by Reasoning Stability and Safety [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2015

  55. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2015

  56. Video Primal Sketch: A Unified Middel Level Representation of video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    Journal of Mathematical Imaging and Vision, 2015

  57. Learning Sparse FRAME Models for Natural Image Patterns [pdf] [web]
    J. Xie, W. Hu, S.-C. Zhu, and Y.N. Wu
    International Journal urnal of Computer Vision (IJCV), 2015

  58. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    arXiv: 1410.0576, short version appears at EMMCVPR 2015

  59. Attributed Grammars for Joint Estimation of Human Attributes, Parts and Poses [pdf] [web]
    S. Park and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  60. Mining And-Or Graphs for Graph Matching and Object Discovery [pdf]
    Q. Zhang, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  61. Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face [pdf]
    J. Joo, F. Steen, and S.-C. Zhu
    International Conference on Computer vision (ICCV), 2015

  62. A Unified Framework for Human-Robot Knowledge Transfer
    N. Shukla, C. Xiong, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  63. Represent and Infer Human Theory of Mind for Human-Robot Interaction [pdf]
    Y. Zhao, S. Holtzen, T. Gao, and S.-C. Zhu
    AAAI Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI), 2015

  64. Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition [pdf] [web]
    Y. Zhu*, Y. Zhao*, and S.-C. Zhu
    *Equal contributors
    Computer Vision and Pattern Recognition (CVPR), 2015

  65. Joint Inference of Groups, Events and Human Roles in Aerial Videos [pdf] [web]
    T. Shu, D. Xie, B. Rothrock, S. Todorovic, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  66. Joint Action Recognition and Pose Estimation From Video [pdf]
    X. Nie, C. Xiong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2015

  67. Evaluating Human Cognition of Containing Relations with Physical Simulation [pdf] [web]
    W. Liang, Y. Zhao, Y. Zhu, and S.-C. Zhu
    Annual Cognitive Science Conference (CogSci), 2015

  68. Mapping Energy Landscapes of Non-Convex Learning Problems [pdf]
    M. Pavlovskaia, K. Tu, and S.-C. Zhu
    Energy Minimization Method for Computer Vision and Pattern Recognition (EMMCVPR), 2015

    69. 2014

  69. Learning Mixtures of Bernoulli Templates by Two-Round em with Performance Guarantee [pdf] [slides]
    A. Barbu, T. Wu, and Y.N. Wu
    Electronic Journal of Statistics (EJS), 2014

  70. Joint Video and Text Parsing for Understanding Events and Answering Queires [pdf] [web]
    K. Tu, M. Meng, M. Lee, T. Choi, and S.-C. Zhu
    IEEE MultiMedia, 2014

  71. Unsupervised Learning ofCompositional Sparse Code for Natural Image Representation [pdf] [web]
    Y. Hong, Z. Si, W. Hu, S.-C. Zhu, and Y.N. Wu
    Quarterly of Applied Mathematics, 2014

  72. Animated Pose Templates for Modeling and Detecting Human Actions
    B. Yao, B. Nie, Z. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2014 [pdf] [web]

  73. Integrating Context and Occlusion forCar Detection by Hierarchical And-Or Model [pdf] [web]
    B. Li, T. Wu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2014

  74. Visual Persuasion: Inferring the Communicative Intents of Images [pdf] [web]
    J. Joo, W. Li, F. Steen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  75. Cross-View Action Modeling, Learning and Recognition [pdf] [web]
    J. Wang, B. Nie, Y.N. Wu, and S.-C. Zhu
    of Computer Vision and Pattern Recognition (CVPR), 2014.

  76. Single-View 3D Scene Parsing by Attributed Grammar [pdf] [web]
    X. Liu, Y. Zhao, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  77. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    Y. Lu, T. Wu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2014

  78. Learning Inhomogeneous FRAME Modelsfor Object Patterns [pdf] [web]
    J. Xie. W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  79. Unsupervised Learning of Dictionaries of Hierarchical Compositional Models [pdf] [web]
    J. Dai, Y. Hong, W. Hu, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Pattern Recognition (CVPR), 2014

  80. Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    International Conference on Robotics and Automations (ICRA), 2014

    81. 2013

  81. Video Event Parsingand Learning with Goal and Intent Prediction [pdf] [web]
    M. Pei, Z. Si, B. Yao, and S.-C. Zhu
    Computer Vision and Image Understanding (CVIU), 2013

  82. Learning And-Or Templatesfor Object Modeling and Recognition [pdf] [web with data and code]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2013

  83. Abstract Painting with Interactive Control of Perceptual Entropy [pdf] [web] [reprint]
    M. Zhao and S.-C. Zhu
    ACM Trans. on Applied Perception, 2013

  84. Video Stylization: Painterly Rendering and Optimization with Content Extraction [pdf] [web]
    L. Lin, K. Zeng, Y. Wang, Y.-Q. Xu, and S.-C. Zhu
    IEEE Trans. on Circuits and Systems for Video Technology, 2013

  85. Unsupervised Structure Learning of Stochastic And-Or Grammars [pdf] [web]
    K. Tu, M. Pavlovskaia, and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2013

  86. Inferring "Dark Matter" and "Dark Energy" from Videos [pdf] [web]
    D. Xie, S. Todorovic, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  87. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf] [web]
    T. Wu and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  88. Monte Carlo Tree Search for Scheduling Activity Recognition [pdf]
    M. Amer, S. Todorovic, A. Fern, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  89. Human Attribute Recognition by Rich Appearance Dictionary [pdf] [web]
    J. Joo, S. Wang, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  90. Cosegmentation and Cosketch by Unsupervised Learning [pdf] [web]
    J. Dai, Y.N. Wu, J. Zhou, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  91. Concurrent Action Detection with Structural Prediction [pdf] [web]
    P. Wei, N. Zheng, Y. Zhao, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  92. Modeling Occlusion by Discriminative AND-OR Structures [pdf] [web]
    B. Li, W. Hu, T. Wu, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  93. Modeling 4D Human-Object Interactions for Event and Object Recognition [pdf] [web]
    P. Wei, Y. Zhao, N. Zheng, and S.-C. Zhu
    Int’l Conference on Computer Vision (ICCV), 2013

  94. Rates for Inductive Learning of Compositional Models [pdf]
    A. Barbu, M. Pavlovskaia, and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), 2013

  95. Scene Parsing by Integrating Function, Geometry and Appearance Models [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  96. Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics [pdf] [web]
    B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  97. Integrating Grammar and Segmentation forHuman Pose Estimation [pdf] [web]
    B. Rothrock, S. Park, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  98. Discriminatively Trained And-Or Tree Models for Object Detection [pdf] [web]
    X. Song, T. Wu, Y. Jia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  99. Weakly Supervised Learning for Attribute Localization in Outdoor Scenes [pdf] [web]
    S. Wang, J. Joo, Y. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2013

  100. Using Causal Induction in Humans to Learn and Infer Causality from Video [pdf] [poster]
    A. Fire and S.-C. Zhu
    Annual Meeting of the Cognitive Science Society (CogSci), 2013

  101. Learning Perceptual Causality from Video [pdf] [slides] [poster]
    A. Fire and S.-C. Zhu
    AAAI Workshop on Learning Rich Representations from Low-Level Sensors (RepLearning), Bellvue, WA, 2013

    102. 2012

  102. Intrackability: Characterizing Video Statistics and Pursuing Video Representations [pdf] [web]
    H. Gong and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2012

  103. Learning Hybrid image Template (HiT) by Information Projection [pdf] [web]
    Z. Si and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2012

  104. Background Modeling by Subspace Learning on Spatio-temporal Patches [reprint]
    Y. Zhao, H. Gong, Y. Jia, and S.-C. Zhu
    Pattern Recognition Letter, 2012

  105. Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition [pdf] [web]
    M. Amer, D. Xie, M. Zhao, S. Todorovic, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2012

  106. Hierarchical Space Tiling for Scene Modelling [pdf]
    S. Wang, Y. Wang, and S.-C. Zhu
    Asia Conference on Computer Vision (ACCV), 2012

  107. Reconfigurable Templates for Robust Vehicle Detection and Classification [pdf]
    Y. Lu, B. Yao, Y. Wang, and S.-C. Zhu
    Workshop on Application of Computer Vision (WACV), 2012

  108. Learning Reconfigurable Scene Representation by Tangram Model [pdf]
    J. Zhu, T. Wu, S.-C. Zhu, X. Yang, and W. Zhang
    Workshop on Application of Computer Vision (WACV), 2012

  109. Artistic Rendering of Portraits
    M. Zhao and S.-C. Zhu
    Book Chapter in Image and Video based Artistic Stylization, Eds. J. Collomosse and P. Rossin, Springer, 2012

  110. Hierarchical Organization by And-Or Tree
    J. Joo, S. Wang, and S.-C. Zhu
    Book Chapter in Handbook of Perceptual Organization, Eds. J. Wagemans, Springer, 2012

  111. Structure v.s. Appearance and 3D v.s. 2D? A Numeric Answer
    W. Hu, Z. Si, and S.-C. Zhu
    Book Chapter in Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective, Eds. S. Dickinson and Z. Pizlo, Springer, 2012

  112. Learning 3D Object Templates by Hierarchical Quantization of Geometry and Appearance Spaces [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2012

    113. 2011

  113. A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs [pdf] [web]
    T. Wu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2011

  114. C4: Computing Multiple Solutions in Graphical Models by Cluster Sampling [pdf] [web]
    J. Porway and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2011

  115. Image Parsing via Stochastic Scene Grammar [pdf] [web]
    Y. Zhao and S.-C. Zhu
    Neural Information Processing Systems (NIPS), 2011

  116. Unsupervised Learning of Stochastic And-Or Templates for Object modeling [pdf]
    Z. Si and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  117. Human Parsing using Stochastic And-Or grammar and Rich Appearance [pdf]
    B. Rothrock and S.-C. Zhu
    International Workshop on Stochastic Image Grammar (SIG), 2011

  118. Parsing Video Events with Goal inference and Intent Prediction [pdf] [web]
    M. Pei, Y. Jia, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  119. Unsupervised Learning of Event And-Or Grammar and Semantics from Video [pdf] [web]
    Z. Si, M. Pei, Z. Yao, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  120. Image Representation by Active Curves [pdf]
    W. Hu, Y.N. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  121. Video Primal Sketch: A Generic Middle-Level Representation of Video [pdf] [web]
    Z. Han, Z. Xu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2011

  122. Inferring Social Roles in Long Timespan Video Sequence [pdf]
    J. Zhang, W. Hu, B. Yao, Y. Wang, and S.-C. Zhu
    International Workshop on Video Event Categorization, Tagging and Retrieval for Real World Applications, 2011

  123. Customizing Painterly Rendering Styles Using Stroke Processes [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

  124. Portrait Painting Using Active Templates [preprint] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2011

    125. 2010

  125. LearningActive Basis Model for Object Detection and Recognition [pdf] [reprint]
    Y.N. Wu, Z. Si, H. Gong, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2010

  126. A Compositional and Dynamic Model for Face Aging [pdf] [web]
    J. Suo, S.-C. Zhu, S. Shan, and X. Chen
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2010

  127. Layered Graph Matching by Composite Cluster Sampling
    L. Lin, X. Liu, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2010

  128. Hierarchical and Contextual Model for Aerial Image Understanding [pdf] [web]
    J. Porway, K. Wang, and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2010

  129. I2T: Image Parsing to Text Description [pdf] [web]
    Z. Yao, X. Yang, L. Lin, M. Lee, and S.-C. Zhu
    Proceedings of the IEEE (Special Issue on Internet Vision), 2010

  130. Learning Active Basis Models by em-Type Algorithms [pdf]
    Z. Si, H. Gong, S.-C. Zhu, and Y.N. Wu
    Statistical Science, 2010

  131. CO3 for Ultra-fast and Accurate Interactive Segmentation [pdf] [web]
    Y. Zhao, S.-C. Zhu, and S.W. Luo
    ACM conference on Multimedia (MM), 2010

  132. Artistic Paper-cut of Human Portraints [pdf] [web]
    M. Meng, M. Zhao, and S.-C. Zhu
    ACM conference on Multimedia (MM), 2010

  133. Sisley the Abstract Painter [pdf] [web]
    M. Zhao and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  134. Painterly Animation Using Video Semantics and Feature Correspondence [pdf] [web]
    L. Lin K. Zeng, H. Lv, Y. Wang, Y. Xu, and S.-C. Zhu
    International Symposium on Non-Photorealistic Animation and Rendering (NPAR), 2010

  135. Learning Artistic Lighting Template from Portrait Photographs [preprint] [web]
    X. Jin, M. Zhao, X. Chen, Q. Zhao, S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2010

  136. Learning a Probabilistic ModelMixing 3D and 2DPrimitives for View Invariant Object Recognition [pdf] [web]
    W. Hu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

  137. Discovering Scene Categories by Information Projection and Cluster Sampling [pdf]
    D. Dai, T. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2010

    138. 2009

  138. Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2009 [pdf] [reprint]

  139. From Image Parsing to Painterly Rendering [reprint]
    K. Zeng, M. Zhao, C. Xiong, and S.-C. Zhu
    ACM Trans. on Graphics (TOG), 2009

  140. Learning Explicit and Implicit Visual Manifolds by Information Projection [pdf] [reprint]
    S.-C. Zhu, K. Shi, and Z. Si
    Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009

  141. An And-or Graph Model for Face Representation, Sketching and Aging [pdf]
    F. Min, J. Suo, and S.-C. Zhu
    Book Chapter inEncyclopedia of Biometric Recognition, Springer, 2009

  142. Learning Deformable Action Templates from Cluttered Videos [pdf]
    B. Yao and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  143. Evaluating Information Contributions of Bottom-up and Top-down Processes [pdf]
    X. Yang, T. Wu, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2009

  144. Learning Mixed Templates for Object Recognition [pdf]
    Z. Si, H. Gong, Y.N. Wu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  145. Flow Mosaicking: Real-time Pedestrian Counting without Scene-Specific Learning
    Y. Cong, H. Gong, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  146. Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph [pdf]
    X. Liu, L. Lin, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  147. Layered Graph Matching by Composite Clustering with Collaborative and Competitive Interactions
    L. Lin, K. Zeng, X. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2009

  148. Learning Compositional Models for Object Categories from Small Sample Sets [pdf]
    J. Porway, B. Yao, and S.-C. Zhu
    Book Chapter in Object Categorization: Computer and Human Vision Perspectives, Eds. Sven Dickinson et al., Cambridge University Press, 2009

    149. 2008

  149. A Composite Template for Human Face Modeling and Sketch [pdf] [reprint]
    Z. Xu, H. Chen, S.-C. Zhu, and J. Luo
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2008

  150. Perceptual Scale Space and Its Applications [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2008

  151. A Hierarchical and Contextual Model for Aerial Image Understanding [pdf]
    J. Porway, K. Wang, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2008

  152. An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry [pdf]
    W. Hu, H. Gong, S.-C. Zhu, and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2008

  153. Learning a Scene Contextual Model for Tracking and Abnormality Detection [pdf]
    B. Yao, L. Wang, and S.-C. Zhu
    International Workshop on Semantic Learning and Applications in Multimedia, 2008

  154. SAVE: A Framework for Semantic Annotation of Visual Events [pdf]
    M. Lee, A. Hakeem, N. Haering, and S.-C. Zhu
    International Workshop on Internet Vision, 2008

    155. 2007

  155. From Information Scaling of Natural Images to Regimes of Statistical Models [preprint]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Quarterly of Applied Mathematics, 2007

  156. Primal Sketch: Integrating Texture and Structure [pdf] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    Computer Vision and Image Understanding (CVIU), 2007

  157. Generalizing Swendsen-Wang for Image Analysis [long survey]
    A. Barbu and S.-C. Zhu
    Journal of Computational and Graphical Statistics, 2007

  158. A Two-Level Generative Model for Cloth Representation and Shape-From-Shading [pdf]
    F. Han and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2007

  159. Statistical Principles in Image Modeling [pdf]
    Y.N. Wu, J. Li. Z. Liu, and S.-C. Zhu
    Technometrics, 2007

  160. Deformable Template as Active Basis [pdf]
    Y.N. Wu, Z. Si, C. Fleming, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2007

  161. An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples [pdf]
    L. Lin, S. Peng, J. Porway, S.-C. Zhu, and Y. Wang
    International Conference on Computer Vision (ICCV), 2007

  162. Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation tool, and Benchmarks [pdf]
    Z. Yao, X. Yang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  163. Object Category Recognition using Generative Template Boosting
    S. Peng, L. Lin, J. Porway, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  164. An Automatic Portrait System Based on And-Or Graph Representation [pdf]
    F Min, J. Suo, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  165. Dynamic Feature Cascade for Multiple Object Tracking with Trackability Analysis
    Z. Li, H. Gong, S.-C. Zhu, and N. Sang
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  166. Bayesian Inference for Layer Representation with Mixed Markov Random Field [pdf]
    R. Gao, T. Wu, N. Sang, and S.-C. Zhu
    International Conference on Energy Minimization Methods in CVPR (EMMCVPR), 2007

  167. Mapping the Ensemble of Natural Image Patches by Emplicit and Implicit Manifolds [pdf]
    K, Shi and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  168. Compositional Boosting for Computing Hierarchical Image Structures [pdf]
    T. Wu, G. Xia, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2007

  169. Layered Graph Matching with Graph Editing [pdf]
    L. Lin, S.-C. Zhu and Y. Wang
    Computer Vision and Pattern Recognition (CVPR), 2007

  170. A Multi-Resolution Dynamic Model for Face Aging Simulation [pdf]
    J. Suo, F. Min, S.-C. Zhu, S. Shan, and X. Chen
    Computer Vision and Pattern Recognition (CVPR), 2007

    171. 2006

  171. Parsing Images into Regions, Curves, and Curve Groups [pdf] [reprint]
    Z. Tu and S.-C. Zhu
    International Journal urnal of Computer Vision (IJCV), 2006

  172. First-hitting-time Analysis of Independence Metropolis Sampler [pdf] [reprint] A version published at SCTV03 for Vision audience [pdf]
    R. Maciuca and S.-C. Zhu
    Journal of Theoretical Probability, 2006

  173. A Stochastic Grammar of Images [pdf] [reprint]
    S.-C. Zhu and D. Mumford
    Foundations and Trends in Computer Graphics and Vision, 2006

  174. A Genrative Sketch Model for Human Hair Analysis and Synthesis [pdf] [reprint]
    H. Chen and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2006

  175. Composite Templates for Cloth Modeling and Sketching [pdf]
    H. Chen, Z. Xu, Z. Liu, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2006

    176. 2005

  176. What are Textons? [pdf] [reprint]
    S.-C. Zhu, C. Guo, Y. Wang, and Z. Xu
    International Journal of Computer Vision (IJCV), 2005

  177. Image parsing: Unifying Segmentation, Detection and Recognition [pdf] [reprint]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Journal of Computer Vision (IJCV), 2005

  178. Generalizing Swendsen-Wangto Sampling Arbitrary Posterior Probabilities [pdf] [reprint]
    A. Barbu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2005

  179. Incorporating Visual Knowledge Representation in Stereo Reconstruction [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  180. Perceptual Scale Space and It Applications [pdf]
    Y. Z. Wang, S. Bahrami, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  181. Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar [pdf]
    F. Han and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2005

  182. A generative model of human hair for hair sketching [pdf]
    H. Chen and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  183. A High Resolution Grammatical Model for Face Representation and Sketching [pdf]
    Z. Xu, H. Chen, and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

  184. Cloth Representation by Shape from Shading with Shading Primitives [pdf]
    F. Han and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2005

    185. 2004

  185. Range Image Segmentation by an Effective Jump-Diffusion Method [pdf] [reprint]
    F. Han, Z. Tu, and S.-C. Zhu,
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2004

  186. Analysis and Synthesis of Textured Motion: Particles and Waves [pdf] [reprint]
    Y. Wang and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2004

  187. Perceptual Scaling [pdf]
    Y.N. Wu, C. Guo, and S.-C. Zhu
    Book Chapter in Applied Bayesian Modeling and Causal Inference from an Incomplete Data Perspective, Eds. A. Gelman and X.L. Meng, John Wiley, 2004.

  188. Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs [pdf]
    Y. Wang and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  189. Information Scaling Laws in Natural Scenes [pdf]
    C. Guo, Y.N. Wu, and S.-C. Zhu
    Workshop on Generative Model Based Vision, 2004

  190. Multigrid and Multi-level Swendsen-Wang Cuts for Hierarchic Graph Partition [pdf]
    A. Barbu and S.-C. Zhu
    Computer Vision and Pattern Recognition (CVPR), 2004

  191. On the Relationship between Image and Motion Segmentation [pdf]
    A. Barbu and S.-C. Zhu
    Workshop on Spatial Coherence for Visual Motion Analysis, 2004

  192. Automatic Single View Building Reconstruction by Integrating Segmentation
    F. Han and S.-C. Zhu
    Workshop on Perceptual Organization in Computer Vision, 2004

    193. 2003

  193. Statistical Edge Detection: Learning and Evaluating Edge Cue [ps.gz] [reprint]
    S. Kinishi, A. Yuille, J. Coughlan, and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2003

  194. Modeling Visual Patterns by Integrating Descriptive and Generative Models [ps.gz] [reprint]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Journal of Computer Vision (IJCV), 2003

  195. Statistical Modeling and Conceptualization of Visual Patterns [pdf] [reprint]
    S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2003

  196. On Advances in Statistical Modeling of Natural Images [pdf]
    A. Srivastava, A. Lee, E. Simoncelli, and S.-C. Zhu
    Journal of Math Imaging and Vision, 2003

  197. A Mathematical Theory of Primal Sketch and Sketchability [demo] [pdf]
    C. Guo, S.-C. Zhu, and Y.N. Wu
    International Conference on Computer Vision (ICCV), 2003

  198. Image Parsing: Segmentation, Detection, and Recognition [demo] [pdf]
    Z. Tu, X. Chen, A. Yuille, and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  199. Modeling Textured Motion: Particles, Waves, and Cartoon Sketch [demo] [pdf]
    Y. Wang and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  200. Graph Partition by Swendsen-Wang Cut [demo] [pdf]
    A. Barbu and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  201. A Multiscale Generative Model for Animate Shape and Parts [demo] [pdf]
    A. Dubinskiy and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  202. How do Heuristics Expedite Markov Chain Search? [demo] [pdf]
    R. Maciuca and S.-C. Zhu
    International Conference on Computer Vision (ICCV), 2003

  203. Bayesian Reconstruction of 3D Shapes and Scenes from a Single Image [demo] [pdf]
    F. Han and S.-C. Zhu
    International Workshop on High Level Knowledge in 3D Modeling and Motion (HLK), 2003

    204. 2002

  204. Image Segmentation by Data-Driven Markov Chain Monte Carlo [ps.gz] [reprint]
    Z. Tu and S.-C. Zhu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2002

  205. Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?" [ps.gz] [reprint]
    S.-C. Zhu and X. Liu
    IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2002

  206. A Generative Model for Textured Motion: Analysis and Synthesis [pdf]
    Y. Wang and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  207. Parsing Images into Region and Curve Processes [pdf]
    Z. Tu and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002

  208. What are Textons? [pdf]
    S.-C. Zhu, C. Guo, Y.N. Wu, and Y. Wang
    European Conference on Computer Vision (ECCV), 2002

  209. Statistical Modeling of Texture Sketch [pdf]
    Y.N. Wu, S.-C. Zhu, and C. Guo
    European Conference on Computer Vision (ECCV), 2002

  210. A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction
    F. Han, Z. Tu, and S.-C. Zhu
    European Conference on Computer Vision (ECCV), 2002