AI: Commonsense Reasoning, Multi-agent System, VR/AR Task Platforms

 

Cognition: Functionality, Physics, Intentionality, Causality, Value

A Massively Parallel and Scalable Multi-GPU Material Point Method

Xinlei Wang*, Yuxing Qiu*, Stuart R. Slattery, Yu Fang, Minchen Li, Song-Chun Zhu, Yixin Zhu, Min Tang, Dinesh Manocha, and Hongjing Lu
*Equal contributors

Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs

Tao Yuan, Hangxin Liu, Lifeng Fan, Zilong Zheng, Tao Gao, Yixin Zhu, and Song-Chun Zhu

Human Causal Transfer: Challenges for Deep Reinforcement Learning

Mark Edmonds*, James Kubricht*, Colin Summers, Yixin Zhu, Brandon Rothrock, Song-Chun Zhu, and Hongjing Lu
*Equal first author

Spatially Perturbed Collision Sounds Attenuate Perceived Causality in 3D Launching Events

James Kubricht*, Yixin Zhu*, Wei Liang, Song-Chun Zhu, Chenfanfu Jiang, and Hongjing Lu
*Equal first author

Probabilistic Simulation Predicts Human Performance on Viscous Fluid-Pouring Problem

James Kubricht*, Chenfanfu Jiang*, Yixin Zhu*, Song-Chun Zhu, Demetri Terzopoulos, and Hongjing Lu
*Equal first author

Evaluating Human Cognition of Containing Relations with Physical Simulation

Wei Liang, Yibiao Zhao, Yixin Zhu, and Song-Chun Zhu

Detecting Potential Falling Objects by Inferring Human Action and Natural Disturbance

Bo Zheng*, Yibiao Zhao*, Joey C. Yu, Katsushi Ikeuchi, and Song-Chun Zhu
(*equal contribution)

Scene Parsing by Integrating Function, Geometry and Appearance Models

Yibiao Zhao, and Song-Chun Zhu

Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics

Bo Zheng, Yibiao Zhao, Joey C. Yu, Katsushi Ikeuchi, and Song-Chun Zhu

 

Robotics: Task and Motion Planning, Robot Perception, Sensoring

Efficient Task Planning for Mobile Manipulation: a Virtual Kinematic Chain Perspective

Ziyuan Jiao*, Zeyu Zhang*, Weiqi Wang, David Han, Song-Chun Zhu Yixin Zhu, and Hangxin Liu,
*Equal contributors

Human-Robot Interaction in a Shared Augmented Reality Workspace

Shuwen Qiu*, Hangxin Liu*, Zeyu Zhang, Yixin Zhu, and Song-Chun Zhu
*Equal contributors

Learning Virtual Grasp with Failed Demonstrations via Bayesian Inverse Reinforcement Learning

Xu Xie, Changyang Li, Chi Zhang, Yixin Zhu, and Song-Chun Zhu

Self-Supervised Incremental Learning for Sound Source Localization in Complex Indoor Environment

Hangxin Liu*, Zeyu Zhang*, Yixin Zhu, and Song-Chun Zhu
*Equal contributors

Interactive Robot Knowledge Patching using Augmented Reality

Hangxin Liu*, Yaofang Zhang*, Wenwen Si, Xu Xie, Yixin Zhu, and Song-Chun Zhu
*Equal contributors

Feeling the Force: Integrating Force and Pose for Fluent Discovery through Imitation Learning to Open Medicine Bottles

Mark Edmonds*, Feng Gao*, Xu Xie, Hangxin Liu, Siyuan Qi, Yixin Zhu, Brandon Rothrock, and Song-Chun Zhu
*Equal contributors

Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions

Tianmin Shu, Xiaofeng Gao, Michael S. Ryoo, and Song-Chun Zhu

Robot Learning with a Spatial, Temporal, and Causal And-Or Graph

Caiming Xiong, Nishant Shukla, Wenlong Xiong, and Song-Chun Zhu

Robot Learning from Demonstration on a Unified Representation

Caiming Xiong, Nishant Shukla, Pablo Garcia Kilroy, Mun Wai Lee, and Song-Chun Zhu

Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations

Ziyuan Jiao*, Zeyu Zhang*, Xin Jiang, David Han, Song-Chun Zhu Yixin Zhu, and Hangxin Liu,
*Equal contributors

Graph-based Hierarchical Knowledge Representation for Robot Task Transfer from Virtual to Physical World
Zhenliang Zhang, Yixin Zhu, and Song-Chun Zhu
A tale of two explanations: Enhancing human trust by explaining robot behavior
Mark Edmonds*, Feng Gao*, Hangxin Liu*, Xu Xie*, Siyuan Qi, Brandon Rothrock, Yixin Zhu, Ying Nian Wu, Hongjing Lu, and Song-Chun Zhu
*Equal contributors
Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs

Tao Yuan, Hangxin Liu, Lifeng Fan, Zilong Zheng, Tao Gao, Yixin Zhu, and Song-Chun Zhu

Congestion-aware Evacuation Routing using Augmented Reality Devices

Zeyu Zhang, Hangxin Liu, Ziyuan Jiao, Yixin Zhu, and Song-Chun Zhu

High-Fidelity Grasping in Virtual Reality using a Glove-based System

Hangxin Liu*, Zhenliang Zhang*, Xu Xie, Yixin Zhu, Yue Liu, Yongtian Wang, and Song-Chun Zhu
*Equal contributors

Mirroring without Overimitation: Learning Functionally Equivalent Manipulation Actions

Hangxin Liu, Chi Zhang, Yixin Zhu, and Song-Chun Zhu

Unsupervised Learning using Hierarchical Models for Hand-Object Interactions

Xu Xie*, Hangxin Liu*, Mark Edmonds, Feng Gao, Siyuan Qi, Yixin Zhu, Brandon Rothrock, and Song-Chun Zhu
*Equal contributors

A Glove-based System for Studying Hand-Object Manipulation via Joint Pose and Force Sensing

Hangxin Liu*, Xu Xie*, Matt Millar*, Mark Edmonds, Feng Gao, Yixin Zhu, Veronica Santos, Brandon Rothrock, and Song-Chun Zhu
*Equal contributors

 

Vision: Parsing Objects, Scenes and Events

PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points
Siyuan Huang, Yixin Chen, Tao Yuan Siyuan Qi, Yixin Zhu, and Song-Chun Zhu
Hoilistc++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commensense
Yixin Chen*, Siyuan Huang*, Tao Yuan Siyuan Qi, Yixin Zhu, and Song-Chun Zhu
Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation
Siyuan Huang, Siyuan Qi, Yinxue Xiao, Yixin Zhu, Ying Nian Wu,and Song-Chun Zhu
Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image
Siyuan Huang, Siyuan Qi, Yixin Zhu, Yinxue Xiao, Yuanlu Xu,and Song-Chun Zhu
*Equal contributors
Tracking Occluded Objects and Recovering Incomplete Trajectories by Reasoning about Containment Relations and Human Actions
Wei Liang, Yixin Zhu, and Song-Chun Zhu
What is Where: Inferring Containment Relations from Videos
Wei Liang, Yibiao Zhao, Yixin Zhu, and Song-Chun Zhu
Mining And-Or Graphs for Graph Matching and Object Discovery

Quanshi Zhang, Ying Nian Wu, and Song-Chun Zhu

Learning Near-Optimal Cost-Sensitive Decision Policies for Object Detection

Tianfu Wu, and Song-Chun Zhu

Concurrent Action Detection with Structural Prediction
Modeling 4D Human-Object Interactions for Event and Object Recognition

Ping Wei, Yibiao Zhao, Nanning Zheng, and Song-Chun Zhu

Discriminatively Trained And-Or Tree Models for Object Detection

Xi Song, Tianfu Wu, Yunde Jia, and Song-Chun Zhu

Weakly Supervised Learning for Attribute Localization in Outdoor Scenes

Shuo Wang, Jungseock Joo, Yizhou Wang, and Song-Chun Zhu

Cost-Sensitive Top-down/Bottom-up Inference for Multiscale Activity Recognition

Mohamed R. Amer, Dan Xie, Mingtian Zhao, Sinisa Todorovic, and Song-Chun Zhu

Human Parsing using Stochastic And-Or Grammars and Rich Appearances

Brandon Rothrock, and Song-Chun Zhu

LEMMA: A Multi-view Dataset for LEarning Multi-agent Multi-task Activities

Baoxiong Jia, Yixin Chen, Siyuan Huang, Yixin Zhu, and Song-Chun Zhu

Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs

Tao Yuan, Hangxin Liu, Lifeng Fan, Zilong Zheng, Tao Gao, Yixin Zhu, and Song-Chun Zhu

Configurable, Photorealistic Image Rendering and Ground Truth Synthesis by Sampling Stochastic Grammars Representing Indoor Scenes
Chenfanfu Jiang*, Yixin Zhu*, Siyuan Qi*, Siyuan Huang*, Lap-Fai Yu, Demetri Terzopoulos, and Song-Chun Zhu
*Equal contributors
Inferring Hidden Statuses and Actions
in Video by Causal Reasoning
Amy Fire, and Song-Chun Zhu

Joint Inference of Groups, Events and Human Roles in Aerial Videos

Tianmin Shu, Dan Xie, Brandon Rothrock, Sinisa Todorovic, and Song-Chun Zhu

Cosegmentation and Cosketch by Unsupervised Learning

Jifeng Dai, Ying Nian Wu, Jie Zhou, and Song-Chun Zhu

Human Attribute Recognition By Rich Appearance Dictionary

Jungseock Joo, Shuo Wang, and Song-Chun Zhu

Bottom-up / Top-down Inference Processes -- a Numerical Answer

Tianfu Wu, and Song-Chun Zhu

Image Parsing via Stochastic Scene Grammar

Yibiao Zhao, and Song-Chun Zhu

Video Primal Sketch

Z. Han, Z. Xu, and S.-C. Zhu

A Dynamic Model for Face Aging Simulation

Jinli Suo, Song-Chun Zhu, Shiguang Shan, and Xilin Chen

A Hierarchical and Contextual Model for Aerial Image Parsing

Jacob Porway, Qiongchen Wang, and Song-Chun Zhu

Restricted Visual Turing Test for Deep Scene and Event Understanding

Hang Qi, Tianfu Wu, Mun Wai Lee, and Song-Chun Zhu

 

Language: Joint Parsing, Grounding, Alignment, Communication

 

Learning: Statistics, Causality, Utility