Office of Naval Research

Understanding Scenes and Events through
Joint Parsing, Cognitive Reasoning and Lifelong Learning

The goal of this MURI team is to develop machines that have the following capabilities:

We have assembled a multi-disciplinary team from the US and UK, including experts inexperimental psychology and cognition, computer vision and learning, Cognitive and mathematical modeling. We take a multi-disciplinary approach that integrates four areas:

The four areas will be studied in tight loops. Human experiments bring new paradigms to transform computer vision and machine learning; and the latter drive human experiments to probe the brain mechanisms for representation, inference and learning. Each area consists of a spectrum of tasks which we organize in three levels of increasing depth and complexity: (i) Categorical recognition; (ii) joint parsing; (iii) Cognitive reasoning.


This work is supported by the Office of Naval Research grant ONR MURI N00014-16-1-2007