Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following
- Mingyu Ding
- Yan Xu
- et al.
- 2022
- CORL 2022
Bio
I am a researcher at MIT-IBM Watson AI Lab in Cambridge, MA, USA. I received my Ph.D. degree from the Department of Computer Science at The University of Hong Kong. My interests are centered around machine learning and its applications to computer vision and natural language processing. My ultimate research goal is to develop an AI system that can perceive and reason about the physical world, and communicate with humans in natural language.
Publications
S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint
- Wenqi Yang
- Guanying Chen
- et al.
- 2022
- NeurIPS 2022
A UNIFIED FRAMEWORK FOR MASKED AND MASK-FREE FACE RECOGNITION VIA FEATURE RECTIFICATION
- Shaozhe Hao
- Chaofeng Chen
- et al.
- 2022
- ICIP 2022
ComPhy: Compositional Physical Reasoning of Objects and Events from Videos
- Zhenfang Chen
- Kexin Yi
- et al.
- 2022
- ICLR 2022
Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language
- Mingyu Ding
- Zhenfang Chen
- et al.
- 2021
- NeurIPS 2021
STAR: A Benchmark for Situated Reasoning in Real-World Videos
- Bo Wu
- Shoubin Yu
- et al.
- 2021
- NeurIPS 2021
Grounding Physical Object and Event Concepts Through Dynamic Visual Reasoning
- Zhenfang Chen
- Jiayuan Mao
- et al.
- 2021
- ICLR 2021
Patents
Projects
Dromedary
Training language models to better follow user intentions and make them more truthful
Top collaborators
YS
Yikang Shen
Staff Research Scientist, LLM
DC
David D. Cox
VP, AI Models; IBM Director, MIT-IBM Watson AI Lab
DG
Dan Gutfreund
Principal Research Staff Member, Manager, AI Models Science