PKU CoRe Lab
PKU CoRe Lab
Home
People
Research
Themes
Publications
Downloads
Videos
Talks
Communication
[AIR22] Artificial Social Intelligence: A Comparative and Holistic View
In addition to a physical comprehension of the world, humans possess a high social intelligence–the intelligence that senses …
Lifeng Fan
,
Manjie Xu
,
Zhihao Cao
,
Yixin Zhu
,
Song-Chun Zhu
PDF
Cite
中国科学报/科学网1
中国科学报/科学网2
北大新闻网
北大AI院官网
北大科研官微
北大新工科官微
北大AI院官微
[ICLR23] Understanding Embodied Reference with Touch-Line Transformer
We study embodied reference understanding, the task of locating referents using embodied gestural signals and language references. …
Yang Li
,
Xiaoxue Chen
,
Hao Zhao
,
Jiangtao Gong
,
Guyue Zhou
,
Federico Rossano
,
Yixin Zhu
PDF
Cite
Code
Poster
Video
Web
北大新闻网
北大AI院官网
北大新工科官微
北大AI院官微
Interactive Reasoning
[Robotics meets Cognition]
Topics include communication, manipulation, TAMP, teaming, UAV, VR, and XAI.
Zihang Zhao
,
Yuyang Li
,
Yida Niu
Aug 1, 2022
[ScienceRobotics22] In situ bidirectional human-robot value alignment
A prerequisite for social coordination is bidirectional communication between teammates, each playing two roles simultaneously: as …
Luyao Yuan
,
Xiaofeng Gao
,
Zilong Zheng
,
Mark Edmonds
,
Ying Nian Wu
,
Federico Rossano
,
Hongjing Lu
,
Yixin Zhu
,
Song-Chun Zhu
PDF
Cite
Background & Summary in Layperson Language
Code & Data
Movie S1 & S2
MDAR Reproducibility Checklist
Supp PDF
Invited Talk at DeepMind
新华社
CGTN
科技日报/新华网
中国科学报/科学网
北大新闻网
北大AI院官网
北大AI院官微
TechXplore
[CogSci22] What Is the Point? A Theory of Mind Model of Relevance
Although pointing is sparse, overloaded, and indirect, it allows humans to effectively decode shared information, (ex)change their …
Kaiwen Jiang
,
Annya Dahmani
,
Stephanie Stacy
,
Boxuan Jiang
,
Federico Rossano
,
Yixin Zhu
,
Tao Gao
PDF
Cite
[ICCV21] YouRefIt: Embodied Reference Understanding with Language and Gesture
We study the machine’s understanding of embodied reference: One agent uses both language and gesture to refer to an object to …
Yixin Chen
,
Qing Li
,
Deqian Kong
,
Yik Lun Kei
,
Song-Chun Zhu
,
Tao Gao
,
Yixin Zhu
,
Siyuan Huang
PDF
Cite
Code
Dataset
Poster
Video
Supp
Web
[IROS21] Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene
Human-robot collaboration is an essential research topic in artificial intelligence (AI), enabling researchers to devise cognitive AI …
Qi Wu
,
Cheng-Ju Wu
,
Yixin Zhu
,
Jungseock Joo
PDF
Cite
Code
Web
[CogSci21] Individual vs. Joint Perception: a Pragmatic Model of Pointing as Communicative Smithian Helping
The simple gesture of pointing can greatly augment one’s ability to comprehend states of the world based on observations. It …
Kaiwen Jiang
,
Stephanie Stacy
,
Chuyu Wei
,
Adelpha Chan
,
Federico Rossano
,
Yixin Zhu
,
Tao Gao
PDF
Cite
[ACL-Findings21] GRICE: A Grammar-based Dataset for Recovering Implicature and Conversational rEasoning
Understanding what we genuinely mean instead of what we literally say in conversations is challenging for both humans and machines; …
Zilong Zheng
,
Shuwen Qiu
,
Lifeng Fan
,
Yixin Zhu
,
Song-Chun Zhu
PDF
Cite
Web
[CVPR21] Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Humans possess a unique social cognition capability; nonverbal communication can convey rich social information among agents. In …
Lifeng Fan
,
Shuwen Qiu
,
Zilong Zheng
,
Tao Gao
,
Song-Chun Zhu
,
Yixin Zhu
PDF
Cite
Code
Dataset
Video
Supp
Cite
×