Publication Type

Conference Proceeding Article

Version

acceptedVersion

Publication Date

8-2019

Abstract

Existing robotic systems can take actions based on natural language commands but they tend to be only simple commands. On the other hand, in the domain of Natural Language Processing (NLP), complex sentences are processed, but this NLP domain does not make close contact with robotics. The beginning of computer processing of natural language, when traced back to a system such as Winograd’s SHRUDLU, conceived in 1973, actually aimed to address the issues of Natural Language Understanding (NLU) of relatively complex sentences by a robotic system which in turn takes actions accordingly based on the natural language input. NLU, in the robotic context, thus constitutes taking the correct actions from language instructions. This paper explores the use of cognitive linguistic constructs as well as other constructs such as spatial relationship constructs to configure an NLU system for translating complex natural language instructions into actions to be taken by a robot. This research work illustrates that two important steps are necessary: the first step is to translate a language-dependent surface sentential structure into a language independent deep-level predicate representation, and then the next step is to translate the predicate representation into grounded real-world references and constructs that enable a robot to carry out the language instructions accordingly.

Keywords

Complex sentence understanding, Grounding, Language and robotics, Natural language understanding, Predicate meaning representation, Predicate to referent grounding, Robotics, Semantic grounding

Discipline

Artificial Intelligence and Robotics

Research Areas

Intelligent Systems and Optimization

Publication

Intelligent Robotics and Applications: 12th International Conference, ICIRA 2019, Shenyang, China, August 8-11: Proceedings

Volume

11745

First Page

641

Last Page

654

ISBN

9783030275280

Identifier

10.1007/978-3-030-27529-7_54

Publisher

Springer

City or Country

Cham

Additional URL

https://doi.org/10.1007/978-3-030-27529-7_54

Download

Share

COinS