On the use of commonsense ontology for multimedia event recounting

Publication Type

Journal Article

Publication Date

6-2016

Abstract

Textually narrating the observed evidences relevant to the reasons why a video clip is being retrieved for an event is still a highly challenging problem. This paper explores the use of a commonsense ontology, namely ConceptNet, in generating short descriptions for recounting the audio-visual evidences. The ontology is exploited as a knowledge engine to provide event-relevant common sense, which is expressed in terms of concepts and their relationships, for semantics understanding, context-based concept screening and sentence synthesis. A principal way of exploiting the ontology, from extracting the event-relevant semantic network to the formation of syntactic parse trees, is outlined and discussed. Experimental results on two benchmark datasets (TRECVID MED and MediaEval) show the effectiveness of our approach. The findings show insights on the usability of common sense for multimedia search, including the feasibility of inferring relevant concepts for event detection, as well as the quality of textual sentences in meeting human expectation.

Keywords

Event detection, Event recounting, Ontology

Discipline

Computer Sciences | Graphics and Human Computer Interfaces

Research Areas

Intelligent Systems and Optimization

Publication

International Journal of Multimedia Information Retrieval

Volume

5

Issue

2

First Page

73

Last Page

88

ISSN

2192-6611

Identifier

10.1007/s13735-015-0090-3

Publisher

Springer Link

This document is currently not available here.

Share

COinS