Semantics and multimedia: An introduction to symbolic artificial intelligence applied to multimedia

Abstract

This short course is an introduction to symbolic artificial intelligence (AI) applied to multimedia. We assume no previous knowledge of AI and only basic knowledge of multimedia. The short course is divided into three parts. In the first part, we present general notions of AI and discuss the challenges involved in the construction of intelligent multimedia applications, that is, applications enriched with the capacity for semantic query, reasoning, and recommendation. In the second part, we detail the main technologies for symbolic AI and discuss their application to multimedia. In particular, we present the ontology languages RDF(S) and OWL, the description logics (DLs) which give these languages a formal basis, the SPARQL query language, and the vocabularies and extensions that allow us to apply these technologies to multimedia data. In the third and last part, we discuss the Hyperknowledge model: a hybrid model for the representation of knowledge and content. The Hyperknowledge model extends the NCM model, a classic hypermedia model, with the notion of semantic links, which allow for the integrated representation of multimedia content together with its semantic description.