Object-Based Goal Recognition Using Real-World Data

Roger Granada* (Corresponding Author), Juarez Monteiro* (Corresponding Author), Nathan Gavenski* (Corresponding Author), Felipe Meneguzzi* (Corresponding Author)

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingPublished conference contribution

4 Citations (Scopus)


Goal and plan recognition of daily living activities has attracted much interest due to its applicability to ambient assisted living. Such applications require the automatic recognition of high-level activities based on multiple steps performed by human beings in an environment. In this work, we address the problem of plan and goal recognition of human activities in an indoor environment. Unlike existing approaches that use only actions to identify the goal, we use objects and their relations to identify the plan and goal towards which the subject in the video is pursuing. Our approach combines state-of-the-art object and relationship detection to analyze raw video data with a goal recognition algorithm to identify the subject’s ultimate goal in the video. Experiments show that our approach identifies cooking activities in a kitchen scenario.
Original languageEnglish
Title of host publicationAdvances in Soft Computing
Subtitle of host publication19th Mexican International Conference on Artificial Intelligence, MICAI 2020 Mexico Cit, Mexico, October 12-17, 2020 Proceedings, Part 1
EditorsLourdes Martínez-Villaseñor, Oscar Herrera-Alcántara, Hiram Ponce, Félix A. Castro-Espinoza
Place of PublicationCham, Switzerland
Number of pages13
ISBN (Electronic)978-3-030-60884-2
ISBN (Print)978-3-030-60883-5
Publication statusPublished - 7 Oct 2020
Event19th Mexican International Conference on Artificial Intelligence - Mexico City, Mexico
Duration: 12 Oct 202017 Oct 2020

Publication series

NameLecture Notes in Artificial Intelligence
ISSN (Print)2945-9133
ISSN (Electronic)2945-9141


Conference19th Mexican International Conference on Artificial Intelligence
Abbreviated titleMICAI 2020
CityMexico City
Internet address


  • goal recognition
  • relationship detection
  • object detection


Dive into the research topics of 'Object-Based Goal Recognition Using Real-World Data'. Together they form a unique fingerprint.

Cite this