Spatio-temporal reasoning for traffic scene understanding

Publication Date: 
Thursday, 25 August, 2011
Published in: 
7th IEEE International Conference on Intelligent Computer Communication and Processing (ICCP 2011)
Raluca Brehar, Carolina Fortuna, Silviu Bota, Dunja Mladenic, Sergiu Nedevschi

This paper was published in the Proceedings of the 2011 IEEE 7th International Conference on Intelligent Computer Communication and Processing (ICCP 2011), August 25 - 27, 2011 in Cluj-Napoca, Romania.


In this paper we introduce a system for semantic understanding of traffic scenes. The system detects objects in video images captured in real vehicular traffic situations, classifies them, maps them to the OpenCyc1 ontology and finally generates descriptions of the traffic scene in CycL or cvasi-natural language. We employ meta-classification methods based on AdaBoost and Random forest algorithms for identifying interest objects like: cars, pedestrians, poles in traffic and we derive a set of annotations for each traffic scene. These annotations are mapped to OpenCyc concepts and predicates, spatiotemporal rules for object classification and scene understanding are then asserted in the knowledge base. Finally, we show that the system performs well in understanding traffic scene situations and summarizing them. The novelty of the approach resides in the combination of stereo-based object detection and recognition methods with logic based spatio-temporal reasoning.

PDF icon brehar_iccp11s72.pdf732.56 KB