Real-time 3D Camera Tracking for Industrial Augmented Reality Applications

Bleser, G., Pastarmov Y., Stricker, D.

Abstract:
In this paper we present a new solution for real-time 3D camera pose estimation for Augmented Reality (AR) applications. The tracking system does not require special engineering of the environment, such as placing mark-ers or beacons. The required input data are a CAD model of the target object to be tracked, and a calibrated ref-erence image of it. We consider the whole process of camera tracking, and developed both an autonomous ini-tialization and a real-time tracking procedure. The system is robust to abrupt camera motions, strong changes of the lighting conditions and partial occlusions. To avoid typical jitter and drift problems the tracker performs fea-ture matching not only in an iterative manner, but also against stable reference features, which are dynamically cached in case of high confidence. We present experimental results generated with help of synthetic ground truth, real off-line and on-line image sequences using different types of target objects.