마커 소형화와 손가락 터치를 이용한 증강현실 감각형 상호작용 방안

Abstract

Nowadays computer-vision based augmented reality (AR) have been widely adopted in various academic and industrial fields including advertising, education, and product development. Marker tracking is the core part of AR because it significantly affects the quality of interaction and immersion in AR applications. Among various AR interaction approaches, a tangible interaction approach to using two types (product-type and pointer-type) of simple objects for design evaluation has earned great interest in recent years. In most AR interaction approaches, the sizes of markers attached to tangible objects are kept as big as possible to obtain better marker tracking. Thus, we encounter inconvenient situations in which the pointer-type object is so big that it significantly occlude the product-type object in an AR environment. This deteriorates natural visualization and level of immersion in the environment. In this thesis, in order to overcome such problems, we propose tangible AR interaction using fingertip touch combined with small-sized markers. The proposed approach is based on improved marker tracking by facilitating the use of convex polygons and reducing the sizes of AR markers without sacrificing the quality of marker detection. First, we find polygons from the real world image and use their convex polygons to obtain minimum-area rectangles in which AR markers are enclosed. This makes the proposed approach is more robust than ARToolKit which just finds rectangles for marker detection. Second, we properly enlarge the pattern area of each AR marker and use it for marker recognition. Compared with ARToolKit using 25% of the marker as the pattern area, this produces better quality. We empirically verified the quality of the proposed interaction approach, and applied the proposed approach in the process of design evaluation of digital products. From experimental results, we found that the approach is comparably accurate enough to be applied to the design evaluation process and tangible enough to provide a pseudo feeling of manipulating virtual products with human hands.