Mixed reality system, program, portable terminal device, and method

Abstract

An object of the present invention is to provide a mixed reality system that enables a user to experience an MR corresponding to a relatively wide space such as an outdoor space. The present invention includes a portable terminal device having a display for displaying a virtual object to a user in a predetermined real space and a photographing device for photographing the real space, and a mixed reality image is displayed on the display. A mixed reality system for displaying, wherein the mixed reality system includes a plurality of feature point sets arranged in a predetermined real space, and the mobile terminal device outputs each of the feature point sets captured by the imaging device. Recognizing, based on the arrangement position / posture information of each of the feature point sets and the relative position / posture information of the portable terminal device with respect to each of the feature point sets, a virtual space corresponding to the position and the photographing direction of the photographing device in the real space. A viewpoint position of the virtual camera is determined, and a mixed reality image is generated by superimposing an image of a virtual object corresponding to the viewpoint position on a captured image in the real space. [Selection diagram] Fig. 1

Full Text: Google Patents