JP6734537B2 - Information processing apparatus, control method and program therefor, information processing system, control method therefor, and program - Google Patents

Description

Information processing apparatus, control method and program thereof, and information processing system, control method and program thereof, capable of easily displaying a three-dimensional model in a size in which a user wearing a head mounted display can easily see the three-dimensional model Regarding

In recent years, mixed reality technology has become widespread. Using mixed reality technology, we provide a user with a head mounted display (HMD) with a mixed reality image in which a CG model is placed in the real image, and experience the world of mixed reality in which the real image and the virtual space are combined. Can be made.

In generating a mixed reality image, Patent Document 1 below discloses a mechanism capable of changing the display size of an object image by receiving an instruction to change the size of the object image from the user.

JP, 2016-139199, A

The above-mentioned Patent Document 1 discloses a mechanism capable of changing the size of an object displayed on the HMD. However, in order to change the size of the object to a size that the user feels to be an appropriate size, the user has to issue an instruction to change the size of the object until the size is appropriate. It was

Therefore, an object of the present invention is to provide a mechanism that allows a user wearing a head mounted display to easily display a three-dimensional model in a size that is easy to see.

In the information processing apparatus of the present invention, an acquisition unit that acquires information on the position, orientation, and viewing angle of the head-mounted display in the virtual space and a position that displays the three-dimensional model in the virtual space are acquired by the acquisition unit. The position and the orientation of the head mounted display acquired by the acquisition unit, the position specifying unit that specifies the position and the posture, the position of the three-dimensional model specified by the position specifying unit, Based on the determining means for determining the size displayed by the three-dimensional model, and the head mount at the position determined by the position determining means with the size determined by the determining means for the three-dimensional model. A display control means for controlling the display.

According to the present invention, a user wearing a head mounted display can easily display a three-dimensional model in a size that makes it easy to see.

It is a block diagram which shows an example of a structure of the information processing system in this embodiment. It is a block diagram which shows an example of the hardware constitutions of the various apparatuses in this embodiment. It is an image schematically showing a mixed reality space. It is a lineblock diagram explaining an example of functional composition of various devices in this embodiment. It is a block diagram explaining an example of a module configuration of various devices in the present embodiment. It is a flow chart explaining the flow of detailed processing in this embodiment. 7 is a flowchart illustrating a detailed process flow of the mixed reality image generation process of the flowchart in FIG. 6. It is an image for determining the size of displaying the three-dimensional model in the present embodiment. It is a data table which shows an example of various data tables in this embodiment.

An example of the configuration of the information processing system in the embodiment of the present invention will be described with reference to FIG.

As shown in FIG. 1, various devices of the information processing system according to the present invention are communicatively connected via a network 150. For example, the PC 100 is communicably connected to an HMD 101 (a generic term for HMD 101A to HMD 101C).

The PC 100 stores a three-dimensional model (CG model/virtual object) to be superimposed on the real image captured by the HMD 101.

Further, the PC 100 acquires a real image from the HMD 101 (HMD 101A to 101C in FIG. 1) managed by the PC 100 and stores the real image in the storage unit. In addition, the PC 100 identifies and stores the position and orientation of the HMD 101. The position/orientation specifying method of the HMD 101 can be specified by using a two-dimensional marker in a real image captured by the HMD 101, which is described in JP-A-2003-308514. Further, as described in Japanese Patent Application Laid-Open No. 2003-240532, a sensor (optical sensor 104 in FIG. 1) detects the position and orientation of an optical marker installed on the HMD 101 as the position and orientation of the HMD 101, and the PC100 detects the position and orientation. It is also possible to specify by acquiring. In the present embodiment, the position and orientation of the HMD 101 are specified by reading the optical marker with the optical sensor 104, but other methods may be used.

The PC 100 uses the position and orientation of the HMD 101 and the information of the position and orientation of the three-dimensional model and the three-dimensional model stored in the storage unit to generate a mixed reality image in which the three-dimensional model is superimposed on the real image. Then, the mixed reality image is transmitted to the HMD 101 so as to be displayed on the display of the HMD 101. The HMD 101 displays the received mixed reality image on the display. The above is the description of FIG. 1.

FIG. 3 is a schematic diagram schematically showing the mixed reality space. FIG. 3 shows that the three-dimensional model is displayed within the field of view of the HMD 101. The user wearing the HMD 101 can perceive the three-dimensional model as if it exists in the real space.

Conventionally, by displaying a three-dimensional model in an actual size, it has been possible to provide the user with an experience as if a virtual three-dimensional model exists in the real space. However, there are also three-dimensional models that are not suitable for displaying at the actual size, and in that case, the size of the three-dimensional model must be changed to a size that the user can easily see. Therefore, by changing the display magnification of the three-dimensional model so that the three-dimensional model fits within the viewing angle range of the HMD101, the user can perceive the three-dimensional model through the HMD101 in a size that is easy to see. Note that the size changing method is an example, and the size of the three-dimensional model displayed may be changed by a method other than changing the magnification.

Next, with reference to FIG. 2, an example of a hardware configuration of various devices in the embodiment of the present invention will be described.

The CPU 201 centrally controls each device and controller connected to the system bus 204.

In addition, the ROM 202 stores various programs necessary for realizing the functions executed by various devices such as a BIOS (Basic Input/Output System) which is a control program of the CPU 201, an operating system (OS), and the like.

The RAM 203 functions as a main memory, a work area, etc. of the CPU 201. The CPU 201 implements various operations by loading a program or the like required for executing the processing into the RAM 203 and executing the program.

Various programs and the like used by the PC 100 of the present invention to execute various processes described later are recorded in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, definition files and various information tables used by the program according to the present invention are stored in the external memory 211.

The input controller (input C) 205 controls input from a pointing device (input device 209) such as a keyboard and a mouse.

When the input device 209 is a touch panel, the user can give various instructions by pressing down (touching with a finger or the like) in accordance with an icon, a cursor, or a button displayed on the touch panel. Note that the touch panel may be a touch panel such as a multi-touch screen that can detect a position touched by a plurality of fingers.

The video controller (VC) 206 controls display on a display device such as the right eye/left eye display 222 provided in the HMD 101. For example, an external output terminal (for example, Digital Visual Interface) is used to output to the right/left eye display 222. The right/left-eye display 222 is composed of a display for the right eye and a display for the left eye. Further, the input controller (input C) 205 controls display on the display device of the display 212 (liquid crystal display or the like) included in the PC 100. In addition, in FIG. 2, the display is not limited to the liquid crystal display, and may be another display such as a CRT display.

The memory controller (MC) 207 is an adapter for a hard disk (HD) or flexible disk (FD) or a PCMCIA card slot that stores a boot program, browser software, various applications, font data, user files, edit files, various data, and the like. It controls access to the external memory 211 such as a card type memory connected via the.

A communication I/F controller (communication I/FC) 208 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, internet communication using TCP/IP is possible. The communication I/F controller 208 also controls communication with the optical sensor 104 via Gigabit Ethernet (registered trademark) or the like.

The general-purpose bus 212 is used to capture an image from the right-eye/left-eye video camera 221 of the HMD 101. Input from the right-eye/left-eye video camera 221 is performed using an external input terminal (for example, an IEEE 1394 terminal). The right/left-eye video camera 221 includes a right-eye video camera and a left-eye video camera.

The CPU 201 enables display on the display by executing an outline font rasterization process in a display information area in the RAM 203, for example. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the display. The above is the description of FIG.

Next, with reference to FIG. 4, an example of a functional configuration of various devices in the embodiment of the present invention will be described.

The PC 100 includes an operating system 401 (OS), a graphic engine 402, a mixed reality platform 403 (also called MR platform), and a mixed reality application 404 (also called MR application or viewer application), and is controlled by the CPU 201. ..

The operating system 401 controls the input/output of the HMD 101 and transfers the real image obtained from the camera 221 via the input interface to the mixed reality platform 403. The mixed reality image drawn by the graphic engine 402 is output to the display 222 via the output interface.

The graphic engine 402 generates an image to be drawn from the three-dimensional model stored in the external memory 211, superimposes it on the real image, and synthesizes it. The engine used for drawing may be, for example, a widely used graphic engine such as OpenGL or DirectX, or an independently developed graphic engine. In this embodiment, OpenGL is used as the graphic library.

The mixed reality platform 403 identifies the position and orientation of the HMD 101 by reading the optical marker with the optical sensor 104, and aligns the real space and the virtual space. Note that the position/orientation and position alignment techniques can be realized using known techniques, such as JP-A-2002-32784, JP-A-2006-072903, and JP-A-2007-166427.

The mixed reality application 404 receives the position and orientation of the HMD 101, the information of the shape of the three-dimensional model, and the information of the position and orientation of the HMD 101 from the mixed reality platform 403, and issues a drawing command of the three-dimensional model to the graphic engine 402. At this time, an application programming interface (API) of OpenGL is used to issue a command in which identification information of a three-dimensional model to be drawn and position/orientation information are set. The above is the description of FIG.

Next, an example of the module configuration of the HMD 101 and the PC 100 in this embodiment will be described with reference to FIG.

The HMD 101 includes an image capturing unit 301, a captured image transmitting unit 302, an MR image receiving unit 303, and an MR image display unit 304.

The image capturing unit 301 is a functional unit that captures an image of the physical space with the right-eye/left-eye video camera 221.

The captured image transmission unit 302 is a functional unit that transmits the image captured by the right-eye/left-eye video camera 221 to the PC 100.

The MR image receiving unit 303 is a functional unit that receives an MR image (virtual reality image) transmitted from the PC 100.

The MR image display unit 304 is a functional unit that displays the MR image received by the MR image receiving unit 303 on the right-eye/left-eye display 222.

The PC 100 includes a captured image reception unit 321, an acquisition unit 322, a position identification unit 323, a determination unit 324, and a display control unit 325.

The captured image receiving unit 321 is a functional unit that receives the image transmitted from the HMD 101.

The acquisition unit 322 is a functional unit that acquires information on the position and viewing angle of the HMD 101.

The position specifying unit 323 is a functional unit that specifies the position where the three-dimensional model is displayed in the virtual space based on the position and orientation of the HMD 101.

The determination unit 324 is a functional unit that determines the size of the 3D model to be displayed based on the determined display position of the 3D model and the information on the position and viewing angle of the HMD 101.

The display control unit 325 is a functional unit that causes the HMD 101 to display the three-dimensional model in the size determined by the determination unit 324.

The HMD 101 may have the module of the PC 100.

Above, description of the functional structure of PC100 in this embodiment shown in FIG. 5 is complete|finished.

Next, the mixed reality image generation and display processing according to this embodiment will be described with reference to FIG.

After being activated in step S601, the HMD 101 starts capturing a real image using the function of the camera 221 (step S602). Then, the physical image acquired by the imaging process is transmitted to the PC 100 (step S603).

The CPU 201 of the PC 100 receives the real image from the HMD 101 (step S604), and stores the received real image in the external memory 211 (step S605). For example, as shown in the real image table 930 of FIG. 9, the HMD ID 931 that is the identification information of the HMD 101 that is the transmission source of the real image and the real image 932 are stored in association with each other.

The CPU 201 of the PC 100 acquires the position and orientation of the HMD 101 (step S606, corresponding to an acquisition unit) and stores the position and attitude in the external memory 211 (step S607). For example, as shown in the HMD information 910 of FIG. 9, it is represented by the HMD ID 911 that is the identification information of the HMD 101, the position 912 (X, Y, Z coordinates), and the attitude 913 (X, Y, Z coordinates) of the HMD. The direction in which the HMD 101 is turned on) is stored.

The CPU 201 of the PC 100 acquires the information of the three-dimensional model from the external memory 211 and performs a process of generating a mixed reality image superimposed on the reality image received from the HMD 101 (step S608). After that, the generated mixed reality image is transmitted to the HMD 101 (step S609, which corresponds to a display control unit).

A detailed processing flow of the mixed reality image generation processing in step S608 will be described with reference to the flowchart in FIG.

FIG. 7 is a flowchart for explaining the detailed processing flow of the mixed reality image generation processing. Please refer to FIG. 8 because it is an image diagram corresponding to the description of the composite image generation process.

In step S<b>701, the CPU 201 of the PC 100 refers to the HMD position 912 and attitude 913 shown in the HMD information 910 stored in the external memory 211.

In step S702, the CPU 201 of the PC 100 specifies the three-dimensional model to be displayed on the HMD 101. In the present embodiment, it is assumed that the designation of the three-dimensional model to be displayed by the user has been received in advance. The method for accepting the designation of the three-dimensional model to be displayed is not particularly limited, and for example, the selection of the target three-dimensional model from the list of the three-dimensional models displayed on the display 212 may be accepted.

In step S703, the CPU 201 of the PC 100 acquires the “set distance 1000” stored in the external memory 211. In this embodiment, the length is, for example, 3 meters. The set distance 1000 can be set freely. Any method may be used to set the set distance 1000.

In step S704, the CPU 201 of the PC 100 calculates a vector indicating the line of sight of the HMD, which is obtained from the coordinates of the position 912 and the posture 913 acquired in step S701. The calculated line-of-sight vector 1001 is stored in the line-of-sight vector 914 (line-of-sight direction) of the corresponding HMD 101.

In the present embodiment, the size of the three-dimensional model is determined by using the three-dimensional vector so as to fall within the range of the vector, but the two-dimensional vector in which the height information is ignored is used to calculate the size of the vector. The size of the three-dimensional model may be determined so that it falls within the range.

In step S705, the CPU 201 of the PC 100 specifies the display position 1002 that is the center position for displaying the three-dimensional model specified in step S702 (corresponding to position specifying means). In the present embodiment, a position distant from the position 912 of the HMD 101 acquired in step S701 by the value of the “set distance” acquired in step S703 toward the line-of-sight vector 914 is determined as the display position 1002 of the three-dimensional model. To do. The method of identifying the display position 1002 of the three-dimensional model is not limited to this, and the two-dimensional marker is photographed by the right-eye/left-eye video camera 221 to identify the position of the two-dimensional marker, and the identified position is three-dimensional. It may be the display position of the model.

In step S706, the CPU 201 of the PC 100 determines whether the display position 1002 identified in step S705 is within the range of the virtual space. If it is determined to be within the range of the virtual space, the process proceeds to step S708; otherwise, the process proceeds to step S707. The determination as to whether the display position 1002 is within the range of the virtual space can be made by, for example, whether the display position 1002 specified in step S705 is within a predetermined value range.

In step S707, the CPU 201 of the PC 100 performs correction so that the display position 1002 specified in step S705 falls within the range of the virtual space. For example, when the display position 1002 is below the surface defining the ground in the virtual space, the display position 1002 is corrected so as to be above the surface defining the ground. As described above, by correcting the position where the three-dimensional model is displayed so as to be within the range of the virtual space, there is an effect that it becomes possible for the user to experience a mixed reality space that does not cause a sense of discomfort. Note that the correction of the display position 1002 in steps S706 and 707 is not an essential configuration and may be omitted if necessary.

In step S708, the CPU 201 of the PC 100 acquires the viewing angle information of the HMD 101 stored in the external memory 211. The view angle information is information indicating the view information of the HMD 101, and is the view angle information of the right-eye/left-eye video camera 221.

In step S709, the CPU 201 of the PC 100 specifies a normal vector 1004 that is a normal vector passing through the display position 1002 of the three-dimensional model specified in step S705 and that corresponds to the line-of-sight vector 1001 (corresponding to vector specifying means). It is the normal vector 1004 shown in FIG.

In step S710, the CPU 201 of the PC 100 identifies an intersection 1005 between the normal vector 1004 identified in step S709 and the range of the field of view indicated by the viewing angle information.

In step S711, the CPU 201 of the PC 100 calculates the distance D from the display position 1002 of the three-dimensional model specified in step S705 (or corrected in step S707) to the intersection point 1005 specified in step S710 (calculating means). Equivalent to). The calculated distance D is temporarily stored in the memory.

Correction information, which is information for correcting the distance D, may be acquired from the external memory 211, and the distance D may be corrected to a slightly smaller value, for example, based on this correction information. This has the effect of preventing the three-dimensional model from being displayed in the full viewing angle of the HMD 101. On the contrary, it may be corrected so as to have a slightly larger value.

In step S712, the CPU 201 of the PC 100 determines the display magnification of the three-dimensional model based on the value obtained by the distance D and the length (maximum length) from end to end of the three-dimensional model specified in step S702. Is determined (corresponding to the determining means). For example, when the distance D is 4 meters and the length (maximum length) from end to end of the three-dimensional model specified in step S702 is 8 meters, the distance from the end to the end of this three-dimensional model is Determine the magnification so that the length is 4 meters. In this example, the display magnification of the three-dimensional model is determined as 50%. The determined display magnification is stored in the display magnification 926.

The information of the three-dimensional model is, for example, the information shown in the model information 920 of FIG. The model information 920 is information stored in the external memory 211 of the PC 100 in advance. The model ID 921 is identification information of the three-dimensional model. The model name 922 is the file name of the three-dimensional model. File path 923 indicates the location where the file is stored. The position 924 and the posture 925 indicate the position and posture of the three-dimensional model. The CPU 201 of the PC 100, when a camera having the same angle of view as the HMD 101 images the 3D model at the position 924/attitude 925 from the position 912/attitude 913 of the HMD, draws the image of the 3D model as the drawing data 940. To generate.

In step S713, the CPU 201 of the PC 100 combines the drawing data 940 with the real image 932 to generate the mixed reality image 952 (MR image) shown in the MR image table 950 of FIG.

In step S714, the CPU 201 of the PC 100 stores the mixed reality image 952 generated in step S714 in the external memory 211.

This is the end of the description of the detailed processing flow of the mixed reality image generation processing shown in FIG. 7, and returns to the description of FIG.

The HMD 101 receives the mixed reality image transmitted from the PC 100 (step S610) and displays it on the display screen (step S611). It is determined whether or not an instruction to end the display of the mixed reality image has been received from the user, and if it is determined that an instruction to end the display of the mixed reality image has been received from the user, the processing ends; otherwise, the processing To step S602.

As described above, according to the present invention, the user wearing the head mounted display can display the three-dimensional model in a size that makes it easy to see.

In this embodiment, the display size is designated by the display magnification as a method for designating the display size of the three-dimensional model. However, other methods may be used, and the size of the three-dimensional model itself may be designated.

Further, in the present embodiment, the center for displaying the three-dimensional model is controlled so as to be located on the line-of-sight vector 914 away from the HMD 101 by the “set distance 1000”, but other methods may be used. For example, the intersection point between the line-of-sight vector 914 and the wall (boundary) of the space that defines the virtual space is calculated, and the position that is the ratio (for example, 50%) to the distance between the intersection point and the position 912 of the HMD 101 is three-dimensional. It may be the position of the model. By doing so, it is possible to prevent the display center of the 3D model from being set outside the regulated virtual space, and prevent the 3D model from being buried in the ground, for example. effective.

Further, in the present embodiment, the display position and the display magnification of the three-dimensional model are always calculated and displayed, but the present invention is naturally the position 912 and the posture 913 of the HMD 101 at a predetermined timing. It is also possible to determine the display center of the three-dimensional model and the display magnification based on the above, and to display it on the HMD 101.

The present invention can be embodied as, for example, a system, an apparatus, a method, a program, a storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices, or It may be applied to a device consisting of one device. It should be noted that the present invention includes a software program that realizes the functions of the above-described embodiment, which directly or remotely supplies the system or device. The present invention also includes a case where the information processing apparatus of the system or the apparatus is achieved by reading and executing the supplied program code.

Therefore, the program code itself installed in the information processing device to implement the functional processing of the present invention in the information processing device also implements the present invention. That is, the present invention includes the computer program itself for realizing the functional processing of the present invention.

In that case, the program may take any form such as an object code, a program executed by an interpreter, or script data supplied to an OS as long as it has the function of the program.

A recording medium for supplying the program includes, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, MO, a CD-ROM, a CD-R, a CD-RW, and the like. There are also magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROMs, DVD-Rs), and the like.

In addition, as a method of supplying the program, a browser of a client computer is used to connect to a home page on the Internet. The computer program itself of the present invention or the compressed file containing the automatic installation function can be downloaded from the homepage to a recording medium such as a hard disk.

It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from different homepages. That is, a WWW server that allows a plurality of users to download a program file for implementing the functional processing of the present invention on an information processing apparatus is also included in the present invention.

In addition, the program of the present invention is encrypted and stored in a storage medium such as a CD-ROM and distributed to users, and the key information for decrypting the encryption is downloaded from the homepage via the Internet to users who have satisfied predetermined conditions. Let Then, it is also possible to execute the encrypted program by using the downloaded key information and install the program in the information processing device to realize it.

Further, the functions of the above-described embodiments are realized by the information processing device executing the read program. In addition, the OS or the like running on the information processing device performs a part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments can be realized also by the processing.

Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted in the information processing device or a function expansion unit connected to the information processing device. After that, based on the instructions of the program, the CPU or the like included in the function expansion board or the function expansion unit performs some or all of the actual processing, and the processing also realizes the functions of the above-described embodiments.

It should be noted that the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be limitedly interpreted by these. That is, the present invention can be implemented in various forms without departing from its technical idea or its main features.

100 PC
201 CPU
202 RAM
203 ROM
204 System Bus 205 Input Controller 206 Video Controller 207 Memory Controller 208 Communication I/F Controller 209 Keyboard 210 CRT Display 211 External Memory

Claims (11)

Acquisition means for acquiring information on the position, orientation and viewing angle of the head mounted display in the virtual space,
From the position and orientation of the head mounted display acquired by the acquisition unit, a line-of-sight vector specifying unit that specifies a line-of-sight vector indicating a line-of-sight direction of the head-mounted display,
A position specifying unit for specifying a position on the line-of-sight vector specified by the line-of-sight vector specifying unit as a position of the center of the three-dimensional model, which is a position at a predetermined distance from the head mounted display ,
A determining unit that determines the size of the three-dimensional model to be displayed , based on the range of the field of view at a predetermined distance from the head mounted display, which is specified from the information on the viewing angle acquired by the acquiring unit ,
Display control means for controlling the three-dimensional model to be displayed on the head-mounted display at the size determined by the determination means at the position specified by the position specifying means;
An information processing apparatus comprising: The information processing apparatus according to claim 1, wherein the determining unit determines a size within a field of view at a predetermined distance from the head mounted display as a size for displaying the three-dimensional model. A normal vector passing through the position specified by the position specifying means, and a normal vector specifying means for specifying a normal vector with respect to the line-of-sight direction,
Further comprising a calculating means for calculating a distance from the position specified by the position specifying means to an intersection of the normal vector specified by the normal vector specifying means and the viewing angle,
The determination unit, the information processing apparatus according to claim 1 or 2, characterized in that determines the size of display of the three-dimensional model based on the distance calculated by said calculating means. It said position specifying means, and characterized in that the intersection of the boundary defining the viewing direction and the virtual space, a position between the position of the head mounted display is specified as the position of the center of the three-dimensional model The information processing apparatus according to any one of claims 1 to 3 , Said position specifying means, the intersection of the boundary defining the viewing direction and the virtual space, a position between the position of the head-mounted display, a position where the predetermined ratio from the position of the head-mounted display the information processing apparatus according to any one of claims 1 to 4, characterized in that identifying the location of the center of the three-dimensional model. The position of the center of the three-dimensional model specified by the position specifying means, a determining means for determining whether or not the position in the virtual space,
When the determination unit determines that the position is not within the virtual space, the correction unit further corrects the position so that the position is within the virtual space. The information processing apparatus according to any one of 5 above. The information processing device
An acquisition step of acquiring information on the position, posture and viewing angle of the head mounted display in the virtual space;
From the position and orientation of the head mounted display acquired in the acquisition step, a line-of-sight vector specifying step of specifying a line-of-sight vector indicating a line-of-sight direction of the head-mounted display,
A position of a predetermined distance from the head mounted display, a position on the line-of-sight vector specified by the line-of-sight vector specifying step, a position specifying step of specifying the position of the center of the three-dimensional model ,
A determining step of determining a size for displaying the three-dimensional model , based on the range of the field of view at a predetermined distance from the head mounted display, which is specified from the information of the viewing angle acquired by the acquiring step ,
The three-dimensional model, with the magnitude determined by the determination step, the position specified by the position specifying step, characterized in that it comprises a display control step of controlling so as to be displayed on the head-mounted display Control method of information processing apparatus. Information processing equipment,
Acquisition means for acquiring information on the position, orientation and viewing angle of the head mounted display in the virtual space,
From the position and orientation of the head mounted display acquired by the acquisition unit, a line-of-sight vector specifying unit that specifies a line-of-sight vector indicating a line-of-sight direction of the head-mounted display,
A position specifying unit for specifying a position on the line-of-sight vector specified by the line-of-sight vector specifying unit as a position of the center of the three-dimensional model, which is a position at a predetermined distance from the head mounted display ,
A determining unit that determines the size of the three-dimensional model to be displayed , based on the range of the field of view at a predetermined distance from the head mounted display, which is specified from the information on the viewing angle acquired by the acquiring unit ,
The three-dimensional model, wherein a size determined by the determination means, the specified position by the position specifying means, a program to function as a display control means for controlling so as to be displayed on the head-mounted display. Acquisition means for acquiring information on the position, orientation and viewing angle of the head mounted display in the virtual space,
From the position and orientation of the head mounted display acquired by the acquisition unit, a line-of-sight vector specifying unit that specifies a line-of-sight vector indicating a line-of-sight direction of the head-mounted display,
A position specifying unit for specifying a position on the line-of-sight vector specified by the line-of-sight vector specifying unit as a position of the center of the three-dimensional model, which is a position at a predetermined distance from the head mounted display ,
A determining unit that determines the size of the three-dimensional model to be displayed , based on the range of the field of view at a predetermined distance from the head mounted display, which is specified from the information on the viewing angle acquired by the acquiring unit ,
The three-dimensional model, wherein a size determined by the determination means, the specified position by the position specifying means, characterized in that it comprises a display control means for controlling so as to be displayed on the head-mounted display Information processing system. Information processing system
An acquisition step of acquiring information on the position, posture and viewing angle of the head mounted display in the virtual space;
From the position and orientation of the head mounted display acquired in the acquisition step, a line-of-sight vector specifying step of specifying a line-of-sight vector indicating the line-of-sight direction of the head-mounted display,
A position of a predetermined distance from the head mounted display, a position on the line-of-sight vector specified by the line-of-sight vector specifying step, a position specifying step of specifying the position of the center of the three-dimensional model ,
A determining step of determining a size for displaying the three-dimensional model , based on the range of the field of view at a predetermined distance from the head mounted display, which is specified from the information of the viewing angle acquired by the acquiring step ,
The three-dimensional model, with the magnitude determined by the determination step, the position specified by the position specifying step, characterized in that it comprises a display control step of controlling so as to be displayed on the head-mounted display Information processing system control method. Information processing system,
Acquisition means for acquiring information on the position, orientation and viewing angle of the head mounted display in the virtual space,
From the position and orientation of the head mounted display acquired by the acquisition unit, a line-of-sight vector specifying unit that specifies a line-of-sight vector indicating a line-of-sight direction of the head-mounted display,
A position specifying unit for specifying a position on the line-of-sight vector specified by the line-of-sight vector specifying unit as a position of the center of the three-dimensional model, which is a position at a predetermined distance from the head mounted display ,
A determining unit that determines the size of the three-dimensional model to be displayed , based on the range of the field of view at a predetermined distance from the head mounted display, which is specified from the information on the viewing angle acquired by the acquiring unit ,
The three-dimensional model, wherein a size determined by the determination means, the specified position by the position specifying means, a program to function as a display control means for controlling so as to be displayed on the head-mounted display.

Images