JP6638326B2 - Information processing system, control method thereof, and program - Google Patents

Description

  The present invention relates to an information processing system capable of moving a virtual space by an appropriate amount of movement even when the height of a user's viewpoint in a virtual space is changed, a control method thereof, and a program.

  As a conventional technique, there is a mechanism that superimposes an image including a three-dimensionally modeled CG (Computer Graphics, hereinafter referred to as a three-dimensional model) on an image obtained by capturing a real space and presents this to an observer. By using this mechanism, it is possible to make an observer look as if a three-dimensional model exists in the real space. This mechanism is called Mixed Reality (hereinafter, referred to as MR) or Augmented Reality.

  In such a mechanism, Patent Document 1 discloses a mechanism for presenting a virtual space with a sense of scale different from that of the real space by setting the viewpoint of the user in the virtual space to a height different from the height of the viewpoint of the user in the real space. It has been disclosed.

JP-A-5-282279

  By the way, there is a case where a design is reviewed at a plurality of bases. In this case, information sharing is performed in real time by using a mechanism that presents the same virtual space including the three-dimensional model to be reviewed to each user at each of the plurality of bases using mixed reality. Can be.

  Further, for example, when the design is relatively large like a building, the user often checks the inside or outside of the building. In particular, when it is desired to check the bird's-eye view from the top of the building, by applying the mechanism disclosed in Patent Document 1, the height of the viewpoint in the virtual space is changed, and the movement according to this height is performed. The viewpoint can be moved by an amount. By doing so, it is possible to freely walk around and confirm as if one had become a giant.

  However, in the above-mentioned review, since a plurality of users participate and freely look around in the virtual space, if the mechanism of Patent Document 1 is simply applied, all users are set to the same height. There is a problem. That is, since the virtual space viewed by a plurality of users is the same, if one user changes the height of the viewpoint in the virtual space, the setting change is applied to other users, and the other users are changed. Similarly, there is a problem that the height of the viewpoint is changed.

  Therefore, in order for each user to experience the virtual space with a desired sense of scale, it is necessary to change the scale in order, and there is a problem in that a user displayed on an unintended scale has a waiting time.

  In addition, even if the height of the viewpoint in the virtual space can be changed for each user, the review cannot be efficiently performed unless the movement amount of the user is adjusted according to the height of the viewpoint of the user. There is also. For example, even if you can walk around from a viewpoint like a giant, if you apply the amount of movement in the real space as it is to the amount of movement in the virtual space, it will be difficult to move forward. If the viewpoint becomes like a giant, it is necessary to increase the stride, that is, the amount of movement in the virtual space.

  However, Patent Literature 1 discloses a mechanism for adjusting the movement amount according to the height of the viewpoint in the virtual space, but does not disclose a mechanism for performing such adjustment for each user.

  An object of the present invention is to provide a mechanism capable of moving a virtual space by an appropriate amount of movement for each user even when the height of a user's viewpoint in the virtual space is changed.

  In order to achieve the above object, an information processing system according to the present invention is an information processing system for presenting a virtual space, wherein a parameter for changing a height of a viewpoint set in the virtual space is set for each user. , A viewpoint setting unit for setting a viewpoint of the user in the virtual space based on a height of the viewpoint of the user existing in the real space, and a viewpoint of the user set by the viewpoint setting unit. Viewpoint changing means for changing the height of the user according to the parameter corresponding to the user stored in the storage means, moving amount obtaining means for obtaining the moving amount of the user in the real space, and the moving amount Using the parameter corresponding to the user whose moving amount has been acquired by the acquiring unit and the moving amount of the user acquired by the moving amount acquiring unit, the parameter is changed by the viewpoint changing unit. Characterized in that it comprises a moving amount determining means for determining the movement amount of the viewpoint of the user, and a viewpoint moving means for moving the viewpoint of the user by the movement amount determined by the movement amount determination means.

  According to the present invention, even when the height of the viewpoint of the user in the virtual space is changed, it is possible to move the virtual space with an appropriate movement amount for each user.

FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system according to an embodiment of the present invention. FIG. 1 is a diagram illustrating an example of a system configuration of an MR system. FIG. 2 is a diagram illustrating an example of a hardware configuration of a client device 101 and an HMD 102. FIG. 3 illustrates an example of a hardware configuration of a server device 103. FIG. 2 is a diagram illustrating an example of a functional configuration of a client device 101 and a server device 103. 9 is a flowchart illustrating an example of the flow of processing for distributing a virtual space from a client device 101-1 and setting a virtual space in each client device 101. FIG. 4 is a diagram illustrating a state where a user's viewpoint in a virtual space is set based on the user's viewpoint in a real space. It is a flowchart which shows an example of the flow of the process which sets a scale for every user. FIG. 9 is a diagram illustrating an example of a screen configuration of a scale setting screen 900. FIG. 9 is a diagram illustrating an example of a table configuration of user setting scale information 1000, a setting information table 1010, a client information table 1020, and an object information table 1030. It is a flowchart which shows an example of a mixed reality presentation process. It is a figure showing the case where the user's viewpoint in real space moved. FIG. 4 is a diagram illustrating a state in which a user's viewpoint in a virtual space is changed according to a scale set for each user. FIG. 4 is a diagram illustrating a state in which a user's viewpoint in a virtual space has moved by a movement amount according to a scale set for each user. FIG. 4 is a diagram illustrating a state where an avatar indicating a user is arranged in a virtual space. It is a flowchart which shows an example of a scale setting process. FIG. 4 is a diagram illustrating a state in which a user looks into an object in a virtual space. FIG. 14 is a diagram illustrating an example of a scale setting process according to the second embodiment. FIG. 14 is a diagram illustrating an example of a table configuration of an object information table 1030 according to the second embodiment. FIG. 9 is a diagram illustrating a state in which the size of an avatar arranged in a virtual space is changed according to a scale set for each object. FIG. 9 is a diagram illustrating a state in which whether or not to apply a scale set to an object is determined depending on from which direction of an object an avatar arranged in a virtual space contacts.

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a system configuration of the information processing system according to the first embodiment. The information processing system shown in FIG. 1 is a system that uses a mixed reality technology (hereinafter, referred to as an MR technology) to allow users at a plurality of bases to browse and share the same virtual space. The information processing system includes a plurality of MR systems in which the HMD 102 is connected to the client device 101 so that data can be communicated with each other. The client device 101 of each MR system is communicably connected to the server device 103 via a network. I have. The connection between the client device 101 and the HMD 102 may be a wired connection or a wireless connection. Also, any number of MR systems may be included in the information processing system. In the present embodiment, information including an MR system in which the client device 101-1 and the HMD 102-1 are connected, an MR system in which the client device 101-2 and the HMD 102-2 are connected, and a plurality of other MR systems Description will be given as a processing system. Further, since the MR system may be provided for each room or may be provided in the same room, the present embodiment will be described as being provided for each base, but is not limited to this. Note that the configuration of various terminals connected to the system in FIG. 1 is an example, and there are various configuration examples according to applications and purposes.

  The client device 101 is a general-purpose computer. The client device 101 captures an image of a real space (hereinafter, referred to as a real space image) captured (captured) by the HMD 102 and a virtual space image (hereinafter, referred to as a virtual space image) generated by the client device 101. Superimpose. The image generated in this manner (hereinafter, referred to as a mixed reality image) is transmitted to the HMD 102. Since a conventional technique is used for the MR technique, a detailed description is omitted. The client device 101 may be a personal computer or a large-sized computer such as a server. Furthermore, a mobile terminal such as a mobile phone or a tablet terminal may be used. The type of computer is not particularly limited. Further, the processing may be performed by one client device 101 without installing the client device 101 at each base. That is, one client device 101 may construct each MR system in the present embodiment. Further, the place where the client apparatus 101 is installed is not particularly limited.

  The HMD 102 is a head mounted display. The HMD 102 is a device that is mounted on the user's head, and includes a right-eye and left-eye video camera, and a right-eye and left-eye display. The HMD 102 transmits a physical space image captured by the video camera of the HMD 102 to the client device 101. Then, the mixed reality image is received from the client device 101 and displayed on the display. Since the HMD 102 is provided with a display for the right eye and a display for the left eye, a stereoscopic effect can be obtained by parallax. The physical space image captured by the HMD 102 and the mixed reality image displayed by the HMD 102 are preferably moving images (videos), but may be still images captured at predetermined intervals. Also, a device such as a smartphone in which a display and a video camera are installed on the front and back of hardware may be used as a substitute for the head mounted display.

  FIG. 2 is a diagram illustrating an example of a system configuration of the MR system at each base. As described above, the client device 101 is communicably connected to the HMD 102. Further, an infrared camera 202 is connected to the client device 101. The infrared camera 202 is an optical sensor using infrared light. The infrared camera 202 irradiates the real space with infrared light and captures the infrared light reflected by the physical space object, thereby specifying the position and orientation of the real space object in the coordinate system defined by the infrared camera 202. Using the infrared camera 202, the position and orientation (direction, inclination, direction of line of sight, etc. of the HMD 102 (ie, user) in the real space) are specified. The HMD 102 is provided with an object that reflects infrared light called an optical marker 201, and the infrared camera 202 can specify the position and orientation of the HMD 102 by photographing the infrared light reflected by the optical marker 201. Regardless of the position and posture of the user, it is desirable to install a plurality of infrared cameras 202 in the MR system so that the optical marker 201 of the HMD 102 worn by the user can be photographed or detected. Further, the HMD 102 whose position and orientation can be specified is the HMD 102 existing in the shooting range of the infrared camera 202.

  In the present embodiment, the infrared camera 202 is used to specify the position and the posture of the HMD 102 in the real space. However, the present invention is not limited to this, as long as the position and the posture of the HMD 102 in the real space can be specified. For example, a magnetic sensor may be used, or an image captured by the HMD 102 may be analyzed to specify the position and orientation.

  FIG. 3 is a diagram illustrating an example of each hardware configuration of the client device 101 and the HMD 102.

  The CPU 301 controls each device and controller connected to the system bus 304 as a whole.

  The ROM 302 or the external memory 311 stores a basic input / output system (BIOS) and an operating system, which are control programs for the CPU 301. Further, various programs and the like, which will be described later, necessary for realizing the functions executed by the various devices are stored. The RAM 303 functions as a main memory, a work area, and the like for the CPU 301.

  The CPU 301 loads various programs and the like necessary for executing the processing into the RAM 303 and executes the programs to realize various operations.

  An input controller (input C) 305 controls an input from a pointing device (input device 310) such as a keyboard or a mouse.

  A video controller (VC) 306 of the client device 101 controls display on a display such as a right-eye / left-eye display 322 or a display 312 included in the HMD 102. The right-eye / left-eye display 322 is output using, for example, an external output terminal (for example, a Digital Visual Interface). The right-eye / left-eye display 322 includes a right-eye display and a left-eye display. The display 312 is a liquid crystal display or the like, and displays the same display as the right-eye / left-eye display 322 or a GUI (Graphical User Interface) for operating a virtual space.

  A memory controller (MC) 307 controls access to an external memory 311 (storage unit) that stores a boot program, browser software, various applications, font data, user files, edit files, various data, and the like. The external memory 311 is, for example, a hard disk (HD), a flexible disk (FD), or a card type memory connected to a PCMCIA card slot via an adapter.

  A communication I / F controller (communication I / FC) 308 is for connecting and communicating with an external device via a network, and executes communication control processing on the network. For example, Internet communication using TCP / IP is possible. In particular, the communication I / F controller 308 of the client device 101 also controls communication with the infrared camera 202.

  The general-purpose bus 309 of the client device 101 is used to capture an image captured by the right-eye / left-eye video camera 321 of the HMD 102 connected to the client device 101. Input is made from the right-eye and left-eye video cameras 321 using an external input terminal (for example, an IEEE1394 terminal). The right-eye / left-eye video camera 321 includes a right-eye video camera and a left-eye video camera.

  Note that the CPU 301 enables the display on the display by executing the processing (rasterizing) of the outline font in the display information area in the RAM 303, for example. Further, the CPU 301 enables a user instruction with a mouse cursor (not shown) on the display.

  Various programs and the like used by the client device 101 of the present invention to execute various processes described below are recorded in the external memory 311 and are executed by the CPU 301 by being loaded into the RAM 303 as necessary. . Further, definition files and various information tables used by the program according to the present invention are stored in the external memory 311.

  FIG. 4 is a diagram illustrating a hardware configuration of the server device 103. Note that the hardware configuration shown in FIG. 4 is merely an example.

  The CPU 401 controls all devices and controllers connected to the system bus 404.

  The ROM 402 or the external memory 411 stores a basic input / output system (BIOS) and an operating system program, which are control programs for the CPU 401. Further, the external memory 411 stores various programs and the like necessary for realizing the functions executed by the server device 103. The RAM 403 functions as a main memory, a work area, and the like for the CPU 401.

  The CPU 401 loads various programs and the like necessary for executing processing into the RAM 403, and realizes various operations by executing the programs.

  The input controller 405 controls input from an input device 409 such as a pointing device such as a keyboard and a mouse.

  The video controller 406 controls display on a display such as the display 412. The display may be a CRT or a liquid crystal display.

  The memory controller 407 controls access to an external memory 411 such as a hard disk, a flexible disk, or a card-type memory connected to a PCMCIA card slot via an adapter. The external memory 411 (storage means) stores a boot program, browser software, various applications, font data, user files, edit files, various data, and the like.

  The communication I / F controller 408 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, Internet communication using TCP / IP is possible.

  Note that the CPU 401 enables the display on the display 412 by executing the processing (rasterizing) of the outline font in the display information area in the RAM 403, for example. Further, the CPU 401 enables a user instruction with a mouse cursor (not shown) on the display 412.

  Various programs and the like used by the server device 103 of the present invention to execute various processes described below are recorded in the external memory 411. These various programs and the like are executed by the CPU 401 by being loaded into the RAM 403 as necessary. Further, definition files and various information tables used by the program according to the present invention are stored in the external memory 411.

  FIG. 5 is a functional configuration diagram showing a functional configuration of the client device 101 and the server device 103. Note that the functional configuration of the client apparatus 101 and the server apparatus 103 in FIG. 5 is merely an example, and there are various exemplary configurations according to applications and purposes.

  The client device 101 includes, as functional units, a communication control unit 501, a position and orientation acquisition unit 502, a position and orientation identification unit 503, a real space image acquisition unit 504, a virtual space generation unit 505, and a virtual space image acquisition unit 506. , A mixed reality image generation unit 507. The display control unit 508 includes a display control unit 508, a storage unit 509, an object control unit 510, a viewpoint control unit 511, and a scale setting unit 512.

  The communication control unit 501 is a functional unit that transmits and receives various types of information between the HMD 102 and the infrared camera 202 that can communicate with the client device 101. The communication control unit 501 transmits and receives information to and from these devices through the above-described video controller 306, communication I / F controller 308, general-purpose bus 309, and the like. The communication control unit 501 also transmits and receives various information between the other client apparatuses 101 and the server apparatus 103.

  The position and orientation acquisition unit 502 is a functional unit that acquires information indicating the position and orientation (direction) in the real space of the device including the optical marker 201 from the infrared camera 202. In this embodiment, since the HMD 102 includes the optical marker 201, the position and orientation acquisition unit 502 analyzes the position and orientation of the HMD 102 in the real space (the position and orientation of the user wearing the HMD 102) analyzed by the infrared camera 202. The same applies hereinafter). Further, the position and orientation acquisition unit 502 uses the real space image for the right eye and the real space image for the left eye acquired by the real space image acquisition unit 504 from the right-eye and left-eye video cameras 321 by using a method such as triangulation. The position and orientation of an object in the real space can be specified.

  The position and orientation specifying unit 503 is a functional unit that specifies the position and orientation (orientation) in the virtual space corresponding to the position and orientation (orientation) of the HMD 102 in the real space acquired by the position and orientation acquisition unit 502. The coordinate system of the real space (the coordinate system of the infrared camera 202) and the coordinate system of the virtual space are calibrated in advance, and the real space and the virtual space are associated with each other. That is, the position and the posture in the virtual space corresponding to the position and the posture of the HMD 102 in the real space are specified based on this association.

  The physical space image acquisition unit 504 is a functional unit that acquires a physical space image captured by the right-eye / left-eye video camera 321 of the HMD 102.

  The virtual space generation unit 505 is a functional unit that generates a virtual space based on information stored in the external memory 311 of the client device 101. Since the virtual space is a virtual space generated inside the client apparatus 101, information on the shape and size of the space is stored in the external memory 311 and the virtual space is generated based on the information. An object composed of a three-dimensional model can be arranged in the virtual space. The objects are arranged by the object control unit 510.

  The virtual space image acquisition unit 506 is a functional unit that acquires an image of the virtual space generated by the virtual space generation unit 505. When the virtual space image acquisition unit 506 acquires an image of the virtual space, the viewpoint control unit 511 sets a viewpoint in the virtual space based on the position and orientation of the HMD 102 in the virtual space identified by the position and orientation identification unit 503. . Then, a virtual space image when viewed from the viewpoint is generated and acquired. A virtual camera may be installed at this viewpoint to capture an image of the virtual space. That is, rendering is performed.

  The mixed reality image generation unit 507 is a functional unit that generates a mixed reality image by superimposing the virtual space image acquired by the virtual space image acquisition unit 506 on the real space image acquired by the real space image acquisition unit 504.

  The display control unit 508 is a functional unit that controls display of various types of information on the right eye / left eye display 322 of the HMD 102 connected to the client device 101 and the display 312 connected to the client device 101. In particular, the HMD 102 has a function of displaying the mixed reality image generated by the mixed reality image generation unit 507 on the right-eye / left-eye display 322 of the HMD 102.

  The storage unit 509 is a functional unit for storing information of various tables to be described later, information for generating a virtual space, and information such as objects. Add / update / delete information as necessary. In the present embodiment, a description will be given assuming that a common virtual space and an object are stored in the storage unit 509 of each client device 101.

  The object control unit 510 is a functional unit for arranging an object composed of a three-dimensional model in a virtual space. When a virtual space is generated, an object is arranged at a predefined position and orientation. If necessary, the arranged objects are rearranged at different positions and postures.

  The viewpoint control unit 511 is a functional unit for setting the viewpoint of the user in the virtual space based on the position and the posture of the user existing in the real space. The position and orientation of the user existing in the real space are the position and orientation of the HMD 102. Therefore, the position and orientation acquisition unit 502 acquires the position and orientation of the optical marker 201 included in the HMD 102, specifies the position and orientation in the virtual space by the position and orientation identification unit 503, and determines the user's viewpoint based on the identified position and orientation. Is set in the virtual space. In addition, the viewpoint control unit 511 can change the height of the viewpoint in the virtual space and move the viewpoint.

  The scale setting unit 512 is a functional unit for setting scale information for changing the height of the viewpoint and the moving amount of the viewpoint set in the virtual space for each user. The scale setting unit 512 manages the scale information received for each user in association with the user. The scale information is a parameter specified by the user, and specifically indicates a magnification. For example, when the scale information is “2”, the height is doubled, so that the height of the viewpoint set in the virtual space is set to twice the height of a normal space.

  Next, the server device 103 includes a communication control unit 531 and a storage unit 532 as functional units.

  The communication control unit 531 is a functional unit that transmits and receives various information to and from the client device 101 that can communicate with the server device 103. The communication control unit 531 sends and receives information to and from the client device 101 through the communication I / F controller 308 described above.

  The storage unit 532 is a functional unit for storing information such as various tables described later. Add / update / delete information as necessary.

  Next, a flow of a process of distributing a virtual space from the client device 101-1 and setting a virtual space in each client device 101 will be described with reference to a flowchart shown in FIG.

  In step S601, the CPU 301 of the client device 101-1 acquires the virtual space information stored in the external memory 311 of the client device 101-1 using the function of the storage unit 509. The virtual space information is various information for generating a virtual space. Specifically, it is information necessary for shaping the virtual space, such as the shape and size of the virtual space, the objects to be arranged, and the locations where the objects are arranged. This virtual space information can be created by a dedicated CAD application installed in the client device 101. However, this dedicated application is not necessarily installed in all the client devices 101. Therefore, in step S602 described later, the generated virtual space information is distributed, that is, transmitted to the other client devices 101.

  In step S602, the CPU 301 of the client device 101-1 transmits the virtual space information acquired in step S601 to the server device 103 by the function of the communication control unit 501.

  In step S603, the CPU 301 of the client device 101-1 uses the function of the virtual space generation unit 505 to generate a virtual space using the virtual space information acquired in step S601 (virtual space generation unit). The generated virtual space is a virtual space having a shape and a size indicated by the virtual space information, and an object indicated by the virtual space information is arranged in the virtual space. A dedicated viewer application for performing an MR experience is installed in the client device 101-1 and a virtual space is generated by the viewer application. That is, a CAD application is needed to create virtual space information, and a viewer application is needed to create virtual space.

  In step S604, the CPU 301 of the client device 101-1 sets the user's viewpoint on the virtual space generated in step S604 by the function of the viewpoint control unit 511 (viewpoint setting unit). The viewpoint of the user is set in the virtual space based on the height of the viewpoint of the user wearing the HMD 102-1 capable of communicating with the client device 101-1. FIG. 7 is a diagram illustrating a case where the viewpoint is set in the virtual space in step S604. As shown in FIG. 7B, when the coordinates of the user's viewpoint 702 (that is, the position of the HMD 102) existing in the real space are (0, 150, 0), as shown in FIG. , The viewpoint 701 of the user is set at the position of the coordinates (0, 150, 0) in the virtual space.

  In step S605, the CPU 301 of the client device 101-1 executes a mixed reality presentation process so that the user can experience mixed reality via the HMD 102-1. The details of the mixed reality presentation process are shown in FIG. 11 described later.

  On the other hand, in step S606, the CPU 401 of the server device 103 receives the virtual space information transmitted from the client device 101-1 in step S602 by the function of the communication control unit 531. Then, in step S607, the CPU 401 of the server device 103 transmits the virtual space information received in step S606 to the client device 101 with which the server device 103 can communicate, by the function of the communication control unit 531. Here, since it is not necessary to transmit the virtual space information to the client device 101-1 which is the transmission source of the virtual space information received in step S606, it is desirable not to transmit the virtual space information.

  In step S608, the CPU 301 of the client device 101-2 receives the virtual space information transmitted from the server device 103 in step S607 by the function of the communication control unit 501. Then, the received virtual space information is stored in the external memory 311 of the client device 101-2.

  In step S609, the CPU 301 of the client device 101-2 uses the function of the virtual space generation unit 505 to generate a virtual space using the virtual space information received in step S608 (virtual space generation unit). The generation of the virtual space is the same as in step S603. Thus, the same virtual space is generated in any of the client devices 101. Further, if the CAD application is not installed in the client device 101, the virtual space information cannot be created / edited by itself, but the virtual space information is received from the other client devices 101, so that the CAD application becomes unnecessary. However, unless the CAD application is installed, the size and shape of the virtual space and the arrangement position of the object cannot be changed. That is, a virtual space having a different size or shape cannot be set for each client device 101.

  In step S610, the CPU 301 of the client device 101-2 sets the viewpoint of the user on the virtual space generated in step S609 by the function of the viewpoint control unit 511 (viewpoint setting unit). The setting of the viewpoint is the same as in step S604.

  In step S611, the CPU 301 of the client device 101-2 executes a mixed reality presentation process so that the user can experience mixed reality via the HMD 102-2. The details of the mixed reality presentation process are shown in FIG. 11 described later.

  As described above, by distributing the virtual space information from one client device 101 to another client device 101, the same virtual space can be generated in any of the client devices 101. In addition, each client device 101 can allow each user to experience mixed reality using the generated common virtual space.

  Next, a flow of processing for setting a scale for each user will be described with reference to a flowchart shown in FIG.

  The series of processing illustrated in FIG. 8 is executed as a separate process from the series of processing illustrated in FIG. Therefore, it may be executed at any timing. That is, it is possible to change the scale information to an arbitrary magnification in real time even while performing the mixed reality presentation processing of FIG. 11 described later.

  In step S801, the CPU 301 of the client apparatus 101 displays a scale setting screen 900 as shown in FIG. Then, an input to an input form or button provided on the scale setting screen 900 is accepted.

  The scale setting screen 900 is a screen for setting scale information. The scale setting screen 900 includes an input form 901 for inputting scale information, a setting button 902 for saving the scale information input in the input form, and the like. The input form 901 includes an input form for inputting scale information, that is, a magnification, and an input form for inputting a changed viewpoint height. The user selects one of these using radio buttons and inputs parameters.

  When the pressing of the setting button 902 is detected in a state where the parameters are input to the input form 901, the CPU 301 of the client device 101 acquires the parameters input to the input form 901 by the function of the storage unit 509 in step S 802. Then, the acquired parameters are stored as scale information in the user-set scale information 1000 (see FIG. 10). Here, when an input is made on the input form for inputting the magnification, the input magnification is stored in the user-set scale information 1000 as it is. On the other hand, when the input is performed on the input form for inputting the height of the viewpoint after the change, the magnification is calculated based on the height of the current user's viewpoint in the virtual space and the input height. The scale factor is stored in the user-set scale information 1000. In other words, the calculation may be performed by “input height ÷ height of current user's viewpoint” (parameter calculation means). The calculation method is not limited to this.

  In step S803, the CPU 301 of the client device 101 transmits the scale information stored in the user-set scale information 1000 in step S802 to the server device 103 by the function of the communication control unit 501.

  In step S804, the CPU 401 of the server apparatus 103 receives the scale information transmitted from the client apparatus 101 in step S803 by the function of the communication control unit 531. Then, in step S805, the CPU 401 of the server apparatus 103 stores the scale information received in step S804 in the client information table 1020 shown in FIG.

  The client information table 1020 is a data table stored in the external memory 411 of the server device 103. The client information table 1020 includes a client ID 1021, connection destination information 1022, scale information 1023, and virtual space position and orientation information 1024. Note that each item included in the client information table 1020 is merely an example, and the present invention is not limited to this.

  The client ID 1021 is an item in which unique identification information assigned to each client device 101 is stored. The connection destination information 1022 is an item in which information such as an IP address indicating a connection destination of the client device 101 is stored. The scale information 1023 is an item in which scale information set in the client device 101 is stored. The virtual space position / posture information 1024 is an item in which information indicating the position and the posture of the user in the virtual space set by the client device 101 is stored.

  In step S804, when storing the scale information in the client information table 1020, a new record is created and the client ID 1021 is issued. Then, the IP address or the like of the client device 101 that is the transmission source of the scale information is stored in the connection destination information 1022, and the received scale information is stored in the scale information 1023.

  In the present embodiment, since one HMD 102 is connected to one client device 101, the user who wears the HMD 102 corresponds to the client device 101. That is, the scale information set in the client device 101 is scale information corresponding to the user wearing the HMD 102 connected to the client device 101. Therefore, the information processing system accepts the setting of the scale information for each user and stores the setting. Then, the server device 103 manages the scale information of each user in the client information table 1020.

  Next, the details of the mixed reality presentation processing will be described using a flowchart shown in FIG.

  In step S <b> 1101, the CPU 301 of the client device 101 acquires a real space image from the right-eye / left-eye video camera 321 of the HMD 102 using the function of the real space image acquisition unit 504, and stores this in the RAM 303.

  In step S1102, the CPU 301 of the client device 101 acquires information indicating the position and orientation in the real space of the HMD 102 that can communicate with the client device 101 by the function of the position and orientation acquisition unit 502, and stores the information in the RAM 303 (direction acquisition unit). ). As described above, information indicating the position and orientation specified by the infrared camera 202 detecting the optical marker 201 included in the HMD 102 is acquired from the infrared camera 202. Then, it is stored in the current position and orientation information 1012 of the setting information table 1010 shown in FIG. If the current position and orientation information 1012 is already stored, the information indicating the stored position and orientation is copied to the previous position and orientation information 1013, and the information indicating the newly acquired position and orientation is copied to the current position and orientation information. Overwrite 1012. Also, the posture information stored in the virtual space position / posture information 1014 is overwritten with the acquired posture information in the real space (direction changing means).

  For example, if one frame before is the position of the viewpoint 702 in FIG. 7B, and the current frame is the position of the viewpoint 1201 in FIG. 12, the coordinates (0, 150, 0) are included in the previous position and orientation information 1013. , The coordinates (100, 150, 0) are stored in the current position and orientation information 1012. Here, the frame means a frame of a video displayed on the HMD 102.

  The setting information table 1010 is a data table stored in the external memory 311 of the client device 101. The setting information table 1010 includes scale information 1011, current position and orientation information 1012, previous position and orientation information 1013, and virtual space position and orientation information 1014.

  The scale information 1011 is an item in which a magnification indicating a sense of scale when the user browses the virtual space is stored. The current position and orientation information 1012 is an item in which information indicating the position and orientation of the user in the current frame is stored. The front position / posture information 1013 is an item in which information indicating the position and posture of the user in the previous frame is stored. The virtual space position and orientation information 1014 is an item in which information indicating the position and orientation of the user in the virtual space is stored. The virtual space position and orientation information 1014 stores, as initial values, information indicating the positions and orientations set in steps S604 and S610 described above.

  In step S1103, the CPU 301 of the client device 101 calculates the amount of movement of the HMD 102 in the real space by the function of the position and orientation specifying unit 503. More specifically, using the position of the HMD 102 in the real space acquired at the time point one frame before (the previous position / posture information 1013) and the position of the HMD 102 acquired at the current time (the current position / posture information 1012), Calculation (acquisition) is performed (movement amount acquisition means). For example, the time point one frame before is the position of the viewpoint 702 (coordinates (0, 150, 0)) in FIG. 7B, and the position of the viewpoint 1201 (coordinates (100, 150, 0)) shown in FIG. In this case, it can be seen that it has moved 100 cm in the X-axis direction. Therefore, this 100 cm is set as the movement amount of the HMD 102 in the real space. The distance between the two points may be calculated by, for example, the three-square theorem. The calculation method is not particularly limited.

  In step S1104, the CPU 301 of the client device 101 executes a scale setting process in order to set a scale for each user. Details of the scale setting process are shown in FIG. 16 described later. By executing the scale setting process, the scaling factor is stored in the scale information 1011 of the setting information table 1010.

  In step S1105, the CPU 301 of the client device 101 changes the height of the user's viewpoint set in the virtual space according to the scale information corresponding to the user set in step S1104 by the function of the viewpoint control unit 511. (Viewpoint changing means). Then, the information indicating the position of the virtual space position and orientation information 1014 in which the information of the previous frame is stored is overwritten with the information indicating the position of the viewpoint after the change. More specifically, as shown in FIG. 7A, when the user's viewpoint 1201 in the virtual space has coordinates (0, 150, 0), the vertical coordinate is multiplied by the value of the scale information. That is, since the vertical coordinate in the present embodiment is the Y coordinate, “150” that is the Y coordinate is multiplied by, for example, “10” that is the value of the scale information 1011 corresponding to the user. As a result, as shown in FIG. 13, the user's viewpoint 1301 has coordinates (0, 1500, 0).

  In step S1106, the CPU 301 of the client apparatus 101 uses the function of the viewpoint control unit 511 to calculate the viewpoint in the virtual space using the movement amount calculated in step S1103 and the scale information corresponding to the user set in step S1104. Calculate the movement amount. That is, the movement amount of the viewpoint in the virtual space is calculated by multiplying the movement amount calculated in step S1103 by the value of the scale information 1011 (movement amount determination unit).

  In step S1107, the CPU 301 of the client device 101 uses the function of the viewpoint control unit 511 to move the user's viewpoint in the virtual space using the movement amount calculated in step S1106 (viewpoint moving means). That is, since the information indicating the position of the user's viewpoint in the virtual space after the viewpoint height has been changed is stored in the virtual space position and orientation information 1014, the calculated movement amount is added to this position. For example, as shown in FIG. 13, the coordinates of the viewpoint 1301 of the user after changing the height are (0, 1500, 0). Then, the amount of movement (100 cm in the X-axis direction) calculated in step S1103 is multiplied by scale information 1011 (for example, “10”) and added to the position of the viewpoint in the virtual space one frame before. That is, in the real space, the object moves only 100 cm in the X-axis direction, but in the virtual space, the object moves 1000 times, which is ten times as large. Therefore, as shown in a viewpoint 1401 in FIG. 14, the coordinates of the viewpoint 1401 are (1000, 1500, 0). In this way, the viewpoint of the user in the virtual space is moved by the height and the movement amount according to the scale. By performing this for each client device 101, it is possible to change the height of the viewpoint according to the scale information set for each user, and furthermore, it is possible to move the virtual space by the movement amount according to the scale information. Becomes

  Only the change in the position of the user's viewpoint in the virtual space uses the scale information, and the scale information is not applied to the direction (posture) of the viewpoint. For example, when the user's head is rotated 90 degrees to the right, if the rotation angle is multiplied by the value indicated by the scale information, the user will face an unintended direction. In order to prevent this, even if the direction of the user's viewpoint moves in the real space, this movement amount is not multiplied by the scale information.

  In step S <b> 1108, the CPU 301 of the client device 101 transmits the virtual space position and orientation information 1014 and the scale information 1011 stored in the client device 101 to the server device 103 by the function of the communication control unit 501. The virtual space position / posture information 1014 to be transmitted is information in which the height of the viewpoint is changed in step S1105 and the viewpoint is moved in step S1107. The scale information 1011 to be transmitted is the one set in step S1104.

  In step S1109, the CPU 401 of the server device 103 receives the virtual space position and orientation information 1014 and the scale information 1011 transmitted from the client device 101 by the function of the communication control unit 531. The received virtual space position and orientation information 1014 and scale information 1011 overwrite the virtual space position and orientation information 1024 and scale information 1023 of the client information table 1020, respectively. The record to be updated here is a record corresponding to the client device 101 that is the transmission source of each information.

  In step S1110, the CPU 401 of the server apparatus 103 transmits each record (hereinafter, referred to as client information) of the client information table 1020 to the transmission source client apparatus 101 by the function of the communication control unit 531.

  In step S1111, the CPU 301 of the server device 103 receives the client information transmitted from the server device 103 by the function of the communication control unit 501.

  In step S1112, the CPU 301 of the server device 103 uses the function of the object control unit 510 to arrange an avatar indicating another user in the virtual space (a three-dimensional model arrangement unit). The client information received in step S1111 includes virtual space position and orientation information 1014 and scale information 1011 managed by another client device 101. By using this, an avatar, which is a three-dimensional model indicating another user, is arranged in the virtual space. More specifically, the viewpoint of another user is set in the virtual space at the position and orientation indicated by the virtual space position and orientation information 1024 included in the received client information, and the avatar is arranged so that the viewpoint is the head position. I do. Then, the size of the avatar is enlarged or reduced by the magnification indicated by the scale information 1023 (size changing means). At this time, the position of the head is fixed. Further, it is desirable that only avatars of other users are arranged in the virtual space. This is because, even if one's avatar is placed in the virtual space, the view may be obstructed by a three-dimensional model representing the avatar depending on the shape of the avatar.

  By doing so, it is possible to know where other users sharing the same virtual space are, and furthermore, what scale of the user is browsing the virtual space. . FIG. 15 shows a state in which avatars are arranged. When the avatar of another user whose scale information is 10 times is arranged in the virtual space, a three-dimensional model as shown by 1501 in FIG. 15 is displayed in the virtual space. On the other hand, when an avatar of another user whose scale information is one time is arranged in the virtual space, a three-dimensional model as shown by 1502 in FIG. 15 is arranged in the virtual space. In this way, by adjusting the size of the avatar according to the scale information, it is possible to grasp the situation such as whether the user is looking at the virtual space from a bird's-eye view or looking at the virtual space at the same size. .

  In step S1113, the CPU 301 of the client device 101 acquires a virtual space image by capturing the virtual space by the function of the virtual space image acquisition unit 506, and stores the acquired image in the RAM 303 or the like. That is, the virtual space viewed from the viewpoint indicated by the virtual space position and orientation information 1014 is imaged (rendered). Thereby, a virtual space image is generated and stored in the RAM 303 or the like. Note that two virtual space images for the right eye and the left eye are acquired to be displayed on the right-eye and left-eye displays 322 of the HMD 102, respectively.

  In step S1114, the CPU 301 of the client apparatus 101 reads the real space image acquired in step S1101 and the virtual space image acquired in step S1113 from the RAM 303 and the like by the function of the mixed reality image generation unit 507. Then, the virtual space image is superimposed on the real space image to generate a mixed reality image. The generated mixed reality image is stored in the RAM 303 or the like. As described above, the real space image and the virtual space image are each stored in the RAM 303 or the like for the right eye and the left eye, so that the virtual space image for the right eye is superimposed on the real space image for the right eye. Superimpose the virtual space image for the left eye on the real space image for the left eye.

  In step S1115, the CPU 301 of the client device 101 reads the mixed reality image generated in step S1116 from the RAM 303 or the like by the function of the display control unit 508. Then, the image is displayed on the right-eye / left-eye display 322 of the HMD 102 through the video controller 306 (virtual space presentation means). The mixed reality image stored in the RAM 303 or the like has two images for the right eye and the left eye. Therefore, control is performed so that the right-eye mixed reality image is displayed on the right-eye / left-eye display 322 on the right-eye display, and control is performed such that the left-eye mixed reality image is displayed on the right-eye / left-eye display 322 on the left-eye display.

  In step S1116, the CPU 301 of the client device 101 determines whether or not there is an instruction to end the process of presenting the mixed reality to the user wearing the HMD 102. For example, it is determined whether there is an instruction to stop or end the application of the client apparatus 101 that executes the processing of steps S1101 to S1115 described above. If it is determined that the end instruction has been issued, the series of processing ends. If it is not determined that there is an end instruction, that is, if there is no end instruction, the process returns to step S1101, and the processes of steps S1101 to S1115 are repeated until there is an end instruction. As described above, by repeatedly executing the processing of steps S1101 to S1115, information can be updated and presented in real time.

  Next, details of the scale setting process will be described with reference to the flowchart shown in FIG.

  In step S1601, the CPU 301 of the client device 101 refers to the virtual space position and orientation information 1014 using the function of the storage unit 509.

  In step S1602, the CPU 301 of the client device 101 uses the function of the object control unit 510 to determine whether the position of the user's viewpoint indicated by the virtual space position and orientation information 1014 is inside any of the objects arranged in the virtual space. Is determined. By comparing the coordinates of the position of the user's viewpoint with the bounding box surrounding the object, it is determined whether the position of the user's viewpoint is inside the object. If it is determined that the object is inside the object, an object arranged in the virtual space is selected according to the position of the user's viewpoint. The coordinates of the bounding box are managed by the bounding box 1033 of the object information table 1030 shown in FIG.

  The object information table 1030 is a data table stored in the external memory 311 of the client device 101. The object information table 1030 is information included in the virtual space information described above with reference to FIG. The object ID 1031 is an item in which unique identification information assigned to each object is stored. The object-specific scale information 1032 is an item in which scale information corresponding to each object is stored. The bounding box 1033 is an item in which coordinates of a rectangular parallelepiped surrounding the object are stored.

  If the user's viewpoint is located within the range of coordinates indicated by the bounding box 1033, it is determined that the object is inside the object. If it is determined that the position of the user's viewpoint is inside any of the objects, the process proceeds to step S1604. If it is determined that the position of the user's viewpoint is not inside any of the objects, the process proceeds to step S1603.

  In step S1603, the CPU 301 of the client device 101 acquires the magnification stored in the user-set scale information 1000 using the function of the scale setting unit 512, and stores the magnification in the RAM 303.

  On the other hand, in step S1604, the CPU 301 of the client apparatus 101 determines, by the function of the object control unit 510, whether or not there is scale information corresponding to the object whose user's viewpoint is inside. The scale information corresponding to the object refers to the object-specific scale information 1032 of the object, and if the magnification is stored therein, it is determined that the scale information corresponding to the object exists. If it is determined that the scale information corresponding to the object whose user's viewpoint is inside exists, the process proceeds to step S1605. If it is determined that there is no scale information corresponding to the object for which the user's viewpoint is inside, the process advances to step S1603.

  In step S1605, the CPU 301 of the client device 101 obtains, from the object-specific scale information 1032, the scale information corresponding to the object for which the user's viewpoint is determined to be inside by the function of the scale setting unit 512. That is, the magnification stored in the object-specific scale information 1032 is acquired and stored in the RAM 303.

  In step S1606, the CPU 301 of the client apparatus 101 overwrites the scale information 1011 with the scale information stored in the RAM 303 in step S1603 or S1605 by the function of the scale setting unit 512.

  FIG. 17 shows an example where the user's viewpoint is inside the object. The user whose scale information 1011 is “10” times is 1501. When the user moves his or her viewpoint to the inside of the object in order to look inside the house, the user compares the bounding box 1701 with the position of the viewpoint. Thus, when it is determined that the user's viewpoint is inside the object, this object is selected, and the object-specific scale information 1032 corresponding to the selected object can be obtained. In the case of FIG. 17, it is assumed that “1” times can be obtained as the object-specific scale information 1032. Then, this parameter is set in the scale information 1011. When the height of the viewpoint is adjusted using the set scale information 1011, a scale feeling as indicated by 1702 is obtained. In this manner, the scale information corresponding to the object touched by the user makes it possible to change the height and the amount of movement of the user's viewpoint. For example, when browsing the inside of a building, the scale setting screen 900 is displayed. There is no need to set the scale via. That is, it is possible to automatically change the scale simply by touching the object.

  Next, a second embodiment will be described. The second embodiment is a modification of the first embodiment shown in FIG. In the first embodiment, it is determined whether or not the user's viewpoint exists inside the object. In the second embodiment, the scale is adjusted depending on whether or not the viewpoint exists in the area where the object exists. It is a mechanism to make a decision. The area referred to here is a plane area, which corresponds to a land part in a building. That is, when the user enters the land where the building is located, the user can obtain scale information corresponding to the building without looking into the building. Hereinafter, this description will be given.

  Since the second embodiment is a modified example of FIG. 16 in the first embodiment, the drawings other than the object information table 1030 in FIG. 16 and FIG. 10 are the same as those in the first embodiment and will be described. Is omitted.

  Details of the scale setting process in the second embodiment will be described with reference to the flowchart shown in FIG. The scale setting process in the second embodiment is a process in step S1104 in FIG. 11, as in the first embodiment.

  In step S1801, the CPU 301 of the client device 101 refers to the virtual space position and orientation information 1014 by using the function of the storage unit 509.

  In step S1802, the CPU 301 of the client device 101 determines whether the position of the user's viewpoint indicated by the virtual space position / posture information 1014 is within the area of any of the objects arranged in the virtual space by the function of the object control unit 510. Determine whether or not. By comparing coordinates (for example, X coordinates and Z coordinates), which are positions of the user's viewpoint, with a region (for example, an XZ plane) where the object is arranged, the position of the user's viewpoint is within the region of the object. It is determined whether or not. If it is determined that the position of the user's viewpoint is within the object area, the process advances to step S1805. If it is determined that the position of the user's viewpoint is not within the area of the object, the process proceeds to step S1803.

  In step S1803, the CPU 301 of the client device 101 substitutes “0” for the variable Flg by the function of the scale setting unit 512. The variable Flg is a flag indicating whether or not the viewpoint is within the area of any object and the viewpoint of the user has been adjusted using the scale information corresponding to the object.

  In step S1804, the CPU 301 of the client device 101 obtains the magnification stored in the user-set scale information 1000 using the function of the scale setting unit 512, and stores the magnification in the RAM 303.

  On the other hand, in step S1805, the CPU 301 of the client device 101 determines, by the function of the object control unit 510, whether or not there is scale information corresponding to the object whose user's viewpoint is within the area. The scale information corresponding to the object refers to the object-specific scale information 1032 of the object, and if the magnification is stored therein, it is determined that the scale information corresponding to the object exists. If it is determined that there is scale information corresponding to the object for which the user's viewpoint is within the region, the process proceeds to step S1806. If it is determined that there is no scale information corresponding to the object whose user's viewpoint is within the region, the process proceeds to step S1803.

  In step S1806, the CPU 301 of the client device 101 determines whether the variable Flg is “0” by the function of the scale setting unit 512. If it is determined that the variable Flg is “0”, the process proceeds to step S1807. If it is determined that the variable Flg is “1”, the process proceeds to step S1810.

  In step S <b> 1807, the CPU 301 of the client device 101 determines whether or not the scale application direction 1931 exists in the object for which the user's viewpoint is determined to be within the region, using the function of the scale setting unit 512. The scale application direction 1931 is an item of the object information table 1030 shown in FIG. The object information table 1030 according to the second embodiment newly includes the scale application direction 1931 instead of the bounding box 1033 provided in the first embodiment. The scale application direction 1931 is an item in which information indicating a direction in which the object-specific scale information 1032 should be applied is stored. If it is determined that the scale application direction 1931 exists in the object for which the user's viewpoint is within the region, the process advances to step S1808. If it is determined that the scale application direction 1931 does not exist (the scale application direction 1931 is “NULL”) for the object for which the user's viewpoint is within the region, the process proceeds to step S1809.

  In step S1808, the CPU 301 of the client device 101 uses the function of the object control unit 510 to determine whether the scale application direction 1931 of the object for which the user's viewpoint is within the region matches the movement direction of the viewpoint. Is determined. That is, it is determined whether a predetermined condition of the scale application direction 1931 is satisfied. The scale application direction 1931 is a direction having a certain width. Therefore, the scale application direction 1931 and the movement direction of the viewpoint need only be the same movement direction. If it is determined that the scale application direction 1931 of the object for which the user's viewpoint is within the region matches the moving direction of the viewpoint, the process advances to step S1809. If it is not determined that the scale application direction 1931 of the object for which the user's viewpoint is within the region does not match the moving direction of the viewpoint, the process advances to step S1803.

  In step S1809, the CPU 301 of the client device 101 substitutes “1” for the variable Flg by the function of the scale setting unit 512.

  In step S1810, the CPU 301 of the client device 101 acquires, from the object-specific scale information 1032, scale information corresponding to the object for which the user's viewpoint is within the area by the function of the scale setting unit 512. That is, the magnification stored in the object-specific scale information 1032 is acquired and stored in the RAM 303.

  In step S1811, the CPU 301 of the client apparatus 101 overwrites the scale information 1011 with the scale information stored in the RAM 303 in step S1804 or S1810 by the function of the scale setting unit 512. In this way, it is possible to apply either the scale information of the object or the scale information set by the user, depending on whether the position of the user's viewpoint is within the area where the object is located. .

  For example, suppose that the viewpoint moves to the area where the architectural object is arranged when the user 2001 is walking around in the virtual space as shown in FIG. In this case, the object-specific scale information 1032 corresponding to this object is obtained and set in the scale information 1011. That is, the user can browse the object only by moving into the area where the object is arranged, with the sense of scale set for the object.

  Further, as shown in FIG. 21, it is possible to determine whether or not to apply the object-specific scale information 1032 according to the direction from which the object has entered the area where the object is arranged. For example, assume that the scale application direction 1931 of the object is “180 degrees ± 60 degrees”. When the user invades the object from a direction in a range of 120 degrees to 240 degrees (2102), the object-specific scale information 1032 is set in the scale information 1011 (in the example of FIG. 21, 10 times to 1 time). To). With this setting, the position of the viewpoint of the user 2001 in FIG. However, when the vehicle enters from another direction (2101), the original scale information remains (in the example of FIG. 21, it remains at 10 times). In this way, by limiting the direction in which the object-specific scale information 1032 is applied, even if the object has inadvertently entered the area where the object is located, the object-specific scale information 1032 is not applied. This has the effect of ending.

  As described above, even when the height of the viewpoint of the user in the virtual space is changed, it is possible to move the virtual space by an appropriate moving amount for each user.

  The present invention is, for example, possible as an embodiment as a system, an apparatus, a method, a program, a storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. You may apply to the apparatus which consists of three apparatuses.

  Note that the present invention includes a program that directly or remotely supplies a software program that realizes the functions of the above-described embodiments to a system or an apparatus. The present invention also includes a case where the present invention is also achieved by a computer of the system or the apparatus reading and executing the supplied program code.

  Therefore, the program code itself installed in the computer in order to realize (executable) the functional processing of the present invention by the computer also realizes the present invention. That is, the present invention includes the computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of the program, it may be in the form of object code, a program executed by the interpreter, script data supplied to the OS, or the like.

  Examples of a recording medium for supplying the program include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, an MO, a CD-ROM, a CD-R, and a CD-RW. Further, there are a magnetic tape, a nonvolatile memory card, a ROM, a DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a client computer is connected to a homepage on the Internet using a browser. The computer program of the present invention or a compressed file including an automatic installation function can be supplied from the home page by downloading the file to a recording medium such as a hard disk.

  Also, the present invention can be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. In other words, the present invention also includes a WWW server that allows a plurality of users to download a program file for implementing the functional processing of the present invention on a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and downloaded to a user who satisfies predetermined conditions from a homepage via the Internet to download key information for decryption. Let it. It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer to realize the program.

  The functions of the above-described embodiments are implemented when the computer executes the read program. In addition, the OS or the like running on the computer performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on instructions of the program, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of actual processing, and the functions of the above-described embodiments are also realized by the processing.

  It should be noted that the above-described embodiment is merely an example of the embodiment for carrying out the present invention, and the technical scope of the present invention should not be interpreted in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features.

101 Client device 102 HMD
103 server device 201 optical marker 202 infrared camera 301 CPU
302 ROM
303 RAM
304 System bus 305 Input controller 306 Video controller 307 Memory controller 308 Communication I / F controller 309 General-purpose bus 310 Input device 311 External memory 312 Display 321 Right-eye / left-eye video camera 322 Right-eye / left-eye display

Claims (7)

An information processing system for presenting a virtual space,
Storage means for storing a parameter for changing the height of the viewpoint set in the virtual space for each user,
Viewpoint setting means for setting a viewpoint of the user in the virtual space based on a height of the viewpoint of the user existing in the real space;
A viewpoint changing unit that changes the height of the viewpoint of the user set by the viewpoint setting unit in accordance with the parameter corresponding to the user stored in the storage unit;
A moving amount acquiring unit for acquiring a moving amount of the user in the physical space;
Using the parameter corresponding to the user whose moving amount has been acquired by the moving amount acquiring unit and the moving amount of the user acquired by the moving amount acquiring unit, the viewpoint of the user changed by the viewpoint changing unit. Moving amount determining means for determining a moving amount;
An information processing system comprising: a viewpoint moving unit that moves the viewpoint of the user by the moving amount determined by the moving amount determining unit. The information processing system,
Three-dimensional model placement means for placing a three-dimensional model indicating the user in the virtual space,
2. The apparatus according to claim 1, further comprising: a size changing unit configured to change the three-dimensional model arranged by the three-dimensional model arranging unit to a size corresponding to the parameter corresponding to the user indicated by the three-dimensional model. The information processing system as described. The information processing system,
The apparatus according to claim 1, further comprising a parameter calculating unit configured to calculate the parameter corresponding to the user in accordance with a height of a viewpoint of the user existing in the real space and a height of the viewpoint of the user set in the virtual space. Item 3. The information processing system according to item 1 or 2. The information processing system,
A direction obtaining unit that obtains the direction of the user in the real space,
Direction changing means for changing the direction of the viewpoint moved by the viewpoint moving means to the direction acquired by the direction acquiring means,
The method according to claim 1, wherein the direction changing unit changes the direction of a viewpoint in the virtual space without using the moving amount of the user acquired by the moving amount acquiring unit. The information processing system as described. The information processing system,
Virtual space generation means for generating a virtual space for each user;
The virtual space generation means for presenting the virtual space generated by the virtual space generation means to the user corresponding to the virtual space, further comprising: The information processing system as described. A storage method for storing a parameter for changing a height of a viewpoint set in a virtual space for each user, a control method of an information processing system for presenting a virtual space,
A viewpoint setting step of setting a viewpoint of the user in the virtual space, based on a height of the viewpoint of the user existing in the real space,
A viewpoint changing step of changing a viewpoint height of the user set in the viewpoint setting step according to the parameter corresponding to the user stored in the storage unit; ,
A moving amount obtaining unit of the information processing system, the moving amount obtaining step of obtaining a moving amount of the user in the real space;
The moving amount determining means of the information processing system uses the parameter corresponding to the user whose moving amount is obtained in the moving amount obtaining step and the moving amount of the user obtained in the moving amount obtaining step to obtain the viewpoint. A moving amount determining step of determining a moving amount of the viewpoint of the user changed in the changing step;
A viewpoint moving step of moving the viewpoint of the user by the moving amount determined in the moving amount determining step, wherein the viewpoint moving means of the information processing system includes: A program capable of executing a control method of an information processing system for presenting a virtual space, comprising a storage unit that stores a parameter for changing a height of a viewpoint set in a virtual space for each user,
The information processing system,
Viewpoint setting means for setting a viewpoint of the user in the virtual space based on a height of the viewpoint of the user existing in the real space;
A viewpoint changing unit that changes the height of the viewpoint of the user set by the viewpoint setting unit in accordance with the parameter corresponding to the user stored in the storage unit;
A moving amount acquiring unit for acquiring a moving amount of the user in the physical space;
Using the parameter corresponding to the user whose moving amount has been acquired by the moving amount acquiring unit and the moving amount of the user acquired by the moving amount acquiring unit, the viewpoint of the user changed by the viewpoint changing unit. Moving amount determining means for determining a moving amount;
A program that functions as a viewpoint moving unit that moves the viewpoint of the user by the movement amount determined by the movement amount determination unit.

Images