JP2017084215A - Information processing system, control method thereof, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism for browsing a virtual space with a scale corresponding to scale information for each of three-dimensional models arranged in the virtual space.SOLUTION: Scale information for determining a position of a point of sight in a virtual space and a moving amount of the point of sight, is stored for each of three-dimensional models. A three-dimensional model arranged in the virtual space is selected. A position of a point of sight of a user in the virtual space is determined, by use of scale information corresponding to the selected three-dimensional model. A moving amount of use in a real space is acquired. The point of sight of the user is moved with a moving amount to be determined by use of the acquired moving amount of the user and scale information corresponding to the selected three-dimensional model.SELECTED DRAWING: Figure 15

Description

  The present invention relates to an information processing system capable of moving in a virtual space with an appropriate amount of movement even when the height of a user's viewpoint in the virtual space is changed, a control method thereof, and a program.

  As a conventional technique, there is a mechanism in which an image including three-dimensionally modeled CG (Computer Graphics, hereinafter referred to as a three-dimensional model) is superimposed on an image obtained by capturing a real space and presented to an observer. By using this mechanism, it is possible to make the viewer feel as if a three-dimensional model exists in the real space. This mechanism is called mixed reality (hereinafter referred to as MR) or augmented reality.

  In such a mechanism, Patent Document 1 discloses a mechanism that presents a virtual space with a different scale feeling from the real space by setting the user's viewpoint on the virtual space at a height different from the height of the user's viewpoint in the real space. It is disclosed.

JP-A-5-282279

  By the way, there is a case where a design is reviewed at a plurality of bases. In this case, information sharing is performed in real time by using a mechanism that presents the same virtual space including the three-dimensional model to be reviewed to each user at each of the multiple bases using mixed reality. Can do.

  In addition, for example, when the design is relatively large like a building, the user often checks the inside and outside of the building. In particular, when you want to check from the top of the building, you can change the height of the viewpoint in the virtual space by applying the mechanism disclosed in Patent Document 1, and move according to this height The viewpoint can be moved by the amount. By doing this, you can walk around and check as if you were a giant.

  However, even if the mechanism of Patent Document 1 is applied, the height of the viewpoint must be changed between when the inside of the building is viewed and when the outside is viewed. Therefore, the user must make settings each time. Therefore, there was a problem that the building could not be browsed smoothly.

  An object of the present invention is to provide a mechanism capable of browsing a virtual space with a sense of scale corresponding to scale information for each three-dimensional model arranged in the virtual space.

  In order to achieve the above object, an information processing system of the present invention is an information processing system for presenting a virtual space in which a three-dimensional model is arranged, and includes a viewpoint position and a movement amount of the viewpoint in the virtual space. Storage means for storing scale information for determining each 3D model, 3D model selection means for selecting a 3D model arranged in the virtual space, and 3D model selection means. Using the scale information corresponding to the three-dimensional model, the position of the user's viewpoint in the virtual space is determined, viewpoint setting means for setting the viewpoint at the position, and the movement amount of the user in the real space is acquired. A movement amount acquisition unit; a movement amount of the user acquired by the movement amount acquisition unit; and the scan corresponding to the 3D model selected by the 3D model selection unit. And a viewpoint moving means for determining a movement amount of the user's viewpoint set by the viewpoint setting means, and moving the user's viewpoint with the determined movement amount. To do.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to browse virtual space with the feeling of scale according to the scale information for every three-dimensional model arrange | positioned in virtual space.

It is a figure which shows an example of the system configuration | structure of the information processing system in embodiment of this invention. It is a figure which shows an example of the system configuration | structure of MR system. 2 is a diagram illustrating an example of a hardware configuration of a client device 101 and an HMD 102. FIG. 2 is a diagram illustrating an example of a hardware configuration of a server apparatus 103. FIG. 3 is a diagram illustrating an example of functional configurations of a client device 101 and a server device 103. FIG. The flowchart which shows an example of the flow of a process which delivers virtual space from the client apparatus 101-1, and sets a virtual space in each client apparatus 101. FIG. It is a figure which shows a mode that the user's viewpoint in virtual space was set based on the user's viewpoint in real space. It is a flowchart which shows an example of the flow of a process which sets a scale for every user. 6 is a diagram illustrating an example of a screen configuration of a scale setting screen 900. FIG. 5 is a diagram illustrating an example of a table configuration of user setting scale information 1000, a setting information table 1010, a client information table 1020, and an object information table 1030. FIG. It is a flowchart which shows an example of a mixed reality presentation process. It is a figure which shows the case where a user's viewpoint moves in real space. It is a figure which shows a mode that the viewpoint of the user in virtual space was changed according to the scale set for every user. It is a figure which shows a mode that the viewpoint of the user in virtual space moved with the movement amount according to the scale set for every user. It is a figure which shows a mode that the avatar which shows a user is arrange | positioned in virtual space. It is a flowchart which shows an example of a scale setting process. It is a figure which shows a mode that a user looks into an object in virtual space. It is a figure which shows an example of the scale setting process in 2nd Embodiment. It is a figure which shows an example of the table structure of the object information table 1030 in 2nd Embodiment. It is a figure which shows a mode that the magnitude | size of the avatar arrange | positioned in virtual space is changed according to the scale set for every object. It is a figure which shows a mode that it determines whether the scale set to the object is applied depending on from which direction of the object the avatar arrange | positioned in virtual space contacted.

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system according to the first embodiment. The information processing system shown in FIG. 1 is a system that allows users at a plurality of bases to view and share the same virtual space using mixed reality technology (hereinafter referred to as MR technology). The information processing system includes a plurality of MR systems in which the HMD 102 is connected to the client apparatus 101 so as to be able to perform data communication with each other. The client apparatus 101 of each MR system is connected to the server apparatus 103 via a network so as to be communicable. Yes. The connection between the client apparatus 101 and the HMD 102 may be a wired connection or a wireless connection. Any number of MR systems may be included in the information processing system. In the present embodiment, the information includes the MR system to which the client device 101-1 and the HMD 102-1 are connected, the MR system to which the client device 101-2 and the HMD 102-2 are connected, and a plurality of other MR systems. The processing system will be described. In addition, since the MR system may be provided for each room or in the same room, the MR system is described as being provided for each base in the present embodiment, but the present invention is not limited to this. The configuration of various terminals connected on the system of FIG. 1 is an example, and there are various configuration examples depending on the application and purpose.

  The client device 101 is a general-purpose computer. The client device 101 captures a real space image (hereinafter referred to as a real space image) captured (captured) by the HMD 102 and a virtual space image (hereinafter referred to as a virtual space image) generated by the client device 101. Superimpose. The image generated in this way (hereinafter referred to as a mixed reality image) is transmitted to the HMD 102. Since the conventional technique is used for the MR technique, a detailed description is omitted. The client device 101 may be a personal computer or a large computer such as a server. Furthermore, a mobile terminal such as a mobile phone or a tablet terminal may be used. The type of computer is not particularly limited. Further, the processing may be performed by one client device 101 without installing the client device 101 at each site. That is, one client apparatus 101 may construct each MR system in the present embodiment. Further, the location where the client apparatus 101 is installed is not particularly limited.

  The HMD 102 is a head mounted display. The HMD 102 is a device that is worn on the user's head, and includes a right-eye and left-eye video camera, and a right-eye and left-eye display. The HMD 102 transmits a real space image photographed by the video camera of the HMD 102 to the client device 101. The mixed reality image is received from the client apparatus 101 and displayed on the display. Since the HMD 102 is provided with displays for the right eye and the left eye, a stereoscopic effect can be obtained by parallax. The physical space image captured by the HMD 102 and the mixed reality image displayed by the HMD 102 are preferably moving images (video), but may be still images captured at a predetermined interval. Further, a device in which a display and a video camera are installed on the front and back of the hardware, such as a smartphone, may be used as a substitute for the head mounted display.

  FIG. 2 is a diagram showing an example of the system configuration of the MR system at each site. As described above, the client device 101 is communicably connected to the HMD 102. Further, an infrared camera 202 is connected to the client device 101. The infrared camera 202 is an optical sensor using infrared rays. The infrared camera 202 irradiates the real space with infrared rays and shoots the infrared rays reflected by the objects in the real space, thereby specifying the position and orientation of the objects in the real space in the coordinate system defined by the infrared camera 202. Using this infrared camera 202, the position and orientation (direction, inclination, direction of line of sight, etc .; the same applies hereinafter) of the HMD 102 (that is, the user) in the real space are specified. The HMD 102 includes an object that reflects infrared rays, which is an optical marker 201, and the infrared camera 202 can identify the position and orientation of the HMD 102 by photographing the infrared rays reflected by the optical marker 201. It is desirable to install a plurality of infrared cameras 202 in the MR system so that the optical marker 201 of the HMD 102 worn by the user can be photographed or detected regardless of the position or posture of the user. Further, the HMD 102 that can specify the position and orientation is the HMD 102 that exists in the imaging range of the infrared camera 202.

  In the present embodiment, the infrared camera 202 is used to identify the position and orientation of the HMD 102 in the real space, but the present invention is not limited to this as long as the position and orientation of the HMD 102 in the real space can be identified. For example, a magnetic sensor may be used, or an image captured by the HMD 102 may be analyzed to specify the position and orientation.

  FIG. 3 is a diagram illustrating an example of each hardware configuration of the client apparatus 101 and the HMD 102.

  The CPU 301 comprehensively controls each device and controller connected to the system bus 304.

  Further, the ROM 302 or the external memory 311 stores a basic input / output system (BIOS) that is a control program of the CPU 301 and an operating system. Furthermore, various programs to be described later necessary for realizing the functions executed by various apparatuses are stored. A RAM 303 functions as a main memory, work area, and the like for the CPU 301.

  The CPU 301 implements various operations by loading a program or the like necessary for execution of processing into the RAM 303 and executing the program.

  An input controller (input C) 305 controls input from a pointing device (input device 310) such as a keyboard and a mouse.

  A video controller (VC) 306 of the client apparatus 101 controls display on a display device such as a right-eye / left-eye display 322 or a display 312 provided in the HMD 102. For example, an external output terminal (for example, Digital Visual Interface) is used for output to the right eye / left eye display 322. The right-eye / left-eye display 322 includes a right-eye display and a left-eye display. The display 312 is a liquid crystal display or the like, and displays the same display as the right-eye / left-eye display 322 or a GUI (Graphical User Interface) for operating the virtual space.

  A memory controller (MC) 307 controls access to an external memory 311 (storage means) that stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like. The external memory 311 includes, for example, a hard disk (HD), a flexible disk (FD), or a card type memory connected to a PCMCIA card slot via an adapter.

  A communication I / F controller (communication I / FC) 308 is connected to and communicates with an external device via a network, and executes communication control processing in the network. For example, Internet communication using TCP / IP is possible. In particular, the communication I / F controller 308 of the client apparatus 101 also controls communication with the infrared camera 202.

  The general-purpose bus 309 of the client apparatus 101 is used for capturing images captured by the right-eye / left-eye video camera 321 of the HMD 102 connected to the client apparatus 101. Input from the right-eye / left-eye video camera 321 is performed using an external input terminal (for example, an IEEE 1394 terminal). The right-eye / left-eye video camera 321 includes a right-eye video camera and a left-eye video camera.

  For example, the CPU 301 can perform display on the display by executing an outline font rasterization process on a display information area in the RAM 303. Further, the CPU 301 enables a user instruction with a mouse cursor (not shown) on the display.

  Various programs and the like used for the client apparatus 101 of the present invention to execute various processes described later are recorded in the external memory 311 and are executed by the CPU 301 by being loaded into the RAM 303 as necessary. . Furthermore, definition files and various information tables used by the program according to the present invention are stored in the external memory 311.

  FIG. 4 is a diagram illustrating a hardware configuration of the server apparatus 103. Note that the hardware configuration shown in FIG. 4 is merely an example.

  The CPU 401 comprehensively controls each device and controller connected to the system bus 404.

  In addition, the ROM 402 or the external memory 411 stores a BIOS (Basic Input / Output System) that is a control program of the CPU 401 and an operating system program. The external memory 411 stores various programs necessary for realizing the functions executed by the server apparatus 103. The RAM 403 functions as a main memory, work area, and the like for the CPU 401.

  The CPU 401 implements various operations by loading a program or the like necessary for execution of processing into the RAM 403 and executing the program.

  The input controller 405 controls input from an input device 409 such as a keyboard or a pointing device such as a mouse.

  The video controller 406 controls display on a display device such as the display 412. The display device may be a CRT or a liquid crystal display.

  The memory controller 407 controls access to an external memory 411 such as a hard disk, a flexible disk, or a card type memory connected to the PCMCIA card slot via an adapter. The external memory 411 stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like.

  The communication I / F controller 408 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, Internet communication using TCP / IP is possible.

  Note that the CPU 401 enables display on the display 412 by executing outline font development (rasterization) processing on a display information area in the RAM 403, for example. Further, the CPU 401 enables a user instruction with a mouse cursor (not shown) on the display 412.

  Various programs used for the server apparatus 103 of the present invention to execute various processes to be described later are recorded in the external memory 411. These various programs are executed by the CPU 401 by being loaded into the RAM 403 as necessary. Furthermore, definition files and various information tables used by the program according to the present invention are stored in the external memory 411.

  FIG. 5 is a functional configuration diagram illustrating functional configurations of the client device 101 and the server device 103. Note that the functional configurations of the client device 101 and the server device 103 in FIG. 5 are merely examples, and there are various configuration examples depending on applications and purposes.

  The client device 101 includes, as function units, a communication control unit 501, a position / orientation acquisition unit 502, a position / orientation identification unit 503, a real space image acquisition unit 504, a virtual space generation unit 505, and a virtual space image acquisition unit 506. A mixed reality image generation unit 507. In addition, a display control unit 508, a storage unit 509, an object control unit 510, a viewpoint control unit 511, and a scale setting unit 512 are provided.

  The communication control unit 501 is a functional unit that transmits and receives various types of information between the HMD 102 and the infrared camera 202 that can communicate with the client apparatus 101. The communication control unit 501 transmits / receives information to / from these apparatuses through the video controller 306, the communication I / F controller 308, the general-purpose bus 309, and the like described above. The communication control unit 501 also transmits and receives various types of information between the other client apparatuses 101 and the server apparatus 103.

  The position / orientation acquisition unit 502 is a functional unit that acquires information indicating the position and orientation (orientation) in the real space of the device including the optical marker 201 from the infrared camera 202. In this embodiment, since the HMD 102 includes the optical marker 201, the position and orientation acquisition unit 502 analyzes the position and orientation of the HMD 102 in the real space analyzed by the infrared camera 202 (the position and orientation of the user wearing the HMD 102). The same shall apply hereinafter). Further, the position / orientation acquisition unit 502 uses the real space image for the right eye and the real space image for the left eye acquired from the right eye / left eye video camera 321 by the real space image acquisition unit 504, by a method such as triangulation, etc. It is also possible to specify the position and orientation of an object in the real space.

  The position / orientation specifying unit 503 is a functional unit that specifies the position and orientation (orientation) in the virtual space corresponding to the position and orientation (orientation) of the HMD 102 in the real space acquired by the position and orientation acquiring unit 502. The real space coordinate system (the coordinate system of the infrared camera 202) and the virtual space coordinate system are calibrated in advance, and the real space and the virtual space are associated with each other. That is, the position and orientation in the virtual space corresponding to the position and orientation of the HMD 102 in the real space are specified based on this association.

  The real space image acquisition unit 504 is a functional unit that acquires a real space image captured by the right-eye / left-eye video camera 321 of the HMD 102.

  The virtual space generation unit 505 is a functional unit that generates a virtual space based on information stored in the external memory 311 of the client device 101. Since the virtual space is a virtual space generated inside the client apparatus 101, information related to the shape and size of the space is stored in the external memory 311, and the virtual space is generated based on the information. An object composed of a three-dimensional model can be arranged in the virtual space. Objects are arranged by the object control unit 510.

  The virtual space image acquisition unit 506 is a functional unit that acquires an image of the virtual space generated by the virtual space generation unit 505. When the virtual space image acquisition unit 506 acquires a virtual space image, the viewpoint control unit 511 sets the viewpoint in the virtual space based on the position and orientation of the HMD 102 in the virtual space specified by the position / orientation specifying unit 503. . And the virtual space image at the time of seeing from the said viewpoint is produced | generated, and this is acquired. A virtual camera may be installed at this viewpoint to image the virtual space. That is, it renders.

  The mixed reality image generation unit 507 is a functional unit that generates a mixed reality image by superimposing the virtual space image acquired by the virtual space image acquisition unit 506 on the real space image acquired by the real space image acquisition unit 504.

  The display control unit 508 is a functional unit that performs display control of various types of information on the right-eye / left-eye display 322 of the HMD 102 connected to the client apparatus 101 and the display 312 connected to the client apparatus 101. In particular, it has a function of displaying the mixed reality image generated by the mixed reality image generation unit 507 on the right-eye / left-eye display 322 of the HMD 102.

  The storage unit 509 is a functional unit for storing information on various tables to be described later, information for generating a virtual space, information on objects, and the like. Add, update, and delete information as necessary. In the present embodiment, description will be made assuming that a common virtual space or object is stored in the storage unit 509 of each client apparatus 101.

  The object control unit 510 is a functional unit for arranging an object composed of a three-dimensional model in a virtual space. When the virtual space is generated, the object is arranged at a predefined position and posture. If necessary, rearrange the arranged objects at different positions and postures.

  The viewpoint control unit 511 is a functional unit for setting the user's viewpoint in the virtual space based on the position and orientation of the user existing in the real space. The position and posture of the user existing in the real space, that is, the position and posture of the HMD 102. Therefore, the position and orientation acquisition unit 502 acquires the position and orientation of the optical marker 201 included in the HMD 102, specifies the position and orientation in the virtual space by the position and orientation identification unit 503, and the user's viewpoint based on the identified position and orientation To the virtual space. In addition, the viewpoint control unit 511 can change the height of the viewpoint in the virtual space or move the viewpoint.

  The scale setting unit 512 is a functional unit for setting, for each user, scale information for changing the viewpoint height and viewpoint movement amount set in the virtual space. The scale setting unit 512 manages the scale information received for each user in association with the user. The scale information is a parameter designated by the user, and specifically indicates a magnification. For example, when the scale information is “2”, it indicates twice, so the viewpoint height set in the virtual space is set to twice the normal height.

  Next, the server apparatus 103 includes a communication control unit 531 and a storage unit 532 as functional units.

  The communication control unit 531 is a functional unit that transmits and receives various types of information to and from the client device 101 that can communicate with the server device 103. The communication control unit 531 transmits and receives information to and from the client apparatus 101 through the communication I / F controller 308 described above.

  The storage unit 532 is a functional unit for storing information such as various tables described later. Add, update, and delete information as necessary.

  Next, the flow of processing for distributing the virtual space from the client device 101-1 and setting the virtual space in each client device 101 will be described using the flowchart shown in FIG. 6.

  In step S <b> 601, the CPU 301 of the client apparatus 101-1 acquires virtual space information stored in the external memory 311 of the client apparatus 101-1 by using the function of the storage unit 509. The virtual space information is various pieces of information for generating a virtual space. Specifically, it is information necessary for forming the virtual space, such as the shape and size of the virtual space, the object to be arranged, and the arrangement location thereof. This virtual space information can be created by a dedicated CAD application installed in the client apparatus 101. However, this dedicated application is not necessarily installed on all client apparatuses 101. Therefore, in step S602 to be described later, the generated virtual space information is distributed, that is, transmitted to other client apparatuses 101.

  In step S <b> 602, the CPU 301 of the client apparatus 101-1 transmits the virtual space information acquired in step S <b> 601 to the server apparatus 103 by the function of the communication control unit 501.

  In step S603, the CPU 301 of the client device 101-1 generates a virtual space using the virtual space information acquired in step S601 by the function of the virtual space generation unit 505. The generated virtual space is a virtual space having a shape and size indicated by the virtual space information, and an object indicated by the virtual space information is arranged on the virtual space. A dedicated viewer application for MR experience is installed in the client apparatus 101-1, and a virtual space is generated by the viewer application. That is, a CAD application is required to create virtual space information, and a viewer application is required to generate a virtual space.

  In step S604, the CPU 301 of the client device 101-1 sets the user's viewpoint on the virtual space generated in step S604 by the function of the viewpoint control unit 511. Based on the height of the viewpoint of the user wearing the HMD 102-1 capable of communicating with the client apparatus 101-1, the viewpoint of the user is set in the virtual space. FIG. 7 is a diagram illustrating a case where the viewpoint is set on the virtual space in step S604. As shown in FIG. 7B, when the coordinates of the user's viewpoint 702 (that is, the position of the HMD 102) existing in the real space are (0, 150, 0), as shown in FIG. The user's viewpoint 701 is set at the position of coordinates (0, 150, 0) in the virtual space.

  In step S605, the CPU 301 of the client device 101-1 executes mixed reality presentation processing so that the user can experience mixed reality via the HMD 102-1. Details of the mixed reality presentation process are shown in FIG.

  On the other hand, in step S606, the CPU 401 of the server apparatus 103 receives the virtual space information transmitted from the client apparatus 101-1 in step S602 by the function of the communication control unit 531. In step S <b> 607, the CPU 401 of the server apparatus 103 transmits the virtual space information received in step S <b> 606 to the client apparatus 101 with which the server apparatus 103 can communicate using the function of the communication control unit 531. Here, since it is not necessary to transmit the virtual space information to the client apparatus 101-1 that is the transmission source of the virtual space information received in step S <b> 606, it is desirable not to transmit it.

  In step S608, the CPU 301 of the client apparatus 101-2 receives the virtual space information transmitted from the server apparatus 103 in step S607 by the function of the communication control unit 501. The received virtual space information is stored in the external memory 311 of the client device 101-2.

  In step S609, the CPU 301 of the client device 101-2 generates a virtual space using the virtual space information received in step S608 by the function of the virtual space generation unit 505. The generation of the virtual space is the same as that in step S603. As a result, the same virtual space is generated in any client apparatus 101. Further, if the CAD application is not installed in the client apparatus 101, the virtual space information cannot be created / edited by itself, but the CAD application becomes unnecessary by receiving the virtual space information from another client apparatus 101. However, if the CAD application is not installed, the size and shape of the virtual space and the arrangement position of the objects cannot be changed. That is, the virtual space cannot have a different size or shape for each client device 101.

  In step S610, the CPU 301 of the client device 101-2 sets the user's viewpoint on the virtual space generated in step S609 by the function of the viewpoint control unit 511. The setting of the viewpoint is the same as in step S604.

  In step S611, the CPU 301 of the client device 101-2 executes mixed reality presentation processing so that the user can experience mixed reality via the HMD 102-2. Details of the mixed reality presentation process are shown in FIG.

  Thus, by distributing virtual space information from one client device 101 to another client device 101, the same virtual space can be generated in any client device 101. Further, each client device 101 can cause each user to experience mixed reality using the generated common virtual space.

  Next, the flow of processing for setting a scale for each user will be described with reference to the flowchart shown in FIG.

  The series of processes shown in FIG. 8 is executed as a process different from the series of processes shown in FIG. Therefore, it may be executed at any timing. That is, the scale information can be changed to an arbitrary magnification in real time even during the mixed reality presentation process of FIG. 11 described later.

  In step S <b> 801, the CPU 301 of the client apparatus 101 displays a scale setting screen 900 as shown in FIG. 9 on the display 312 by the function of the display control unit 508. And the input with respect to the input form and button with which the scale setting screen 900 is provided is received.

  The scale setting screen 900 is a screen for setting scale information. The scale setting screen 900 includes an input form 901 for inputting scale information, a setting button 902 for saving scale information input to the input form, and the like. The input form 901 includes an input form for inputting scale information, that is, a magnification, and an input form for inputting the height of the changed viewpoint. The user selects one of these by a radio button and inputs a parameter.

  If it is detected that the setting button 902 is pressed while a parameter is input to the input form 901, in step S802, the CPU 301 of the client apparatus 101 acquires the parameter input to the input form 901 by the function of the storage unit 509. Then, the acquired parameter is stored in the user setting scale information 1000 (see FIG. 10) as scale information. Here, when an input form for inputting a magnification is input, the input magnification is stored in the user setting scale information 1000 as it is. On the other hand, when it is entered in the input form for entering the height of the changed viewpoint, the magnification is calculated based on the current viewpoint height of the user in the virtual space and the input height. The scale factor thus stored is stored in the user setting scale information 1000. That is, it may be calculated by “input height ÷ current user viewpoint height”. The calculation method is not limited to this.

  In step S803, the CPU 301 of the client apparatus 101 transmits the scale information stored in the user setting scale information 1000 in step S802 to the server apparatus 103 by the function of the communication control unit 501.

  In step S804, the CPU 401 of the server apparatus 103 receives the scale information transmitted from the client apparatus 101 in step S803 by the function of the communication control unit 531. In step S805, the CPU 401 of the server apparatus 103 stores the scale information received in step S804 in the client information table 1020 illustrated in FIG. 10 by the function of the storage unit 532.

  The client information table 1020 is a data table stored in the external memory 411 of the server device 103. The client information table 1020 includes a client ID 1021, connection destination information 1022, scale information 1023, and virtual space position / orientation information 1024. Each item included in the client information table 1020 is merely an example, and the present invention is not limited to this.

  The client ID 1021 is an item in which unique identification information assigned to each client device 101 is stored. The connection destination information 1022 is an item in which information such as an IP address indicating a connection destination of the client apparatus 101 is stored. Scale information 1023 is an item in which scale information set in the client apparatus 101 is stored. The virtual space position / orientation information 1024 is an item in which information indicating the position and orientation of the user in the virtual space set by the client apparatus 101 is stored.

  In step S804, when scale information is stored in the client information table 1020, a new record is created and a client ID 1021 is issued. Then, the IP address or the like of the client apparatus 101 that is the transmission source of the scale information is stored in the connection destination information 1022, and the received scale information is stored in the scale information 1023.

  In the present embodiment, since one HMD 102 is connected to one client device 101, the user wearing the HMD 102 and the client device 101 are associated with each other. That is, the scale information set in the client apparatus 101 is scale information corresponding to the user who wears the HMD 102 connected to the client apparatus 101. Therefore, the information processing system accepts the setting of scale information for each user and saves it. Then, the server apparatus 103 manages scale information of each user in the client information table 1020.

  Next, details of the mixed reality presentation process will be described with reference to the flowchart shown in FIG.

  In step S <b> 1101, the CPU 301 of the client apparatus 101 acquires a real space image from the right eye / left eye video camera 321 of the HMD 102 by the function of the real space image acquisition unit 504, and stores this in the RAM 303.

  In step S <b> 1102, the CPU 301 of the client apparatus 101 acquires information indicating the position and attitude in the real space of the HMD 102 that can communicate with the client apparatus 101 by the function of the position / orientation acquisition unit 502 and stores the information in the RAM 303. As described above, information indicating the position and orientation specified by the infrared camera 202 detecting the optical marker 201 included in the HMD 102 is acquired from the infrared camera 202. Then, it is stored in the current position / orientation information 1012 of the setting information table 1010 shown in FIG. When the current position and orientation information 1012 is already stored, the information indicating the stored position and orientation is copied to the previous position and orientation information 1013, and the information indicating the newly acquired position and orientation is the current position and orientation information. 1012 is overwritten. In addition, the posture information stored in the virtual space position and posture information 1014 is overwritten with the acquired posture information in the real space.

  For example, if the previous frame is the position of the viewpoint 702 in FIG. 7B and the current frame is the position of the viewpoint 1201 in FIG. 12, coordinates (0, 150, 0) are included in the previous position and orientation information 1013. The coordinates (100, 150, 0) are stored in the current position / orientation information 1012. The term “frame” used herein refers to a frame of video displayed on the HMD 102.

  The setting information table 1010 is a data table stored in the external memory 311 of the client device 101. The setting information table 1010 includes scale information 1011, current position and orientation information 1012, previous position and orientation information 1013, and virtual space position and orientation information 1014.

  The scale information 1011 is an item in which a magnification indicating a feeling of scale when the user browses the virtual space is stored. The current position / orientation information 1012 is an item in which information indicating the position and orientation of the user in the current frame is stored. The previous position / posture information 1013 is an item in which information indicating the position and posture of the user in the previous frame is stored. The virtual space position and orientation information 1014 is an item in which information indicating the position and orientation of the user in the virtual space is stored. The virtual space position / orientation information 1014 stores information indicating the position and orientation set in steps S604 and S610 described above as initial values.

  In step S <b> 1103, the CPU 301 of the client apparatus 101 calculates the amount of movement of the HMD 102 in the real space by the function of the position / orientation specifying unit 503. More specifically, by using the position of the HMD 102 obtained in the previous space in the real space (previous position and orientation information 1013) and the position of the HMD 102 acquired at the current time (current position and orientation information 1012), the amount of movement Calculate whether it was done. For example, the time point one frame before is the position of the viewpoint 702 in FIG. 7B (coordinates (0, 150, 0)), and at the present time the position of the viewpoint 1201 shown in FIG. 12 (coordinates (100, 150, 0)). If so, it can be seen that it has moved 100 cm in the X-axis direction. Therefore, this 100 cm is set as the movement amount of the HMD 102 in the real space. The distance between the two points may be calculated by, for example, the three-square theorem. The calculation method is not particularly limited.

  In step S1104, the CPU 301 of the client apparatus 101 executes scale setting processing so as to perform scale setting for each user. Details of the scale setting process are shown in FIG. By executing the scale setting process, the magnification is stored in the scale information 1011 of the setting information table 1010.

  In step S1105, the CPU 301 of the client apparatus 101 changes the height of the user's viewpoint set in the virtual space according to the scale information corresponding to the user set in step S1104 by the function of the viewpoint control unit 511. (Viewpoint setting means). Then, the information indicating the position of the viewpoint after the change is overwritten with the information indicating the position of the virtual space position and orientation information 1014 in which the information of the previous frame is stored. More specifically, as shown in FIG. 7A, when the user's viewpoint 1201 in the virtual space is the coordinate (0, 150, 0), the vertical coordinate is multiplied by the value of the scale information. That is, since the vertical coordinate in the present embodiment is the Y coordinate, “150” that is the Y coordinate is multiplied by “10” that is the value of the scale information 1011 corresponding to the user, for example. As a result, as shown in FIG. 13, the user's viewpoint 1301 has coordinates (0, 1500, 0).

  In step S1106, the CPU 301 of the client apparatus 101 uses the function of the viewpoint control unit 511 to calculate the viewpoint in the virtual space using the movement amount calculated in step S1103 and the scale information corresponding to the user set in step S1104. The amount of movement is calculated. That is, the movement amount of the viewpoint in the virtual space is calculated (acquired) by multiplying the movement amount calculated in step S1103 by the value of the scale information 1011 (movement amount acquisition means).

  In step S1107, the CPU 301 of the client apparatus 101 moves the viewpoint of the user in the virtual space using the movement amount calculated in step S1106 by the function of the viewpoint control unit 511 (viewpoint moving unit). That is, since the information indicating the position of the viewpoint of the user in the virtual space after changing the height of the viewpoint is stored in the virtual space position / orientation information 1014, the calculated movement amount is added to this position. For example, as shown in FIG. 13, the coordinates of the user's viewpoint 1301 after changing the height are (0, 1500, 0). This is multiplied by scale information 1011 (for example, “10”) by the movement amount calculated in step S1103 (100 cm in the X-axis direction) and added to the viewpoint position in the virtual space one frame before. That is, only 100 cm is moved in the X-axis direction in the real space, but it is moved 1000 cm, which is ten times that in the virtual space. Therefore, as shown in the viewpoint 1401 of FIG. 14, the coordinates of the viewpoint 1401 are (1000, 1500, 0). In this way, the user's viewpoint in the virtual space is moved with a height and movement amount corresponding to the scale. By executing this for each client device 101, the height of the viewpoint can be changed according to the scale information set for each user, and the virtual space can be moved by the movement amount corresponding to the scale information. It becomes.

  The scale information is only used to change the position of the user's viewpoint in the virtual space, and the scale information is not applied to the direction (posture) of the viewpoint. For example, when the user's head is rotated 90 degrees to the right, if this rotation angle is multiplied by the value indicated by the scale information, the user will turn in an unintended direction. In order to prevent this, even if the orientation of the user's viewpoint moves in the real space, this movement amount is not multiplied by the scale information.

  In step S <b> 1108, the CPU 301 of the client apparatus 101 transmits the virtual space position / orientation information 1014 and the scale information 1011 stored in the client apparatus 101 to the server apparatus 103 by the function of the communication control unit 501. The transmitted virtual space position / orientation information 1014 is obtained by changing the viewpoint height in step S1105 and moving the viewpoint in step S1107. The scale information 1011 to be transmitted is set in step S1104.

  In step S <b> 1109, the CPU 401 of the server apparatus 103 receives the virtual space position / orientation information 1014 and the scale information 1011 transmitted from the client apparatus 101 by the function of the communication control unit 531. The received virtual space position / orientation information 1014 and scale information 1011 overwrite the virtual space position / orientation information 1024 and scale information 1023 of the client information table 1020, respectively. The record to be updated here is a record corresponding to the client apparatus 101 that is the transmission source of each information.

  In step S <b> 1110, the CPU 401 of the server apparatus 103 transmits each record (hereinafter referred to as client information) of the client information table 1020 to the transmission source client apparatus 101 using the function of the communication control unit 531.

  In step S <b> 1111, the CPU 301 of the server apparatus 103 receives the client information transmitted from the server apparatus 103 by the function of the communication control unit 501.

  In step S <b> 1112, the CPU 301 of the server apparatus 103 arranges an avatar indicating another user on the virtual space by the function of the object control unit 510 (three-dimensional model arrangement unit). The client information received in step S1111 includes virtual space position / orientation information 1014 and scale information 1011 managed by another client apparatus 101. By using this, an avatar, which is a three-dimensional model indicating another user, is placed on the virtual space. More specifically, the viewpoint of another user is set in the virtual space with the position and orientation indicated by the virtual space position / orientation information 1024 included in the received client information, and the avatar is arranged so that the viewpoint becomes the head position. To do. Then, the size of the avatar is enlarged or reduced at a magnification indicated by the scale information 1023 (size changing means). At this time, the head position is fixed. Moreover, it is desirable to arrange only the avatars of other users in the virtual space. This is because even if one's own avatar is placed in the virtual space, depending on the shape of the avatar, the field of view may be blocked by a three-dimensional model showing the avatar.

  By doing so, it becomes possible to grasp where other users sharing the same virtual space are located, and what scale the user is browsing the virtual space. . FIG. 15 shows a state where an avatar is arranged. When an avatar of another user whose scale information is 10 times is placed in the virtual space, a three-dimensional model as indicated by 1501 in FIG. 15 is displayed in the virtual space. On the other hand, when an avatar of another user whose scale information is one is arranged in the virtual space, a three-dimensional model as indicated by 1502 in FIG. 15 is arranged in the virtual space. In this way, by adjusting the size of the avatar according to the scale information, it becomes possible to grasp the situation whether the virtual space is seen from a bird's-eye view or whether the virtual space is seen in life size. .

  In step S <b> 1113, the CPU 301 of the client apparatus 101 acquires a virtual space image by imaging the virtual space using the function of the virtual space image acquisition unit 506, and stores this in the RAM 303 or the like. That is, the virtual space viewed from the viewpoint indicated by the virtual space position and orientation information 1014 is imaged (rendered). As a result, a virtual space image is generated and stored in the RAM 303 or the like. Note that two images, a right-eye virtual space image and a left-eye virtual space image, are acquired for display on each of the right-eye and left-eye displays 322 of the HMD 102.

  In step S <b> 1114, the CPU 301 of the client apparatus 101 reads out the real space image acquired in step S <b> 1101 and the virtual space image acquired in step S <b> 1113 from the RAM 303 or the like by the function of the mixed reality image generation unit 507. Then, the virtual space image is superimposed on the real space image to generate a mixed reality image. The generated mixed reality image is stored in the RAM 303 or the like. As described above, since the real space image and the virtual space image are stored in the RAM 303 or the like for each of the right eye and the left eye, the virtual space image for the right eye is superimposed on the real space image for the right eye. The virtual space image for the left eye is superimposed on the real space image for the left eye.

  In step S1115, the CPU 301 of the client apparatus 101 reads the mixed reality image generated in step S1116 from the RAM 303 or the like by the function of the display control unit 508. Then, the image is displayed on the right eye / left eye display 322 of the HMD 102 through the video controller 306. The mixed reality image stored in the RAM 303 or the like has two images for the right eye and the left eye. Therefore, control is performed so that the mixed reality image for the right eye is displayed on the right eye display of the right eye / left eye display 322, and the mixed reality image for the left eye is displayed on the left eye display of the right eye / left eye display 322.

  In step S <b> 1116, the CPU 301 of the client apparatus 101 determines whether there is an instruction to end the process of presenting mixed reality to the user wearing the HMD 102. For example, it is determined whether or not there has been an instruction to stop or end the application of the client apparatus 101 that executes the processes of steps S1101 to S1115 described above. If it is determined that an end instruction has been issued, the series of processes ends. If it is not determined that there is an end instruction, that is, if there is no end instruction, the process returns to step S1101, and steps S1101 to S1115 are repeated until an end instruction is issued. In this way, by repeatedly executing the processing from step S1101 to step S1115, information can be updated and presented in real time.

  Next, the details of the scale setting process will be described using the flowchart shown in FIG.

  In step S <b> 1601, the CPU 301 of the client apparatus 101 refers to the virtual space position / orientation information 1014 using the function of the storage unit 509.

  In step S1602, the CPU 301 of the client apparatus 101 determines whether the position of the user's viewpoint indicated by the virtual space position / orientation information 1014 is inside any of the objects arranged in the virtual space by the function of the object control unit 510. Determine whether. It is determined whether or not the position of the user's viewpoint is inside the object by comparing the coordinates that are the position of the user's viewpoint and the bounding box surrounding the object. If it is determined that the object is inside the object, an object arranged in the virtual space is selected according to the position of the viewpoint of the user (three-dimensional model selection means). The coordinates of the bounding box are managed by the bounding box 1033 of the object information table 1030 shown in FIG.

  The object information table 1030 is a data table stored in the external memory 311 of the client device 101. The object information table 1030 is information included in the virtual space information described above with reference to FIG. The object ID 1031 is an item in which unique identification information assigned to each object is stored. The object specific scale information 1032 is an item in which scale information corresponding to each object is stored. The bounding box 1033 is an item in which coordinates of a rectangular parallelepiped surrounding the object are stored.

  If the user's viewpoint is located within the coordinate range indicated by the bounding box 1033, it is determined that the object is inside the object. If it is determined that the position of the user's viewpoint is inside one of the objects, the process proceeds to step S1604. If it is determined that the position of the user's viewpoint is not inside any object, the process advances to step S1603.

  In step S <b> 1603, the CPU 301 of the client apparatus 101 acquires the magnification stored in the user setting scale information 1000 by the function of the scale setting unit 512 and stores it in the RAM 303.

  On the other hand, in step S <b> 1604, the CPU 301 of the client apparatus 101 determines whether there is scale information corresponding to an object for which the user's viewpoint is inside by the function of the object control unit 510. The scale information corresponding to the object refers to the object specific scale information 1032 of the object, and if the magnification is stored here, it is determined that the scale information corresponding to the object exists. If it is determined that there is scale information corresponding to the object for which the user's viewpoint is located, the process proceeds to step S1605. If it is determined that there is no scale information corresponding to the object for which the user's viewpoint is located, the process proceeds to step S1603.

  In step S <b> 1605, the CPU 301 of the client apparatus 101 acquires scale information corresponding to the object whose user viewpoint is inside from the object-specific scale information 1032 by the function of the scale setting unit 512. That is, the magnification stored in the object specific scale information 1032 is acquired and stored in the RAM 303.

  In step S1606, the CPU 301 of the client device 101 overwrites the scale information 1011 with the scale information stored in the RAM 303 in step S1603 or step S1605 by the function of the scale setting unit 512.

  FIG. 17 shows an example in which the user's viewpoint exists inside the object. A user whose scale information 1011 is “10” times is 1501. When the user moves his / her viewpoint to the inside of the object in order to look inside the house, the bounding box 1701 is compared with the position of the viewpoint. Thus, when it is determined that the user's viewpoint exists inside the object, this object is selected, and object-specific scale information 1032 corresponding to the selected object can be acquired. In the case of FIG. 17, it is assumed that “1” times can be acquired as the object unique scale information 1032. Then, this parameter is set in the scale information 1011. When the height of the viewpoint is adjusted using the set scale information 1011, a scale feeling as indicated by 1702 is obtained. As described above, the scale information corresponding to the object touched by the user can be used to change the height and movement amount of the user's viewpoint. The need to set the scale via That is, the scale can be automatically changed simply by touching the object.

  Next, a second embodiment will be described. The second embodiment is a modification of FIG. 16 in the first embodiment. In the first embodiment, it is determined whether or not the user's viewpoint exists inside the object. In the second embodiment, the scale is adjusted depending on whether or not the viewpoint exists in the area where the object exists. This is a determination mechanism to be performed. The area here is a plane area, and in the case of a building, it corresponds to a land portion. That is, when entering the part of the land where the building is arranged, scale information corresponding to the building can be acquired without the user looking into the building. This will be described below.

  Since the second embodiment is a modification of FIG. 16 in the first embodiment, the drawings other than the object information table 1030 in FIGS. 16 and 10 are the same as those in the first embodiment, and thus will be described. Is omitted.

  Details of the scale setting process in the second embodiment will be described with reference to the flowchart shown in FIG. The scale setting process in the second embodiment is the process in step S1104 in FIG. 11 as in the first embodiment.

  In step S <b> 1801, the CPU 301 of the client apparatus 101 refers to the virtual space position / orientation information 1014 using the function of the storage unit 509.

  In step S1802, the CPU 301 of the client apparatus 101 uses the function of the object control unit 510 to determine whether the position of the user's viewpoint indicated by the virtual space position / orientation information 1014 is within the area of any object placed in the virtual space. Determine whether or not. By comparing the coordinates (for example, the X coordinate and the Z coordinate) that are the position of the user's viewpoint with the area (for example, the XZ plane) in which the object is arranged, the position of the user's viewpoint is within the object area. It is determined whether or not. If it is determined that the position of the user's viewpoint is within the object area, the process advances to step S1805. If it is determined that the position of the user's viewpoint is not within the area of the object, the process proceeds to step S1803.

  In step S1803, the CPU 301 of the client apparatus 101 substitutes “0” for the variable Flg by the function of the scale setting unit 512. The variable Flg is a flag indicating whether or not the viewpoint is within the area of any object and the user's viewpoint is adjusted using scale information corresponding to the object.

  In step S <b> 1804, the CPU 301 of the client apparatus 101 acquires the magnification stored in the user setting scale information 1000 by the function of the scale setting unit 512 and stores it in the RAM 303.

  On the other hand, in step S <b> 1805, the CPU 301 of the client apparatus 101 determines whether there is scale information corresponding to an object for which the user's viewpoint is within the area by the function of the object control unit 510. The scale information corresponding to the object refers to the object specific scale information 1032 of the object, and if the magnification is stored here, it is determined that the scale information corresponding to the object exists. If it is determined that there is scale information corresponding to an object for which the user's viewpoint is within the area, the process proceeds to step S1806. If it is determined that there is no scale information corresponding to the object for which the user's viewpoint is in the area, the process advances to step S1803.

  In step S1806, the CPU 301 of the client apparatus 101 determines whether or not the variable Flg is “0” by the function of the scale setting unit 512. If it is determined that the variable Flg is “0”, the process proceeds to step S1807. If it is determined that the variable Flg is “1”, the process proceeds to step S1810.

  In step S <b> 1807, the CPU 301 of the client apparatus 101 determines whether or not the scale application direction 1931 exists in the object whose user viewpoint is determined to be within the area by the function of the scale setting unit 512. The scale application direction 1931 is an item in the object information table 1030 shown in FIG. The object information table 1030 in the second embodiment is newly provided with this scale application direction 1931 instead of the bounding box 1033 provided in the first embodiment. The scale application direction 1931 is an item in which information indicating the direction in which the object specific scale information 1032 is to be applied is stored. If it is determined that the scale application direction 1931 exists in the object whose user viewpoint is within the area, the process advances to step S1808. If it is determined that the scale application direction 1931 does not exist in the object whose user viewpoint is within the area (the scale application direction 1931 is “NULL”), the process advances to step S1809.

  In step S1808, the CPU 301 of the client apparatus 101 determines whether or not the scale application direction 1931 of the object in which the user's viewpoint is in the area matches the movement direction of the viewpoint by the function of the object control unit 510. Determine. That is, it is determined whether or not a predetermined condition of the scale application direction 1931 is satisfied. The scale application direction 1931 is a direction having a certain width. Therefore, the scale application direction 1931 and the viewpoint movement direction may be the same movement direction. If it is determined that the scale application direction 1931 of the object for which the user's viewpoint is within the area matches the movement direction of the viewpoint, the process advances to step S1809. If it is not determined that the scale application direction 1931 of the object for which the user's viewpoint is within the area does not match the movement direction of the viewpoint, the process advances to step S1803.

  In step S1809, the CPU 301 of the client apparatus 101 substitutes “1” for the variable Flg by the function of the scale setting unit 512.

  In step S <b> 1810, the CPU 301 of the client apparatus 101 acquires scale information corresponding to an object for which the user's viewpoint is within the area from the object-specific scale information 1032 using the function of the scale setting unit 512. That is, the magnification stored in the object specific scale information 1032 is acquired and stored in the RAM 303.

  In step S1811, the CPU 301 of the client apparatus 101 overwrites the scale information 1011 with the scale information stored in the RAM 303 in step S1804 or step S1810 by the function of the scale setting unit 512. In this way, either the scale information of the object or the scale information set by the user can be applied depending on whether or not the position of the user's viewpoint is within the area where the object is arranged. .

  For example, as shown in FIG. 20, when the user 2001 is walking around in the virtual space, the viewpoint is moved to the area where the building object is arranged. In this case, object specific scale information 1032 corresponding to this object is acquired and set in the scale information 1011. That is, the user can browse the object with a sense of scale set for the object only by moving into the area where the object is arranged.

  Further, as shown in FIG. 21, it is possible to determine whether or not to apply the object specific scale information 1032 depending on from which direction the object has entered the area where the object is arranged. For example, it is assumed that the scale application direction 1931 of the object is “180 degrees ± 60 degrees”. When the user enters from a direction in the range of 120 degrees to 240 degrees of the object (2102), the object specific scale information 1032 is set in the scale information 1011 (in the example of FIG. 21, 10 times to 1 time). ). When set in this way, the position of the viewpoint of the user 2001 in FIG. However, when entering from other directions (2101), the original scale information remains (in the example of FIG. 21, it remains 10 times). In this way, by limiting the direction in which the object specific scale information 1032 is applied, the object specific scale information 1032 is not applied even when the object is unintentionally intruded into the area where the object is arranged. It has the effect of being finished.

  As described above, even when the height of the viewpoint of the user in the virtual space is changed, the virtual space can be moved with an appropriate movement amount for each user.

  The present invention can be implemented as a system, apparatus, method, program, storage medium, or the like, and can be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Therefore, in order to realize (executable) the functional processing of the present invention by a computer, the program code itself installed in the computer also realizes the present invention. That is, the present invention also includes a computer program for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let me. It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

101 Client device 102 HMD
103 Server Device 201 Optical Marker 202 Infrared Camera 301 CPU
302 ROM
303 RAM
304 System bus 305 Input controller 306 Video controller 307 Memory controller 308 Communication I / F controller 309 General-purpose bus 310 Input device 311 External memory 312 Display 321 Right-eye / left-eye video camera 322 Right-eye / left-eye display

Claims (7)

An information processing system for presenting a virtual space in which a three-dimensional model is arranged,
Storage means for storing scale information for determining the position of the viewpoint in the virtual space and the amount of movement of the viewpoint for each of the three-dimensional models;
3D model selection means for selecting a 3D model arranged in the virtual space;
Using the scale information corresponding to the three-dimensional model selected by the three-dimensional model selecting means, determining the position of the user's viewpoint in the virtual space, and setting the viewpoint at the position;
A movement amount acquisition means for acquiring the movement amount of the user in the real space;
The viewpoint of the user set by the viewpoint setting unit using the movement amount of the user acquired by the movement amount acquisition unit and the scale information corresponding to the 3D model selected by the 3D model selection unit. An information processing system comprising: a viewpoint moving unit that determines a movement amount of the user and moves the viewpoint of the user by the determined movement amount.   The viewpoint setting unit uses the scale information corresponding to the three-dimensional model selected by the three-dimensional model selection unit when the moving direction of the viewpoint of the user satisfies a predetermined condition, and uses the scale information corresponding to the user in the virtual space. The information processing system according to claim 1, wherein a position of the viewpoint is determined and a viewpoint is set at the position. The viewpoint setting means determines the position of the user's viewpoint in the virtual space using the scale information designated by the user when the three-dimensional model selection means has not selected a three-dimensional model, Set the viewpoint at that position,
The viewpoint movement unit uses the user movement amount acquired by the movement amount acquisition unit and the scale information specified by the user to determine the movement amount of the user viewpoint set by the viewpoint setting unit. 3. The information processing system according to claim 1, wherein the information processing system determines and moves the viewpoint of the user by the determined movement amount.   The information according to any one of claims 1 to 3, wherein the three-dimensional model selection unit selects a three-dimensional model arranged in the virtual space according to a position of the viewpoint of the user. Processing system. The information processing system includes:
3D model placement means for placing a 3D model indicating the user in the virtual space;
5. The information according to claim 1, further comprising: a size changing unit that changes the three-dimensional model arranged by the three-dimensional model arranging unit to a size corresponding to the scale information. Processing system. Information processing system for presenting a virtual space in which a three-dimensional model is arranged, comprising storage means for storing, for each three-dimensional model, scale information for determining the position of the viewpoint in the virtual space and the amount of movement of the viewpoint Control method,
A three-dimensional model selection step in which the three-dimensional model selection means of the information processing system selects a three-dimensional model arranged in the virtual space;
The viewpoint setting means of the information processing system determines the position of the user's viewpoint in the virtual space using the scale information corresponding to the 3D model selected in the 3D model selection step, and the viewpoint is set at the position. A viewpoint setting step for setting
A movement amount acquisition step in which the movement amount acquisition means of the information processing system acquires the movement amount of the user in real space;
The viewpoint movement means of the information processing system uses the movement amount of the user acquired in the movement amount acquisition step and the scale information corresponding to the 3D model selected in the 3D model selection step. A control method for an information processing system, comprising: a viewpoint movement step of determining a movement amount of the user's viewpoint set in the setting step and moving the viewpoint of the user by the determined movement amount. Information processing system for presenting a virtual space in which a three-dimensional model is arranged, comprising storage means for storing, for each three-dimensional model, scale information for determining the position of the viewpoint in the virtual space and the amount of movement of the viewpoint A program capable of executing the control method of
The information processing system;
3D model selection means for selecting a 3D model arranged in the virtual space;
Using the scale information corresponding to the three-dimensional model selected by the three-dimensional model selecting means, determining the position of the user's viewpoint in the virtual space, and setting the viewpoint at the position;
A movement amount acquisition means for acquiring the movement amount of the user in the real space;
The viewpoint of the user set by the viewpoint setting unit using the movement amount of the user acquired by the movement amount acquisition unit and the scale information corresponding to the 3D model selected by the 3D model selection unit. And a function for moving the user's viewpoint with the determined amount of movement.

Images