JP6600051B2 - Application control program, application control method, and application control system - Google Patents

Description

  The present invention relates to an application control program, an application control method, and an application control system for allowing a plurality of users to share a virtual space.

  A virtual reality game is known in which an image of a virtual space is displayed and played on a mounting display (hereinafter referred to as HMD: head mounted display) mounted on a user's head. The HMD includes a tracking sensor such as a gyro sensor, and can detect the movement of the user's head. When the user moves the head, the HMD changes the image displayed on the display following the movement of the head. As described above, the game image follows the movement of the head, so that the user can concentrate more on the game. That is, it is possible to increase the sense of immersion in the game.

  As one of such virtual reality games, a game played by a plurality of users has also been proposed. Patent Document 1 describes a game in which a plurality of users each play with an HMD. In this game, the position information of each user wearing the HMD is reflected in the position information of the avatar in the virtual space, and the avatar of each user is drawn in the virtual space.

JP 2014-177776 A

  On the other hand, when a plurality of users try to play a virtual reality game, it is not always possible to prepare the same number of HMDs as the number of players to play. In addition, some users may be resistant to wearing the HMD. In this way, a variety of situations are assumed, but both a user who does not wear the HMD and a user who wears the HMD can participate, and a game that increases the degree of contribution to the application of the user who does not wear the HMD is I can't find it.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an application control program, an application control method, and an application control system that can be played simultaneously by a user wearing a wearing display and a user not wearing the wearing display. There is to do.

  An application control program that solves the above problem is an application control program that outputs an image of a virtual space on a mounting display worn by a first user and a display used by a second user.

  The application control program causes the control unit to output an image of the virtual space to the wearing display according to the posture of the first user, and the second user visually recognizes based on an operation of the second user. Specify the range.

  And causing the control unit to output an image of the specified range of virtual space on the display used by the second user, and causing the wearing display to display the specified range in an identifiable manner. Let

  According to this, the user wearing the wearing display and the user not wearing can play simultaneously.

  In the application control program, the step of displaying the specified range in an identifiable manner is such that at least one of brightness, saturation, and hue of an image included in the specified range is different from an image outside the specified range. It is preferable to display it.

  Regarding the application control program, when the virtual space includes an object and the object is included in an overlapping portion between the specified range and the range displayed on the wearing display, the display mode of the object changes. It is preferable to do.

  Regarding the application control program, when the virtual space includes an object, and the object is included in an overlapping portion of the specified range and the range displayed on the wearing display, the first user for the object is included. It is preferable to enable the action according to.

  In the application control program, it is preferable that a horizontal viewing angle in the specified range is made smaller than a horizontal viewing angle of the image in the virtual space output from the mounted display.

  An application control method for solving the above-described problem is an application control method for outputting an image of a virtual space on a mounting display worn by a first user and a display used by a second user. A step of outputting an image of the virtual space on the mounted display according to the posture of one user, a range that the second user visually recognizes based on an operation of the second user, and a display used by the second user And outputting an image of the specified range of the virtual space, and displaying the specified range in an identifiable manner on the wearing display.

  According to this, the user wearing the wearing display and the user not wearing can play simultaneously.

  An application control system that solves the above problem is an application system that includes a mounting display worn by a first user and a control unit that outputs an image to a display used by a second user, and that outputs an image of a virtual space, The control unit specifies a range that the second user visually recognizes based on the operation of the second user, and a step of outputting an image of the virtual space on the display according to the posture of the first user, The step of outputting the image of the specified range of the virtual space on the display used by the second user, and the step of displaying the specified range on the wearing display in an identifiable manner are performed.

  According to this, the user wearing the wearing display and the user not wearing can play simultaneously.

  According to the present invention, a user wearing a wearing display and a user not wearing can play simultaneously.

The conceptual diagram which looked down at the application control system of 1st Embodiment. The block diagram which shows the application control system of the embodiment functionally. The conceptual diagram explaining the virtual space and the image visually recognized by the user in the embodiment. Explanatory drawing of the 2nd virtual space image output to the touchscreen display of the embodiment. Explanatory drawing of the bird's-eye view image output to the touchscreen display of the embodiment. Explanatory drawing of the 2nd virtual space image output to the touchscreen display of the embodiment. Explanatory drawing of the 1st virtual space image output to the mounting display of the embodiment. Explanatory drawing of the 1st virtual space image output to the mounting display of the embodiment. Explanatory drawing of the process sequence which outputs an image to the mounting | wearing display in the embodiment. Explanatory drawing of the process sequence which stops the moving object in the embodiment. Explanatory drawing of the 2nd virtual space image output to the touchscreen display of 2nd Embodiment. Explanatory drawing of the 2nd virtual space image output to the touchscreen display of 3rd Embodiment. Explanatory drawing of the 1st virtual space image output to the mounting display of 4th Embodiment. Explanatory drawing of the 1st virtual space image output to the touchscreen display of a modification. Explanatory drawing of the 2nd virtual space image output to the touchscreen display of a modification. It is a virtual space image output to the mounting display of a modification, (a) is an image output to a mounting display, (b) is explanatory drawing of the image output to a touchscreen display.

(First embodiment)
Hereinafter, an embodiment of an application control program, an application control method, and an application control system will be described with reference to FIGS. In the present embodiment, it is assumed that a game application is provided as an application that shares a virtual space among a plurality of users.

  As shown in FIG. 1, the application control system includes a head mounted display (hereinafter, HMD) 11, an operation unit (controller) 14, a main display 12, and a touch panel display 13 as wearing displays. The HMD 11 is attached to the head of the first user 101. An image of the virtual space is displayed on the HMD 11. The first user 101 searches for an object moving in the virtual space (hereinafter referred to as a moving object), and performs an action (second action) on the found moving object by operating the operation unit 14. In the present embodiment, the first user 101 searches for a moving object such as “ghost” and snips the moving object by turning on the operation unit 14.

  The images output to the main display 12 and the touch panel display 13 are visually recognized by the second user 102. The second user 102 supports the first user 101 by operating the touch panel display 13 while visually recognizing images output to the main display 12 and the touch panel display 13. Note that the second user 102 may be able to teach the position of the moving object to the first user 101 by a voice or a voice input through a microphone.

  A schematic configuration of the application control system 10 will be described with reference to FIG. The application control system 10 includes a HMD 11, an operation unit 14, a main display 12, a touch panel display 13, and a control device 15 connected thereto.

  The HMD 11 includes an HMD control unit 30, a tracking sensor 31, and a display unit 32. The HMD control unit 30 outputs a signal corresponding to the detection result of the tracking sensor 31 to the control device 15 and inputs various signals such as an image signal from the control device 15. The tracking sensor 31 is a sensor for specifying a point of interest of the first user 101 and detects the position and orientation of the head of the first user 101. The tracking sensor 31 includes, for example, at least one sensor among a gyro sensor, an acceleration sensor, a geomagnetic sensor, and the like. As another embodiment, the tracking sensor 31 is a sensor that directly detects the movement of the eyeball of the first user 101, for example, a line-of-sight detection sensor that detects near-infrared rays in the iris and detects the reflected light. May be. The display unit 32 of the HMD 11 displays an image in a predetermined range centered on the point of interest of the first user 101 in the virtual space. That is, an image within a predetermined range is displayed so as to be visible to the first user 101. The virtual space image output to the display unit 32 of the HMD 11 is hereinafter referred to as a “first virtual space image”.

  The operation unit 14 includes, for example, an operation button and an operation lever, and is configured to be operated by the first user 101 without viewing. The operation unit 14 includes an acceleration sensor and the like, and can detect a change in direction from the initial position, a change amount thereof, and the like. The operation unit 14 outputs a signal indicating on / off of the operation by the second user 102, a change amount of the direction of the operation unit 14, and the like to the control device 15.

  The main display 12 is a display that can be viewed by the second user 102. The first virtual space image is displayed on the main display 12 in synchronization with the display unit 32 of the HMD 11.

  The touch panel display 13 may be a touch panel display provided in a housing, or may be a portable information terminal such as a tablet or a smartphone. The touch panel display 13 outputs an image obtained by projecting a part of the virtual space (hereinafter referred to as a second virtual space image). In the present embodiment, as the second virtual space image, an image obtained by looking inside the virtual space from the viewpoint set at a position above the first user 101 in the vertical direction is used. The initial screen of the second virtual space image displayed on the touch panel display 13 when the game is started is the same as the position of the virtual space projected on the first virtual space image displayed on the display unit 32 of the HMD 11. . The viewpoint position of the second virtual space image on the initial screen may be the same as or different from the viewpoint position of the first virtual space image on the initial screen. The position where the virtual space is projected onto the second virtual space image is changed and specified according to a predetermined touch operation such as a swipe operation of the second user 102. For example, the projection range of the virtual space is changed by the swipe operation of the second user 102, the second virtual space image is changed, and the change of the projection range of the virtual space is stopped by stopping the swipe operation. A display range of the second virtual space image is designated. The “touch operation” includes, for example, a tap operation, a swipe operation, a flick operation, a pinch-in operation, a pinch-out operation, a touch-and-hold operation, and the like. Furthermore, the touch panel display 13 outputs a signal corresponding to the touch operation of the second user 102 to the control device 15. For example, the touch panel display 13 outputs a signal corresponding to the swipe operation locus, a signal corresponding to the contact position, and the like.

  The first virtual space image output to the display unit 32 of the HMD 11 and the second virtual space image output to the touch panel display 13 are images in the same virtual space, but the former depends on the posture of the first user 101. The difference is that the display range of the virtual space is changed while the latter changes the display range of the virtual space according to the touch operation of the second user 102. The touch panel display 13 displays a bird's-eye view image of the virtual space seen from a predetermined position.

  The control device 15 acquires signals output from the HMD 11, the operation unit 14, and the touch panel display 13, and manages the game progress in the virtual space by the first user 101 and the second user 102.

  The control device 15 includes a control unit 16, a storage unit 17, and an image information storage unit 25. The control unit 16 includes a calculation unit, a volatile storage unit, and a nonvolatile storage unit, and executes a game according to an application control program recorded in the nonvolatile storage unit. The storage unit 17 is a storage unit for image processing, and may be a volatile storage unit or a non-volatile storage unit. In the storage unit 17, game management information 18, attention point information 19, designated display range information 20, object position information 21, and contact position information 22 are recorded.

  The game management information 18 is information including the user ID, the progress of the game, and the like, and is updated as the game progresses. The attention point information 19 is information indicating the position and orientation information of the head of the first user 101 detected by the tracking sensor 31, or information indicating the position of the attention point identified from the position and orientation of the head. The attention point information 19 is updated with the position and orientation of the head of the first user 101. The designated display range information 20 is information indicating a range displayed on the touch panel display 13 by the second user 102 by a touch operation, and is updated with the touch operation of the second user 102. The object position information 21 is information indicating the position of a moving object that moves in the virtual space. The control unit 16 randomly moves each moving object according to the application control program. The object position information 21 is updated with a change in the position of the moving object. The position of the moving object is synchronized between the first virtual space image output to the HMD 11 and the main display 12 and the second virtual space image output to the touch panel display 13. Furthermore, the contact position information 22 indicates a contact position on the screen of the touch panel display 13 and is updated each time the second user 102 performs a touch operation. The image information storage unit 25 stores information for drawing an image of the virtual space.

  The control unit 16 records attention point information 19 based on the signal input from the HMD 11 in the storage unit 17. Further, the control unit 16 records a signal corresponding to the designated display range input from the touch panel display 13 in the storage unit 17 as the designated display range information 20.

  The control unit 16 acquires image information in a predetermined range centered on the point of interest based on the point of interest information 19 among the image information recorded in the image information storage unit 25, and the HMD 11 and the main display as the first virtual space image. 12 is output. Further, the control unit 16 records the designated display range designated by the touch operation of the second user 102 in the storage unit 17 as the designated display range information 20. Further, the control unit 16 acquires image information from the image information storage unit 25 based on the designated display range information 20 and outputs it to the touch panel display 13 as a second virtual space image. Further, the control unit 16 outputs a bird's-eye view image obtained by bird's-eye view of part or the whole of the virtual space to the touch panel display 13.

  With reference to FIG. 3, the virtual space and the first virtual space image output to the HMD 11 and the main display 12 will be described. The HMD control unit 30 specifies the position and orientation of the head of the first user 101. For example, the position and orientation of the head are centered on the Y axis and the Y axis along the vertical direction, the pitch θp indicating the rotation direction around the X axis and the X axis along the horizontal direction, with the initial position as a reference. The yaw θy indicating the rotation direction, the Z axis along the depth direction, and the roll θr indicating the rotation direction around the Z axis and the angle around each axis are calculated. The HMD control unit 30 outputs the position in the three axis directions and the angle around each axis to the control unit 16 as attention point information 19.

  The control unit 16 specifies the attention point 114 or the line-of-sight direction D in the virtual space 110 based on the attention point information 19. As a method for specifying the attention point or the line-of-sight direction, a known method according to the type of the tracking sensor 31 or the like can be used. For example, the control unit 16 virtually sets a straight line connecting the left eye position and the right eye position, extends in a direction orthogonal to the straight line, and passes through the middle point of the left eye position and the right eye position as the line-of-sight direction D. . Furthermore, the control unit 16 can specify the intersection point between the line-of-sight direction D and the object (or background) as the attention point 114. When a tracking sensor that detects the movement of the eyeball or a sensor that detects reflected light from within the iris is used, the line-of-sight direction may be specified based on the movement of the eyeball or the reflected light.

  The control unit 16 acquires image information of the attention range 111 that is a range based on the attention point 114 and the line-of-sight direction D from the image information storage unit 25 and outputs the image information to the display unit 32 of the HMD 11 as a first virtual space image. For example, the attention range 111 is the horizontal viewing angle α in the horizontal direction centered on the viewing direction D and the vertical direction when the direction from the viewpoint position of the first user 101 toward the attention point 114 is the viewing direction D. This is a range specified by an angle such as a vertical viewing angle (not shown). The horizontal viewing angle α and the vertical viewing angle are not physical viewing angles of the first user 101, but are rendering angles for generating an image of the virtual space 110. The control unit 16 also outputs an image corresponding to the acquired image information to the main display 12.

  In the first virtual space image displayed on the HMD 11 and the first virtual space image displayed on the main display, when a predetermined action is not performed on the image, the entire virtual space is displayed in an initial state. For example, the initial state is a state of “darkness”, that is, a state where the brightness and saturation of the image are low. In the initial first virtual space image, the moving object 115 moving in the virtual space is displayed in a non-display state. The non-display state is an unclear state in which a moving object is not displayed at all or is difficult to view. Examples of the unclear display state include a state where only a part of the moving object 115 is displayed and the whole is not displayed, or a state in which at least one of the lightness, saturation and hue of the moving object 115 is brought close to the background to make it difficult to see. It is. Further, for example, in the virtual space, the second user 102 is displayed as a character 116 such as a drone or an avatar. In the present embodiment, the position of the character 116 maintains the position above the first user 101 in the vertical direction.

  When the display range is designated by the touch operation of the second user 102 on the touch panel display 13, the control unit 16 acquires the designated display range from the touch panel display 13 and stores the designated display range information 20 as the storage unit 17. To record. Further, the control unit 16 outputs the designated display range 112 corresponding to the designated display range information 20 to the touch panel display 13 as a second virtual space image in a display mode different from the initial state of the first virtual space image. Specifically, the display mode at this time is a changed state in which at least one of lightness, saturation, and hue is different from the initial state, for example, a state in which light is irradiated, that is, the lightness is in the initial state. The saturation and hue are different from the initial state. Based on the object position information 21, the control unit 16 displays the moving object in the second virtual space image so as to be visible. Thereby, the second user can visually recognize the moving object on the second virtual space image.

  Furthermore, when at least a part of the attention range 111 of the first user 101 and the designated display range 112 designated by the second user 102 overlap, the control unit 16 includes the first virtual space image, The overlapping part is displayed in a changed state different from the initial state. Specifically, the overlapping portion is displayed in a state in which at least part of brightness, saturation, and hue is different from those of the other portions. FIG. 3 shows a state in which the entire designated display range 112 is included in the attention range 111. In the first virtual space image, the light is displayed as if it is emitted from the character 116 itself or the light source of the character 116.

  The control unit 16 designates the designated display range 112 designated by the second user 102 in the virtual space 110 (first action), and reflects the first action in the first virtual space image. Specifically, the control unit 16 displays only the moving object 115 included in the overlapping portion (the overlapping range in the virtual space) of the attention range and the designated display range 112 in the first virtual space image (the visible state). The moving object 115 that exists in a region other than the overlapping portion is set to a non-display state (non-viewable state). For this reason, the first user 101 can visually recognize the moving object 115 only when the attention range 111 and the designated display range 112 are overlapped and the moving object 115 is included in the overlapping portion.

  In the present embodiment, the horizontal viewing angle β of the designated display range 112 designated by the second user 102, in other words, the projection range in the virtual space for generating the second virtual space image, is the first virtual space. It is smaller than the horizontal viewing angle α of the projection range in the virtual space for generation. That is, when the horizontal viewing angle β of the second virtual space image is greater than or equal to the horizontal viewing angle α of the first virtual space image, the first user 101 can easily display the designated display range 112 reflected in the first virtual space image. Can be found in On the other hand, when the horizontal viewing angle β of the second virtual space image is smaller than the horizontal viewing angle α of the first virtual space image, the first user 101 finds the designated display range 112 reflected in the first virtual space image. It becomes difficult. The ratio of the horizontal viewing angle β of the second virtual space image to the horizontal viewing angle α of the first virtual space image may be determined according to the target game balance. In the present embodiment, by making the horizontal viewing angle β of the second virtual space image smaller than the horizontal viewing angle α of the first virtual space image, the degree of contribution of the second user 102 to the game is increased, and the first user 101 The second user 102 cooperates to advance the game.

  Further, the second user 102 can stop the movement of the moving object 115 in the vicinity of the contact position by a predetermined touch operation on the touch panel display 13. At this time, the second user 102 performs a touch-and-hold operation for continuing the contact between the finger and an arbitrary position on the screen. When a touch-and-hold operation is performed, the control unit 16 specifies a moving object within a predetermined distance from the contact position as a first action, and stops the movement (movement) of the specified moving object 115. That is, the movement of one nearest moving object 115 is stopped with respect to one contact position. For example, when there are five moving objects 115 in the virtual space 110 and it is desired to stop these movements, a touch-and-hold operation is performed using five fingers.

  Furthermore, the first user 101 can perform the second action only on the moving object 115 included in the designated display range 112 and made visible. In the present embodiment, the moving object 115 is sniped as the second action. At this time, if the movement of the moving object 115 is stopped by the touch operation of the second user 102, it is easy to aim at the moving object 115 and it is easy to perform an effective second action. Specifically, when detecting the on operation of the operation unit 14, the control unit 16 transmits the light beam 118 from the virtual position 117 of the operation unit 14 along the direction of the operation unit 14 in the first virtual space image and the second virtual space. Display on a spatial image. If the direction of the light beam 118 matches the position of the moving object 115, the control unit 16 determines that the second action has been performed effectively. Specifically, it is determined that the moving object 115 has been shot, and a score or the like is given to the first user 101. On the other hand, the control unit 16 does not display the action light beam 118 for the moving object 115 not included in the designated display range 112. Alternatively, even if the action light beam 118 is emitted toward the moving object 115 not included in the designated display range 112, it may be determined to be invalid. The control unit 16 causes the action light beam 118 to be displayed on the display unit 32, the main display 12, and the touch panel display 13 of the HMD 11.

Next, screens displayed on the display unit 32, the main display 12, and the touch panel display 13 of the HMD 11 will be described with reference to FIGS.
As shown in FIG. 4, the control unit 16 renders the virtual space image information recorded in the image information storage unit 25 according to the designated display range 112 and displays the second virtual space image 121. Information is generated, and brightness, saturation, and hue of the generated image information for the second virtual space image 121 are adjusted and output to the touch panel display 13. Even if the second virtual space image 121 displays the same range as the first virtual space image, at least a part of brightness, saturation, and hue is different from the initial state of the first virtual space image. Specifically, the control unit 16 displays the entire second virtual space image 121 in a state where the lightness is high as if it was irradiated with light. In addition, the control unit 16 causes the second virtual space image 121 to display the moving object 115 that moves based on the object position information 21. However, since the moving object 115 is moving randomly, if the designated display range 112 is not changed, the moving object 115 displayed first may move out of the screen. For example, the second user 102 performs a swipe operation to change the designated display range 112 to change the screen, and searches for the moving object 115 to notify the first user 101 of the position of the moving object 115.

  As illustrated in FIG. 5, the control unit 16 outputs the overhead image 122 to the touch panel display 13 by acquiring the image information for the overhead image recorded in the image information storage unit 25 or rendering the image information in the virtual space. . The bird's-eye view image 122 is an image obtained by bird's-eye view of the entire virtual space, and displays the position of the character 116, for example. The control unit 16 displays the designated display range 112 designated by the second user 102 in the overhead image 122 in a changed state where light is irradiated, and displays the other parts in an initial state such as darkness. . In addition, the control unit 16 displays the moving object 115 on the overhead image 122.

  As shown in FIG. 6, when the second user 102 performs a touch and hold operation on the second virtual space image 121 displayed on the touch panel display 13, the control unit 16 moves within a predetermined distance from the finger contact position. The object 115 is specified, and the movement of the specified moving object 115 is stopped. In FIG. 6, the control unit 16 stops the movement of the moving object 115 whose relative distance to each of the contact positions P1, P3, and P4 is within a predetermined distance. On the other hand, the control unit 16 cannot identify the moving object 115 in the vicinity of the contact position P2, and does not stop the moving object 115. For the moving object 115 on the right side in the figure, the relative distance from the contact position P5 exceeds the predetermined distance. Do not stop that move.

  As illustrated in FIG. 7, the control unit 16 outputs the first virtual space image 120 to the display unit 32 of the HMD 11 and changes the display range according to the posture of the first user 101. When the control unit 16 determines that the attention range 111 of the first user 101 and the designated display range 112 designated by the second user 102 are overlapped, the overlapping portion 125 is irradiated with light. Display in the changed state. Moreover, the control part 16 displays parts other than the duplication part 125 among the 1st virtual space images 120 in the initial state like darkness. Further, when the overlapping portion 125 includes the moving object 115, the control unit 16 displays only the moving object 115 included in the overlapping portion 125 and does not display the moving object 115 not included in the overlapping portion 125.

  As illustrated in FIG. 8, when the control unit 16 inputs a signal corresponding to the ON operation from the operation unit 14, the first virtual space image 120 reflecting the second action on the first virtual space image 120 is displayed on the HMD 11. To the unit 32. For example, the control unit 16 outputs the light beam 118 along the direction of the operation unit 14 from the virtual position 117 of the operation unit 14 in the virtual space based on the signal output from the operation unit 14 and detecting the direction of the operation unit 14. Display. When the moving object 115 exists in the direction of the light beam 118, the control unit 16 validates the sniper that is the second action. At this time, as described above, when the movement of the moving object 115 is stopped, it is easy to aim at the moving object 115, but it is possible to snip the moving object 115 that has not stopped moving. For example, the control unit 16 calculates a score corresponding to the number of times that an effective action has been performed within a time limit, for example, and adds a score to the score information included in the game management information 18.

Next, with reference to FIG. 9 and FIG. 10, the procedure of each process for providing a game to the first user 101 and the second user 102 will be described.
First, with reference to FIG. 9, the procedure of the process of outputting the first virtual space image 120 to the HMD 11 and the main display 12 will be described. The process of outputting the first virtual space image 120 is started when a start condition is established, for example, when the operation unit 14 or another device is operated and a game is started. In parallel with this process, the control unit 16 acquires the coordinates of the designated display range 112 of the touch panel display 13 and performs a process of recording the coordinates as designated display range information 20 in the storage unit 17.

  The control unit 16 acquires the attention point information 19 recorded in the storage unit 17 (step S1). Then, the control unit 16 specifies the attention range 111 based on the attention point information 19. In addition, the control unit 16 acquires the designated display range information 20 recorded in the storage unit 17 (Step S2). Then, the control unit 16 specifies the designated display range 112 based on the designated display range information 20.

  When the attention range 111 and the designated display range 112 are specified, the control unit 16 determines whether or not the attention range 111 and the designated display range 112 overlap (step S3). For example, the control unit 16 determines whether or not these ranges overlap based on the range of the attention range 111 in the virtual space coordinate system and the range of the designated display range 112 in the virtual space coordinate system. When the control unit 16 determines that the attention range 111 and the designated display range 112 do not overlap (step S3: NO), the image information corresponding to the attention range 111 among the image information recorded in the image information storage unit 25 is displayed. The first virtual space image that is read out and is in the initial state is output to the display unit 32 and the main display 12 of the HMD 11 (step S8).

  In step S3, when the control unit 16 determines that the attention range 111 and the designated display range 112 overlap (step S3: YES), based on the object position information 21, whether or not the moving object 115 is included in the overlapping portion. Is determined (step S4). When the control unit 16 determines that the moving object 115 is not included in the overlapping part (step S4: NO), the overlapping part is changed (step S7), and the first virtual space image is displayed on the display unit 32 and the main display of the HMD 11. 12 (step S8). As a result, the first virtual space image 120 in which the overlapping portion is changed and the moving object 115 is not displayed is displayed on the display unit 32 and the main display 12 of the HMD 11.

  In step S4, when the control unit 16 determines that the moving object 115 is included in the overlapping portion of the attention range 111 and the designated display range 112 (step S4: YES), the overlapping portion is changed (step S5). The moving object 115 included in the portion is displayed (step S6). Then, the first virtual space image 120 is output to the display unit 32 and the main display 12 of the HMD 11 (step S8). As a result, the overlapping part is changed, and the first virtual space image 120 in which the moving object 115 is displayed in the overlapping part is displayed on the display unit 32 and the main display 12 of the HMD 11.

  As described above, when the control unit 16 outputs the first virtual space image 120, the control unit 16 returns to step S1 and repeats steps S1 to S8 until the game ends. When the operation unit 14 is turned on, the control unit 16 displays the light beam 118 on the first virtual space image 120. In addition, when the position of the moving object 115 in the display state matches the direction of the operation unit 14, the control unit 16 determines that the second action has been performed effectively.

  Next, processing for stopping the movement of the moving object 115 upon receiving the touch operation of the second user 102 will be described with reference to FIG. The process of stopping the movement of the moving object 115 is started when a start condition such as when the control unit 16 detects a touch and hold operation is satisfied. In parallel with this process, the control unit 16 acquires the coordinates of the designated display range 112 of the touch panel display 13 and performs a process of recording the coordinates as designated display range information 20 in the storage unit 17.

  The control unit 16 acquires the contact position information 22 recorded in the storage unit 17 and specifies the contact position (step S10). Further, the control unit 16 determines whether or not at least one moving object 115 near the contact position has been specified (step S11). Specifically, the control unit 16 specifies the position of the moving object 115 based on the object position information 21. Then, the relative distance between the specified contact position and the position of the moving object 115 is calculated, and it is determined whether or not there is the moving object 115 whose relative distance is within a predetermined distance.

  When the control unit 16 determines that there is no moving object 115 whose relative distance from the contact position is within the predetermined distance (step S11: NO), the control unit 16 ends the process without stopping the movement of the moving object 115. In addition, when the control unit 16 determines that there is at least one moving object 115 whose relative distance from the contact position is within the predetermined distance (step S11: YES), the control unit 16 stops the movement of the specified moving object. (Step S12).

  Then, when the movement of the specified moving object 115 is stopped, the control unit 16 determines whether or not the finger of the second user 102 has been released from the screen of the touch panel display 13 (step S13). When determining that the finger of the second user 102 has not been released (step S13: NO), the control unit 16 continues to stop the movement of the identified moving object 115 (step S12). When determining that the finger of the second user 102 has been released (step S13: YES), the control unit 16 resumes the movement of the moving object 115 (step S14) and ends the touch-and-hold operation process. And if start conditions are satisfied, the control part 16 will repeat the process from step S1 to step S13.

As described above, according to the first embodiment, the following effects can be obtained.
(1) In the above embodiment, the control unit 16 of the control device 15 outputs a virtual space image to both the HMD 11 and the touch panel display 13. The second user 102 designates the designated display range 112 by a touch operation without wearing the HMD 11, and the control unit 16 identifies a range corresponding to the touch operation in the virtual space as the first action. Furthermore, the first user 101 operates the moving object 115 displayed in the overlapping portion of the attention range 111 and the designated display range 112 using the operation unit 14, and the control unit 16 responds to the operation. Then, the second action is performed on the moving object 115. Therefore, since it is assumed that the first user 101 is performing the first action in order for the first user 101 to perform the second action, the first user 101 and the second user 102 are in the virtual space. You can advance the game in cooperation.

  (2) In the above embodiment, the control unit 16 specifies the designated display range 112 designated by the second user 102. Then, the control unit 16 reflects the designated display range 112 on the first virtual space image 120. Therefore, the second user 102 can point an arbitrary range to the first user 101 without wearing the HMD 11.

  (3) In the above embodiment, when the designated display range 112 and the attention range 111 do not overlap, the control unit 16 outputs the moving object 115 to the HMD 11 in a non-display state, and the designated display range 112 and the attention range. If 111 overlaps, the moving object 115 included in the overlapping part is output to the HMD 11 as a display state. That is, an arbitrary range including the moving object 115 is specified by the second user 102, and the moving object 115 can be viewed by the first user by including the range in which the first user 101 is specified in the attention range 111. . Therefore, the first user 101 and the second user 102 can advance the game in cooperation.

  (4) In the above embodiment, the control unit 16 uses at least one of the brightness, saturation, and hue of the designated display range 112 as the brightness, saturation, and hue of the other ranges in the first virtual space image. Output to the HMD 11 in a different state. According to this, the first user 101 wearing the HMD 11 can distinguish between the range designated on the touch panel display 13 and the other range. Moreover, since the control part 16 displays the range designated with the touch panel display 13 by the 2nd user 102 so that light was irradiated, compared with the case where the said range is enclosed with a line and it points to the 1st user 101, etc. A decrease in the immersive feeling of the first user 101 can be suppressed.

  (5) In the above embodiment, the control unit 16 validates the second action for only the moving object 115 included in the overlapping portion of the attention range 111 and the designated display range 112. Therefore, in order to effectively perform the second action, it is assumed that the moving object 115 is included in the designated display range 112 designated by the second user 102. Therefore, the first user 101 and the second user 102 cooperate with each other. The game can be advanced.

  (6) In the above embodiment, the control unit 16 makes the horizontal viewing angle β of the second virtual space image 121 smaller than the horizontal viewing angle α of the first virtual space image 120. Therefore, since the first user 101 needs to perform an operation for the second action in a narrow range in the virtual space, the difficulty of the second action becomes high and the support of the second user 102 is necessary. . Therefore, the first user 101 and the second user 102 can advance the game in cooperation.

  (7) In the above embodiment, the control unit 16 always displays the moving object 115 on the touch panel display 13. Accordingly, in order for the first user 101 to find the moving object 115, it is assumed that the second user 102 provides the positional information of the moving object 115 by specifying the specified display range 112. Therefore, the first user 101 and the second user 102 can advance the game in cooperation.

  (8) In the above embodiment, the control unit 16 moves the moving object 115 in the first virtual space image 120 output to the HMD 11. In addition, the control unit 16 stops the movement of the moving object 115 in the first virtual space image 120 and the second virtual space image 121 output to the touch panel display 13 based on the touch operation of the touch panel display 13 as the first action. . This makes it easier for the first user 101 to snip the second action against the moving object 115 whose movement has been stopped. Thereby, the 1st user 101 and the 2nd user 102 can advance a game in cooperation.

  (9) In the embodiment described above, the control unit 16 specifies the moving object 115 near the contact point on the screen of the touch panel display 13 and stops the movement only with respect to the moving object 115. That is, the movement of one moving object 115 can be stopped at one contact point. The second user 102 only needs to touch the vicinity of the moving object 115 whose movement is to be stopped, and it is easy to intuitively understand the operation for stopping the movement. When stopping the movement of the plurality of moving objects 115, the same number of contact points as the number of moving objects 115 are required. Therefore, the difficulty of stopping the moving objects can be increased according to the number of moving objects 115 to be stopped.

  (10) In the embodiment described above, the control unit 16 outputs the overhead image 122 obtained by overlooking the virtual space to the touch panel display 13 with the moving object 115 in the display state. Therefore, the second user 102 can grasp the position and state of the moving object 115 included in the virtual space. For this reason, it is easy to include in the designated display range 112 the moving object 115 intended for the sniper as the second action. Further, the second user 102 can easily grasp the positional relationship between the designated display range 112 and the moving object 115.

(Second Embodiment)
Next, a second embodiment embodying the present invention will be described. In addition, since 2nd Embodiment is the structure which changed the 1st action in 1st Embodiment, it attaches | subjects the same code | symbol about the same part, and abbreviate | omits the detailed description.

  In the first embodiment, the first action is specified in the designated display range 112, but in the present embodiment, the first action is a selection of the moving object 115 based on the operation of the second user 102. In the present embodiment, the initial state of the first virtual space image 120 output to the HMD 11 may be at least the moving object 115 is in a non-display state. That is, the first virtual space image 120 of the present embodiment may not be in a display state with low brightness such as “darkness”.

  As shown in FIG. 11, a moving object 115 is displayed in the second virtual space image 121 displayed on the touch panel display 13. The second user 102 specifies the moving object 115 by a touch operation. Although FIG. 11 shows an example in which there is one contact position P10, there may be a plurality of contact positions.

  The control unit 16 acquires the coordinates of the contact position P10 from the touch panel display 13, and determines whether or not there is a moving object 115 whose relative distance from the coordinates of the contact position P10 is equal to or less than a predetermined distance based on the object position information 21. To do.

  When the control unit 16 determines that there is a moving object 115 having a relative distance from the contact position P10 that is equal to or less than the predetermined distance, the control unit 16 sets the moving object 115 as a display state on the first virtual space image 120, and the display unit 32 of the HMD 11 Output to the main display 12. In the present embodiment, unlike the first embodiment, the process of stopping the movement of the moving object 115 in the vicinity of the contact position P10 is not performed.

  The control unit 16 continues to display the moving object 115 on the first virtual space image while the state where the relative distance between the contact position P10 and the moving object 115 is not more than the predetermined distance is maintained. On the other hand, even if the second user 102 continues the touch operation, when the relative distance between the contact position P10 and the moving object 115 exceeds the predetermined distance as the moving object 115 moves, the control unit 16 moves the moving object 115 to the moving object 115. Set to non-display state.

  Thus, in this embodiment, since the moving object 115 selected by the second user 102 is displayed on the first virtual space image 120, the work of specifying the moving object 115 becomes a finer work. As a result, close cooperation between the first user 101 and the second user 102 is required, and it is possible to enhance the interest by making the game difficulty level suitable.

As described above, according to the second embodiment, in addition to the effect (1) described in the first embodiment, the following effects can be obtained.
(11) In the above embodiment, the control unit 16 of the control device 15 specifies the moving object 115 selected by the second user 102. Then, the control unit 16 displays the moving object 115 selected by the second user 102 on the first virtual space image 120. Therefore, the second user 102 can point the selected moving object 115 to the first user 101 without wearing the HMD 11.

(Third embodiment)
Next, a third embodiment embodying the present invention will be described. In addition, since 3rd Embodiment is a structure which makes the designation | designated display range in 1st Embodiment variable, the same code | symbol is attached | subjected about the same part and the detailed description is abbreviate | omitted.

  In the first embodiment, the entire range displayed on the touch panel display 13 by the second user 102 by the touch operation is set as the designated display range 112. However, in the present embodiment, the designated display range 112 by the touch operation of the second user 102 is used. The size and position of the can be changed.

  As shown in FIG. 12, the second user 102 performs a pinch-in operation in which the designated display range 112 is traced on the screen so that two fingers are brought close to each other, or a pinch-out operation in which the screen is moved so that two fingers are moved away from each other. The size and position are changed by performing. The designated display range 112 is the entire screen in the initial state, and the control unit 16 reduces the designated display range 112 based on the locus of the pinch-in operation when the pinch-in operation is performed, and performs the pinch-out operation when the pinch-out operation is performed. The designated display range 112 reduced based on the locus is enlarged. In addition, after performing a pinch-in operation or a pinch-out operation, when the two fingers are moved while being in contact with the screen, the control unit 16 maintains the size of the designated display range 112 based on the input locus of the operation. The designated display range 112 is moved within the screen. Note that the light source position (origin) may be moved with the movement of the designated display range 112.

  Further, a special effect on the moving object 115 may be generated by reducing the designated display range 112. For example, the moving object 115 included in the designated display range 112 may not be moved outside the designated display range 112 when the reduction of the designated display range 112 is started. As a result, by reducing the designated display range 112, the moving objects 115 included in the designated display range 112 can be collected in the reduced designated display range 112. When the moving objects 115 are collected in such a narrow range, the first user 101 can easily snip the many moving objects 115 at a time.

  When a pinch-in operation is performed, the control unit 16 reduces the designated display range 112 according to the length and angle of the input trajectory based on the input trajectory of the touch operation. In addition, the control unit 16 outputs a second virtual space image 121 in which the brightness, saturation, and hue of the reduced designated display range 112 are changed from the other ranges to the touch panel display 13. At this time, in the second virtual space image 121, a part in an initial state, for example, a part with low brightness and saturation in which “darkness” is expressed is displayed. At this time, the control unit 16 may set the moving object 115 included in the initial state portion to the display state or the non-display state.

  In addition, the control unit 16 determines whether or not there is an overlapping portion between the attention range 111 and the designated display range 112 of the first user 101, and if there is an overlapping portion, the overlapping portion is changed to a changed state, otherwise The first virtual space image 120 in the initial state is output to the display unit 32 and the main display 12 of the HMD 11.

  The second user 102 performs a pinch-out operation for expanding the designated display range 112 when the moving object 115 included in the designated display range 112 disappears or decreases due to effective sniper by the first user 101 or the like. This is performed on the screen of the display 13. When a pinch-out operation is performed, the control unit 16 inputs an input locus of the touch operation, and expands the designated display range 112 according to the length and angle of the input locus. In addition, the control unit 16 outputs the second virtual space image 121 in which the enlarged designated display range 112 is changed and the other part is in the initial state to the touch panel display 13. As a result, the new display object 112 includes the new moving object 115.

As described above, according to the third embodiment, in addition to the effects (1) to (10) described in the first embodiment, the following effects can be obtained.
(12) In the above embodiment, the control unit 16 can indicate only a part of the screen, for example, in order to change the size and position of the designated display range 112 based on the touch operation on the screen of the touch panel display 13.

(Fourth embodiment)
Next, a fourth embodiment embodying the present invention will be described. In the fourth embodiment, the moving object is hidden on the touch panel display, and the moving object is displayed in the second virtual space image according to the operation of the operation unit. Therefore, the same part as the first embodiment Are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the first embodiment, the first action is specified for the designated display range 112 based on the operation of the second user 102, and the second action is the sniper for the moving object 115 based on the operation of the first user. In the present embodiment, the first action is a selection of the moving object 115 by the first user 101, and the second action is an attack on the moving object 115 based on the touch operation of the touch panel display 13 of the second user 102.

  As illustrated in FIG. 13, the control unit 16 outputs the first virtual space image 120 in which the moving object 115 is always displayed to the display unit 32 and the main display 12 of the HMD 11. The operation unit 14 operated by the first user 101 is a controller capable of changing direction, turning on and off, and a glove-type controller. The first user 101 operates the operation unit 14 to select the moving object 115 in the virtual space. Specifically, the control unit 16 changes the direction of the light source 130 such as a flashlight displayed in the first virtual space image 120 by operating the operation unit 14 and moves the object by irradiating the moving object 115 with light. The object 115 is selected. Alternatively, the moving object 115 is captured using a tool such as a net or a container in the virtual space.

  The control unit 16 inputs the signal output from the operation unit 14 and determines whether or not the moving object 115 has been selected based on the object position information 21. When determining that the moving object 115 has been selected, the control unit 16 outputs a second virtual space image 121 in which the selected moving object 115 is displayed to the touch panel display 13.

  In the second virtual space image 121 output to the touch panel display 13, the moving object 115 is not displayed in the initial state. When the moving object 115 selected by the first user 101 is displayed on the second virtual space image 121, the second user performs an attack by touching the moving object 115 in the display state. When the control unit 16 determines that an attack on the moving object 115 has been performed based on the signal input from the touch panel display 13, the attack on the moving object 115 is reflected in the first virtual space image 120, and the HMD 11 and the main display 12. Output to.

As described above, according to the fourth embodiment, the following effects can be obtained.
(13) In the above embodiment, the first user 101 selects the moving object 115 and causes the selected moving object 115 to be displayed on the second virtual space image 121. The second user 102 can attack the moving object 115 displayed in the virtual space without wearing the HMD 11. Therefore, the first user 101 and the second user 102 can advance the game in cooperation.

(Other embodiments)
In addition, each said embodiment can also be suitably changed and implemented as follows.
In each of the above embodiments, the control unit 16 sets the position of the character 116 corresponding to the second user 102 as the position above the first user 101 in the vertical direction. Instead of this, the position of the character 116 may be changed based on, for example, a touch operation on the screen of the touch panel display 13 by the second user 102.

  In each of the above embodiments, the horizontal viewing angle β of the second virtual space image is made smaller than the horizontal viewing angle α of the first virtual space image. Instead, the horizontal viewing angle β of the second virtual space image is the same as the horizontal viewing angle α of the first virtual space image 120 or is larger than the horizontal viewing angle α of the first virtual space image. Also good. This makes it easy to find the designated display range 112, which is effective when, for example, it is desired to reduce the difficulty of finding an object. Similarly, the vertical viewing angle of the second virtual space image may be smaller than the vertical viewing angle of the second virtual space image. Alternatively, it may be greater than or equal to the vertical viewing angle of the second virtual space image.

  In each of the above embodiments, the control unit 16 displays the attention range of the first user 101 on the main display 12 as the first virtual space image. Instead of or in addition to this, the control unit 16 may display the attention range 111 of the first user 101 on the second virtual space image 121, for example. The attention range 111 may be indicated by being surrounded by a line, or may be displayed with at least one of brightness, saturation, and hue different from the background of the second virtual space image 121. In this case, the main display 12 visually recognized by the second user 102 can be omitted.

  In each of the above embodiments, the control unit 16 outputs the overhead image 122 obtained by overlooking the virtual space to the touch panel display 13. However, when it is easy to grasp the position of the object in the virtual space, the display of the overhead image 122 may be omitted.

  In each of the embodiments described above, the control unit 16 displays at least one of the brightness, saturation, and hue of the designated display range 112 different from the brightness, saturation, and hue of the portion other than the designated display range 112. . In addition to this, as the first action, the designated display range 112 may be displayed surrounded by a line displayed in the image, or a mark such as an arrow may be displayed.

  In each of the above embodiments, the control unit 16 makes the first virtual difference by making at least one of the brightness, saturation, and hue of the designated display range 112 different from the brightness, saturation, and hue of the portion other than the designated display range 112. It displayed on the space image and the 2nd virtual space image. In addition, the control unit 16 may change and display at least one of the brightness, saturation, and hue of the designated display range 112 with the passage of time. Specifically, when the control unit 16 displays the designated display range 112 with lightness, saturation, and hue such that light is irradiated, the designated display range 112 is darkened over time. Alternatively, at least one of brightness, saturation, and hue may be changed so that light of a color different from the light in the initial state is irradiated.

  In each embodiment described above, the control unit 16 stops the movement of the moving object 115 as the first action based on the contact position on the touch panel display 13 by the second user 102. Instead of or in addition to this, the control unit 16 may stop the movement of the moving object 115 based on an item selection operation displayed on the screen of the touch panel display 13. For example, when a special item displayed on the screen of the touch panel display 13 is selected, the movement of all the moving objects 115 displayed on the screen of the touch panel display 13 may be stopped. Further, when the item is dragged and dropped to the vicinity of the moving object 115, the movement of the moving object 115 may be stopped.

  In each embodiment described above, the control unit 16 stops the movement of the moving object 115 as the first action based on the contact position on the touch panel display 13 by the second user 102. Instead of or in addition to this, the movement of a moving object included in a predetermined range corresponding to one contact position may be stopped. The predetermined range corresponding to one contact position is, for example, a circular range centered on the contact position, or a rectangular shape, a fan shape, or the like starting from the contact position (corner). Alternatively, the predetermined range may be selected by performing a swipe operation or tapping with two fingers.

  In the above embodiments, the second action is performed on the moving object 115 that always moves. Instead of or in addition to this, the second action may be performed on an object placed at a predetermined fixed position in the virtual space. Examples of such objects include boxes, doors, musical instruments, and the like arranged in the virtual space. In this case, the second action is, for example, an action of opening a box lid, opening a door, playing a musical instrument, or the like.

  In each of the embodiments described above, the second action cannot be performed on the moving object 115 that is not included in the overlapping portion of the attention range 111 and the designated display range 112, or is invalid even if the second action is performed. It was. Alternatively, the second action may be performed on an object that is not included in the overlapping portion. In this case, for example, the object included in the overlapping portion may be clearly displayed so that the aim is easy to aim, and the object not included in the overlapping portion may be displayed unclearly so that the aim is easy to aim. In addition, when an effective action is performed on an object not included in the overlapping portion, the score may be higher than when an effective action is performed on the object included in the overlapping portion.

  In each of the above embodiments, the predetermined object (moving object 115) is hidden in the first virtual space image output to the display unit 32 of the HMD 11 and the main display 12. Instead, the object that is the target of the second action may be displayed in the first virtual space image. In this case, for example, the display mode of the overlapped portion of the attention range 111 and the designated display range 112 is displayed in a mode different from the other portions, and the second action is enabled only for the moving object 115 included in the overlapped portion. It may be. Even in this case, since the second action is effective only for the predetermined object included in the overlapping portion, the first user 101 and the second user 102 can advance the game in cooperation.

  Alternatively, the display mode of the object or the virtual space image including the object may be different between the first virtual space image and the second virtual space image. For example, the second virtual space image can be enlarged and reduced, or an object can be displayed at an arbitrary angle. However, the first virtual space image cannot be enlarged and reduced, or can be displayed at a fixed angle. Only objects can be displayed. Alternatively, the second virtual space image may be an overhead image that is an overhead view of the virtual space including the object, and the overhead image may not be displayed in the first virtual space image. Alternatively, predetermined image processing such as transmission and edge extraction can be performed on the second virtual space image, but predetermined image processing may not be performed on the first virtual space image.

  FIG. 14 and FIG. 15 are examples in which the second virtual space image is an overhead image obtained by overlooking a virtual space including an object, and the first virtual space image is an image other than the overhead image. For example, the game performed by the first user 101 and the second user 102 is a puzzle game that combines three-dimensional figures. As illustrated in FIG. 14, the control unit 16 outputs, to the HMD 11 or the like, a first virtual space image 120 that is an image of a virtual space including the solid figure 150 that is an object, according to the posture of the first user 101. The solid figure 150 is not particularly limited to a triangular prism, a cone, a sphere, or the like other than a cube and a rectangular parallelepiped. The first user 101 operates the operation unit 14 to combine solid figures. When a predetermined number or more of solid figures 150 are combined, it is difficult to include the entire pattern formed by the combination of solid figures 150 in the viewing angle of the first virtual space image 120. For this reason, when forming the target pattern of the first user 101, it is difficult to determine at least one of the position where the three-dimensional figure 150 should be arranged and the type of the three-dimensional figure 150 to be arranged.

  As shown in FIG. 15, the control unit 16 outputs to the touch panel display 13 an overhead image 122 that is an overhead view of a pattern formed by combining the solid figures 150. Since the 2nd user 102 can visually recognize the whole pattern in the bird's-eye view image 122, it can judge easily which solid figure 150 should be arrange | positioned in which position.

  As shown in FIG. 15, for example, when the second user 102 touches a predetermined position on the screen of the touch panel display 13, the control unit 16 adds a three-dimensional figure to the first virtual space image 120 as shown in FIG. 14. The position where 150 is to be arranged is displayed by the designated position mark 151 (first action). Alternatively, in addition to the indication position mark 151, the position where the three-dimensional figure 150 is to be arranged may be displayed in a mode different from the display mode of other parts. The control part 16 arrange | positions the solid figure 150 in the position based on operation of the operation part 14 of the 1st user 101 (2nd action).

  In a puzzle game in which an action is performed based on the type of the three-dimensional figure 150, for example, the second user 102 selects an arbitrary three-dimensional figure 150 from the display area 153 for selecting the type of the three-dimensional figure 150, and The position where the solid figure 150 is to be placed is touched (see FIG. 15). As shown in FIG. 14, the control unit 16 displays the type of the three-dimensional figure 150 to be arranged with the type identification mark 152 (first action). Furthermore, the position where the three-dimensional figure 150 should be arranged may be displayed by the indication position mark 151 or the like. The first user 101 operates the operation unit 14 to place the three-dimensional figure 150 indicated by the type identification mark 152 at the position indicated by the indication position mark 151.

  In each of the above embodiments, as the first action, the range in the virtual space is designated as the designated display range 112 based on the touch operation on the touch panel display 13. Instead of this, as a first action, a direction or an arbitrary position in the virtual space may be indicated based on a touch operation on the touch panel display 13.

  FIG. 16 shows an example of a screen output in the maze game. As shown in FIG. 16A, the control unit 16 displays an image of the solid maze 160 provided in the virtual space on the display unit 32 of the HMD 11 as the first virtual space image 120. The control unit 16 outputs the first virtual space image 120 according to the posture of the user, and also proceeds through the three-dimensional maze 160 based on the operation of the operation unit 14 or the user position detected by the sensor. The aerial image 120 is changed. As illustrated in FIG. 16B, the control unit 16 causes the touch panel display 13 to display an overhead image of the three-dimensional maze 160 as the second virtual space image 121. The control unit 16 displays the position 161 of the first user 101 on the second virtual space image 121. For example, the second user 102 traces the direction in which the first user 101 is to travel with the finger according to the progress of the first user 101 while viewing the second virtual space image 121. The control part 16 acquires the input locus | trajectory according to touch operation from the touchscreen display 13, and displays the direction instruct | indicated in the 1st virtual space image 120 along the input locus | trajectory (1st action). For example, the direction indicated by the second user 102 may be displayed on the first virtual space image 120 as light with different brightness, saturation, and hue with respect to the background, or as an indicator such as an arrow. May be. The first user 101 proceeds through the solid maze 160 by operating the operation unit 14 with reference to the direction instructed on the first virtual space image 120.

  In each of the above embodiments, in addition to the HMD 11 that detects the position and orientation of the head of the first user 101, a position detection sensor that detects the position of the first user 101 in the real space may be provided. The control unit 16 detects not only the position and orientation of the head of the first user 101 but also the position where the first user 101 stands by the position detection sensor, and image information in the virtual space according to the position where the first user 101 stands. Is rendered to display the first virtual space image. In this way, since the first virtual space image is changed as the first user 101 moves, it is possible to further enhance the immersive feeling.

  In each of the above embodiments, the game that outputs a virtual space image to the HMD 11 and the touch panel display 13 is embodied as a game that snips a predetermined object. Instead, it may be embodied in other games such as an exploration game, a card game, a racing game, a fighting game, a simulation game, and a role playing game. Further, the action on the object is not limited to “sniper”, but may be other actions such as deforming, throwing, hitting, scattering, dividing, rotating, moving, and the like.

  In each of the above embodiments, the application that outputs an image of the virtual space to the HMD 11 and the touch panel display 13 is embodied in a game. Instead, applications that output images of the virtual space to the HMD 11 and the touch panel display 13 are applications other than games, such as simulation applications and training applications that are used in fields other than games, such as medical fields and educational fields. Also good.

Next, technical ideas that can be grasped from the above-described embodiment and other examples will be described below together with their effects.
[A] In an application control program for outputting an image of a virtual space using a mounting display worn by a first user and a control unit for outputting an image to a display used by a second user, the control unit includes the first user The virtual space image is output to the wearing display according to the posture of the display, the display range of the virtual space is determined based on the input operation of the second user, and the determined display is displayed on the display used by the second user. An image of the virtual space in the range is output, the second user's operation on the virtual space is accepted, a first action is performed in the virtual space, and the first action is reflected on the wearing display An image of the virtual space is output, and the first action is reflected according to an operation on the operation unit by the first user. Application control program for causing to function as a means for performing a second action in serial virtual space.
[B] The application control program according to [a], wherein the means for performing the first action controls movement of an object based on an input operation of the second user as the first action.
[C] The application control program according to [a] or [b], wherein the means for performing the first action selects an object based on an input operation of the second user as the first action.
[D] means for causing the control unit to further function as means for moving a moving object to be subjected to the second action in the image of the virtual space output to the mounted display, and for performing the first action; The means for stopping the movement of the moving object based on the operation of the display as the first action and outputting an image of the virtual space reflecting the first action is an image to be output to the wearing display The application control program according to any one of [a] to [c], wherein the movement of the moving object is stopped.
[E] The application according to [d], wherein the means for performing the first action specifies the moving object in the vicinity of the contact point on the display screen, and stops the movement only with respect to the moving object. Control program.
[F] The means for outputting the image of the virtual space in which the first action is reflected, when the determined display range overlaps the attention range according to the posture of the first user, A predetermined object included in the overlapping portion is set to a display state, and when there is the predetermined object not included in the overlapping portion, the predetermined object is output to the wearing display as a non-display state [a] to The application control program according to any one of [e].
[G] The means for outputting the image of the virtual space in which the first action is reflected includes at least one of brightness, saturation, and hue of the determined display range, and brightness, saturation of the other ranges. And the application control program according to [f], which is output to the mounted display in a state different from the hue.
[H] The means for performing the second action activates the second action only for a predetermined object included in an overlapping portion of the determined display range and the attention range corresponding to the posture of the first user. The application control program according to [f] or [g].
[I] The unit according to any one of [f] to [h], wherein the unit that outputs the image of the virtual space to the display outputs the predetermined object that is the target of the second action in a display state. Application control program.
[J] The means for outputting the image of the virtual space in which the first action is reflected is based on the determined display range rather than the viewing angle in the horizontal direction of the image of the virtual space output on the wearing display. The application control program according to any one of [a] to [i], which reduces a viewing angle in the horizontal direction.
[K] The means for outputting the image of the virtual space to the display further functions as means for outputting an image in which the virtual space is looked down and a predetermined object to be subjected to the second action is displayed. The application control program according to any one of claims [a] to [j].
[L] In an application control method for outputting an image of a virtual space using a mounting display worn by a first user and a control unit for outputting an image to a display used by a second user, the control unit includes the first user The virtual space image is output to the wearing display according to the posture of the user, the display range of the virtual space is determined based on the input operation of the second user, and the determined display is displayed on the display used by the second user. An image of the virtual space in the range is output, the second user's operation on the virtual space is accepted, a first action is performed in the virtual space, and the first action is reflected on the wearing display An image of the virtual space is output, and the temporary action in which the first action is reflected in response to an operation on the operation unit by the first user. Application control method characterized by performing a second action in space.
[M] In an application control system that outputs an image of a virtual space provided with a wearing display worn by the first user and a control unit that outputs an image to the display used by the second user, the control unit includes the first user The virtual space image is output to the wearing display according to the posture of the display, the display range of the virtual space is determined based on the input operation of the second user, and the determined display is displayed on the display used by the second user. An image of the virtual space in the range is output, the second user's operation on the virtual space is accepted, a first action is performed in the virtual space, and the first action is reflected on the wearing display Before outputting the image of the virtual space and reflecting the first action according to the operation of the operation unit by the first user Application control system characterized by performing the second action in the virtual space.

DESCRIPTION OF SYMBOLS 11 ... Head mounted display (HMD) as a mounting | wearing display, 12 ... Main display, 13 ... Touch panel display, 14 ... Operation part, 15 ... Control apparatus, 16 ... Control part, 17 ... Memory | storage part, 18 ... Game management information, 19 Reference point information 20 Reference designation range information 21 Object position information 22 Contact position information 24 Gaze position specifying unit 25 Image information storage unit 30 HMD control unit 31 Tracking sensor 32 DESCRIPTION OF SYMBOLS ... Display part 101 ... 1st user, 102 ... 2nd user, 110 ... Virtual space, 111 ... Attention range, 112 ... Designated display range, 114 ... Attention point, 115 ... Moving object, 116 ... Character, 118 ... Ray, 120 ... 1st virtual space image, 121 ... 2nd virtual space image, 122 ... Overhead image, 125 ... Overlapping part.

Claims (7)

An application control program for outputting a virtual space image to a display worn by a first user and a display used by a second user,
On one or more computers,
Outputting the image of the virtual space to the wearing display according to the posture of the first user;
Identifying a range visually recognized by the second user based on the operation of the second user, and outputting a virtual space image of the identified range on a display used by the second user;
An application control program for causing the wearing display to display the specified range in an identifiable manner.   The step of displaying the specified range in an identifiable manner displays at least one of brightness, saturation, and hue of an image included in the specified range different from an image outside the specified range. Item 2. The application control program according to Item 1.   The virtual space includes an object, and when the object is included in an overlapping portion between the specified range and the range displayed on the wearing display, the display mode of the object is changed. 2. The application control program according to 2.   When the virtual space includes an object and the object is included in an overlapping portion between the specified range and the range displayed on the wearing display, the action by the first user is validated for the object. The application control program according to any one of claims 1 to 3.   The application control according to any one of claims 1 to 4, wherein a horizontal viewing angle of the specified range is made smaller than a horizontal viewing angle of an image of the virtual space output from the mounted display. program. An application control method for outputting an image of a virtual space to a wearing display worn by a first user and a display used by a second user,
One or more computers
Outputting the image of the virtual space to the wearing display according to the posture of the first user;
Identifying a range visually recognized by the second user based on the operation of the second user, and outputting a virtual space image of the identified range on a display used by the second user;
And displaying the specified range in an identifiable manner on the wearing display. An application system that includes a wearing display worn by a first user and a control unit that outputs an image to a display used by a second user, and that outputs an image of a virtual space,
The control unit is
Outputting the image of the virtual space to the wearing display according to the posture of the first user;
Identifying a range visually recognized by the second user based on the operation of the second user, and outputting a virtual space image of the identified range on a display used by the second user;
An application control system that performs the step of displaying the specified range in an identifiable manner on the wearing display.

Images