JP6506486B2 - Apparatus for providing virtual reality image and program for providing virtual reality image - Google Patents

Description

  The present invention relates to a virtual reality image providing apparatus and a virtual reality image providing program, and is particularly suitable for use in a virtual reality image providing apparatus configured to display an avatar image of a viewer in a virtual reality space. .

  In recent years, the use of virtual reality (VR: virtual reality) technology that allows a virtual world created in a computer to experience as if it were a reality is spreading. There are various applications of VR, but by displaying image data of a three-dimensional space in an HMD (head mounted display) such as goggles worn by a user, the inside of the three-dimensional space drawn to the HMD There is a system that allows users to virtually experience various experiences. In this type of VR technology, many are provided in which images of the entire sky can be viewed according to the user's gaze or head movement.

  There is also a system in which a viewer or a virtual person when the viewer interacts with a computer is displayed as an avatar image in a three-dimensional space (see, for example, Patent Documents 1 and 2). Patent Document 1 discloses a configuration in which avatars are positioned based on positional information of eyeballs of a user wearing the HMD in displaying avatars in a three-dimensional space. Specifically, it is described that the head of a person is positioned and the avatar is moved based on positional information of two eyeballs of the first eyeball and the second eyeball.

  Further, Patent Document 2 discloses that it is possible to easily determine the direction in which the user is looking in the virtual reality space by changing the direction of the avatar's head. Specifically, while the three-dimensional output server sequentially transmits the screen data to be displayed to the HMD, the data on the rotation in the yaw direction and the pitch direction of the HMD is received from the HMD, and the screen is based on the received data on the rotation While changing data, changing avatar data of a user corresponding to HMD is described.

JP, 2014-86091, A JP, 2017-27477, A

  In the technology described in Patent Document 2, the three-dimensional output server sequentially transmits screen data to a plurality of HMDs. The screen data to be transmitted includes avatar data, which is data relating to an avatar that is a part of each user who wears each HMD, and space data, which is data relating to a virtual three-dimensional space. The HMDs of the respective users each display a virtual three-dimensional space screen of the entire circumference centered on itself and display a plurality of avatars in the virtual three-dimensional space.

  In the technology described in Patent Document 2, the same virtual three-dimensional space screen is displayed on any HMD, and a plurality of avatars are displayed in the same manner on any HMD. However, in this case, the image is not an image reflecting the real space in which a plurality of users wearing the HMD exist, and there is a problem that the display becomes a reality or a poor sense of reality.

  The present invention has been made to solve such a problem, and when displaying avatar images corresponding to a plurality of viewers who wear the HMD in the real space in a virtual reality space image of the HMD, The purpose is to be able to provide a more realistic virtual reality space image.

  In order to solve the problems described above, according to the present invention, spatial data related to a virtual reality space, avatar data related to avatars that are alternates of at least other viewers among a plurality of viewers existing in the real space, and a plurality of avatars Based on relative position data representing the relative relative position of the viewer, the position of the user is taken as a predetermined position in the screen, and relative positions of the plurality of viewers are reflected relative to the predetermined position in the screen. A virtual reality space image in which an avatar image exists at a certain position is displayed.

  According to the present invention configured as described above, when avatar images corresponding to a plurality of viewers wearing the HMD in the real space are displayed in the virtual reality space image of the HMD, each viewing is performed for each HMD. The avatar image is displayed at a position reflecting the relative positional relationship of a plurality of viewers with reference to the position of the person. As a result, the virtual reality space image displayed on each HMD becomes an image in which avatars of other viewers are displayed at the same relative position as the reality for each viewer, providing a more realistic virtual reality space image can do.

1 is a diagram showing an example of the overall configuration of a VR image display system to which a virtual reality image providing device according to the present embodiment is applied. It is a block diagram showing an example of functional composition of HMD (virtual reality image offer device) by this embodiment. It is a figure for demonstrating an example of the relative position data by this embodiment. It is a figure which shows the relationship between the relative positional relationship of a three-dimensional space, each avatar, and the range of a virtual reality space image. It is a figure which shows the example of the virtual reality space image produced | generated by the image generation part of this embodiment. It is a figure which shows the modification of the VR image display system to which the virtual reality image provision apparatus by this embodiment is applied.

  Hereinafter, an embodiment of the present invention will be described based on the drawings. FIG. 1 is a view showing an example of the overall configuration of a VR image display system to which a virtual reality image providing device according to the present embodiment is applied.

VR image display system of the present embodiment includes a plurality of HMD 100 _-1 which a plurality of viewers are worn, 100 _-2, ··· 100 _-n (hereinafter, sometimes, referred to as the HMD 100 are collectively), external The computer 200 is configured. The HMD 100 corresponds to the virtual reality image providing device of the present embodiment. The plurality of HMDs 100 and the external computer 200 are connected by a wired or wireless communication network 300.

  Each of the plurality of HMDs 100 incorporates a computer for reproducing three-dimensional space data related to the virtual reality space. The external computer 200 transmits avatar data on avatars to be displayed in a three-dimensional space to each HMD 100. Each HMD 100 generates and displays a virtual reality space image in which avatars of viewers are superimposed on a three-dimensional space image.

  FIG. 2 is a block diagram showing an example of a functional configuration of the HMD 100 according to the present embodiment. As shown in FIG. 2, the HMD 100 of this embodiment has, as its functional configuration, a space data acquisition unit 11, an avatar data acquisition unit 12, a relative position data acquisition unit 13, an image generation unit 14, a display control unit 15, and direction detection. It comprises the part 16 and is comprised. The image generation unit 14 includes a space data reproduction unit 14A and an avatar image generation unit 14B. Further, the HMD 100 of the present embodiment includes a space data storage unit 101, an avatar data storage unit 102, and a relative position data storage unit 103 as storage media.

  Each of the functional blocks 11 to 16 can be configured by any of hardware, DSP (Digital Signal Processor), and software. For example, when configured by software, each of the functional blocks 11 to 16 actually includes the CPU, RAM, ROM, etc. of the computer that the HMD 100 incorporates, and records the RAM, ROM, hard disk, semiconductor memory, etc. It is realized by operating a program stored in a medium.

  The spatial data storage unit 101 stores spatial data related to a virtual reality space. The spatial data stored in the spatial data storage unit 101 is three-dimensional spatial data of the entire sky, in which the display can be changed according to the viewing direction of the viewer. This three-dimensional space data can be generated in advance using known techniques relating to virtual reality. The three-dimensional space data is generated by, for example, a personal computer or the like in which a dedicated editor is installed, and stored in the space data storage unit 101 of the HMD 100.

  The space data acquisition unit 11 acquires three-dimensional space data from the space data storage unit 101 and supplies the acquired three-dimensional space data to the image generation unit 14. Acquisition of three-dimensional space data is executed when displaying a virtual reality space image on the HMD 100.

  The avatar data acquisition unit 12 acquires avatar data regarding avatars that are avatars of viewers other than the viewer among the plurality of viewers existing in the real space from the external computer 200 via the communication network 300, and acquires the avatar data Are stored in the avatar data storage unit 102. The avatar data acquired by the avatar data acquiring unit 12 is three-dimensional image data which is changed to a display of a state viewed from a different direction by changing a viewpoint.

In the present embodiment, the number of HMDs 100 connected to the external computer 200 is arbitrary. The external computer 200 stores avatar data of the same number as the number of HMDs 100 connected. Among the plurality of avatar data stored in the external computer 200, the avatar data acquisition unit 12 acquires avatar data corresponding to a viewer other than oneself. For example, the avatar data acquisition unit 12 of the HMD 100 _-1 acquires avatar data other than viewers wearing the HMD 100 _-1 from the external computer 200.

  The relative position data acquisition unit 13 acquires relative position data representing the actual relative positional relationship of a plurality of viewers present in the real space from the external computer 200 via the communication network 300, and the acquired relative position data is relative It is stored in the position data storage unit 103. In the present embodiment, although the positions at which a plurality of viewers wearing the HMD 100 exist are arbitrary, the positional relationship between them does not dynamically change, and is fixed. For example, a typical case is a case in which a plurality of viewers wearing the HMD 100 sit in a predetermined seat.

  That is, in the present embodiment, the positions of a plurality of viewers existing in the real space are determined in advance, and relative position data representing the actual relative positional relationship of the plurality of viewers is preset in the external computer 200 There is. The relative position data acquisition unit 13 of each HMD 100 acquires relative position data stored in the external computer 200.

FIG. 3 is a diagram for explaining an example of relative position data. Here, an example in which 6 viewers wearing each six HMD 100 _-1 to 100 _-6 to exist side by side in an arc shape. FIG. 3A shows a relative positional relationship with the other five HMDs 100 _{-2 to} 100 _-6 based on the position of the HMD 100 _-1 located at the left end of the arc. In FIG. 3A, a line connecting two HMDs 100 indicates a relative positional relationship. The relative position data corresponding to this line may be composed of vector data based on the position of the HMD 100 _-1 or may be composed of coordinate data. As shown in FIG. 3 (a), case where the relative position data relative to the position of the HMD 100 _-1, the relative position data HMD 100 _-1 to get.

The relative position data HMD 100 _-2 is obtained, in which reference to the position of the HMD 100 _-2, expressed another five HMD 100 _-1, the relative positional relationship between the 100 _-3 100 _-6 respectively . The relative position data HMD 100 _-3 is obtained, which on the basis of the position of the HMD 100 _-3, expressed another five HMD 100 _-1 100 _-2, the relative positional relationship between the 100 _-4 100 _-6 respectively It is. Similarly, relative position data acquired by the other HMDs 100 _{-4 to} 100 _-6 are each representing relative positional relationships with the other five HMDs 100 based on their own positions. Each of the HMDs 100 _{-2 to} 100 _-6 acquires relative position data corresponding to itself from the external computer 200.

FIG. 3B shows another example of relative position data. In the example of FIG. 3B, the relative positional relationship between the HMDs 100 adjacent to each other is configured as relative position data. That is, the relative positional relationship between HMD 100 _-1 and HMD 100 _-2 , the relative positional relationship between HMD 100 _-2 and HMD 100 _-3 , the relative positional relationship between HMD 100 _-3 and HMD 100 _-4 , the HMD 100 _-4 and HMD 1005 _-5 relative positional relationship, as representing the relative positional relationship between the HMD 100 _-5 and HMD 100 _-6, relative position data is constituted.

Case where the relative position data as shown in FIG. 3 (b), the relative position data of six HMD 100 _-1 to 100 _-6 acquires becomes both the same. However, its relative position six HMD 100 _-1 to 100 _-6 among which are included in the data, data is needed to indicate whether they correspond to any position. For this data indicating the own position, six HMD 100 _-1 to 100 _-6 to get those relevant from an external computer 200, respectively.

  In addition, it is essential to synchronously perform acquisition of three-dimensional space data by the space data acquisition unit 11, acquisition of avatar data by the avatar data acquisition unit 12, and acquisition of relative position data by the relative position data acquisition unit 13. Absent. For example, when avatar data and relative position data are acquired in advance from external computer 200 and stored in avatar data storage unit 102 and relative position data storage unit 103, and the virtual reality space image is displayed on HMD 100, spatial data acquisition Three-dimensional space data may be acquired from the space data storage unit 101 by the unit 11.

  The image generation unit 14 is based on the three-dimensional space data acquired by the space data acquisition unit 11, the avatar data acquired by the avatar data acquisition unit 12, and the relative position data acquired by the relative position data acquisition unit 13. The virtual reality space image is generated in which the avatar image is present at a position reflecting the actual relative positional relationship of a plurality of viewers, with the position of the user as a predetermined position in the screen and with the predetermined position in the screen as a reference. The display control unit 15 causes the virtual reality space image generated by the image generation unit 14 to be displayed.

  The direction detection unit 16 detects the direction in which the head of the viewer wearing the HMD 100 is facing. That is, the HMD 100 is equipped with a gyro sensor and an acceleration sensor. The direction detection unit 16 can detect the motion of the head of the viewer based on the detection signals from these sensors.

  The spatial data acquisition unit 11 uses the spatial data storage unit 101 so that the three-dimensional space realized on the display of the HMD 100 dynamically changes according to the movement of the head of the viewer detected by the direction detection unit 16. Change the 3D spatial data to be acquired. The space data reproduction unit 14A of the image generation unit 14 reproduces, for display, the three-dimensional space data acquired by the space data acquisition unit 11 in accordance with the movement of the head of the viewer. As a result, a three-dimensional space image in which the three-dimensional space in front is expanded is reproduced if the viewer faces the front, and a three-dimensional space image in which the three-dimensional space on the right is expanded when the viewer faces the right is reproduced. When the viewer faces the left, a three-dimensional space image is reproduced such that the three-dimensional space on the left side is expanded.

  The avatar image generation unit 14B generates an avatar image related to a viewer other than the user based on the avatar data acquired by the avatar data acquisition unit 12. At this time, as described above, the avatar image generation unit 14B sets the position of the avatar as a predetermined position in the screen (for example, the center position at the lower end of the screen), and the reality of a plurality of viewers with reference to the center position at the lower end A plurality of avatar images are generated such that each exists at a position reflecting the relative positional relationship of. Further, the avatar image generation unit 14B generates a plurality of avatar images with a size that reflects the sense of perspective according to the relative positional relationships of the realities of the plurality of viewers.

  Further, the avatar image generation unit 14B generates an avatar such that the direction of the avatar image realized on the display of the HMD 100 dynamically changes according to the movement of the head of the viewer detected by the direction detection unit 16 Change the image For example, when it is detected by the direction detection unit 16 that the viewer has turned in a direction to look at another viewer in front, the avatar image generation unit 14B is an avatar in a state in which the other viewer is viewed straight Generate an image. In addition, when the direction detection unit 16 detects that the viewer has turned in a direction to look at another viewer obliquely, the avatar image generation unit 14B is in a state in which the other viewer is viewed obliquely Generate avatar images.

FIG. 4 shows the three-dimensional space represented by three-dimensional space data, the relative positional relationship between avatars (viewers) represented by relative position data, and the orientation of the head of the viewer detected by the direction detection unit 16 FIG. 7 is a diagram showing a relationship with a range of a virtual reality space image generated by the image generation unit 14 according to (line of sight direction). FIGS. 4A and 4B show an example in the case where a viewer 111 _-1 (a viewer wearing the HMD 100 _-1 ) positioned at the left end of the arc is a reference. Further, FIG. 4 (c) illustrates an example where the viewer 111 _-3 (HMD 100 _-3 fitted viewer) reference located arc center.

FIG. 5 is a view showing an example of a virtual reality space image generated by the image generation unit 14 corresponding to the states shown in FIGS. 4 (a) to 4 (c). That is, FIGS. 5A and 5B show virtual reality space images displayed on the HMD 100 _-1 worn by the viewer 111 _-1 located at the left end of the arc. Further, FIG. 5C shows a virtual reality space image displayed on the HMD 100 _-3 worn by the viewer 111 _-3 located at the center of the arc. In FIG. 5, for convenience of explanation, only the avatar image is shown, and the three-dimensional space image is not shown.

As shown in FIG. 4 (a), the image generation unit 14 of the viewer 111 _-1 wears HMD 100 _-1 which is located at the left end of the arc, the center position of the three-dimensional space 41 which is represented by a three-dimensional spatial data It is understood that the viewer _111-1 exists. With reference to the position of the viewer 111 _-1, other viewers 111 _-2 to 111 _-6 (viewers respectively mounted HMD 100 _-2 to 100 _-6) are real relative represented by the relative position data It is understood that each exists at a position reflecting the positional relationship.

Here, if that viewer 111 _-1 is facing the direction of the arrow A has been detected by the direction detecting unit 16, the image generation unit 14, the position of the viewer 111 _-1 to the center position of the lower end of the screen, A virtual reality space image is generated such that the three-dimensional space in the direction indicated by the range 42 expands. Therefore, as shown in FIG. 5A, avatar images relating to other viewers 111 _{-2 to} 111 _-6 do not exist in the virtual reality space image generated by the image generation unit 14.

On the other hand, as shown in FIG. 4B, it is detected by the direction detection unit 16 that the viewer _111-1 is pointing in the direction of arrow B (direction to the left of 90 degrees with respect to arrow A). case, the image generating unit 14, the position of the viewer 111 _-1 to the center position of the bottom of the screen, to generate a virtual reality space image as spread three-dimensional space in the direction indicated by the range 43. Therefore, as shown in FIG. 5B, avatar images relating to other viewers 111 _{-2 to} 111 _-6 exist in the virtual reality space image generated by the image generation unit 14. In addition, the avatar images of the viewers 111 _{-2 to} 111 _-6 reflect the sense of perspective at a position reflecting the actual relative positional relationship with reference to the center position of the lower end of the screen where the viewer 111 _-1 is present. Each is displayed in the size that you

Further, as shown in FIG. 4C, the image generation unit 14 of the HMD 100 _-3 worn by the viewer 111 _-3 located at the center of the arc is the center of the three-dimensional space 41 represented by the three-dimensional space data. It is _understood that the viewer _111-3 exists at the position. With reference to the position of the viewer 111 _-3, other viewers 111 _-1 to 111 _-2, the 111 _-4 to 111 _-6, reflecting the actual relative positional relationship indicated by the relative position data positions To be present in each

Here, if that viewer 111 _-3 is facing the direction of arrow C is detected by the direction detecting unit 16, the image generation unit 14, the position of the viewer 111 _-3 and the center position of the lower end of the screen, A virtual reality space image is generated such that the three-dimensional space in the direction indicated by the range 44 expands. Therefore, as shown in FIG. 5 (c), in the virtual reality space image generated by the image generation unit 14, other viewers 111 _-1 to 111 _-2, the avatar related 111 _-5 to 111 _-6 There is an image. Also, the avatar images of the viewers 111 _{-1 to} 111 _-2 and 111 _{-5 to} 111 _-6 reflect actual relative positional relationships based on the center position of the lower end of the screen where the viewer 111 _-3 is present. Is displayed in the size where the perspective is reflected.

  As described above in detail, in the present embodiment, space data related to the virtual reality space, avatar data related to avatars that are other than the viewer among the plurality of viewers existing in the real space, and the plurality of viewers The position which made one's position a predetermined position in a screen based on relative position data showing the actual relative position relation of, and made the relative position relation of a plurality of viewers reflect on the basis of the predetermined position in the screen concerned The virtual reality space image in which the avatar image exists is displayed.

  According to this embodiment configured in this manner, relative positional relationships among a plurality of viewers are determined for each of the HMDs 100 worn by a plurality of viewers existing in the real space, based on the positions of the viewers themselves. The avatar image is displayed at the reflected position. As a result, virtual reality space images displayed on each HMD 100 become avatars in which avatars of other viewers are displayed at the same relative position as the reality for each viewer, providing a more realistic virtual reality space image. can do.

  In the above embodiment, an example in which three-dimensional space data is stored in advance in the space data storage unit 101 of the HMD 100 has been described, but the present invention is not limited to this. For example, the HMD 100 may also acquire three-dimensional space data from the external computer 200. Also in this case, it is not essential to synchronously acquire three-dimensional space data, avatar data and relative position data. For example, avatar data and relative position data may be acquired in advance, and when displaying a virtual reality space image on the HMD 100, three-dimensional space data may be reproduced while being acquired from the external computer 200.

  Further, in the above embodiment, an example in which the virtual reality image providing device of the present embodiment is mounted on the HMD 100 has been described, but the present invention is not limited to this. For example, the virtual reality image providing device of the present embodiment may be mounted on the external computer 200. In this case, the HMD 100 includes the display control unit 15 and the direction detection unit 16. On the other hand, the external computer 200 includes a space data storage unit 101, an avatar data storage unit 102 and a relative position data storage unit 103, a space data acquisition unit 11, an avatar data acquisition unit 12, a relative position data acquisition unit 13, and an image generation unit 14. Prepare.

  Then, the space data acquisition unit 11, the avatar data acquisition unit 12, and the relative position data acquisition unit 13 of the external computer 200 acquire three-dimensional space data, avatar data and relative position data from the respective storage units 101 to 103, and generate an image. The unit 14 generates a virtual reality space image and transmits it to the HMD 100. The display control unit 15 of the HMD 100 causes the display control unit 15 to display the virtual reality space image transmitted from the external computer 200. The HMD 100 also notifies the external computer 200 of the direction of the head of the viewer detected by the direction detection unit 16 via the communication network 300. The image generation unit 14 of the external computer 200 changes the virtual reality space image to be generated according to the notified head direction of the viewer.

  In the above embodiment, the avatar data acquisition unit 12 acquires avatar data of viewers other than the viewer among the plurality of viewers existing in the real space, but the present invention is not limited to this. For example, the avatar data acquisition unit 12 acquires avatar data of all the viewers who exist in the real space, including oneself, and the image generation unit 14 generates a virtual reality space image including one's avatar image. May be

Further, in the above embodiment, in addition to displaying avatars of a plurality of viewers at a position reflecting the actual relative positional relationship, the avatar image reflecting the direction of the head to which the real viewers are facing May be generated. For example, if in the example of FIG. 4 (b), the viewer 111 _-6 who is at the right end of the arc, it has been detected by the direction detecting section 16 facing to the right there are the viewer 111 _-1, viewers the avatar image corresponding to the viewer 111 _-6 in the virtual reality space image to be displayed on the 111 _-1 HMD 100 _-1, and image facing the viewer 111 _-1.

  In order to realize this, each HMD 100 notifies the external computer 200 of the direction of the viewer's head detected by the direction detection unit 16 via the communication network 300. The external computer 200 notifies the direction of the head of the viewer notified from each HMD 100 to the HMD 100 other than the notification source via the communication network 300. The image generation unit 14 generates the avatar image of the other viewer in consideration of the direction of the head of the other viewer notified from the external computer 200.

  Further, in the above embodiment, only the display of the virtual reality space image (including the avatar image) on the HMD 100 has been mentioned, but it goes without saying that the sound can be output from the speaker together with the display of the image. In this case, audio may be output from an external speaker shared by a plurality of viewers, or audio may be output from a speaker mounted on the HMD 100.

  FIG. 6 is a view showing a modified example of the VR image display system to which the virtual reality image providing device according to the present embodiment is applied. In addition to the display of the virtual reality space image, this FIG. 6 is shown including the structure regarding the output of an audio | voice. The VR image display system shown in FIG. 6 includes an external speaker 400 shared by a plurality of viewers, and a speaker mounted on the HMD 100 (hereinafter referred to as a mounted speaker).

Here as shown in FIG. 6 (b), 1 single physical space in which a plurality of viewers are present (e.g., room) shows an example in which a plurality of external speakers 400 _-1 400 _-4 plurality of locations in the ing. The on-board speaker provided in the HMD 100 may be a headphone-type speaker configured to be located near both ears when the viewer wears the HMD 100, or may be configured to be located in a place other than near both ears It may be a small speaker. Further, as shown in FIG. 6B, the HMD 100 may be configured to include a headset having a microphone in addition to a headphone type speaker.

  The external computer 200 reproduces the sound in synchronization with the display of the virtual reality space image, and outputs the sound from the external speaker 400. The individual HMDs 100 worn by a plurality of viewers also reproduce sound in synchronization with the display of the virtual reality space image, and output it from the mounted speakers. For example, it is conceivable that the main sound is output from the external speaker 400 and the sub sound is output from the mounted speaker of the HMD 100. Specifically, as one example of the rendering effect, it is conceivable to output the main sound of a large volume from the external speaker 400, and output the sub sound of a small volume from the mounted speaker of the HMD 100.

  The audio data relating to the sub audio output from the mounted speaker of the HMD 100 may be stored in advance in the space data storage unit 101 of the HMD 100 or may be acquired from the external computer 200 at the time of reproduction. . Alternatively, the audio data relating to the sub audio output from the on-board speaker of the HMD 100 may be one in which the speaker's voice of the viewer input from the microphone of a certain HMD 100 is transmitted to another HMD 100 via the external computer 200 . In this way, the viewer can listen to the main voice output from the external speaker 400 and can also hear the speaker voice of another viewer from the on-board speaker of the HMD 100 as a sub-voice.

  When voice data related to a speaker's voice of a viewer input from a microphone of an HMD 100 is transmitted to another HMD 100 and output from a headphone-type on-board speaker, the transmission source of the voice data is the speaker voice from the on-board speaker The speaker voice may be output from either the left speaker or the right speaker, depending on whether it is located on the left side or the right side relative to the other HMD 100 that outputs.

For example, from the mounted speaker of the HMD 100 _-3 worn by the viewer 111 _{-3 at} the center of the arc shown in FIG. 4 (c), it is transmitted from the HMD 100 _-1 worn by the viewer 111 _-1 located at the left end of the arc. and when outputting the speaker voice of the viewer 111 _-1 based on the audio data, since the HMD 100 _-1 viewers 111 _-1 positioned relatively right side viewed from the center of the HMD 100 _-3, right speaker Output the speaker's voice only from

Audio transmitted from the mounted speaker of HMD 100 _-3 worn by the viewer 111 _{-3 at} the center of the arc shown in FIG. 4C from the HMD 100 _-6 worn by the viewer 111 _-6 located at the right end of the arc when outputting the speaker voice of the viewer 111 _-6 based on the data, since the HMD 100 _-6 viewers 111 _-6 positioned relatively left side as viewed from the center of the HMD 100 _-3, from only the left speaker Make the speaker's voice output.

  In this way, it is possible to give a sense of reality that sounds can be heard from the direction in which the speaker is actually present. Further, the volume of the speaker voice to be output may be adjusted according to the relative distance between the HMD 100 as the transmission source of the voice data and the HMD 100 as the transmission destination. In this way, from the direction in which the speaker is actually present, the speaker voice can be heard at a volume according to the actual relative distance, so it is possible to increase the sense of reality.

  In addition, any of the above-described embodiments is merely an example of embodying the present invention, and the technical scope of the present invention should not be interpreted in a limited manner. That is, the present invention can be implemented in various forms without departing from the scope or main features of the present invention.

11 spatial data acquisition unit 12 avatar data acquisition unit 13 relative position data acquisition unit 14 image generation unit 14A spatial data reproduction unit 14B avatar image generation unit 15 display control unit 16 direction detection unit 100 HMD
200 external computer

Claims (9)

A virtual reality image providing device for providing a virtual reality space image to be displayed on a head mounted display, comprising:
A direction detection unit that detects the direction in which the head of the viewer wearing the head mounted display is facing;
A spatial data acquisition unit that acquires spatial data related to a virtual reality space;
An avatar data acquisition unit that acquires avatar data relating to an avatar that is at least one other viewer among the plurality of viewers existing in the real space;
A relative position data acquisition unit that acquires relative position data representing actual relative positional relationships of the plurality of viewers;
Based on the space data, the avatar data, and the relative position data, the position of the user is determined as a predetermined position in the screen, and the direction detection unit detects among the plurality of viewers based on the predetermined position in the screen. Providing an image generation unit for generating a virtual reality space image in which the avatar image is present at a position reflecting the actual relative positional relationship only for the viewer belonging to the predetermined range corresponding to the head orientation A virtual reality image providing apparatus characterized by the above. The positions of a plurality of viewers existing in the real space are determined in advance, and relative position data representing the actual relative positional relationship of the plurality of viewers is set in advance,
The virtual reality image providing apparatus according to claim 1, wherein the relative position data acquisition unit acquires the preset relative position data. The space data acquisition unit acquires the space data from a storage medium included in the head mounted display,
3. The avatar data acquisition unit and the relative position data acquisition unit respectively acquire the avatar data and the relative position data from an external computer to which the head mount display is connected. Virtual reality image provider.   The space data acquisition unit, the avatar data acquisition unit, and the relative position data acquisition unit are characterized in that the space data, the avatar data, and the relative position data are acquired from an external computer to which the head mounted display is connected. The virtual reality image providing apparatus according to claim 1 or 2. A virtual reality image providing program for providing a virtual reality space image to be displayed on a head mounted display, comprising:
Direction detection means for detecting the direction in which the head of the viewer wearing the head mounted display is facing;
Spatial data acquisition means for acquiring spatial data related to virtual reality space,
Avatar data acquisition means for acquiring avatar data relating to an avatar that is at least one other viewer among a plurality of viewers existing in the real space;
Relative position data acquiring means for acquiring relative position data representing actual relative positional relationships of the plurality of viewers, and the position of the user within the screen based on the spatial data, the avatar data and the relative position data Based on the predetermined position in the screen, the actual relative positional relationship is reflected only for the viewers belonging to the predetermined range corresponding to the head direction detected by the direction detecting means, based on the predetermined position in the screen A virtual reality image providing program for causing a computer to function as an image generation unit that generates a virtual reality space image in which the avatar image is present at a position where the virtual reality space is located. The image generation unit
5. The avatar image according to any one of claims 1 to 4, characterized in that, for a viewer belonging to the predetermined range, the avatar image of a size reflecting the sense of perspective according to the relative positional relationship represented by the relative position data is generated. The virtual reality image provision apparatus as described in a term. The image generation unit
The direction of the head of each viewer is acquired by communication for the viewers belonging to the predetermined range, and the direction of the head of each viewer is reflected to generate the avatar image. 6. The virtual reality image providing device according to any one of 6. The head mounted display is equipped with a right speaker corresponding to the right ear of the viewer wearing the head mounted display, a left speaker corresponding to the left ear, and a microphone for picking up the speaker's voice And
The head mounted display acquires speaker voices picked up by other microphones mounted on other head mounted displays, and can be output from the right speaker or the left speaker.
When the speaker voices of viewers other than the viewer wearing the head mounted display are output from the right speaker or the left speaker, the one viewer and the other viewer The virtual reality image providing device according to any one of claims 1 to 4, 6, 7 wherein the output is made from one of the speakers reflecting the relative positional relationship of (1). The head mounted display is equipped with a speaker for outputting voice and a microphone for collecting speaker voice,
The head mounted display can acquire a speaker voice picked up by another microphone mounted on another head mounted display, and can output it from the speaker,
When the speaker voices of viewers other than the one who wears the head mounted display are output from the speaker, the volume reflecting the relative distance between the one viewer and the other viewer The virtual reality image providing device according to any one of claims 1 to 4, 6, 7 wherein the output is made from the speaker.