JP6955351B2 - Protective devices, protection methods and protection programs - Google Patents

Description

The present invention relates to protective devices, protection methods and protection programs.

Conventionally, there is known a technology of virtual reality (VR) that provides a feeling of being in a virtual space by projecting an image in the virtual space within the field of view of the user.

Japanese Unexamined Patent Publication No. 2013-232205

However, the above-mentioned conventional technique may give an excessive impact to the user.

In recent years, an HMD (Head Mounted Device) or the like that covers the user's field of view and provides an image of the VR space in consideration of binocular parallax has increased the immersive feeling in the VR space. For this reason, when an event that may give an impact (for example, surprise) to the user occurs, such as when the user falls in the VR space or an object collides with the user, an excessive impact is given to the user. There is a risk of giving.

The present application has been made in view of the above, and an object of the present application is to reduce the impact on the user.

The protective device according to the present application includes an estimation unit that estimates the impact degree, which is the degree of impact received by the user through the virtual reality space, and when the impact degree estimated by the estimation unit exceeds a predetermined threshold value, the above-mentioned It is characterized by having an execution unit that executes protection measures for protecting the user from impact.

According to one aspect of the embodiment, the impact on the user can be reduced.

FIG. 1 is a diagram showing an example of protection processing executed by the information providing device according to the embodiment. FIG. 2 is a diagram showing a configuration example of the information providing device according to the embodiment. FIG. 3 is a diagram showing an example of information registered in the object database according to the embodiment. FIG. 4 is a diagram showing an example of information registered in the event database according to the embodiment. FIG. 5 is a diagram illustrating an example of an event predicted by the information providing device according to the embodiment. FIG. 6 is a flowchart showing an example of a flow of protection processing executed by the information providing device according to the embodiment. FIG. 7 is a diagram showing an example of a hardware configuration.

Hereinafter, the protective device, the protection method, and the embodiment for implementing the protection program according to the present application (hereinafter, referred to as “the embodiment”) will be described in detail with reference to the drawings. It should be noted that this embodiment does not limit the protection device, protection method and protection program according to the present application. Further, in each of the following embodiments, the same parts will be designated by the same reference numerals, and duplicate description will be omitted.

[Embodiment]
[1. About the process displayed by the information providing device]
First, with reference to FIG. 1, an example of protection processing executed by an information providing device, which is an example of a protection device, will be described. FIG. 1 is a diagram showing an example of protection processing executed by the information providing device according to the embodiment.

In the following description, as a protection process executed by the information providing device 10, the impact degree of the user U is reduced when the image of the VR space is drawn and displayed on the HMD 100 worn by the user U. An example of the process of editing and displaying the video will be described, but the embodiment is not limited to this. For example, the protection process provided by the information providing device 10 may be performed stand-alone by the HMD 100. Further, the protection process provided by the information providing device 10 may be realized by, for example, a game machine connected to the HMD 100 and displaying an image of a VR space such as a game via the HMD 100.

[1-1. An example of an information providing device]
The information providing device 10 is an information processing device capable of communicating with the HMD 100 via a predetermined network N (for example, see FIG. 2) such as the Internet or a wireless LAN (Local Area Network), and is, for example, a server device or a server device. Realized by cloud systems, game machines, etc. The information providing device 10 may be able to communicate with an arbitrary number of HMDs 100 via the network N.

The HMD 100 is a wearable device worn by the user U, and by displaying various images such as still images and moving images provided by the information providing device 10 in the field of view of the user U, the user U looks as if he / she is. It provides the feeling of being in a VR space. Further, the HMD 100 may have a function of outputting the voice received from the information providing device 10.

[1-2. An example of processing related to VR space]
Here, an example of the VR space provided by the information providing device 10 and the HMD 100 to the user U will be described. For example, the information providing device 10 stores the shape, appearance (mapped image, surface treatment, etc.), arrangement position, and the like of various objects displayed as VR such as a building and a character. Further, the information providing device 10 identifies the viewpoint of the user U in the VR space, and draws an image for the HMD 100 to reproduce the scene when the VR space is visually recognized from the specified viewpoint in the field of view of the user U. .. Then, the information providing device 10 transmits the drawn image to the HMD 100 and displays it on the HMD 100 to provide the user U with a scene in the VR space.

Further, for example, the HMD 100 collects information such as which direction the user U is facing, whether the user U has moved, how much the user U has moved, and various operations in the VR space. The collection may be collected by a camera, an information processing device, or the like that operates in conjunction with the HMD 100. Then, the HMD 100 transmits various collected information to the information providing device 10. In such a case, the information providing device 10 redraws an image of the scene visually recognized by the user U in the VR space according to the direction of the user U and the content of the operation in the VR space, and transmits the drawn image to the HMD 100. do.

In addition to the above-mentioned processing, the information providing device 10 and the HMD 100 may provide the user U with a scene of the VR space by using an arbitrary technique. That is, the information providing device 10 and the HMD 100 can apply the well-known VR technology.

[1-3. Example of protection processing]
In recent years, due to advances in VR-related technology, such as providing images that take binocular parallax into consideration, covering the field of view of user U, and moving the viewpoint in VR space according to the movement of user U, etc. The feeling of being put into the VR space is getting stronger. Therefore, for example, when the user U is suddenly attacked in a game or the like, when a high-speed object such as a bullet collides, or when the object suddenly enters the field of view of the user U, the VR space is displayed. When an event that may give a shock to the user occurs in the VR space, such as when the user falls, there is a risk of giving an excessive shock (that is, a shock) to the user.

Therefore, the information providing device 10 executes the following protection processing. First, the information providing device 10 estimates the degree of impact, which is the degree of impact received by the user U through the VR space. Then, when the estimated impact degree exceeds a predetermined threshold value, the information providing device 10 executes a protection measure for protecting the user U from the impact. For example, the information providing device 10 predicts an event that occurs in the field of view of the user U or the user U in the VR space. In addition, the information providing device 10 estimates the degree of impact on the predicted event. Then, when the impact degree exceeds a predetermined threshold value, the information providing device 10 causes an impact such as lowering the resolution of the image provided to the user U or cutting the image for a predetermined period before and after the event occurs. Edit the image of the VR space provided to the user U so as to reduce it.

[1-4. About the event]
Here, the information providing device 10 may predict the occurrence of an arbitrary event as long as it is an event that can give a shock to the user in the VR space. For example, the information providing device 10 may predict whether or not a predetermined object collides with the user U in the VR space. To give a more specific example, the information providing device 10 determines a predetermined position based on the position, moving direction, and moving speed of the user U in the VR space, and the position, moving direction, and moving speed of another object. It may be possible to predict whether or not the object will collide with the user U when the time elapses. Further, for example, the information providing device 10 collides with the user U outside the field of view of the user U in the VR space, depending on whether or not a predetermined object is moving in the direction of the user U. You may predict whether or not.

Further, the information providing device 10 may predict whether or not a predetermined object collides with the user U due to an action of another user in the VR space. For example, the information providing device 10 determines whether or not another user different from the user U is aiming at the user U with a weapon in the VR space such as a gun in a game or the like. Then, when another user is aiming at the user U with a weapon in the VR space such as a gun, the information providing device 10 may predict that the user U and the ammunition will collide with each other.

Further, the information providing device 10 may predict whether or not an object enters the field of view of the user U at a predetermined speed or higher. That is, the information providing device 10 determines whether or not various events that are predetermined events that may give a shock to the user U occur before drawing the image in the VR space. You can predict it.

[1-5. Impact degree estimation]
Then, when the information providing device 10 predicts that an event that may give an impact to the user U will occur, the information providing device 10 estimates the degree of the impact given to the user U when the event occurs. For example, the information providing device 10 estimates the degree of impact, which is a numerical value indicating the degree of impact. For example, when it is predicted that a predetermined object collides with the user U, the information providing device 10 estimates the degree of impact when the predetermined object is generated by the user U.

Here, when a predetermined object collides with the virtual body of the user U in the VR space, the degree of impact differs depending on whether the object collides with the foot or the face of the virtual body of the user U. It is considered different. In general, when a predetermined object collides in VR space, it is predicted that the impact degree is higher when the collision position collides with a position closer to the user U's viewpoint (that is, a virtual eye position) in VR space. Will be done. Therefore, the information providing device 10 may estimate the impact degree of the user U according to the position where a predetermined object collides with the virtual body of the user U in the VR space. For example, the information providing device 10 estimates the collision position between the virtual body of the user U and a predetermined object, and calculates a higher impact degree as the estimated position is closer to the viewpoint of the user U. May be good.

Further, it is predicted that the faster the speed at which a predetermined object collides with the user U, the higher the impact degree of the user U. Therefore, the information providing device 10 may estimate the impact degree of the user U according to the speed at which a predetermined object collides with the user U. For example, when the information providing device 10 predicts that a predetermined object will collide with the user U, the moving speed when the object collides with the user U and the movement until the object collides with the user U. Calculate the speed. Then, the information providing device 10 may calculate a higher impact degree as the calculated moving speed is higher.

As a result of such processing, for example, in the information providing device 10, the user U is shot by another user at the impact level when the user U is shot by another user in the VR space. It can be estimated before drawing the image at the time. As a result, the information providing device 10 can execute various protection measures described later when an event having a high impact degree occurs.

To give a more specific example, the information providing device 10 predicts whether or not a predetermined object collides with the user U at a speed faster than a predetermined speed in the field of view of the user U as an event. Then, when it is predicted that a predetermined object collides with the user U at a speed faster than the predetermined speed in the field of view of the user U, the information providing device 10 calculates an impact degree higher than the predetermined threshold value. .. As a result, the information providing device 10 can execute various protection measures described later when an event predicted to have a high impact degree occurs, such as when the user U is shot in the VR space.

The information providing device 10 may estimate the degree of impact by using various other parameters. For example, the impact felt by the user U is predicted to differ depending on the size, shape, and type of the object approaching the user U in the VR space. Therefore, the information providing device 10 accepts the registration of the score for each object as a parameter of the impact degree given to the user U. Then, the information providing device 10 may calculate the impact degree based on the score given in advance to the predetermined object that collides with the user.

For example, the information providing device 10 accepts registration of a score higher than that of an object that reproduces a soft material for an object that reproduces a hard material. Further, the information providing device 10 accepts the registration of a score higher than that of the object having a smooth shape for the object having a sharp shape. Then, the information providing device 10 may calculate the impact degree of a higher value as the value of the score of the object colliding with the user U is higher.

[1-6. About conflicts with other users]
Here, it is considered that the impact degree of the user U increases not only when the object collides with the user U but also when the object suddenly collides with the first user in the field of view of the user U, for example. .. For example, if the first user in the field of view of the user U is suddenly attacked by the second user outside the field of view of the user U, it is considered that a large impact will occur on the user U.

Therefore, the information providing device 10 may estimate the degree of impact based on an event on another user included in the field of view of the user U. For example, the information providing device 10 predicts whether or not a predetermined event occurs in an object that is included in the field of view of the user U and that indicates another user. To give a more specific example, in the information providing device 10, the speed at which an object that has moved from outside the field of view of the user U to another user's object included in the field of view of the user U is equal to or higher than a predetermined threshold value. Predicts whether or not there is a collision as a predetermined event. Then, when the information providing device 10 predicts that a predetermined event will occur in an object indicating another user, the degree of impact that the user U receives when the event occurs in the field of view of the user U. The degree of impact may be estimated.

For example, the information providing device 10 may calculate the value of the impact degree based on various parameters such as the speed, shape, and type of the colliding object. Further, for example, the information providing device 10 calculates the impact degree of another user who collides with the object in the same manner as when the object collides with the user U, and the calculated impact degree is added to the user U and another user. The impact degree of the user U may be a value obtained by integrating a coefficient according to the distance to the user (for example, a coefficient of 1 or less whose value becomes smaller as the distance increases).

That is, the information providing device 10 predicts whether or not an event in which the impact degree exceeds a predetermined threshold value can give an impact to the user U within the field of view of the user U, and predicts whether or not the event occurs to the user U. When it is predicted that an event that can give an impact will occur, the degree of impact that the event gives to the user U may be calculated. As a result of such processing, the information providing device 10 can execute an appropriate protection measure when an event occurring in the field of view of the user U gives an impact to the user U by a predetermined threshold value or more. ..

[1-7. About calculation of possibility]
The information providing device 10 may calculate the possibility of various events occurring and estimate the degree of impact based on the calculated possibility. For example, the information providing device 10 executes a protection measure when the product of the value of the impact degree received by the user U when a certain event occurs and the possibility that the event occurs exceeds a predetermined threshold value. May be good.

[1-8. About estimation of impact using user history]
Here, when a certain event occurs in a game or the like, it is considered that a beginner receives a greater impact than an experienced person. It is also considered that the degree of impact received by the user U changes depending on whether the user U is male or female, the age of the user U, and the demographic attribute and the psychographic attribute of the user U. .. Further, when the user U frequently watches content having a generally high impact degree such as a horror movie or an action movie, the impact degree received by the user U is considered to be lower than that of other users. ..

Therefore, the information providing device 10 may estimate the impact degree of the user U based on the attribute information of the user U. For example, the information providing device 10 relates to the user U, such as whether or not the user U is a beginner, the gender of the user U, the type of content viewed by the user U, the search history of the user U in the VR space, and the like. The impact degree of the user U may be calculated based on various attribute information.

[1-9. About protection measures]
Here, when the impact degree of the user U exceeds a predetermined threshold value, the information providing device 10 reduces the impact received by the user U by executing various protection measures. For example, when drawing an image when an event occurs, the information providing device 10 reduces the resolution of the image, blurs the image, cuts the image for a predetermined period before and after the event occurs, or switches to a predetermined image. By performing various editing on the video provided to the user U, the impact of the user U is reduced.

The information providing device 10 may implement arbitrary protection measures as long as the impact of the user U can be reduced. For example, the information providing device 10 may set the image when an event occurs in slow motion. Further, the information providing device 10 may convert the image into a monochrome image, and may draw and provide an image from a viewpoint different from the viewpoint of the user U in the VR space, for example. More specifically, the information providing device 10 may draw and provide an image of a viewpoint such as viewing the virtual body of the user U from the sky when an event occurs.

Further, the information providing device 10 may implement different protection measures for each event that occurs. For example, when an event occurs in which an object collides with the user U, the information providing device 10 changes the viewpoint of the image to be drawn to a viewpoint from the sky before the event occurs. On the other hand, when an event occurs in which an object collides with another user in the field of view of the user U, the information providing device 10 may set the image at the time of the event in slow motion.

[1-10. About an example of protection processing]
Hereinafter, an example of the protection process executed by the information providing device 10 will be described with reference to FIG. In the example shown in FIG. 1, an example in which the user U plays a game called FPS (First Person Shooter) in the VR space has been described.

For example, the information providing device 10 predicts an event that occurs in the field of view of the user U or the user U in the VR space (step S1). For example, in the example shown in FIG. 1, an object VU01 showing a virtual body of a user U and an object VU02 showing a virtual body of a user different from the user U exist in the VR space. In such a case, the information providing device 10 determines whether or not the object VU02 is trying to attack the object VU01 with a virtual weapon, and if it is trying to attack, the object such as an ammunition collides with the object VU01. Predict.

In such a case, the information providing device 10 estimates the degree of impact of the predicted event on the user U (step S2). For example, the information providing device 10 has a predicted event "collision", a type of object to collide "bullet", a score "100" given to the object, a speed "100" when the object collides, and an attribute of the user U. Based on various information about the event such as "beginner", the impact degree of the user U when the event occurs is calculated. For example, the information providing device 10 calculates the impact degree received by the user U when the ammunition collides with the object VU01 as "100".

Then, when the estimated impact degree exceeds a predetermined threshold value, the information providing device 10 draws an image edited so as to reduce the impact degree (step S3). For example, when the object OB01 of the ammunition is fired and hits the object VU01, the information providing device 10 draws the image SVP1 of the field of view of the user U intentionally blurred. More specifically, the information providing device 10 blurs the video from the video before the object OB01 collides with the object VU01 by a predetermined time to the video after the object OB01 collides with the object VU01 by a predetermined time. And draw. That is, the information providing device 10 takes measures to reduce the impact degree of the user U on the video provided to the user U.

Then, the information providing device 10 provides the drawn VR space image to the HMD 100 (step S4). As a result, the HMD 100 can provide the video with the protection measures to the user U (step S5).

[2. Configuration of information providing device]
Hereinafter, an example of the functional configuration of the information providing device 10 described above will be described. FIG. 2 is a diagram showing a configuration example of the information providing device according to the embodiment. As shown in FIG. 2, the information providing device 10 includes a communication unit 20, a storage unit 30, and a control unit 40.

The communication unit 20 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 20 is connected to the network N by wire or wirelessly, and transmits / receives information to / from the HMD 100.

The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. Further, the storage unit 30 stores the object database 31 and the event database 32. Hereinafter, an example of information registered in each of the databases 31 and 32 will be described with reference to FIGS. 3 and 4.

Data of various objects in the VR space are registered in the object database 31. For example, FIG. 3 is a diagram showing an example of information registered in the object database according to the embodiment. In the example shown in FIG. 3, information such as "object ID (Identifier)", "object data", "arrangement position", "object type", and "impact score" is registered in the object database 31.

Here, the "object ID" is an identifier that identifies an object. Further, the "object data" is data related to the object indicated by the associated "object ID", and is data on the shape and texture of the object. Further, the "arrangement position" is a position on the VR space in which the object indicated by the associated "object ID" is arranged. Further, the "object type" is information indicating what the object indicates in the VR space, such as whether it is a user or an ammunition. Further, the "impact score" is a parameter for calculating the impact degree generated when an object collides with a user's object, that is, a score.

For example, in the example shown in FIG. 3, the object database 31 has the object ID “object ID # 1”, the object data “data # 1”, the placement position “position # 1”, the object type “user”, and the impact score. Information such as "10" is registered in association with each other. Such information is that the object indicated by the object ID "object ID # 1" is an object drawn using the object data "data # 1", and the position on the VR space indicated by the arrangement position "position # 1". Indicates that it is located in. Further, such information indicates that the object type of the object indicated by the object ID "object ID # 1" is "user", that is, the body of the user in the VR space, and the impact score is "10". ..

Events to be predicted are registered in the event database 32. For example, FIG. 4 is a diagram showing an example of information registered in the event database according to the embodiment. In the example shown in FIG. 4, information such as "event ID", "event content", and "parameter" is registered in the event database 32. Here, the "event ID" is an identifier that identifies an event. Further, the "event content" is information indicating the content of the event to be predicted. Further, the "parameter" is various conditions used when predicting the associated "event content". For example, the information providing device 10 determines that the associated "event content" occurs when the condition registered as the "parameter" is satisfied in the VR space.

For example, in the example shown in FIG. 4, the event ID "event # 1", the event content "collision", and the parameter "velocity: 20 or more" are registered in association with each other in the event database 32. Such information is that the event indicated by the event ID "event # 1" is the content indicated by the event content "collision", that is, an event in which another object collides with the user U, and the parameter "velocity: 20 or more". Indicates that the event is expected to occur when the content indicated by is satisfied, that is, when the moving speed of another object is "20 or more".

In the examples shown in FIGS. 3 and 4, conceptual values such as "object # 1", "data # 1", "position # 1", and "event # 1" are described, but in reality, each of them is described. Character strings that identify objects and events, modeling data, positions in VR space, and the like are registered in the database. In addition, various types of information used for drawing the VR space and predicting whether or not an event will occur will be registered in each of the databases 31 and 32.

Returning to FIG. 2, the explanation will be continued. The control unit 40 is a controller, and for example, various programs stored in a storage device inside the information providing device 10 by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) are stored in a RAM or the like. Is realized by executing as a work area. Further, the control unit 40 is a controller, and may be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 2, the control unit 40 includes a reception unit 41, a prediction unit 42, an estimation unit 43, an execution unit 44, and a drawing unit 45. The reception unit 41 receives various information for drawing the VR space from the HMD 100. For example, the reception unit 41 accepts an operation indicating the direction of the user U, the behavior of the user U in the VR space, and the like.

The prediction unit 42 predicts an event that occurs in the field of view of the user U or the user U in the VR space. For example, the prediction unit 42 predicts whether or not a predetermined object collides with the user U in the VR space as an event. Further, the prediction unit 42 predicts whether or not a predetermined object collides with the user U due to an action of another user in the VR space. Further, the prediction unit 42 predicts whether or not a predetermined object collides with the user U at a speed faster than the predetermined speed in the field of view of the user U as an event. Further, the prediction unit 42 predicts whether or not a predetermined event occurs in an object that is included in the field of view of the user U and indicates another user.

For example, the prediction unit 42 causes an event when a predetermined time (for example, about several milliseconds to several tens of milliseconds) elapses based on the direction of the user U and the behavior of the user U received by the reception unit 41. It is determined whether or not various events registered in the database 32 occur. For example, when the information shown in FIG. 4 is registered, the prediction unit 42 determines whether or not another object collides with the object of the user U at a speed of "20 or more", and the object of the user U is ammunitioned. Determine if objects collide. More specifically, the prediction unit 42 generates various events registered in the event database 32 when a predetermined time elapses, based on the orientation of the user U, the operation content, the state of each object, and the like. The possibility is calculated, and the event that the calculated possibility exceeds a predetermined threshold value is regarded as an event that occurs when a predetermined time elapses.

For example, FIG. 5 is a diagram illustrating an example of an event predicted by the information providing device according to the embodiment. For example, in the examples shown in FIGS. 5A and 5B, the first user object VU01, the second user object VU02, and the third user object VU03 are arranged in the VR space. ing. Further, in the examples shown in FIGS. 5A and 5B, it is assumed that the object VU03 is equipped with a gun object.

Here, as shown in FIG. 5A, when the object VU03 is trying to attack the object VU01 with a predetermined weapon, the information providing device 10 estimates the attack range S1 of the gun used by the object VU03. Then, when the object VU01 is included in the attack range S1 and the third user inputs an operation for performing an attack, the information providing device 10 predicts that the bullet will collide with the object VU01.

Further, as shown in FIG. 5B, when the object VU03 is trying to attack the object VU02 with a predetermined weapon, the information providing device 10 has the attack range S1 of the gun used by the object VU03 and the object VU01. The range S2 of the field of view (that is, the image provided to the first user) is estimated. Then, when the object VU02 included in the range S2 is included in the attack range S1 and the third user inputs an operation for performing an attack, the information providing device 10 is included in the field of view of the object VU01. It is predicted that a bullet will collide with the object VU02.

Here, in the states shown in FIGS. 5A and 5B, when an object of ammunition collides with the objects VU01 and VU02, it is estimated that both of them give an impact to the first user corresponding to the object VU01. NS. Therefore, the information providing device 10 executes various protection measures such as blurring the image when the predicted event occurs.

The example shown in FIG. 5 is just an example, and the prediction unit 42 may predict an event that occurs based on arbitrary information. For example, the prediction unit 42 predicts an event to occur based on the situation in various VR spaces such as the position and orientation of each object, the performance of each object, the performance of the item equipped by each object, the attack range, and the visual field range. Just do it. More specifically, the prediction unit 42 may determine whether or not the condition registered as a parameter in the event database 32 is satisfied, and if it is satisfied, it may determine that the corresponding event occurs.

The estimation unit 43 estimates the degree of impact, which is the degree of impact received by the user through the VR space. More specifically, the estimation unit 43 estimates the degree of impact on an event predicted to occur. For example, when it is predicted that a predetermined object such as an ammunition collides with the user U, the estimation unit 43 estimates the degree of impact when the predetermined object collides with the user U. Further, for example, 43 estimates the impact degree of the user U according to the position where a predetermined object collides with the virtual body of the user U in the VR space.

Further, the estimation unit 43 estimates the impact degree of the user according to the speed at which the predetermined object collides with the user U. Further, when it is predicted that a predetermined object collides with the user U at a speed faster than the predetermined speed in the field of view of the user U, the estimation unit 43 calculates an impact degree higher than the predetermined threshold value. Further, the estimation unit 43 calculates the impact degree based on the score given in advance to the predetermined object that collides with the user U. Further, when the estimation unit 43 is an object included in the field of view of the user and it is predicted that a predetermined event will occur in the object indicating another user, the event will occur in the field of view of the user U. The impact degree, which is the degree of impact received by the user U at that time, is estimated.

For example, when the prediction unit 42 predicts that a predetermined event will occur, the estimation unit 43 assigns the type of the object (for example, a colliding object) related to the predicted event, the content of the event to occur, and each object. The impact degree of the user U is calculated based on the impact score, the position where another object of the object of the user U collides, the speed of the object at the time of collision, and the like. For example, when the object of the ammunition collides with the object of the user U at a position close to the viewpoint of the object of the user U at a speed faster than a predetermined threshold value, the estimation unit 43 calculates an impact degree having a value higher than the predetermined threshold value.

The estimation unit 43 may estimate the degree of impact, which is the degree of impact received by the user U, based on the event predicted to occur in the VR space and the attribute information of the user U. For example, the estimation unit 43 may estimate a higher impact degree when the user U is a beginner. Further, for example, when the estimation unit 43 calculates the possibility that each event occurs by the prediction unit 42, the estimation unit 43 integrates the possibility calculated by the prediction unit 42 with the value of the impact degree when each event occurs. The value may be calculated as the actual impact degree.

When the estimated impact degree exceeds a predetermined threshold value, the execution unit 44 executes a protection measure for protecting the user U from the impact. For example, the execution unit 44 edits the image of the VR space provided to the user U so as to reduce the impact as a protection measure. The execution unit 44 may execute different types of protection measures according to the content of the event that occurs.

For example, the execution unit 44 determines whether or not the impact degree estimated by the estimation unit 43 is higher than a predetermined threshold value. Then, when the execution unit 44 determines that the impact degree estimated by the estimation unit 43 is higher than a predetermined threshold value, the execution unit 44 instructs the drawing unit 45 to blur when drawing the image. The execution unit 44 may instruct the drawing unit 45 not to draw the image for a predetermined period before and after the event occurs, and instructs the drawing unit 45 to shift the viewpoint to a predetermined viewpoint such as a bird's-eye view. You may.

The drawing unit 45 draws the VR space. For example, the drawing unit 45 generates an image in which the field of view of the user U in the VR space is drawn according to the operation and orientation of the user U, the arrangement position of each object, and the like. Further, the drawing unit 45 blurs the image when a predetermined event occurs, or generates an image drawn from a viewpoint different from the viewpoint of the user U, in accordance with the instruction from the execution unit 44. Then, the drawing unit 45 provides the generated image to the HMD 100.

[3. An example of the flow of processing executed by the information providing device]
Subsequently, the flow of the protection process executed by the information providing device 10 will be described with reference to FIG. FIG. 6 is a flowchart showing an example of a flow of protection processing executed by the information providing device according to the embodiment. The information providing device 10 repeatedly executes the process shown in FIG.

For example, the information providing device 10 predicts a possible event in the VR space based on the arrangement relationship between the objects (step S101). Subsequently, the information providing device 10 estimates the degree of impact of the predicted event on the user U (step S102). Then, the information providing device 10 determines whether or not the impact degree exceeds a predetermined threshold value (step S103), and if it exceeds (step S103: Yes), draws an image edited so that the impact degree is low. (Step S104), and the process ends. On the other hand, when the impact degree does not exceed a predetermined threshold value (step S103: No), the information providing device 10 draws the VR space as it is (step S105), and ends the process.

[4. Modification example]
In the above, an example of the protection process by the information providing device 10 has been described. However, the embodiment is not limited to this. Hereinafter, variations of the protection process and the calculation process executed by the information providing device 10 will be described.

[4-1. About VR space]
In the above example, the information providing device 10 estimates the impact degree of the user U in the VR space in which the so-called 3D (Dimension) object is arranged. However, the embodiment is not limited to this. For example, the information providing device 10 predicts an event that occurs in the robot or drone when the user U operates the robot or drone, and estimates and estimates the impact degree of the user U when the predicted event occurs. Based on the results, various protection measures may be implemented. More specifically, the information providing device 10 estimates the surrounding state of the robot or drone based on the image analysis technology, and based on the estimation result, whether or not a predetermined event such as a collision with an object occurs. May be determined.

That is, in the embodiment, the impact received by the user through the VR space is not only the impact caused by the event generated in the completely simulated space in which the 3D object is arranged, but also the image captured by the robot or the drone ( That is, it is a concept including the impact received by the user through the image taken from the viewpoint of the virtual user U).

[4-2. About estimation]
Further, the information providing device 10 may estimate the impact degree of the user U based on arbitrary information other than the above-mentioned information. For example, when the user U wears a wearable device capable of acquiring various biological information such as pulse and sweating, the information providing device 10 impacts the user U based on the biological information measured by the wearable device. The degree may be estimated. For example, when the information providing device 10 predicts that a predetermined event will occur and the pulse rate exceeds a predetermined threshold value, the information providing device 10 estimates an impact degree having a value higher than the predetermined threshold value, and the predetermined event occurs. If the pulse rate is equal to or less than a predetermined threshold value when predicted, the impact degree of a value lower than the predetermined threshold value may be estimated.

Further, the information providing device 10 may accept a setting from the user U as to whether or not to execute the above-mentioned protection process. Further, for example, the information providing device 10 determines whether or not an object whose score exceeds a predetermined threshold value is included in the vicinity of the object of the user U, and the score is a predetermined threshold value in the vicinity of the object of the user U. The processing load may be reduced by executing the above-mentioned protection process only when the object exceeding the above is included.

The information providing device 10 may execute the above-mentioned protection process at any timing as long as it is executed prior to drawing the VR space.

[4-3. Device configuration〕
The information providing device 10 may be realized by a front-end server and a back-end server. In such a case, the reception unit 41 and the drawing unit 45 shown in FIG. 2 are arranged on the front-end server, and the prediction unit 42, the estimation unit 43, and the execution unit 44 are arranged on the back-end server. Further, the databases 31 and 32 registered in the storage unit 30 may be stored in an external storage server.

[4-4. others〕
Further, among the processes described in the above-described embodiment, all or a part of the processes described as being automatically performed can be manually performed, and conversely, the processes described as being manually performed. It is also possible to automatically perform all or part of the above by a known method. In addition, the processing procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically dispersed / physically distributed in any unit according to various loads and usage conditions. Can be integrated and configured.

In addition, the above-described embodiments can be appropriately combined as long as the processing contents do not contradict each other.

[4-5. program〕
Further, the information providing device 10 according to the above-described embodiment is realized by, for example, a computer 1000 having a configuration as shown in FIG. 7. FIG. 7 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to the output device 1010 and the input device 1020, and the arithmetic unit 1030, the primary storage device 1040, the secondary storage device 1050, the output IF (Interface) 1060, the input IF 1070, and the network IF 1080 are connected by the bus 1090. Has.

The arithmetic unit 1030 operates based on a program stored in the primary storage device 1040 or the secondary storage device 1050, a program read from the input device 1020, or the like, and executes various processes. The primary storage device 1040 is a memory device that temporarily stores data used by the arithmetic unit 1030 for various calculations, such as a RAM. Further, the secondary storage device 1050 is a storage device in which data used by the calculation device 1030 for various calculations and various databases are registered, such as a ROM (Read Only Memory), an HDD (Hard Disk Drive), and a flash memory. Is realized by.

The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various information such as a monitor and a printer. For example, USB (Universal Serial Bus), DVI (Digital Visual Interface), and the like. It is realized by a connector of a standard such as HDMI (registered trademark) (High Definition Multimedia Interface). Further, the input IF 1070 is an interface for receiving information from various input devices 1020 such as a mouse, a keyboard, and a scanner, and is realized by, for example, USB.

The input device 1020 includes, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), or a tape. It may be a device that reads information from a medium, a magnetic recording medium, a semiconductor memory, or the like. Further, the input device 1020 may be an external storage medium such as a USB memory.

The network IF1080 receives data from another device via the network N and sends it to the arithmetic unit 1030, and also transmits the data generated by the arithmetic unit 1030 to the other device via the network N.

The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040, and executes the loaded program.

For example, when the computer 1000 functions as the information providing device 10, the arithmetic unit 1030 of the computer 1000 realizes the function of the control unit 40 by executing the program loaded on the primary storage device 1040.

[5. effect〕
As described above, the information providing device 10 estimates the degree of impact, which is the degree of impact received by the user U through the VR space. Then, when the estimated impact degree exceeds a predetermined threshold value, the information providing device 10 executes a protection measure for protecting the user U from the impact. Therefore, the information providing device 10 can reduce the impact on the user U even when the degree of immersion in the VR space is high.

Further, the information providing device 10 predicts an event that occurs in the field of view of the user U or the user U in the VR space. Then, the information providing device 10 estimates the degree of impact on the predicted event. Therefore, the information providing device 10 estimates the degree of impact when, for example, an event occurs in the object of the user U in the VR space or when an event occurs in the field of view of the user U. When the estimated impact degree exceeds a predetermined threshold value, a protection measure for protecting the user U from the impact is executed. Therefore, the information providing device 10 can reduce the impact on the user U.

Further, for example, the information providing device 10 predicts whether or not a predetermined object collides with the user U in the VR space as an event, and if it is predicted that the predetermined object collides with the user U, the information providing device 10 is used. The degree of impact when a predetermined object collides with the person U is estimated. Further, for example, the information providing device 10 predicts whether or not a predetermined object collides with the user U due to the action of another user U in the VR space. Therefore, the information providing device 10 can reduce the impact when an object suddenly collides or is attacked by another player.

Further, for example, the information providing device 10 estimates the impact degree of the user U according to the position where a predetermined object collides with the virtual body of the user U in the VR space. Therefore, for example, the information providing device 10 executes the protection measure when the object collides with the face of the user U, and does not execute the protection measure when the object collides with the hand of the user U. Such processing can be realized.

Further, the information providing device 10 estimates the impact degree of the user U according to the speed at which a predetermined object collides with the user U. Further, the information providing device 10 predicts whether or not a predetermined object collides with the user U at a speed faster than a predetermined speed in the field of view of the user U as an event. Then, when it is predicted that a predetermined object collides with the user U at a speed faster than the predetermined speed in the field of view of the user U, the information providing device 10 calculates an impact degree higher than the predetermined threshold value. .. Therefore, the information providing device 10 can reduce the impact in a sudden collision.

In addition, the information providing device 10 calculates the degree of impact based on a score given in advance to a predetermined object that collides with the user U. Therefore, the information providing device 10 can appropriately estimate the degree of impact.

Further, the information providing device 10 predicts whether or not a predetermined event occurs in an object that is included in the field of view of the user U and indicates another user U, and is within the field of view of the user U. If it is an included object and it is predicted that a predetermined event will occur in an object indicating another user U, the impact on the user U when the predetermined event occurs within the field of view of the user U Estimate the degree of impact. Therefore, the information providing device 10 can reduce the impact when another player is suddenly attacked in the field of view.

Further, the information providing device 10 calculates the possibility that a predetermined event occurs in the field of view of the user U or the user U in the VR space, and estimates the impact degree according to the calculated possibility. Therefore, the information providing device 10 can determine whether or not to reduce the impact according to the possibility that an event will occur.

Further, the information providing device 10 estimates the degree of impact, which is the degree of impact received by the user U, based on the event predicted to occur in the VR space and the attribute information of the user U. Therefore, the information providing device 10 implements protection measures for users who need to reduce the impact such as beginners, and protects users who do not need to reduce the impact so much such as experienced people. It is possible to realize control such as not executing measures.

Further, as a protection measure, the information providing device 10 edits the image of the VR space provided to the user U so as to reduce the impact. Therefore, the information providing device 10 can reduce the impact when an event occurs.

Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to practice the present invention in other improved forms.

Further, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the specific part can be read as a specific means or a specific route.

10 Information provider 20 Communication unit 30 Storage unit 31 Object database 32 Event database 40 Control unit 41 Reception unit 42 Prediction unit 43 Estimate unit 44 Execution unit 45 Drawing unit 100 HMD

Claims (13)

Based on the relative positional relationship between the position of the user and the position of the object in the virtual real space, and the moving direction of the user and the object, the user and the object in the virtual real space In the case of a collision, the degree of impact received by the user is determined according to the relative position and moving direction of the user and the object related to the collision and the viewpoint of the user in the field of view of the user. Estimating part to estimate and
When the degree of impact estimated by the estimation unit exceeds a predetermined threshold value, the degree of impact given to the user when the user collides with the object in the virtual reality space is reduced. In addition, an execution unit that executes a process of editing the image of the virtual reality space provided to the user, and
A protective device characterized by having. It has a prediction unit that predicts the user or an event that occurs in the user's field of view in the virtual reality space.
The estimating unit, about the event that is predicted by the prediction unit, collision occurring in the field of view of the user and the user on the basis of the user's viewpoint and the relative position置及beauty moving direction of said object The protective device according to claim 1, wherein the protection device is estimated. The prediction unit predicts whether or not a predetermined object collides with the user in the virtual reality space as the event.
Wherein said estimation unit, when said predetermined object to the user by the prediction unit is predicted to collide, based on the relative position置及beauty moving direction as the user's viewpoint of the said user object the device according to claim 2, characterized in that estimating the collision occurring in the field of view of the user. The protection device according to claim 3, wherein the prediction unit predicts whether or not a predetermined object collides with the user due to an action of another user in the virtual reality space. The estimating section of the virtual body of the user in the virtual reality space, depending on the position where the predetermined object collides, for the user, relative position置及of the said user object the device according to claim 3 or 4, characterized in that estimating the collision occurring in the field of view of the user based on the user's viewpoint and fine movement direction. The estimator in accordance with the speed at which the predetermined object collides with the user, wherein the user, based on the relative position置及beauty moving direction as the user's viewpoint of the said user object the device according to any one of claims 3-5, characterized in that estimating the collision occurring in the field of view of the user. As the event, the prediction unit predicts whether or not a predetermined object collides with the user at a speed faster than a predetermined speed in the field of view of the user.
When the estimation unit predicts that the predetermined object collides with the user at a speed faster than the predetermined speed in the user's field of view, the estimation unit causes the user and the object to collide with each other. the degree of impact on the user is higher than the predetermined threshold value, collision occurring in the field of view of the user based on the relative position置及beauty moving direction as the user's viewpoint of the said user object the device according to any one of claims 2-6, characterized in that to estimate. The estimation unit, on the basis of the previously assigned scores for a given object striking the user, based on the relative position置及beauty moving direction as the user's viewpoint of the said user object the device according to any one of claims 3-7, characterized in that estimating the collision occurring in the field of view of the user. The prediction unit predicts whether or not a predetermined event occurs in an object that is included in the field of view of the user and indicates another user.
The estimation unit is an object included in the field of view of the user, and when a predetermined event is predicted to occur in an object indicating another user, the event occurs in the field of view of the user. the user receives when a, and characterized by estimating a collision occurring in the field of view of the user based on the relative position置及beauty moving direction as the user's viewpoint of the said user object The protective device according to any one of claims 2 to 8. The prediction unit calculates the possibility that a predetermined event occurs in the virtual reality space within the field of view of the user or the user, and the estimation unit calculates the possibility calculated by the prediction unit. claim 2-9, characterized in that estimating the collision occurring in the field of view of the user based on the user to the relative position置及beauty moving direction as the user's viewpoint of the object 1 The protective device described in 1. The estimation unit, an event which is expected to occur in the virtual reality space, based on the attribute information of the user, the user receives the relative position置及beauty moving direction of the said user object and protection device according to any one of claims 1 to 10, characterized in that estimating the collision occurring in the field of view of the user based on the user's viewpoint. A protection method performed by a protective device,
Based on the relative positional relationship between the position of the user and the position of the object in the virtual real space, and the moving direction of the user and the object, the user and the object in the virtual real space In the case of a collision, the degree of impact received by the user is determined according to the relative position and moving direction of the user and the object related to the collision and the viewpoint of the user in the field of view of the user. Estimating process to estimate and
When the degree of impact estimated by the estimation step exceeds a predetermined threshold value, the degree of impact given to the user when the user collides with the object in the virtual reality space is reduced. In addition, an execution step of executing a process of editing the image of the virtual reality space provided to the user, and
A protection method characterized by including. Based on the relative positional relationship between the position of the user and the position of the object in the virtual real space, and the moving direction of the user and the object, the user and the object in the virtual real space In the case of a collision, the degree of impact received by the user is determined according to the relative position and moving direction of the user and the object related to the collision and the viewpoint of the user in the field of view of the user. Estimating procedure to estimate and
When the degree of impact estimated by the estimation procedure exceeds a predetermined threshold value, the degree of impact given to the user when the user collides with the object in the virtual reality space is reduced. In addition, an execution procedure for executing a process of editing the image of the virtual reality space provided to the user, and
A protection program that lets your computer run.

Images