JP7085656B1 - Information processing equipment, information processing methods and programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress user sickness due to digital contents including virtual space experience. An information processing device according to an embodiment is an information processing device mounted on a vehicle, and includes an acquisition unit, an estimation unit, and a guidance processing unit. The acquisition unit acquires the internal and external situations regarding the user of the digital content including the virtual space experience. The estimation unit estimates the user's sickness situation based on the situation acquired by the acquisition unit. The guidance processing unit executes guidance processing for guiding the vehicle to a running state in which the sickness is suppressed, according to the user's sickness situation estimated by the estimation unit. [Selection diagram] FIG. 4

Description

The embodiments of the disclosure relate to information processing devices, information processing methods, programs and map storage devices.

Conventionally, a technique for providing a user with digital contents including a virtual space experience such as VR (Virtual Reality) and MR (Mixed Reality) using an HMD (Head Mounted Display) or the like is known.

Further, in such a technique, a VR system that can be mounted on a moving body such as a vehicle and can use the moving body as a motion platform has also been proposed (see, for example, Patent Document 1).

JP-A-2017-102401

However, there is room for further improvement in the prior art in suppressing user sickness due to digital content including virtual space experience.

For example, it is known that a user who receives VR content can experience "VR sickness" similar to motion sickness. VR sickness is one of the agitation illnesses that can occur due to a cause such as a gap between the image and the movement of the user's body. In particular, in the case of a VR system mounted on a vehicle, since the movement of the vehicle is added to the movement of the user's body, the deviation from the image becomes more complicated, and VR sickness tends to occur easily. In addition, the addition of normal motion sickness symptoms makes it more likely that more complex motion sickness symptoms will occur.

One aspect of the embodiment is made in view of the above, and provides an information processing device, an information processing method, a program, and a map storage device capable of suppressing user sickness due to digital contents including a virtual space experience. The purpose is to do.

The information processing device according to one embodiment is an information processing device mounted on a vehicle and has a control unit. The control unit acquires internal and external situations regarding a user of digital content including at least a virtual space experience. In addition, the control unit estimates the user's sickness due to the digital content based on the acquired situation. In addition, the control unit executes a guidance process for guiding the vehicle to a traveling state in which the sickness is suppressed, according to the estimated sickness situation of the user and the type of the digital content. Further, the control unit performs a running performance change process for changing the setting related to the running performance of the vehicle stepwise according to the sickness situation of the user and the type of the digital content, and an operation instruction for instructing the driving operation of the vehicle. The guidance process is executed in the order of the process and the travel route change process for changing the travel route of the vehicle.

According to one aspect of the embodiment, it is possible to suppress the user's sickness due to the digital content including the virtual space experience.

FIG. 1 is a diagram showing a schematic configuration of an information processing system according to an embodiment. FIG. 2 is an explanatory diagram of VR sickness. FIG. 3 is a schematic explanatory diagram of the information processing method according to the embodiment. FIG. 4 is a block diagram showing a configuration example of the information processing system according to the embodiment. FIG. 5 is a block diagram showing a configuration example of the induction processing unit. FIG. 6 is a diagram showing an example of a threshold value that becomes an execution trigger of the guidance process. FIG. 7 is a diagram showing instruction contents in operation instruction processing. FIG. 8 is a diagram showing an output example in the operation instruction processing. FIG. 9 is a diagram showing an example of parameters changed by the traveling performance change process. FIG. 10 is an explanatory diagram (No. 1) of the traveling route change process. FIG. 11 is an explanatory diagram (No. 2) of the traveling route change process. FIG. 12 is a flowchart showing a processing procedure executed by the information processing apparatus according to the embodiment. FIG. 13 is a flowchart showing a processing procedure of the operation instruction processing. FIG. 14 is a flowchart showing a processing procedure of the traveling performance change processing. FIG. 15 is a flowchart showing a processing procedure of the traveling route change processing.

Hereinafter, embodiments of the information processing apparatus, information processing method, program, and map storage apparatus disclosed in the present application will be described in detail with reference to the accompanying drawings. The present invention is not limited to the embodiments shown below.

Further, in the following, the case where the information processing system 1 according to the embodiment is an in-vehicle system mounted on a vehicle will be described as an example. Further, in the following, it is assumed that the information processing system 1 according to the embodiment is a VR system that provides VR contents as digital contents including a virtual space experience to the user.

First, the outline of the information processing method according to the embodiment will be described with reference to FIGS. 1 to 3. FIG. 1 is a diagram showing a schematic configuration of an information processing system 1 according to an embodiment. Further, FIG. 2 is an explanatory diagram of VR sickness. Further, FIG. 3 is a schematic explanatory diagram of the information processing method according to the embodiment.

As shown in FIG. 1, the information processing system 1 according to the embodiment includes an HMD 3 and an information processing device 10.

The HMD 3 is an information processing terminal for presenting the VR content provided by the information processing apparatus 10 to the user U and allowing the user to enjoy the VR experience. The HMD3 is a wearable computer that is worn and used on the head of the user U, and is a goggle type in the example of FIG. The HMD3 may be of the eyeglass type or the hat type.

The HMD 3 includes a display unit 3a, a speaker 3b, and a sensor unit 3c. The display unit 3a is provided so as to be arranged in front of the user U, and displays an image included in the VR content provided by the information processing apparatus 10.

In the example of FIG. 1, one display unit 3a is provided in front of each of the left and right eyes of the user U, but only one may be used. Further, the display unit 3a may be a non-transmissive type that completely covers the field of view, or may be a video transmissive type or an optical transmissive type. In this embodiment, it is assumed to be a non-transparent type.

The speaker 3b is provided in a headphone type as shown in FIG. 1, for example, and is attached to the ear of the user U. The speaker 3b outputs the sound included in the VR content provided by the information processing device 10.

The sensor unit 3c is a device that detects changes in the internal and external conditions of the user U, and includes, for example, a camera, a motion sensor, and the like.

The information processing device 10 is, for example, a computer, which is an in-vehicle device mounted on a vehicle and is connected to the HMD 3 by wire or wirelessly to provide VR contents to the HMD 3. Further, the information processing apparatus 10 acquires the change in the situation detected by the sensor unit 3c at any time, and reflects the change in the situation in the VR content.

For example, the information processing apparatus 10 can change the direction of the field of view of the VR content in the virtual space according to the change in the head and the line of sight of the user U detected by the sensor unit 3c.

By the way, in providing VR contents using such HMD3, it is known that user U may have "VR sickness" similar to motion sickness.

As shown in FIG. 2, VR sickness may occur due to a cause such as a deviation between the image and the body movement of the user U. Further, in the case of a VR system mounted on a vehicle, the movement of the vehicle due to changes in the surrounding environment is added to the movement of the user's body, so that the deviation from the image becomes more complicated and VR sickness tends to occur easily. ..

Therefore, the information processing method according to the embodiment is an information processing method using the information processing device 10 mounted on the vehicle, and acquires the internal and external situations regarding the user U, and based on the acquired situations, the VR of the user U. It was decided to estimate the sickness situation and execute the guidance process to guide the vehicle to a running state in which the VR sickness is suppressed according to the estimated VR sickness situation.

Specifically, as shown in FIG. 3, in the information processing method according to the embodiment, the information processing apparatus 10 obtains the internal and external situations regarding the user U at any time, and estimates the VR sickness situation of the user U (step S1). ). The information processing apparatus 10 estimates the VR sickness situation by detecting, for example, a change in the physical condition of the user U.

Further, the information processing apparatus 10 estimates the VR sickness situation based on the usage status of the VR content such as the type of the VR content being provided, the status of the video, and the status of the sound.

Further, the information processing device 10 estimates the VR sickness situation based on the traveling situation of the vehicle V such as the road condition, the vehicle V condition, and the operation condition. Further, the information processing apparatus 10 estimates the VR sickness situation based on the user information including various parameters indicating the susceptibility to sickness for each user, for example.

The information processing apparatus 10 can use, for example, an estimation model generated by using a machine learning algorithm in the estimation processing of the VR sickness situation. Such an estimation model is appropriately reinforcement-learned based on the estimation result of the actual VR sickness situation. As a result of reinforcement learning, for example, a determination threshold value for estimating a VR sickness situation is appropriately updated.

Then, the information processing apparatus 10 executes a guidance process for guiding the vehicle V to a traveling state in which VR sickness is suppressed according to the estimation result in step S1 (step S2).

Such guidance processing is, for example, "operation instruction processing" for instructing the driver of vehicle V on a driving operation method. Further, the guidance process is, for example, a "travel performance change process" for changing a setting related to the travel performance of the vehicle V. Further, the guidance process is, for example, a "travel route change process" for changing the travel route of the vehicle V. The specific contents of these induction processes will be described later with reference to FIGS. 6 to 11.

By executing such a guidance process, it is possible to suppress the VR sickness of the user U due to the VR content.

As described above, the information processing method according to the embodiment is an information processing method using the information processing device 10 mounted on the vehicle V, and acquires the internal and external situations regarding the user U, and the user is based on the acquired situations. The VR sickness situation of U is estimated, and the guidance process for inducing the vehicle V to be in a running state in which the VR sickness is suppressed is executed according to the estimated VR sickness situation.

Therefore, according to the information processing method according to the embodiment, it is possible to suppress the VR sickness of the user U due to the VR content. Hereinafter, a configuration example of the information processing system 1 to which the information processing method according to the embodiment is applied will be described more specifically.

FIG. 4 is a block diagram showing a configuration example of the information processing system 1 according to the embodiment. Further, FIG. 5 is a block diagram showing a configuration example of the induction processing unit 13d. Note that FIGS. 4 and 5 show only the components necessary for explaining the features of the embodiment, and the description of general components is omitted.

In other words, each component shown in FIGS. 4 and 5 is a functional concept and does not necessarily have to be physically configured as shown. For example, the specific form of distribution / integration of each block is not limited to the one shown in the figure, and all or part of it may be functionally or physically distributed in any unit according to various loads and usage conditions. It can be integrated and configured.

Further, in the description using FIGS. 4 and 5, the description of the components already described may be simplified or omitted.

As shown in FIG. 4, the information processing system 1 according to the embodiment includes an HMD 3 and an information processing device 10.

Since HMD3 has already been described with reference to FIG. 1, the description thereof is omitted here. The information processing device 10 includes a storage unit 12 and a control unit 13. Further, the information processing device 10 is connected to various sensors 7, an output device 20, and a vehicle control device 30 via a network such as a CAN (Controller Area Network) or directly.

The various sensors 7 are a group of sensors that sense the inside and outside of the vehicle V, and include, for example, a camera 7a, a vital sensor 7b, an acceleration sensor 7c, a steering angle sensor 7d, and the like.

The camera 7a is a front camera, a rear camera, a side camera, an indoor camera, etc. mounted on the vehicle V, and photographs the inside and outside of the vehicle V. The indoor camera captures, for example, the state of the user U.

The vital sensor 7b is a sensor that detects the physical condition of the user U, and is attached to the user U, for example, to measure vital data such as the user U's heartbeat, brain waves, blood oxygen concentration, and sweating.

The acceleration sensor 7c measures the acceleration applied to the vehicle V and the vehicle speed. The steering angle sensor 7d measures the steering angle of the vehicle V. Of course, the various sensors 7 may include sensors other than the sensors 7a to 7d shown in FIG.

The output device 20 is a device that outputs information to the vehicle interior, and includes a display 21, a speaker 22, and the like, which will be described later. The output device 20 is realized by, for example, a car navigation device. The vehicle control device 30 is a device that controls the vehicle V, and is, for example, an ECU (Electronic Control Unit) that controls traveling system devices such as an engine, a transmission, a brake, and a suspension.

The storage unit 12 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. In the example of FIG. 4, the VR content DB (Data) is realized. Base) 12a, user information 12b, estimation model 12c, and guidance processing information 12d are stored.

The VR content DB 12a is a database in which a VR content group provided to the HMD 3 is stored. The user information 12b is information about a user who uses the HMD3, and includes various parameters and the like indicating the above-mentioned susceptibility to sickness for each user. The user information 12b is appropriately updated based on the estimation result of the past VR sickness situation of the user U.

The estimation model 12c is an estimation model generated by using the above-mentioned machine learning algorithm. In the estimation model 12c, for example, a value indicating the VR sickness situation of the user U (for example, the degree of VR sickness) is input by inputting data indicating various situations inside and outside the user U acquired by the acquisition unit 13b described later. The indicated level value) is calculated and output.

The guidance processing information 12d is information on the guidance processing executed according to the degree of VR sickness of the user U, and includes, for example, a threshold value of the degree of VR sickness to which the guidance processing should be executed.

The control unit 13 is a controller, and for example, various programs stored in the storage unit 12 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like execute RAM as a work area. It is realized by being done. Further, the control unit 13 can be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

The control unit 13 has a providing unit 13a, an acquisition unit 13b, an estimation unit 13c, and a guidance processing unit 13d, and realizes or executes the functions and operations of information processing described below.

The providing unit 13a provides the VR content stored in the VR content DB 12a to the HMD3. Further, the providing unit 13a acquires the change in the situation detected by the sensor unit 3c of the HMD 3 at any time, and reflects the change in the situation in the VR content.

The acquisition unit 13b acquires sensing data from various sensors 7 at any time. Further, the acquisition unit 13b acquires the usage status of the VR content such as the type of the VR content being provided, the video status, and the audio status from the provision unit 13a at any time. Further, the acquisition unit 13b outputs various acquired data to the estimation unit 13c.

The estimation unit 13c estimates the VR sickness situation of the user U using the estimation model 12c based on various data acquired by the acquisition unit 13b. Further, the estimation unit 13c outputs the estimated estimation result to the induction processing unit 13d.

The guidance processing unit 13d executes guidance processing for guiding the vehicle V to a running state that suppresses VR sickness according to the estimation result of the estimation unit 13c. The acquisition unit 13b, the estimation unit 13c, and the guidance processing unit 13d may execute each assigned process when the VR content is provided to the HMD 3 by the providing unit 13a.

Therefore, in such a case, the providing unit 13a turns on the acquisition unit 13b, the estimation unit 13c, and the induction processing unit 13d when providing the VR content to the HMD3. Further, when the VR content is not provided to the HMD 3, the providing unit 13a controls off the acquisition unit 13b, the estimation unit 13c, and the induction processing unit 13d. Hysteresis control and slow control are preferably performed when switching on / off.

It is desirable to provide a switch that can be turned on even when the VR content is not used so that the device can be used for normal motion sickness reduction at the request of the user. In this case, it is desirable to perform reinforcement learning of sickness estimation and adaptive control when VR contents are not used.

As shown in FIG. 5, the guidance processing unit 13d has an operation instruction unit 13da, a traveling performance changing unit 13db, and a traveling route changing unit 13dc. The guidance processing unit 13d executes the guidance processing.

As already described, the guidance process is, for example, an "operation instruction process" for instructing the driver of the vehicle V on a driving operation method. Further, the guidance process is, for example, a "travel performance change process" for changing a setting related to the travel performance of the vehicle V. Further, the guidance process is, for example, a "travel route change process" for changing the travel route of the vehicle V.

The operation instruction unit 13da executes "operation instruction processing". Further, the traveling performance changing unit 13db executes the “driving performance changing process”. In addition, the travel route change unit 13dc executes the "travel route change process".

It should be noted that these guidance processes are executed, for example, when the level value indicating the degree of VR sickness of the user U estimated by the estimation unit 13c exceeds a predetermined threshold value. FIG. 6 is a diagram showing an example of a threshold value that becomes an execution trigger of the guidance process. As shown in FIG. 6, such a threshold value is set according to, for example, the type of content.

As shown in FIG. 6, first, the sickness of each content is calculated by using a calculation formula, table data, or the like by, for example, the sickness calculation process executed by the estimation unit 13c. The susceptibility to sickness can be calculated and estimated by the type of content including genres such as action type and horror type. An index indicating the susceptibility to sickness may be added to the content itself as metadata, for example, by a content maker or the like. Further, the server device may collect and analyze data indicating the sickness status of the user U at the time of actual content reproduction, and create a database of the susceptibility of each content to sickness.

Then, the estimation unit 13c calculates the threshold value at the time of each control execution based on the calculated value indicating the susceptibility to sickness. Although such calculation can be performed by the calculation formula corresponding to the graph of FIG. 6, in reality, it is preferable to use table data in which the relationship between the threshold value and the susceptibility to sickness is mapped in advance.

As shown in FIG. 6, the table data (which can be rephrased as a threshold graph) is, for example, in the order of less influence on the movement (trip) of the vehicle V, in the order of driving performance change, operation instruction, and traveling route change. Kind is prepared.

Then, when the VR sickness situation reaches each threshold value, the guidance processing unit 13d executes the travel performance change processing, the operation instruction processing, or the travel route change processing corresponding to each threshold value. For example, as shown in FIG. 6, it is assumed that the sickness of the content A is a, and the threshold value for the sickness is ya1, ya2, and ya3.

Here, when the VR sickness degree Ym of a certain user U “Mr. m” increases and reaches the threshold value ya1, the estimation unit 13c causes the guidance processing unit 13d to execute the traveling performance change processing. In other words, the guidance processing unit 13d shifts to a mode in which the traveling performance of the vehicle V is less likely to get sick. Further, when the VR sickness degree Ym further increases and reaches the threshold value ya2, the estimation unit 13c causes the guidance processing unit 13d to execute the operation instruction processing. In other words, the guidance processing unit 13d shifts the operation instruction of the vehicle V to a mode in which the vehicle V is less likely to get sick. Further, when the VR sickness degree Ym further increases and reaches the threshold value ya3, the estimation unit 13c causes the guidance processing unit 13d to execute the traveling route change processing. In other words, the guidance processing unit 13d shifts the travel path of the vehicle V to a mode in which the vehicle V is less likely to get sick (that is, changes the travel route).

In addition, there is also a control method for returning the mode to the original state when the degree of VR sickness decreases. In such control, the threshold value for returning is a threshold value having hysteresis (that is, a value having a lower degree of VR sickness than the threshold values ya1, ya2, and ya3). Further, when the degree of VR sickness decreases, a control method that does not return the mode to the original state may be adopted.

It should be noted that each threshold value is canceled when the reproduction of the content is completed, and is set again when the content changes. Alternatively, it may be canceled after the trip of the vehicle V is completed.

The operation instruction processing executed by the operation instruction unit 13da will be described. FIG. 7 is a diagram showing instruction contents in operation instruction processing. Further, FIG. 8 is a diagram showing an output example in the operation instruction processing.

As shown in FIG. 7, the operation instruction unit 13da is based on various data acquired by the acquisition unit 13b and the estimation result by the estimation unit 13c, for example, an instruction regarding acceleration (for example, "slow acceleration at about half the usual acceleration". Instructions on deceleration (eg, "Decelerate slowly at twice the usual deceleration distance", etc.), or instructions on speed when turning (eg, "Slowly turn at half the usual speed"). Please do ") and output it to the display 21 or speaker 22. The display 21 may be an instrument panel, a head-up display, or the like, in addition to the display of the car navigation device.

Further, the operation instruction unit 13da may display the image of the VR content provided by the user U on the display 21. In the example of FIG. 8, an example in which the video of the VR content is overlapped and displayed on a part of the car navigation screen is shown. As a result, the user U is made to understand the content of the VR content provided by the driver, and if it is presumed that the content is easy to get drunk, for example, the driver is allowed to gradually accelerate or decelerate. Can be conscious.

It should be noted that the image is not the VR content image itself, but an image that is deformed so that the susceptibility to sickness can be understood. An image or the like expressing the display color, characters, characters, etc. may be displayed.

In addition to displaying the video of the VR content on the display 21, the sound of the VR content may be output from the speaker 22.

Next, the running performance changing process executed by the running performance changing unit 13db will be described. FIG. 9 is a diagram showing an example of parameters changed by the traveling performance change process.

As shown in FIG. 9, the traveling performance changing unit 13db changes, for example, the control sensitivity of the traveling system and the setting of parameters related to the characteristics of the vehicle mechanism system. For the parameters related to the control sensitivity of the traveling system, for example, the operation speed coefficient and the like are changed. In other words, for example, fuel injection control, motor control, etc. are adjusted so that the engine does not rapidly become high torque and high rotation even if the same accelerator operation is performed so that the acceleration at the time of starting becomes gentle. .. Further, regarding the parameters related to the characteristics of the vehicle mechanism system, for example, the suspension hardness, the damper braking characteristics, and the like are changed.

Then, the traveling performance changing unit 13db outputs the changed parameter to the vehicle control device 30, and causes the vehicle control device 30 to perform vehicle control according to the changed parameter.

In addition, it is desirable to display (notify) to the driver that the driving performance has been changed, along with the reason (spinning of about XX occurs).

Next, the travel route change process executed by the travel route change unit 13dc will be described. FIG. 10 is an explanatory diagram (No. 1) of the traveling route change process. Further, FIG. 11 is an explanatory diagram (No. 2) of the traveling route change process.

As shown in FIG. 10, the travel route changing unit 13dc changes the travel route based on, for example, the map data included in the map DB 12da with a sickness parameter. The map DB 12da with a sickness parameter is included in, for example, the guidance processing information 12d. The map DB12da with a sickness parameter is, for example, a database of map data in which a sickness coefficient for weighting susceptibility to sickness is set for each road section.

The map DB 12da with a sickness parameter can be realized and provided as a map storage device by a storage device (storage medium) such as a non-volatile memory, a hard disk, or an optical disk. The configuration provided may be, for example, a configuration built in the information processing device 10 or a configuration provided by a server device wirelessly connected to the information processing device 10. Further, the map DB 12da with a sickness parameter is appropriately learned and enhanced in the information processing device 10 or the server device based on the data acquired in real time in the information processing device 10 or the data collected from each information processing device 10. It is preferable to be done.

FIG. 10 schematically shows map data set so that the number of curves gradually increases in the sections P1 to P2, the sections P2 to P3, and the sections P3 to P4, and the sickness coefficient gradually increases accordingly. ..

The index of the susceptibility to sickness of each route can be calculated by a method such as accumulation of "distance of each section of the target route x sickness coefficient of the relevant section". In addition, since it is considered preferable to avoid a section that is extremely prone to sickness from the viewpoint of avoiding sudden sickness, an upper limit of sickness is set, for example, a section in which the sickness coefficient is larger than the threshold value, or "section distance x section concerned". It is also preferable to select a route to be detoured by excluding routes including a section in which the “sickness coefficient” exceeds the threshold value.

Then, as shown in FIG. 11, for example, when the level value of the VR sickness of the user U exceeds the above-mentioned threshold value at the point P, the travel route changing unit 13dc returns to the destination G based on the map DB 12da with the sickness parameter. Calculate other driving routes to go and change to a driving route that is less likely to get sick. FIG. 11 shows an example in which the traveling route, which had many curves before the change, was changed to the traveling route calculated as a detour but many straight lines and less sickness.

The travel route changing unit 13dc may estimate the susceptibility to sickness from curves, undulations, the number of intersections, and the like based on map data without sickness parameters. Further, the travel route changing unit 13dc may calculate the susceptibility to sickness for a plurality of travel routes at the time when the destination G is set, and recommend the travel route that is the least sick.

Next, the processing procedure executed by the information processing apparatus 10 according to the embodiment will be described with reference to FIGS. 12 to 15. FIG. 12 is a flowchart showing a processing procedure executed by the information processing apparatus 10 according to the embodiment. It should be noted that such processing is repeatedly executed while the VR content is being used, but is repeatedly executed while the vehicle is being used (during traveling) if the sickness suppression function is selected to be operated even when the VR content is not being used.

Further, FIG. 13 is a flowchart showing a processing procedure of the operation instruction processing. Further, FIG. 14 is a flowchart showing a processing procedure of the traveling performance change processing. Further, FIG. 15 is a flowchart showing a processing procedure of the traveling route change processing. The processing procedure shown in FIG. 12 is repeated at any time while the providing unit 13a provides the VR content to the HMD 3.

As shown in FIG. 12, first, the acquisition unit 13b acquires the internal and external situations regarding the user U (step S101). Then, the estimation unit 13c estimates the VR sickness situation of the user U based on the acquired situation (step S102). Further, the acquisition unit 13b acquires the type of VR content (step S103).

Then, the guidance processing unit 13d determines whether or not the degree of VR sickness of the user U exceeds a predetermined threshold value (step S104). Here, when the threshold value is exceeded (step S104, Yes), the guidance processing unit 13d determines the guidance processing content according to the VR sickness situation and the type of VR content (step S105).

Then, the guidance processing unit 13d executes the operation instruction processing in step S106, the traveling performance change processing in step S107, and the traveling route change processing in step S108 based on the determined contents, and ends the processing. It should be noted that steps S106 to S108 may be selectively selected and executed, or at least two of the three processes may be executed in parallel.

If the threshold value is not exceeded in step S104 (steps S104, No), the process ends.

Further, as shown in FIG. 13, in the operation instruction processing, the operation instruction unit 13da relates to, for example, acceleration, deceleration, or turning speed based on various data acquired by the acquisition unit 13b and estimation results by the estimation unit 13c. Generate an operation instruction (step S201).

Then, the operation instruction unit 13da determines the output destination according to the generated operation instruction (step S202). Then, the operation instruction unit 13da outputs an operation instruction to the determined output destination (step S203), and ends the process.

Up to now, the operation instruction processing has been described as giving an operation instruction to the driver of the vehicle V, but when the vehicle V is an autonomous driving vehicle, the vehicle control device 30 that performs the automatic driving control is provided with respect to the vehicle control device 30. Operation instructions may be given. In such a case, the operation instruction unit 13da generates an operation instruction signal for the vehicle control device 30, selects the vehicle control device 30 as an output destination, and outputs the operation instruction signal to the vehicle control device 30. At this time, the content of the operation instruction to the automatic driving control is displayed (notified) to the passengers such as the driver so that the passengers can recognize it.

Further, as shown in FIG. 14, in the traveling performance changing process, the traveling performance changing unit 13db changes, for example, the control sensitivity of the traveling system (step S301). Further, the traveling performance changing unit 13db changes the characteristics of the vehicle mechanism system, for example (step S302). Then, the process is terminated. At this time, the content of the change in driving performance is displayed (notified) to the passengers such as the driver so that the passengers can recognize it.

Further, as shown in FIG. 15, in the traveling route changing process, the traveling route changing unit 13dc acquires the map data with the sickness parameter (step S401). Then, the travel route changing unit 13dc recalculates the travel route from the current location to the destination based on the acquired map data (step S402). Then, based on the result of the recalculation, the travel route changing unit 13dc changes the travel route to a travel route that is less likely to cause sickness (step S403), and ends the process. At this time, the route change content is displayed (notified) to the passengers such as the driver so that the passengers can recognize it.

In addition, it is preferable to enable the driver to instruct the driver not to change the route by operating a switch (adding a switch operation determination process and a route maintenance process) so as to prevent an inconvenient route change.

As described above, the information processing device 10 according to the embodiment is an information processing device mounted on the vehicle V, and includes an acquisition unit 13b, an estimation unit 13c, and a guidance processing unit 13d. The acquisition unit 13b acquires the internal and external status of the user U of the VR content (corresponding to an example of "digital content including the virtual space experience"). The estimation unit 13c estimates the sickness situation of the user U based on the situation acquired by the acquisition unit 13b. The guidance processing unit 13d executes a guidance process for guiding the vehicle V to a traveling state in which the sickness is suppressed, according to the sickness situation of the user U estimated by the estimation unit 13c.

Therefore, according to the information processing apparatus 10 according to the embodiment, it is possible to suppress the VR sickness of the user U due to the VR content.

Further, the guidance processing unit 13d executes an operation instruction processing for instructing the driving operation of the vehicle V as the guidance processing.

Therefore, according to the information processing apparatus 10, it is possible to guide the vehicle V to a traveling state in which sickness is suppressed, based on the driving operation of the vehicle V.

Further, the vehicle V is an autonomous driving vehicle, and the guidance processing unit 13d executes an operation instruction process for instructing the vehicle control device 30 that automatically controls the vehicle V to drive.

Therefore, according to the information processing apparatus 10, even when the vehicle V is an autonomous driving vehicle, it is possible to guide the vehicle V to a traveling state in which sickness is suppressed based on the driving operation of the vehicle V.

Further, the guidance processing unit 13d executes a running performance change process for changing the setting related to the running performance of the vehicle V as the guiding process.

Therefore, according to the information processing apparatus 10, by changing the setting related to the traveling performance of the vehicle V, it is possible to guide the vehicle V to a traveling state in which sickness is suppressed.

Further, the guidance processing unit 13d changes the parameters related to the control sensitivity of the traveling system and / or the parameters related to the characteristics of the vehicle mechanism system in the traveling performance change processing.

Therefore, according to the information processing apparatus 10, the vehicle V can be guided to a running state in which sickness is suppressed by changing parameters related to the operation speed coefficient, suspension hardness, damper braking characteristics, and the like.

Further, the guidance processing unit 13d executes a travel route change process for changing the travel route of the vehicle V as the guidance process.

Therefore, according to the information processing apparatus 10, by changing the traveling path of the vehicle V, the vehicle V can be guided to a traveling state in which the sickness is suppressed.

Further, the guidance processing unit 13d calculates the travel route based on the map data in which the parameters related to the susceptibility to sickness are set for each road section in the travel route change processing.

Therefore, according to the information processing apparatus 10, it is possible to change the traveling route to a traveling route that is less likely to cause sickness.

In the above-described embodiment, the case where the HMD 3 and the information processing apparatus 10 are separated has been described as an example, but the present invention is not limited to this, and the configuration is such that the HMD 3 and the information processing apparatus 10 are integrated. There may be.

Further, in the above-described embodiment, the case where the information processing device 10 and the output device 20 and the vehicle control device 30 are separated has been described as an example, but the present invention is not limited to this, and the information processing device 10 is used. The output device 20, the information processing device 10 and the vehicle control device 30, or the information processing device 10, the output device 20, and the vehicle control device 30 may be integrated.

Further, in the above-described embodiment, the HMD3 is taken as an example as a presentation device for presenting the VR content provided by the information processing apparatus 10 to the user U, but the presentation device is not limited to this, and the presentation device is not limited to this, for example, a bone. It may include a conduction speaker, or it may include a vibration presentation device that presents vibration, such as a body sonic.

Further, the presentation device is not limited to the wearable computer, and for example, a front window, a side window, or the like of the vehicle V may be configured by a display, and video may be output to the display. Further, the audio output may be performed on the in-vehicle speaker. Usually, a plurality of in-vehicle speakers can be appropriately arranged in multiple directions including front, back, left, and right, which is suitable for 3D reproduction.

Further, in the above-described embodiment, the example in which the information processing device 10 provides VR content is given, but any digital content including a virtual space experience may be used, and AR (Augmented Reality) content or MR content may be used. ..

Further effects and variations can be easily derived by those skilled in the art. For this reason, the broader aspects of the invention are not limited to the particular details and representative embodiments described and described above. Thus, various modifications can be made without departing from the spirit or scope of the overall concept of the invention as defined by the appended claims and their equivalents.

1 Information processing system 3 HMD
3a Display unit 3b Speaker 3c Sensor unit 7 Various sensors 10 Information processing device 12 Storage unit 12a VR content DB
12b User information 12c Estimated model 12d Guidance processing information 12da Map DB with sickness parameters
13 Control unit 13a Providing unit 13b Acquisition unit 13c Estimating unit 13d Guidance processing unit 13da Operation instruction unit 13db Driving performance changing unit 13dc Driving route changing unit 20 Output device 21 Display 22 Speaker 30 Vehicle control device

Claims (6)

It is an information processing device mounted on a vehicle, has a control unit, and has a control unit.
The control unit
Get inside and outside situations about users of digital content, at least including virtual space experiences,
Based on the acquired situation, the sickness situation of the user due to the digital content is estimated, and
According to the estimated sickness situation of the user and the type of the digital content, the guidance process for guiding the vehicle to a running state in which the sickness is suppressed is executed.
A driving performance change process for changing settings related to the driving performance of the vehicle, an operation instruction processing for instructing the driving operation of the vehicle, and a traveling route of the vehicle in stages according to the user's sickness situation and the type of the digital content. The guidance process is executed in the order of the travel route change process.
Information processing equipment. The vehicle is an autonomous driving vehicle.
The control unit
The operation instruction process for instructing the driving operation is executed for the vehicle control device that automatically controls the driving of the vehicle.
The information processing apparatus according to claim 1 . The control unit
In the traveling performance change process, the parameters related to the control sensitivity of the traveling system and / or the parameters related to the characteristics of the vehicle mechanism system are changed.
The information processing apparatus according to claim 1 or 2 . The control unit
In the travel route change process, the travel route is calculated based on the map data in which parameters related to susceptibility to sickness are set for each road section.
The information processing apparatus according to claim 1, 2 or 3 . It is an information processing method executed by an information processing device mounted on a vehicle.
Get inside and outside situations about users of digital content, at least including virtual space experiences,
Based on the acquired situation, the sickness situation of the user due to the digital content is estimated, and
According to the estimated sickness situation of the user and the type of the digital content, the guidance process for guiding the vehicle to a running state in which the sickness is suppressed is executed.
A driving performance change process for changing settings related to the driving performance of the vehicle, an operation instruction processing for instructing the driving operation of the vehicle, and a traveling route of the vehicle in stages according to the user's sickness situation and the type of the digital content. The guidance process is executed in the order of the travel route change process.
Information processing method. For computers installed in vehicles
To get inside and outside of the user of digital content, at least including the virtual space experience,
To estimate the user's sickness situation due to the digital content based on the acquired situation,
To execute a guidance process for guiding the vehicle to a running state in which the sickness is suppressed according to the estimated sickness situation of the user and the type of the digital content.
A driving performance change process for changing settings related to the driving performance of the vehicle, an operation instruction processing for instructing the driving operation of the vehicle, and a traveling route of the vehicle in stages according to the user's sickness situation and the type of the digital content. The guidance process is executed in the order of the travel route change process.
A program to execute.

Images