JP4337521B2 - In-vehicle information provider - Google Patents

Description

  The present invention relates to an in-vehicle information providing apparatus that displays an image or the like in a vehicle.

  With respect to a display device that displays an image or the like, there is known a technique for preventing the observer from feeling uncomfortable when the observer moves. Patent Document 1 discloses a display device in which an optical element such as a Fresnel lens is disposed between the display device and an observer. In this display device, an observer observes a virtual image projected at a position near infinity by a Fresnel lens. When the observer observes the normal of the Fresnel lens from below, a projected image is observed above the normal, and when viewed from above the normal, a projected image is observed below the normal.

  Patent Document 2 discloses a display device in which the display device is fixed to the observer's head. In this display device, the display image is scrolled in the direction opposite to the movement of the head in accordance with the movement of the head of the observer, so that it looks as if the image is fixed to the observer.

Japanese Patent Laid-Open No. 10-73785 JP-A-8-220470

  In the technique of Patent Document 1, an optical element is disposed between a display and an observer. For example, when observing a display disposed in a vehicle, it is necessary to secure an optical path space for the optical element. It is difficult to reduce the size. Further, when the display rotates relative to the observer due to the vehicle swinging, the observer's line of sight changes and the observer feels uncomfortable. Moreover, since the display device is fixed to the head in the technique of Patent Document 2, it is not suitable for observing an image from the display device attached in the vehicle.

  The present invention calculates the relative displacement in the translation direction of the image displayed on the display means based on the movement of the vehicle and the occupant, and the display position of the image displayed on the display means in real time so as to cancel the calculated displacement. With regard to the on-vehicle information providing apparatus to be moved, the movement amount is increased when a decrease in the occupant's face temperature is detected.

  In the in-vehicle information providing apparatus according to the present invention, it is possible to reduce the uncomfortable feeling that an occupant who observes provided information in the vehicle feels when the vehicle is rocking.

The best mode for carrying out the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a diagram showing an overview of an in-vehicle information providing apparatus according to a first embodiment of the present invention. In FIG. 1, an in-vehicle information providing apparatus 100 includes a vehicle motion detection unit 101, a human body database unit 102, an occupant motion estimation unit 103, an information source device 104, a substantially infinity information input unit 105, and a face temperature measurement unit. 106, an environmental condition measurement unit 107, a control unit 108, and an image display unit 109.

  FIG. 2 is an image diagram of a vehicle on which the in-vehicle information providing apparatus 100 is mounted. In FIG. 2, an observer (vehicle occupant) 21 sits on a seat 22 and observes image information displayed on the image display unit 109.

  The vehicle motion detection unit 101 detects the translational motion of the vehicle and the rotational motion of the vehicle, and outputs detection signals to the occupant motion estimation unit 103 and the control unit 108, respectively. The human body database unit 102 stores data indicating a human body head rocking transfer function with respect to vehicle rocking. The stored data is a database of data measured in advance for a plurality of subjects. Vehicle swing is indicated by a detected value of vehicle motion.

  The occupant motion estimation unit 103 reads information indicating the head motion of the occupant 21 from the human body database unit 102 using the detection signal indicating the vehicle motion, and estimates the motion (displacement) of the occupant 21's head, particularly the eyeball. . The occupant motion estimation unit 103 sends information indicating the estimated eyeball displacement to the control unit 108.

  The information source device 104 sends display data input from an external device (not shown) to the control unit 108. The display data is data such as an image displayed on the image display unit 109. Display data input from an external device is called pleasure information.

  The substantially infinite information input unit 105 includes a video camera 105A provided outside the vehicle, and sends an image signal input from the video camera 105A to the control unit 108. This image signal corresponds to a distant view in front of the vehicle taken by the video camera 105A. Therefore, a signal input from the substantially infinity information input unit 105 is referred to as substantially infinity information.

  The face temperature measurement unit 106 includes, for example, an infrared video camera 106A provided on the side of the rearview mirror, and uses the image signal based on an infrared image corresponding to the face of the occupant 21 obtained by the video camera 106A to use the face of the occupant 21 Measure the temperature distribution. The measurement results are sent to the control unit 108 as signals indicating the face average temperature, the forehead temperature, and the nose temperature.

  The environmental condition measuring unit 107 includes, for example, a sensor group 107A such as a temperature sensor and a humidity sensor provided in the vehicle interior, and a visible light video camera 107B provided beside the room mirror. The environmental condition measuring unit 107 measures the solar radiation / radiation distribution on the face of the occupant 21 using an image signal based on the visible light image corresponding to the face of the occupant 21 obtained by the visible light video camera 107B. The measurement result and the detection signal from the sensor are sent to the control unit 108, respectively.

  The control unit 108 uses the detection signal from the face temperature measurement unit 106 and the detection signal from the environmental condition measurement unit 107 to cause the occupant 21 to feel the discomfort that the occupant 21 feels by gazing at the display image of the image display unit 109 ( Detect the degree of discomfort. Here, discomfort and discomfort are so-called motion sickness symptoms.

  Further, the control unit 108 determines an image display method by the image display unit 109 based on the detected degree of uncomfortable feeling and the vehicle motion, and the image display unit 109 determines the image display method based on the detected eyeball displacement and vehicle motion. The displacement amount is determined, and the display data of the substantially infinity information is moved so that the display position of the substantially infinity information moves (image shifts) in real time within the display screen of the image display unit 109 according to the determined image displacement amount. Process. A display method (display control method) in the image display unit 109 will be described later.

  The control unit 108 further processes the image data of the enjoyment information and the substantially infinite information according to the determined display method, and displays the combined information (appropriate display) of the infinite information after the data processing together with the enjoyment information. Process. Data processing and processing performed here will be described later. The control unit 108 is configured to control each unit of the in-vehicle information providing apparatus 100 in addition to determining the display method and processing the image data. The control unit 108 outputs processed image data for side-by-side display to the image display unit 109 as a display signal corresponding to the input interface of the image display unit 109.

  The image display unit 109 is configured by, for example, a liquid crystal display or the like, and is disposed in the traveling direction (for example, forward) of the vehicle with respect to the passenger 21 in the vehicle interior. The image display unit 109 displays an image, text, or the like based on the input display signal on the liquid crystal display panel.

  FIG. 3A is a diagram illustrating an example of an image displayed on the image display unit 109 by display data (substantially infinite information) from the approximately infinity information input unit 105. As described above, the scenery is far away (infinity) sufficiently away from the vehicle (occupant). FIG. 3B is a diagram illustrating an example of an image displayed on the image display unit 109 by display data (enjoyment information) from the information source device 104. FIG. 3C is a diagram illustrating an example of an image in which substantially infinity information and enjoyment information are displayed together by, for example, picture-in-picture display.

  The vehicle occupant 21 observes the side-by-side image of enjoyment information and substantially infinity information displayed on the image display unit 109. Usually, the occupant 21 mainly observes enjoyment information.

  In the in-vehicle information providing apparatus 100 according to the first embodiment, the priority (priority) of the information displayed side by side is changed according to the degree of discomfort felt by the occupant 21 and the magnitude of the vehicle swing, The display position of the image based on the information at approximately infinity is moved so as to cancel the vehicle swing.

  The flow of display processing performed by the control unit 108 of the in-vehicle information providing apparatus 100 will be described with reference to the flowchart of FIG. In step S10 of FIG. 4, the control unit 108 determines whether the screen power supply of the image display unit 109 is turned on. The control unit 108 makes an affirmative determination in step S10 when the screen power supply is turned on and proceeds to step S20. If the screen power supply is not turned on, the control unit 108 makes a negative determination in step S10 and repeats the determination process.

  In step S20, the control unit 108 resets the parameter D to the initial value 0, and proceeds to step S23. The parameter D is a determination value indicating the degree of discomfort felt by the occupant 21 by watching the screen. In step S23, the control unit 108 resets the time count t of the timer to the initial value 0, and proceeds to step S26.

  In step S26, the control unit 108 starts measuring time t by the timer and proceeds to step S30. In step S30, the control unit 108 outputs a command to the vehicle movement detection unit 101, detects the movement of the vehicle (movement measurement), and proceeds to step S40. Thereby, the vehicle motion detection part 101 detects the translational motion and rotational motion (for example, pitch motion) of a vehicle, respectively.

  In step S40, the control unit 108 outputs a command to the occupant motion estimation unit 103 to estimate the motion of the head of the occupant 21 and proceeds to step S50. Specifically, the occupant motion estimation unit 103 searches the human body database unit 102 and selects a human body swing transfer function corresponding to the latest detected value of vehicle motion from the database. The occupant motion estimation unit 103 calculates an estimated value of the motion (particularly vertical movement) of the head (particularly the eyeball) of the occupant 21 using the selected human body swing transfer function and the detected value of the vehicle motion, The data is sent to the control unit 108.

  In step S50, the control unit 108 calculates the relative displacement between the display screen and the eyeball by the image display unit 109, and proceeds to step S55. Specifically, the amount of screen movement in the translational direction accompanying the rotational movement of the vehicle is calculated using a detection signal indicating the vehicle movement (the amount of screen movement in this case is the pitch direction (vertical direction) of the image display unit 109). The relative displacement is obtained based on the calculated screen movement amount and the estimated value of the occupant head movement.

  In step S55, the control unit 108 determines whether or not the time count t is greater than the predetermined time t0. If t> t0 is satisfied, the control unit 108 makes a positive determination in step S55 and proceeds to step S60. If t> t0 is not satisfied, the control unit 108 makes a negative determination in step S55 and proceeds to step S140. In the case of proceeding to step S140, the process of determining the degree of discomfort felt by the occupant 21 is skipped. That is, the degree of discomfort of the occupant 21 is determined every predetermined time t0.

  In step S60, the control unit 108 measures the face temperature of the occupant 21. Specifically, a command is output to the face temperature measuring unit 106, the face of the occupant 21 is photographed by the infrared video camera 106A, and the process proceeds to step S70. In step S70, the control unit 108 instructs calculation of the average temperature Tf, forehead temperature Tfh, and nose temperature Tn of the occupant 21's face, and proceeds to step S80. Thereby, the face temperature measurement unit 106 measures the temperature distribution of the face of the occupant 21 using the image signal based on the infrared image, and acquires the face average temperature Tf, the forehead temperature Tfh, and the nose temperature Tn.

  In step S80, the control unit 108 measures a thermal environment condition in the passenger compartment. Specifically, a command is sent to the environmental condition measurement unit 107, and the vehicle interior including the occupant 21's face is photographed by the visible light video camera 107B, and the solar radiation / radiation distribution on the occupant 21's face is measured. Further, the temperature and humidity in the passenger compartment are measured by the sensor group 107A.

  In step S90, the control unit 108 calculates a difference ΔTp between the forehead temperature Tfh and the nose temperature Tn, and proceeds to step S100. In step S100, the control unit 108 determines whether or not the difference ΔTp is larger than a predetermined value Tp0. If ΔTp> Tp0 is satisfied, the control unit 108 makes a positive determination in step S100 and proceeds to step S140. If ΔTp> Tp0 is not satisfied, the control unit 108 makes a negative determination in step S100 and proceeds to step S110. When the process proceeds to step S140, the process of determining the degree of discomfort felt by the occupant 21 is skipped, and the value of the discomfort determination value D is not changed.

  In general, the difference ΔTp between the forehead temperature Tfh and the nose temperature Tn of a person increases when the person's mental load is large. Therefore, when proceeding to step S140, it is considered that the occupant 21 has a high mental load. On the other hand, when the process proceeds to step S110, it is considered that the occupant 21 has a low mental load, and the process proceeds to a process for determining the degree of discomfort felt by the occupant 21.

  In step S110, the control unit 108 calculates an estimated value Tfe of the human face temperature using the measured thermal environment condition, and proceeds to step S120. This calculation is performed, for example, by referring to a database of data measured in advance for a subject under a plurality of thermal environments.

  In step S120, the control unit 108 calculates a difference ΔTf between the average temperature Tf and the estimated facial temperature value Tfe, and proceeds to step S130. In step S130, the control unit 108 determines the degree D of discomfort and proceeds to step S140. The discomfort determination value D is obtained, for example, by multiplying the difference ΔTf by a predetermined coefficient. As a result, the determination value D increases as the actual facial temperature becomes lower than the estimated facial temperature Tfe.

  In general, a person feels discomfort / discomfort as a subjective symptom when the visual information he obtains and the information from the vestibular apparatus (semicircular canal, otolith) are inconsistent. At this time, facial pallor or cold sweat occurs as an objective symptom. Such objective symptoms progress with increasing subjective symptoms. When the face is pale, the temperature of the face decreases due to vasoconstriction of the face. Also, when cold sweat occurs, the temperature of the face decreases due to the sweating action. The determination of the degree of discomfort D determines the degree of the objective symptom occurring in the passenger 21. Since the facial temperature varies depending on the thermal environment condition, comparison with the estimated facial temperature value Tfe is performed to remove the influence of the thermal environment condition (step S120).

  In step S140, the control unit 108 determines a display method and proceeds to step S150. Specifically, the priority (priority level) of the information to be displayed side by side (for example, picture-in-picture display) according to the magnitude of the sense of incongruity determination value D and the magnitude of the latest detected value of vehicle motion ), To determine the saturation, brightness, and contrast of the information to be displayed. The priority is indicated by the size / position of the image based on each of the enjoyment information and the information at approximately infinity. The size of the image is the size of the image at the time of picture-in-picture display, and the position of the image is the display position of the image on the display screen of the image display unit 109.

  In step S150, the control unit 108 inputs substantially infinity information (a photographed image of the front scenery) from the substantially infinity information input unit 105, and proceeds to step S160. In step S160, the control unit 108 uses the above-described screen movement amount and relative displacement, and the display image necessary for the image displayed on the image display unit 109 to appear to the occupant 21 without being swung in space. Is calculated, and the process proceeds to step S170.

  In step S170, the control unit 108 processes the display data so that the display position of the substantially infinite information moves within the display screen of the image display unit 109 according to the calculated image displacement amount. The control unit 108 further performs processing necessary for picture-in-picture display of the enjoyment information and the display data of substantially infinite information to be sent to the image display unit 109 according to the determined control method, and proceeds to step S180. . For the processing for picture-in-picture display, for example, the display data is resized so that the image based on the pleasure information is displayed in a reduced size, and a predetermined portion of the image based on the information at approximately infinity is replaced with the reduced image after the resize processing. By doing. Thereby, display data is generated so that the reduced image of the enjoyment information is displayed in a picture-in-picture manner on an image based on the information at approximately infinity. The predetermined portion depends on the size of the image and the position of the image determined in step S140.

  In step S180, the control unit 108 sends a command to the image display unit 109 to display an image based on the processed display data, and the process proceeds to step S190. As a result, the image display unit 109 displays a picture-in-picture image based on the enjoyment information and the information at approximately infinity.

  In step S190, the control unit 108 determines whether the screen power supply of the image display unit 109 is turned off. The control unit 108 makes an affirmative determination in step S190 when the screen power is turned off, and ends the process of FIG. On the other hand, when the screen power is not turned off, the control unit 108 makes a negative determination in step S190, returns to step S23, and repeats the above-described processing.

Details of the image shift will be described. When focusing on the movement in the pitch direction accompanying the acceleration / deceleration of the vehicle, the displacement of the relative position between the eyeball of the occupant 21 and the image display unit 109 is roughly divided into the following two.
A. Due to pitch movement occurring on the vehicle side. Due to pitch movement occurring on the passenger side (especially the eyeball)

  The above A will be described with reference to FIG. When the vehicle decelerates, a nose dive phenomenon occurs in which the front portion of the vehicle sinks. When the display screen by the image display unit 109 is positioned in the traveling direction of the vehicle with respect to the occupant 21, the nose dive causes a rotational movement in the pitch direction (in this case, downward) in the image display unit 109. Therefore, the control unit 108 performs display data processing for displacing the display position of the substantially infinite information in the pitch direction (in this case, upward) so as to cancel the movement of the image display unit 109.

  FIG. 5B is a diagram showing a display screen of the image display unit 109 on which an image shift for canceling the vehicle pitch movement at the time of nose dive is performed. As a result of the upward movement of the substantially infinity information displayed on the image display unit 109 in accordance with the downward movement amount of the image display unit 109, the displayed substantially infinity information and the relative displacement between the eyeballs become zero. For the occupant 21, the information at approximately infinity appears to stand still in the space.

  Contrary to the nose dive when the vehicle is decelerated, when the vehicle accelerates, a squat phenomenon occurs in which the rear part of the vehicle sinks. When the display screen by the image display unit 109 is positioned in the traveling direction of the vehicle with respect to the occupant 21, a rotational motion in the pitch direction (in this case, upward) is generated in the image display unit 109 by squats. Therefore, the control unit 108 performs display data processing for displacing the display position of the substantially infinite information in the pitch direction (downward in this case) so as to cancel the movement of the image display unit 109.

  FIG. 5C is a diagram showing a display screen of the image display unit 109 on which an image shift for canceling vehicle pitch movement is performed during squat. Depending on the amount of upward movement of the image display unit 109, the information about the infinity displayed on the image display unit 109 is moved downward. As a result, the displayed information about the infinity and the relative displacement between the eyes become zero. For the occupant 21, the information at approximately infinity appears to stand still in the space.

  As shown in FIG. 2, when the video camera 105 </ b> A that captures the external scenery as the information at approximately infinity is provided in the vehicle, the video camera 105 </ b> A also rotates with the vehicle. Therefore, the image of the external landscape by the video camera moves in the direction opposite to the direction of the pitch movement generated in the image display unit 109 itself within the display screen of the image display unit 109. As a result, the substantially infinite distance information and the relative displacement between the eyeballs caused by the pitch movement of the vehicle are smaller than when no pitch movement occurs in the video camera.

  The above B will be described with reference to FIG. When the vehicle is actually decelerating and accelerating, rotational movement in the pitch direction also occurs on the head of the passenger 21. When the head of the occupant 21 rotates forward during vehicle deceleration, the position of the occupant 21's head (particularly the eyeball) moves downward relative to the image display unit 109 when the position of the image display unit 109 does not move. Therefore, the control unit 108 moves the substantially infinite information displayed on the image display unit 109 downward according to the downward movement amount of the eyeball of the occupant 21. FIG. 6B is a diagram showing a display screen of the image display unit 109 on which an image shift for canceling the head pitch movement at the time of nose dive is performed. The image shift direction in this case is the same as the direction in which vehicle pitch movement is canceled during squat.

  When the head of the occupant 21 rotates backward during vehicle acceleration, the position of the head of the occupant 21 (especially the eyeball) with respect to the image display unit 109 when the position of the image display unit 109 does not move when the vehicle accelerates. Moves upward. Therefore, the control unit 108 moves the substantially infinite information displayed on the image display unit 109 upward according to the upward movement amount of the eyeball of the occupant 21. The image shift direction in this case is the same as the direction in which vehicle pitch movement is canceled during nose dive.

  In the present embodiment, the relative displacement between the image display unit 109 and the eyeball is obtained, and the image is shifted by the information at substantially infinity according to the relative displacement, so that the influence of both the A and B pitch movements is canceled. Thus, it is possible to perform image shift.

  FIG. 7 is a diagram for explaining the correspondence between the magnitude of vehicle swing (that is, the magnitude of the vehicle motion detection value) and the display control method. In FIG. 7, “image size” is a display area in the display screen of the image display unit 109, and indicates an area ratio in a case where substantially infinity information and enjoyment information are displayed together. When the vehicle swing is small, the enjoyment information is prioritized by setting the area of the infinite information to “small” and the area of the enjoyment information to “large”. FIG. 8A shows an example in which picture-in-picture display is performed with priority on the enjoyment information.

  On the contrary, when the vehicle swing is large, priority is given to the information at approximately infinity by setting the area of the information at approximately infinity to “large” and the area of the enjoyment information at “small”. FIG. 8B shows an example in which picture-in-picture display is performed with priority given to information at approximately infinity. The priority can be changed stepwise according to the magnitude of the vehicle swing, and the numbers 1 to 5 in FIG. 7 can be set in five stages according to the magnitude of the vehicle swing. It shows that.

  In FIG. 7, “display position” is a position at which an image based on enjoyment information is displayed on the display screen by the image display unit 109. “Center” indicates that the display is displayed at the center of the display screen, and “Progression direction” indicates that the display position is changed when the vehicle turns left or right. The control unit 108 generates a display signal so that an image based on the pleasure information is displayed on the right side of the display screen when the vehicle is turned right, and an image based on the pleasure information is displayed on the left side of the display screen when the vehicle is turned left. It should be noted that the display position can be set in five stages between “center” and “traveling direction” according to the magnitude of the vehicle swing.

  FIG. 9A is a diagram illustrating an example in which an image based on enjoyment information is displayed at the center of the display screen by the image display unit 109. In this way, the image based on the enjoyment information is displayed in the center of the screen when the vehicle swing is small (the vehicle motion detection value is smaller than a predetermined value) and when the vehicle swing is large (the vehicle motion detection value is predetermined). If the value is greater than)) FIG. 9B is a diagram showing an example in which an image based on enjoyment information is displayed on the right side of the display screen by the image display unit 109. The image based on the enjoyment information is displayed on the right side of the screen in the case of a right turn when the vehicle swing is large (the vehicle motion detection value is equal to or greater than a predetermined value). In addition, illustration is abbreviate | omitted about the example of a display at the time of a left turn when a vehicle rocking | fluctuation is large (the image by pleasure information is displayed on the left side of a screen).

  In addition to the above-described “image size” and “display position”, at least one of “saturation”, “brightness”, and “contrast” may be changed. For example, when the vehicle swing is small, at least one of the saturation, lightness, and contrast of the image based on the enjoyment information is given priority over the saturation, lightness, and contrast of the image based on the information at approximately infinity so that the enjoyment information is given priority. Make it relatively high. Accordingly, as a result of the enjoyment information displayed on the image display unit 109 being highlighted rather than the substantially infinite information, the occupant 21 observes an image in which the enjoyment information has priority over the substantially infinite information.

  On the other hand, when the vehicle swing is large, at least one of the saturation, brightness, and contrast of the image based on the information at approximately infinity is used so that priority is given to the information at approximately infinity. Relatively higher. As a result, the information at the substantially infinite distance displayed on the image display unit 109 is highlighted with respect to the enjoyment information. As a result, the occupant 21 observes an image in which the information at approximately infinite distance is prioritized over the enjoyment information.

  The reason why the priority of the side-by-side display is changed according to the magnitude of the vehicle swing will be described. When focusing on the movement in the pitch direction accompanying the acceleration / deceleration of the vehicle, the above-described nose dive phenomenon occurs when the vehicle decelerates. At this time, in the state where the occupant 21 is gazing at the image display unit 109 (particularly, the image based on the enjoyment information) that has moved downward along the nose dive, the visual information of the occupant 21 and the information from the vestibule are not changed as described above. The contradiction causes the occupant 21 to feel uncomfortable and uncomfortable. Therefore, the control unit 108 gives priority to the information about infinity over the enjoyment information, so that the occupant 21 mainly observes the information about infinity, so that the line of sight of the occupant 21 is guided to a space corresponding to a distant outside scenery. As a result, the visual information of the occupant 21 and the information provided by the vestibule are matched, making it difficult for the occupant 21 to feel uncomfortable or uncomfortable, and even if the occupant 21 feels uncomfortable or uncomfortable, the degree can be reduced. It becomes possible.

  The control unit 108 gives priority to the information at approximately infinity over the enjoyment information when the squat phenomenon occurs as in the case where the nose dive occurs. As a result, the line of sight of the occupant 21 is guided to a space corresponding to the distant exterior scenery, and the visual information of the occupant 21 matches the information from the vestibular apparatus, making the occupant 21 less likely to feel discomfort and discomfort. If so, the degree is reduced.

  When the vehicle swing is small, the relative movement of the image display unit 109 with respect to the occupant 21 is small. ) Is almost the same. In this case, the passenger 21 is made to observe the image based on the enjoyment information with priority.

  The relationship between the magnitude of the unnatural feeling determination value D and the priority of the side-by-side display will be described. When the occupant 21 feels uncomfortable or uncomfortable (that is, when the unnatural feeling determination value D is larger than a predetermined value), the control unit 108 responds to the magnitude of the vehicle swing as shown in FIG. Processing for further increasing the priority to be determined is performed. Specifically, the priority corresponding to a larger numerical value in the range of numbers 1 to 5 in five steps in FIG. For example, even if the priority is “3” based on the magnitude of the swing, if the determination value D for the uncomfortable feeling is large, the priority is set to “4” or “5” depending on the magnitude of D.

  Thus, by further increasing the priority at the time of side-by-side display determined according to the magnitude of the vehicle swing according to the size of the unnatural feeling determination value D, the degree of uncomfortable feeling or uncomfortable feeling felt by the occupant 21 is increased. Further reduction is possible.

The first embodiment described above will be summarized.
(1) The image display unit 109 is configured by a liquid crystal display or the like, and is disposed in the vehicle traveling direction (for example, forward) with respect to the passenger 21 in the vehicle interior. The image display unit 109 includes, for example, an image based on a display signal input from the information source device 104 (enjoyment information) and a scene outside the vehicle based on a signal input from the approximately infinity information input unit 105 (approximately infinity information). A side (for example, picture-in-picture) display image is displayed.

(2) The control unit 108 detects the swing of the vehicle, and when the detected value is equal to or greater than the predetermined value, the information display unit 109 displays the information at approximately infinity over the enjoyment information, and the detected value is predetermined. If it is less than the value, the enjoyment information is prioritized and displayed on the image display unit 109 over the information at approximately infinity. As a result, when the vehicle swing is large, the occupant 21 mainly observes the scenery outside the vehicle (guides the sight line of the occupant 21 to the scenery outside the vehicle), so the visual information of the occupant 21 and the vestibular device (semicircular canal, otolith) ) And the passenger 21 are less likely to feel discomfort and discomfort. Furthermore, when the passenger feels uncomfortable or uncomfortable, the degree can be reduced. When the vehicle swing is small, the occupant 21 mainly observes the enjoyment information (guides the sight line of the occupant 21 to the enjoyment information). In this case, since the visual information of the occupant 21 and the information by the semicircular canal and the otolith are not inconsistent, the occupant 21 can enjoy the enjoyment information without feeling uncomfortable or uncomfortable.

(3) Since the estimated value of the head (particularly eyeball) motion of the occupant 21 is calculated using the vehicle motion detection data and the head swing transfer function stored in the human body database unit 102, the occupant 21 The eyeball position of the occupant 21 can be obtained without providing a motion detection sensor on the head or the like. Since no detection sensor is attached to the occupant 21, an increase in cost can be suppressed and no burden is imposed on the occupant 21.

(4) Since the amount of movement in the pitch direction (vertical direction) of the image display unit 109 accompanying the rotational motion of the vehicle is calculated using detection data indicating the vehicle motion, no motion detection sensor is provided for the image display unit 109. Even the position of the image display unit 109 can be obtained.

(5) Since the relative displacement between them is obtained using the eyeball position in (3) above and the position of the image display unit 109 in (4) above, the displacement between the two can be obtained even in different motion states. Can do.

(6) The amount of movement in the pitch direction (vertical direction) of the image display unit 109 and the abbreviated display on the image display unit 109 so as to cancel the movement of the display image due to the change in the relative displacement of (5) above. Since the display position of the infinity information has been moved in the pitch direction (image shifted), the influence of both A and B pitch movements is cancelled, and the infinity information is almost stationary in space for the occupant 21. looks like. As a result, in a situation where the occupant 21 is gazing at almost infinity information on the display screen, the visual information obtained by the occupant 21 matches the information from the vestibular apparatus (semicircular canal, otolith), so the occupant 21 feels discomfort / discomfort. Can be further reduced.

(7) An image based on pleasure information and an image based on approximately infinity information are displayed side by side in picture-in-picture display, and the resizing process is performed so that the image based on the pleasure information is displayed in a reduced size. Overlaid on the image by infinite information. Since the reduction process is not performed on the image based on the information at substantially infinite distance, it is easier for the occupant 21 to obtain the position information of the space corresponding to the distant view than when the reduction process is performed. Also, picture-in-picture display is different from the case where two images are displayed side by side so that no image overlap occurs, and image display can be performed by effectively using the entire display screen of the image display unit 109.

(8) When the vehicle turns right, the image based on the pleasure information is displayed on the right side of the display screen, and when the vehicle turns left, the image based on the pleasure information is displayed on the left side of the display screen. 21 lines of sight can be guided in the turning direction. As a result, the field of view outside the vehicle can easily enter the field of view of the occupant 21, and the discomfort and discomfort felt by the occupant 21 can be further reduced.

(9) Since the discomfort felt by the occupant 21 is determined, and the priority at the time of side-by-side display determined based on the magnitude of the swing of the vehicle is further increased according to the magnitude of the judgment value D. Thus, it is possible to further reduce the degree of discomfort / discomfort felt by the occupant 21. Since the priority is changed in accordance with the ease of feeling the occupant 21's uncomfortable feeling (individual difference in sensitivity), the degree of discomfort / discomfort felt by the occupant 21 can be effectively reduced. In addition, when there is no fall of a passenger | crew's face temperature and the determination value D is small, it is set as the priority determined based on the magnitude | size of rocking | fluctuation of a vehicle.

(10) The discomfort determination value D is determined by photographing the face of the occupant 21 with the infrared video camera 106A and using the detected face temperature of the occupant 21 based on the photographed infrared image. It is not necessary to provide a temperature detection sensor or the like on the face of the vehicle, and no burden is placed on the passenger 21.

(11) The occupant detected in (10) by measuring the temperature and humidity in the passenger compartment and the environmental conditions such as solar radiation and radiation on the face of the occupant 21 and calculating the estimated face temperature Tfe under the thermal environment condition It was made to compare with the face temperature Tf of 21. Accordingly, since the change in the facial temperature caused by the thermal environment condition can be removed, it is possible to prevent the passenger from erroneously determining that the passenger feels uncomfortable when the facial temperature of the occupant decreases due to the thermal environment condition.

(12) When the difference ΔTp between the forehead temperature Tfh and the nose temperature Tn is larger than a predetermined value Tp0, it is considered that the occupant's mental load is large. Therefore, when the occupant's face temperature decreases due to an increase in mental load, it is prevented that the occupant erroneously determines that the occupant feels uncomfortable.

  In the above description, an image based on pleasure information and an image based on approximately infinity information are displayed side by side in picture-in-picture display. However, two images are displayed side by side or adjacently displayed so as not to overlap each other. May be.

  In the above description, increasing the saturation, lightness, contrast, etc. relative to the other of the near-infinity information and the enjoyment information is equivalent to lowering the saturation of the other.

(Second embodiment)
In the second embodiment, only the image based on the enjoyment information is displayed on the image display unit, and the display position of the image based on the enjoyment information is shifted within the display screen of the image display unit. The image shift amount is determined by the image displacement amount of the image display unit determined based on the displacement of the occupant's eyeball and the vehicle motion, and the image displacement gain determined according to the magnitude of the unnatural feeling determination value D. .

  FIG. 10 is a diagram showing an overview of the in-vehicle information providing apparatus according to the second embodiment of the present invention. In FIG. 10, the in-vehicle information providing apparatus 200 includes a vehicle motion detection unit 201, a human body database unit 202, an occupant motion estimation unit 203, an information source device 204, a face temperature measurement unit 205, and an environmental condition measurement unit 206. A control unit 207 and an image display unit 208.

  The vehicle motion detection unit 201 detects the translational motion of the vehicle and the rotational motion of the vehicle, and outputs detection signals to the occupant motion estimation unit 203 and the control unit 207, respectively. The human body database unit 202 stores data indicating a human body head rocking transfer function with respect to vehicle rocking.

  The occupant motion estimation unit 203 estimates the motion (displacement) of the occupant's head, particularly the eyeball, using a detection signal indicating vehicle motion. The information source device 204 sends display data input from an external device (not shown) to the control unit 207. The display data is data such as an image to be displayed on the image display unit 208, and is called enjoyment information.

  The face temperature measurement unit 205 measures the temperature of the occupant's face, that is, the face average temperature, the forehead temperature, and the nose temperature, using an image signal based on the infrared image.

  The environmental condition measuring unit 206 measures the solar radiation and radiation distribution on the occupant's face using an image signal based on the visible light image, and measures the temperature and humidity in the passenger compartment.

  The control unit 207 uses the detection signal from the face temperature measurement unit 205 and the detection signal from the environmental condition measurement unit 206 to sense the discomfort (discomfort) that the occupant feels by gazing at the display image on the image display unit 208. ) Is detected.

  The control unit 207 further determines the displacement gain of the image displayed on the image display unit 208 based on the detected degree of discomfort, and determines the amount of image displacement based on the detected eyeball displacement and vehicle motion. The value obtained by multiplying the displacement amount by the displacement gain is used as the image shift amount, and the display of the enjoyment information is performed so that the display position of the enjoyment information moves in accordance with the image shift amount (image shift) in the display screen of the image display unit 208. Process the data.

  The control unit 207 is configured to control each unit of the in-vehicle information providing apparatus 200 in addition to performing the image shift process. The control unit 207 outputs the processed image data to the image display unit 208 as a display signal corresponding to the input interface of the image display unit 208.

  The image display unit 208 is constituted by, for example, a liquid crystal display or the like, and is disposed in the traveling direction (for example, forward) of the vehicle with respect to the passenger in the vehicle interior. The image display unit 208 displays an image, text, or the like based on the input display signal on the liquid crystal display panel.

  The flow of display processing performed by the control unit 207 of the in-vehicle information providing apparatus 200 will be described with reference to the flowchart of FIG. Each process from step S210 to step S330 in FIG. 11 is the same as each process from step S10 to step S130 in FIG.

  In step S340 of FIG. 11, the control unit 207 determines the image displacement gain and proceeds to step S350. Specifically, the displacement gain at the time of the image shift is determined according to the magnitude of the sense of incongruity determination value D and the magnitude of the latest detected value of vehicle motion.

  In step S350, the control unit 207 calculates an image displacement amount and proceeds to step S360. Specifically, using the above-described vertical movement amount and relative displacement of the screen, the displacement amount of the display image that is necessary for the image displayed on the image display unit 208 to appear stationary without shaking in the space. Is calculated.

  In step S360, the control unit 207 instructs the image display unit 208 to display an image, and proceeds to step S370. Specifically, the image displacement amount is calculated by multiplying the image displacement amount by the image displacement gain, and the display data is processed so that the display position of the enjoyment information moves within the display screen of the image display unit 208. The image is sent to the image display unit 208.

  In step S370, the control unit 207 determines whether the screen power of the image display unit 208 is turned off. The control unit 207 makes an affirmative determination in step S370 when the screen power is turned off, and ends the process of FIG. On the other hand, if the screen power supply is not turned off, the control unit 207 makes a negative determination in step S370, returns to step S223, and repeats the above-described processing.

  FIG. 12 is a diagram illustrating a correspondence relationship between the magnitude of the vehicle swing and the image displacement gain. When the vehicle swing is small (the vehicle motion detection value is smaller than the predetermined value), the image displacement gain = 0, and when the vehicle swing is large (the vehicle motion detection value is larger than the predetermined value), the image displacement gain = 1. . In FIG. 12, the numbers 1 to 5 indicate that the magnitude of the image displacement gain can be set in five steps according to the magnitude of the vehicle swing. That is, the image displacement gain is changed stepwise between 0 and 1 according to the magnitude of the vehicle swing.

  The image shift amount by which the display position of the amusement information actually moves within the display screen of the image display unit 208 is proportional to the product of the image displacement gain and the image displacement amount. That is, the larger the vehicle swing, the larger the image shift amount, and the smaller the vehicle swing, the smaller the image shift amount. The five-step determination of the vehicle swing may be performed by providing determination values at each step in advance and comparing the detected values of the vehicle motion with these determination values.

  A relationship between the magnitude of the unnatural feeling determination value D and the image displacement gain will be described. When the passenger feels uncomfortable or uncomfortable (that is, when the unnatural feeling determination value D is larger than a predetermined value), the control unit 207 determines according to the magnitude of the vehicle swing as shown in FIG. The processing for further increasing the image displacement gain is performed. Specifically, the gain corresponding to a larger numerical value in the range of 5 to 5 in FIG. For example, even if the gain is “2” when judging from the magnitude of the swing, if the judgment value D for the uncomfortable feeling is large, the priority is set to any one of “3” to “5” according to the magnitude of D. .

The second embodiment described above will be summarized.
(1) The control unit 207 cancels the movement of the display image due to the change in the pitch direction (vertical direction) of the image display unit 208 and the relative displacement between the occupant's eyeball and the image display unit 208. In addition, since the display position of the enjoyment information displayed on the image display unit 208 is moved in the pitch direction (the image is shifted), the influence due to both the pitch movements A and B is canceled, and the enjoyment information is almost in the space for the occupant. It appears to be stationary. As a result, in a situation where the occupant gazes at the display image, the visual information obtained by the occupant and the information from the vestibular apparatus (semicircular canal, otolith) match, so that the discomfort and discomfort felt by the occupant can be reduced.

(2) Since the discomfort felt by the occupant is determined and the image displacement gain multiplied by the image displacement amount is changed according to the magnitude of the determination value D, the degree of discomfort / discomfort felt by the occupant Can be further reduced. Since the change of the image displacement gain is performed in accordance with the ease of feeling the occupant's discomfort (individual difference in sensitivity), the degree of discomfort / discomfort felt by the occupant can be effectively reduced. When there is no decrease in the occupant's face temperature and the determination value D is small, the image displacement gain is determined based on the magnitude of the vehicle swing.

(Third embodiment)
In the third embodiment, an infrared video camera for detecting the occupant's face temperature is also used to detect a relative displacement between the occupant's head (eyeball) and the image display unit.

  FIG. 13: is a figure which shows the outline | summary of the vehicle-mounted information provision apparatus by 3rd embodiment of this invention. In FIG. 13, the in-vehicle information providing apparatus 300 includes a vehicle motion detection unit 301, a facial image photographing unit 302, a facial temperature calculation unit 303, an environmental condition measurement unit 304, an information source device 305, a control unit 306, An infrared irradiation unit 307 and an image display unit 308 are provided.

  The vehicle motion detection unit 301 detects the translational motion of the vehicle and the rotational motion of the vehicle, and outputs a detection signal to the control unit 306. The face image photographing unit 302 is constituted by, for example, an infrared video camera provided on the side of the room mirror, and obtains an infrared image corresponding to the occupant's face. Image signals corresponding to the infrared image are sent to the face temperature calculation unit 303 and the control unit 306, respectively.

  The face temperature calculation unit 303 calculates the temperature distribution of the occupant's face using an image signal based on the infrared image. The calculation results are sent to the control unit 306 as signals indicating the face average temperature, the forehead temperature, and the nose temperature.

  The environmental condition measurement unit 304 measures the solar radiation and radiation distribution on the occupant's face using an image signal based on the visible light image, and measures the temperature and humidity in the passenger compartment.

  The information source device 305 sends display data input from an external device (not shown) to the control unit 306. The display data is data such as an image to be displayed on the image display unit 308, and is called enjoyment information.

  The control unit 306 detects the movement of the occupant's head (particularly, the eyeball) using an image signal based on the infrared image, and determines the amount of image displacement based on the detected displacement of the eyeball and vehicle movement. The control unit 306 uses the calculated value from the face temperature calculation unit 303 and the detection signal from the environmental condition measurement unit 304 to sense discomfort (discomfort) that the occupant feels by gazing at the display image on the image display unit 308. ) Is detected.

  The control unit 306 further determines a displacement gain of an image to be displayed on the image display unit 308 based on the detected degree of uncomfortable feeling, and sets a value obtained by multiplying the image displacement amount by the displacement gain as an image shift amount. The display data of the enjoyment information is processed so that the display position of the enjoyment information is moved in accordance with the image shift amount (image shift) on the display screen 308.

  The control unit 306 is configured to control each unit of the in-vehicle information providing apparatus 300 in addition to performing the image shift process. The control unit 306 outputs the processed image data to the image display unit 308 as a display signal corresponding to the input interface of the image display unit 308.

  The infrared irradiation unit 307 is configured by, for example, an infrared LED, and irradiates the passenger's face with infrared light according to a command from the control unit 306.

  The image display unit 308 is configured by a liquid crystal display, for example, and is disposed in the traveling direction (for example, forward) of the vehicle with respect to the passenger in the vehicle interior. The image display unit 308 displays an image or text based on the input display signal on the liquid crystal display panel.

  The flow of display processing performed by the control unit 306 of the in-vehicle information providing apparatus 300 will be described with reference to the flowchart of FIG. Each process from step S410 to step S420 in FIG. 14 is the same as each process from step S10 to step S20 in FIG.

  In step S421 in FIG. 14, the control unit 306 sends a command to the infrared irradiation unit 307, turns on infrared irradiation, and proceeds to step S423.

  Each process from step S423 to step S430 is the same as each process from step S23 to step S30 in FIG.

  In step S440, the control unit 306 outputs a command to the face image photographing unit 302, causes the occupant's face to be photographed by the infrared video camera, and proceeds to step S450. Since the occupant's face is irradiated with infrared light, the image quality is improved as compared to when the infrared light is not irradiated, and feature points can be easily extracted.

  In step S450, the control unit 306 detects the movement of the occupant's head (particularly the eyeball) using the image signal based on the infrared image, and calculates the relative displacement between the eyeball and the screen of the image display unit 308. Proceed to step S455.

  In step S455, the control unit 306 determines whether or not the time count t is greater than the predetermined time t0. If t> t0 is satisfied, the control unit 306 makes an affirmative determination in step S455 and proceeds to step S457. If t> t0 is not satisfied, the control unit 306 makes a negative determination in step S455 and proceeds to step S540. In the case of proceeding to step S540, the process of determining the degree of uncomfortable feeling felt by the passenger is skipped. That is, the degree of discomfort of the occupant is determined every predetermined time t0.

  In step S457, the control unit 306 sends a command to the infrared irradiation unit 307 to turn off infrared irradiation and outputs a command to the face image photographing unit 302 to increase the photographing sensitivity of the infrared video camera, and the process proceeds to step S460.

  In step S460, the control unit 306 performs facial temperature measurement. Specifically, a command is output to the facial image photographing unit 302, and the occupant's face is photographed by the infrared video camera, and the process proceeds to step S470. At this time, since the infrared light is not irradiated on the occupant's face, an image by the radiant infrared light from the face is taken, and the measurement error in the face temperature measurement can be suppressed.

  In step S470, the control unit 306 sends a command to the face temperature calculation unit 303 to instruct calculation of the average temperature Tf, forehead temperature Tfh, and nose temperature Tn of the occupant's face, and the process proceeds to step S480. Thereby, the face temperature calculation unit 303 measures the temperature distribution of the occupant's face using the image signal based on the infrared image, and calculates the face average temperature Tf, the forehead temperature Tfh, and the nose temperature Tn, respectively.

  In step S480, the control unit 306 measures the thermal environment condition in the passenger compartment. Specifically, a command is sent to the environmental condition measurement unit 304, and the vehicle interior including the occupant's face is photographed with a visible light video camera, and the solar radiation / radiation distribution on the occupant's face is measured. Further, the temperature and humidity in the passenger compartment are measured by the sensor group. Since infrared light is not irradiated on the occupant's face at this time, measurement errors during measurement of solar radiation / radiation distribution on the face can be suppressed.

  In step S485, the control unit 306 sends a command to the infrared irradiation unit 307 to turn on the infrared irradiation and outputs a command to the face image photographing unit 302 to reduce the photographing sensitivity of the infrared video camera (return to the value before the increase). ) And go to step S490.

  Each process from step S490 to step S570 is the same as each process from step S290 to step S370 in FIG.

  In step S580, the control unit 306 sends a command to the infrared irradiation unit 307, turns off the infrared irradiation, and ends the process of FIG.

The third embodiment described above will be summarized.
(1) As in the second embodiment, the influence of both A and B pitch movements is canceled and the joyful information appears to be almost stationary in space for the occupant, so the occupant watches the display image. It is possible to reduce the sense of discomfort and discomfort that is felt in situations where the user does.

(2) Similar to the second embodiment, since the image displacement gain is changed according to the magnitude of the unnatural feeling determination value D, the uncomfortable / uncomfortable feeling is adjusted according to the ease of feeling of the uncomfortable feeling of the passenger (individual difference in sensitivity). The degree of pleasure can be effectively reduced.

(3) Since the infrared video camera for detecting the occupant's face temperature is also used to detect the occupant's head (eyeball) motion, compared to the case where a dedicated motion detection unit (or occupant motion estimation unit) is provided. Thus, the cost of the apparatus can be reduced.

(4) Infrared light was irradiated during photographing to detect the occupant's head (eyeball) movement, and no infrared light was emitted during photographing to detect the occupant's face temperature. Therefore, it is possible to improve the shooting image quality at the time of motion detection and facilitate the extraction of feature points, while suppressing measurement errors during temperature measurement.

  Correspondence between each component in the claims and each component in the best mode for carrying out the invention will be described. A display means is comprised by the image display part 109 (208,308), for example. The vehicle motion detection means is configured by, for example, the vehicle motion detection unit 101 (201, 301). The occupant information acquisition means is configured by, for example, the human body database unit 102 (202) and the occupant motion estimation unit 103 (203), or the face image photographing unit 302 and the control unit 306. The temperature detecting means is constituted by, for example, the face temperature measuring unit 106 (205), or the face image photographing unit 302 and the face temperature calculating unit 303. The display control means and the movement amount control means are configured by the control unit 108 (207, 306), for example. In addition, as long as the characteristic function of this invention is not impaired, each component is not limited to the said structure.

It is a figure which shows the outline | summary of the vehicle-mounted information provision apparatus by 1st embodiment of this invention. It is an image figure of the vehicle carrying the vehicle-mounted information provision apparatus. (a) It is a figure which shows the example of a display image by substantially infinity information. (b) It is a figure which shows the example of a display image by enjoyment information. (c) It is a figure which shows the example which carried out the picture-in-picture display of the substantially infinity information and pleasure information. It is a flowchart explaining the flow of the display process performed in a control part. (a) It is a figure explaining the pitch motion of the display apparatus by a nose dive phenomenon. (b) It is a figure which shows the display screen in which the image shift for canceling a pitch motion was performed. (c) It is a figure which shows the display screen in which the image shift for canceling a pitch motion was performed. (a) It is a figure explaining the pitch motion of a passenger | crew's head by a nose dive phenomenon. (b) It is a figure which shows the display screen in which the image shift for canceling a pitch motion was performed. It is a figure explaining the correspondence of the size of swing of vehicles, and a display control method. (a) It is a figure which shows the example of the display image giving priority to pleasure information. (b) It is a figure which shows the example of the display image which gave priority to substantially infinity information. (a) It is a figure which shows the example by which the image by pleasure information was displayed on the center of the display screen. (b) It is a figure which shows the example by which the image by pleasure information was displayed on the right side of a display screen. It is a figure which shows the outline | summary of the vehicle-mounted information provision apparatus by 2nd embodiment of this invention. It is a flowchart explaining the flow of the display process performed in a control part. It is a figure explaining the correspondence of the size of rocking of a vehicle, and image displacement gain. It is a figure which shows the outline | summary of the vehicle-mounted information provision apparatus by 3rd embodiment of this invention. It is a flowchart explaining the flow of the display process performed in a control part.

Explanation of symbols

100 (200, 300) ... In-vehicle information providing device 101 (201, 301) ... Vehicle motion detection unit 102 (202) ... Human body database unit 103 (203) ... Crew motion estimation unit 104 (204, 305) ... Information source device 105 ... near infinity information input unit 106 (205) ... facial temperature measurement unit 107 (206, 304) ... environmental condition measurement unit 108 (207, 306) ... control unit 109 (208, 308) ... image display unit 302 ... facial image Imaging unit 303 ... facial temperature calculation unit 307 ... infrared irradiation unit

Claims (6)

Display means for displaying information to be provided to the occupant as an image;
Vehicle motion detection means for detecting the movement of the vehicle;
Occupant information acquisition means for detecting or estimating the movement of the occupant;
Temperature detecting means for detecting the face temperature of the occupant;
The relative displacement in the translation direction of the image displayed on the display means is calculated based on the movement of the vehicle and the occupant, and the display position of the image displayed on the display means is canceled in real time so as to cancel the calculated displacement. Display control means to be moved;
And a movement amount control means for instructing the display control means to increase the movement amount of the displayed image when a decrease in the occupant's face temperature is detected by the temperature detection means. Information providing device. In the in-vehicle information providing apparatus according to claim 1,
The movement amount control means increases the gain of image displacement in the case of a large vehicle movement that tends to cause discomfort due to image gaze, and decreases the gain of image displacement in the case of a small vehicle movement that hardly causes discomfort. Furthermore, when the occupant's face temperature decreases due to a sense of incongruity due to the image gaze, the on-vehicle information providing apparatus further increases the gain of the image displacement. In the in-vehicle information providing apparatus according to claim 1,
The movement amount control means increases the movement amount of the image when the relative displacement calculated by the display control means is large and is likely to cause discomfort due to image gaze, and the calculated relative displacement is small and causes discomfort due to image gaze. When it is difficult to occur, the in-vehicle information providing apparatus is configured to instruct the display control unit to reduce the movement amount and further increase the movement amount according to a decrease in the passenger's face temperature. In the vehicle-mounted information provision apparatus in any one of Claims 1-3,
The in-vehicle information providing apparatus characterized in that the temperature detecting means includes an infrared camera, and detects an occupant's face temperature using an infrared image captured by the infrared camera. In the in-vehicle information providing apparatus according to claim 4,
The movement amount control means controls the occupant's facial temperature based on at least one of temperature, humidity, solar radiation, radiation state of the passenger compartment, and a temperature difference between different parts of the occupant's face detected from the infrared light image. An in-vehicle information providing apparatus characterized by not instructing to increase the amount of movement according to a decrease in the face temperature when it is determined that the decrease is not due to image gaze. In the in-vehicle information providing apparatus according to claim 4,
The occupant information acquisition means shares the infrared camera with the temperature detection means,
The occupant information acquisition means shoots a state where the occupant is irradiated with infrared light with the infrared camera,
The on-vehicle information providing apparatus characterized in that the temperature detecting means captures a state in which an occupant is not irradiated with infrared light with the infrared camera.

Images