JP2008079737A - Concentration degree evaluating apparatus and display device for vehicle equipped with the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a concentration degree evaluating apparatus which is used for evaluating concentration degree of a driver or the like on visual information on the basis of reflective eye movements deeply relating to the concentration degree, and also to provide a vehicular display device which gives appropriate display information to the driver or the like on the basis of the evaluated concentration degree. <P>SOLUTION: The apparatus and the device comprise a reflective eye movement detector 10 for detecting reflective eye movement and a concentration degree estimating means 20 for estimating concentration degree on the basis of the reflective eye movement detection result detected by the reflective eye movement detector. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a concentration degree evaluation apparatus that evaluates the degree of concentration of visual information of a driver or other operator (hereinafter referred to as a driver), and a display state of display information in a vehicle based on the evaluated degree of concentration. It is related with the display apparatus for vehicles which changes.

Conventionally, a driver's gaze point is detected, and if there is a road facility such as a stop sign in the central viewing area based on the gaze point, it is determined that the driver recognizes the road facility. A vehicle driving support device that determines that a driver's degree of recognition of the road equipment is low if the road equipment exists outside the central vision area and that alerts the driver is known (for example, patent document) 1).
JP 2005-182307 A

  However, in the configuration described in Patent Document 1 described above, it is only determined whether or not the road facility has been viewed based on the driver's gazing point, and depends on the complexity of the display contents and the individual ability difference of the driver. Since the degree of concentration on the display when the display object is recognized is not considered, the presence of a necessary display object may not be noticed.

  By the way, the visual recognition behavior during driving is a multitasking operation that requires visual recognition of a visual target in peripheral vision if there is some change in the periphery while visually recognizing a certain display. The awareness of the peripheral vision depends on how much attention is paid to the surroundings, but the ability to pay attention to the surroundings depends on how concentrated the information is viewed with the central vision, It depends on the complexity of the above-mentioned display contents and individual ability differences.

  Accordingly, an object of the present invention is to provide a concentration evaluation device that evaluates the degree of concentration on visual information based on reflective eye movements that are closely related to concentration. Furthermore, it aims at providing the display apparatus for vehicles which can give suitable display information to a driver | operator etc. based on the evaluated degree of concentration.

In order to achieve the above object, a concentration evaluation apparatus according to the first invention includes a reflective eye movement detecting means for detecting a reflective eye movement of a driver,
A degree-of-concentration estimating means for estimating the degree of concentration of the driver or the like based on the result of the detection of the reflective eye movement detected by the means for detecting the reflective eye movement;
It is characterized by comprising. Accordingly, the concentration level of the driver or the like can be appropriately evaluated based on the reflective eye movement deeply related to the concentration level.

2nd invention is the concentration evaluation apparatus based on 1st invention,
The concentration degree estimating means includes a reflective eye movement model formula setting means for setting a reflective eye movement model formula based on a result of the detection of the reflective eye movement when the driver visually recognizes the reference visual information,
When the driver visually recognizes any visual information, based on the reflective eye movement detection result detected by the reflective eye movement detection means and the reflective eye movement model formula, The degree of concentration of the driver or the like is estimated. This makes it possible to evaluate the degree of concentration with high reliability using the reflective eye movement model formula.

A third invention is the concentration evaluation apparatus according to the second invention,
The concentration degree estimating means includes the reflective eye movement detection result detected by the reflective eye movement detection means when the driver or the like visually recognizes any visual information, and the reflective eye movement model formula. The degree of concentration of the driver or the like with respect to the visual information is estimated by comparing the output value. As a result, the degree of concentration of the driver or the like can be accurately evaluated from the difference between the output value calculated by the reflective motion model formula and the actual detection value.

4th invention is the concentration evaluation apparatus which concerns on 1st-3rd invention,
The reflective eye movement detection means includes imaging means for detecting head movement and eye movement of a driver or the like, and vehicle movement state quantity detection means for detecting a vehicle movement state quantity. This makes it possible to evaluate the degree of concentration according to the actual driving of each driver, etc., taking into account individual differences in the concentration of the driver.

The vehicle display device according to a fifth aspect of the present invention includes the inventions according to the first to fourth concentration degree evaluation devices,
Display control means for changing the display state of the display information based on the degree of concentration evaluated by the concentration degree evaluation device;
It is characterized by comprising. Accordingly, it is possible to provide display information in an appropriate display state in consideration of the degree of concentration on the visual information of the driver and the like including the driving state of each driver and the like.

  According to the present invention, it is possible to appropriately evaluate the degree of concentration of a driver or the like. In addition, display information in an appropriate display state can be provided to the driver or the like based on the evaluated degree of concentration.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a functional block diagram illustrating main components of the concentration degree evaluation apparatus 60 according to the first embodiment. The concentration degree evaluation apparatus 60 according to the first embodiment includes a reflective eye movement detection unit 10 and a concentration degree estimation unit 20.

  The reflective eye movement detection means 10 is a means for detecting reflective eye movement of a driver or the like. Here, the reflective eye movement means a reflex eye movement, and in this embodiment, includes a vestibular ocular reflex (VOR) and an optokinetic reflex (OKN). Good. Vestibulo-oculomotor reflex is a compensating action that moves the eyeball so that the image on the retina is not blurred with respect to the movement of the head. The optokinetic reflection is a compensating action that moves the eyeball so that the image on the retina is not blurred with respect to the movement of the entire visual field.

  In order to detect these reflective eye movements, the reflective eye movement detection means 10 may include a head movement measuring unit 11, a visual field fluctuation measuring unit 12, and an eye movement measuring unit 13 as necessary. For these measurements, for example, an imaging means such as a camera may be used, or a magnetic sensor may be used for measuring the position and movement of the head.

  The concentration degree estimation means 20 is a means for performing calculation for estimating the degree of concentration of the driver or the like based on the reflection eye movement detection result detected by the reflection eye movement detection means 10. In the present embodiment, as will be described later, since it is recognized that there is a large correlation between the reflective eye movement and the concentration, the concentration estimation means 20 estimates the concentration based on the reflective eye movement. It is what.

  In order to execute the estimation calculation, the concentration degree estimation means 20 is based on the eye movement model parameter identification unit 30 which is a reflective eye movement model formula setting means and the reflective eye movement model formula, and reflects the reflectivity according to the input. An eye movement model output value specifying unit 40 that outputs an eye movement model output value, and a display concentration degree evaluation unit 50 that compares the reflective eye movement model output value with an actual eye movement measurement value and performs a concentration degree estimation calculation. And may include.

  The eye movement model parameter identification unit 30 is based on the result of the detection of the reflective eye movement detected by the reflective eye movement detection means 10 when the driver visually recognizes the reference visual image with a small load. This is a reflective motion model formula setting means for identifying model parameters and setting a reflective eye movement model formula.

  The eye movement model output value specifying unit 40 specifies and outputs an eye movement model output value corresponding to the input information when predetermined input information is input using the set reflective eye movement model formula. To do.

  The display concentration evaluation unit 50 compares these values based on the reflective eye movement model output value and, for example, the eye movement measurement value of the reflective eye movement detection result, and estimates and evaluates the concentration degree of the driver or the like. Do.

  These functions are classified for convenience, but may be integrally configured as an arithmetic unit such as a computer, for example, an ECU (electronic control unit) mounted on a vehicle.

  FIG. 2 is a diagram illustrating a processing flow by the concentration evaluation apparatus according to the present embodiment. Hereinafter, the concentration evaluation apparatus according to the present embodiment will be described along the processing flow of FIG. 2. However, as a premise, in the present embodiment, the concentration evaluation apparatus 60 according to the present embodiment is performed in the environment shown in FIG. 3. A description will be given based on the measurement result to which is applied.

  FIG. 3 is a diagram illustrating an experimental environment in which the concentration level is evaluated using the concentration level evaluation apparatus 60 according to the present embodiment. In FIG. 3, a vibrating chair 70 and a screen 71 for displaying a display target are provided. The vibrating chair 70 generates rolling and pitching imitating shaking during driving of the vehicle. Moreover, since it can also rotate in the horizontal direction, it is configured to generate yawing during vehicle operation.

  In addition, for example, an image as shown in FIGS. 4A and 4B is displayed on the screen 71. FIG. 4 is a diagram illustrating an image display example of the screen 71. In FIG. 4A, a reference task serving as a reference image is displayed at the top of the screen screen, and a display object to be evaluated for concentration is displayed at the bottom of the screen. In FIG. 4 (b), the display object is deleted from the lower part of the screen of FIG. 4 (a), only the reference task as reference image information is displayed, and the visual information similar to that when driving on a normal road is displayed. The screen is displayed.

  Based on the data measured in such an experimental environment, an example of the operation of the concentration evaluation apparatus according to the present embodiment will be described below. The measurement experiment in the present embodiment is performed by imitating an actual driving situation. Therefore, the contents described below can be applied to a driver or the like during actual vehicle driving. Components similar to those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

  In step 100, when the specific information is not visually recognized, that is, the reflective eye movement in the reference visual field information shown in FIG. 4B is detected using the reflective eye movement detection means 10. For example, more specifically, eye movement, head movement, and visual field variation are respectively measured by the eye movement measuring unit 13, the head movement measuring unit 11, and the visual field variation measuring unit 12 provided in the reflective eye movement detecting unit 10. taking measurement. In this embodiment, the eye movement, head position and head posture, visual field variation, etc. of the subject may be measured using, for example, a camera or a magnetic sensor. In this embodiment, eye movement, head position and head posture, and visual field variation are measured. However, if other measurement objects are preferred for detecting reflective eye movement, detection is performed using them. May be. By this step, reference reflective eye movement data in a normal driving state with a small load of display information of the subject is detected.

  In step 110, based on the detection result data detected by the reflective eye movement detection means 10, the eye movement model parameter identification unit 30, which is the reflective eye movement model expression setting means, uses the parameters of the subject's reflective eye movement model expression. To decide.

  Here, an example of the parameter identification method of the reflective eye movement model will be described with reference to FIG. FIG. 5 is a diagram showing a basic model of reflective eye movement. In FIG. 5, the eye movement parameter identification unit 30 includes a VOR (vestibular eye movement reflection) 31, an OKR (field-of-view movement reflection) 32, and a neural integrator 33.

  The VOR 31 is for constructing a vestibulo-oculomotor reflex model. Vestibulo-oculomotor reflex compensates for blurring of the field of vision due to head movement, so it is considered that the eye movement is almost the opposite of head movement, and detection of head position and posture (rotation) A model can be built based on the results. Accordingly, the VOR 31 can model the linear acceleration and rotational angular velocity of the head to the rotational angular velocity of the eyeball and reproduce a three-dimensional eye movement.

  On the other hand, OKR32 is for constructing a optokinetic reflex model. The optokinetic reflection compensates for blurring of the visual field due to the movement of the entire visual field, and can be modeled by constructing a closed loop system that guarantees a deviation between the forward visual field and the gaze point. Therefore, in FIG. 5, a closed loop is formed that applies negative feedback to the input of visual field variation from the eye movement model output from the neural integrator.

  In this way, the reflective eye movement model modeled by VOR 31 and OKR 32 is added and integrated into one model, and then the neural integrator 33 takes into account the time delay in which the movement is reflected from the head to the eyeball. Then, a reflective eye movement model formula is set. Note that the reflective eye movement model equation may be expressed by, for example, six degrees of freedom of the x, y, and z axes and rotation around the x, y, and z axes.

  On the other hand, since the eye movement measurement unit 13 of the reflective eye movement detection unit 10 also measures the actual eye movement, the reference is based on the comparison between the set reflective eye movement model formula and the actual measurement value of the eye movement. The internal parameters of the VOR 31 and the OKR 32 in the state where only the task is displayed on the screen can be specified.

  FIG. 6 is a diagram showing a comparison result between the eye movement output value in the model of FIG. 5 and the actual measurement value of the eye movement determined by the above method. The model output value (dashed line) and the actual measured value (solid line) are almost the same, and the eye movement parameter identification unit 30 of the concentration evaluation apparatus according to the present embodiment visually recognizes specific information such as in-vehicle display. It has been shown that the reflexive eye movement model in a state of not performing can be estimated with high reliability.

  As described above, in step 110 of FIG. 2, the reflective eye movement model formula is set based on the detection result of the reflective eye movement when the subject visually recognizes the reference visual information shown in FIG. 4B. Is done.

  Next, in step 120 of FIG. 2, visual information of a character string consisting of alphabets is displayed at the bottom of the screen 71 shown in FIG. 4A, and eye movements when the subject is viewing this screen, Measure and detect reflective eye movements based on head movements, visual field fluctuations, etc. Here, the subject is given a task in advance, for example, searching for any one of the characters A, B, C, D, E from the character string instead of looking at the character string of the alphabet casually, Eye movements and head movements when performing the task. Try to detect visual field variations. Thereby, the situation similar to visually recognizing a specific display during driving can be created. The detection data may be detected by the reflective eye movement detection means 10 including the head movement measurement unit 11, the visual field fluctuation measurement unit 12, and the eye movement measurement unit 13 as described in Step 100.

  In step 130, in the eye movement model output value specifying unit 40, the head movement and visual field fluctuation detection data among the reflection eye movement detection results obtained in step 120 are used as the reflection eye movement obtained in step 110. Input to the model formula and determine the model output value of the reflective eye movement model.

  In Step 140, the display concentration evaluation unit 50 compares the actual measurement data of the eye movement obtained in Step 120 with the model output value of the reflective eye movement model determined in Step 130, and compares the two output values. From the error amount, a concentration evaluation value for the display object to be evaluated is determined, and the entire processing flow is terminated.

  Here, the determination method of the concentration evaluation value of the display information performed in steps 120, 130, and 140 will be described in detail.

  FIG. 7 is a block diagram for determining the degree of concentration evaluation value, and shows a functional block configuration for determining the degree of concentration on the display information when the subject visually recognizes the display information to be evaluated. In FIG. 7, the same reference numerals are given to the same components as those described so far.

  In FIG. 7, the main components include a human unit 14, an eye movement model output value specifying unit 40, and a concentration degree evaluation value time-series data determining unit 51.

  As described above, the eye movement model output value specifying unit 40 inputs the head movement and visual field variation data measured in step 120 of FIG. 2 to the model formula set by the eye movement model parameter identification unit 30. A reflective eye movement model output value is calculated.

  Similarly, the eye movement data measured in step 120 is input to the human unit 14. The Human unit 14 includes a noise removal unit 15 therein, and the noise removal unit 15 further includes an abnormal value removal unit 16 and a high-pass filter 17. The abnormal value removing unit 16 separates abnormal values other than reflective eye movements such as blinks and saccades. Further, the high-pass filter 17 removes a drift (low frequency component) that occurs with time in a device that measures eye movement, and uses the output as a reflective eye movement measurement value.

  The Human unit 14 including the noise removing unit 15 may be provided inside the eye movement measurement unit 13 or may be provided between the eye movement measurement unit 13 and the display concentration degree evaluation unit 50. , It may be provided in the input part of the display concentration degree evaluation unit 50. Preferably, it is provided inside the eye movement measurement unit 13 and it is desirable to detect accurate eye movement as a measurement value from the beginning of the measurement.

  Next, a concentration degree evaluation value time series data determination unit 51 provided inside the display concentration degree evaluation unit 50 determines concentration degree evaluation value time series data E (t). Here, the concentration degree evaluation value time-series data determination unit 51 includes a difference calculation unit 52 and a low-pass filter 53. The difference calculation unit 52 calculates the absolute value of the difference between the model output value and the measurement value. The low-pass filter 53 removes high-frequency components other than the frequency band caused by vibrations, such as fixed eye movements and electrical noise generated from the measurement equipment and wiring. In this way, the concentration degree evaluation value time series data E (t) is determined.

  Next, an example of a method for determining an evaluation value J for display information when viewing display information to be evaluated from the concentration degree evaluation value time series data E (t) will be described with reference to FIG. To do. FIG. 8 is a diagram showing a calculation method of the concentration degree evaluation value J. FIG. 8A shows the concentration degree evaluation value time series data E (t), the horizontal axis is time (unit: sec), and the vertical axis is. It is a graph illustrated with amplitude (unit deg.).

  In FIG. 8A, when the amplitude of E (t) is large, the difference between reflective eye movements when visual information with low load is visually recognized and visual information including display information with high load is visually recognized. Is large, indicating that the concentration level is higher. Therefore, a predetermined amplitude value T may be set as a threshold value, and a region having an amplitude higher than this threshold value may be regarded as a region where the degree of concentration is increasing.

  FIG. 8B shows a method of calculating the concentration evaluation function J based on the region having a high concentration determined by the threshold value of the concentration evaluation value time series data E (t) shown in FIG. Show. As shown in FIG. 8B, the integrated value of the area where the concentration degree of the concentration degree evaluation value time series data E (t) is determined to be high is divided by the integrated value of the entire area E (t). Thus, the evaluation function J may be determined.

  In this way, the concentration degree can be estimated and calculated by the concentration degree estimating means 20, and the concentration degree can be evaluated by the concentration degree evaluation apparatus 60 according to the present embodiment.

  Next, a measurement example of the concentration evaluation value when viewing certain display information using the concentration evaluation device 60 according to the present embodiment will be described.

  FIG. 9 gives visual demands for displaying the nine alphabets shown at the bottom of the screen in FIG. 4 (a), including five of A, B, C, D, and E. Model output values and measurement results of eye movements in the horizontal and vertical directions given a mental demand to search for the presence of any of the characters, and evaluation of concentration It is the figure which showed the result of value time series data E (t).

  The result of FIG. 9 is that the model output value and the measurement value that are almost the same when the specific information is not visually recognized as shown in FIG. 6 are concentrated to visually recognize the specific information. It shows how well the reflex behavior of the eyeball has failed. Thereby, it is shown that the concentration degree with respect to the display image of the subject can be evaluated by the concentration degree evaluation apparatus according to the present embodiment.

  FIG. 10 is a diagram showing a measurement example different from FIG. FIG. 10 shows a case where a visual demand displaying four alphabets is given to a subject, and a mental demand for searching for any of the three letters A, B, and C is given to the subject. FIG. 10 shows the measurement results when the subject is given a display that requires a lower degree of concentration than in the case of FIG. When E (t) is compared with the case of FIG. 9, the amplitude is small both in the horizontal direction and in the vertical direction. Therefore, it is shown that E (t) is correspondingly reduced in a display that requires a low degree of concentration.

  FIG. 11 is a diagram illustrating an example of a result of obtaining the concentration evaluation value J described in FIG. 8 with respect to E (t) obtained in this way. As shown in FIG. 11, as the amount of visual demand and mental demand increases, that is, as the display is given to the subject to require more concentration on the display for performing the task, the concentration degree evaluation value J also increases. From this, it is possible to quantitatively represent the degree to which the reflex behavior of the subject's eyeball does not function normally due to the concentration on the display, and the concentration evaluation device 60 according to the present embodiment can display the display image. It shows that the degree of concentration can be quantitatively evaluated.

  The concentration evaluation device 60 according to the present embodiment includes, for example, vehicle state detection means provided on the vehicle such as a gyro sensor by the reflective eye movement detection means 10, and takes into consideration the driving state of the vehicle. If it is configured to accurately detect the reflective eye movement, it can be applied to a vehicle as it is. In the present embodiment, the concentration evaluation target person is described as a test subject, but in the case of being mounted on a vehicle, the driver or the like is the concentration evaluation target person. Note that this embodiment can be applied not only to the vehicle but also to other uses for performing a visual recognition action requiring concentration.

  Thus, the concentration degree evaluation apparatus 60 according to the present embodiment can quantitatively evaluate the concentration degree based on the reflective eyeball movement of the driver or the like.

  Next, an example of application to a vehicle display device using the concentration evaluation device described so far will be described.

  FIG. 12 shows a vehicle display device 80 provided with a concentration degree evaluation device 60 according to the present embodiment. The vehicle display device 80 further includes display control means 81 for controlling display information based on the concentration degree evaluation device 60 and display means 82 for giving display information to the driver or the like.

  The display control unit 81 may be configured as an ECU, or may be configured integrally with the concentration degree estimation unit 20. The display means 82 only needs to be able to display visual information to the vehicle occupant. For example, the display means 82 may be configured as a display disposed in front of the vehicle as used in a navigation system, or displayed on the windshield. It may be configured like a head-up display.

  Next, what kind of display control the display control means 81 performs in the vehicle display device 80 according to the present embodiment will be described.

  FIG. 13 is a diagram showing the relationship between the degree of concentration and the ease of recognizing the surrounding area. FIG. 13 is experimental data showing a range in which a peripheral display with a certain intensity is noticed when the degree of concentration in central vision is changed. A solid line with a high degree of concentration indicates a case where visual information with a high degree of difficulty is given to the subject, and a broken line with a low degree of concentration indicates a case where visual information with a lower degree of difficulty is given to the subject. In FIG. 13, the range of the solid line having a higher difficulty level is narrower than the range of the broken line having a lower difficulty level, and the more difficult the information to be visually recognized at the center, that is, the higher the degree of concentration on the information, It has been shown that it becomes difficult to notice.

  FIG. 14 is experimental data showing the relationship between the peripheral display intensity and the detection rate when the degree of concentration in central vision is constant. From FIG. 14, it can be seen that the peripheral display is easily noticed when the peripheral display intensity is increased. Therefore, for example, if the peripheral display intensity such as the luminance, contrast, and size of the peripheral display is increased, the driver or the like can easily notice the peripheral display.

  Therefore, when the driver visually recognizes certain in-vehicle information while driving, an image of the degree of difficulty in which the display concentration level exceeds a certain value is displayed in the vehicle in order to prevent the situation where the driver does not notice the necessary peripheral information presentation. For example, the display intensity of the peripheral display object displayed at the same time as the image may be increased for display. Specifically, for example, based on the estimation result of the concentration degree estimation means 20, the display control means 81 increases the brightness of the peripheral display object displayed on the display means 82, increases the contrast, increases the size, etc. The display state may be changed.

  As described above, the display device 80 for the vehicle according to the present embodiment can provide display information to the driver or the like in an appropriate display state based on the degree of concentration of the driver or the like. Can support driving.

  FIG. 15 is a functional block diagram of the concentration evaluation apparatus 60a according to the second embodiment. FIG. 16 is a functional block diagram of the vehicle display device 80a according to the second embodiment. In FIG. 16, only the display control means 81 and the display means 82 are added to the concentration degree evaluation apparatus 60a of FIG. 15, and the other components are the same.

  The concentration evaluation device 60 and the vehicle display device 80 using the concentration estimation device 60 according to the first embodiment estimate the concentration from the difficulty of the display information itself, and the periphery of information with high concentration, that is, information that is difficult to read. The purpose of this is to increase the display intensity of the display information displayed on the vehicle to make the driver aware of it.

  On the other hand, in the concentration evaluation device 60a and the vehicle display device 80a using the same according to the second embodiment, an apparatus capable of providing display information in accordance with the information processing ability of the driver and the like is further considered. It is intended to provide.

  In other words, the information processing ability of the driver differs depending on various factors such as age and past training experience, but as the display information in the vehicle for the driver to drive comfortably, pay attention to the display information. A display that can be visually read without being required is desirable. In order for all drivers to satisfy this condition, it is necessary to determine display contents such as the amount of display information in accordance with drivers having low information processing capabilities.

  However, if the display contents are defined in this way, a driver with high information processing ability can provide more detailed information because only a small amount of information can be displayed even though there is still sufficient margin in the degree of concentration. Can be frustrated. Therefore, in the concentration display device 60a and the vehicle display device 80a according to the second embodiment, in order to eliminate a driver's dissatisfaction with a high processing capability and to allow a driver with a low processing capability to drive comfortably, A device capable of providing in-vehicle display information in accordance with the information processing ability of each driver is provided.

  15, the difference between the concentration evaluation device 60a according to the second embodiment and the concentration evaluation device 60 according to the first embodiment in FIG. 1 is that the reflective eye movement detection means 10a has the head movement measurement unit 11, the visual field. In addition to the fluctuation measurement unit 12 and the eye movement measurement unit 13, the vehicle movement state quantity detection means 18 is further included.

  In FIG. 15, the concentration level measurement or evaluation according to the second embodiment is performed by a vehicle. By measuring or evaluating the degree of concentration each time you travel, you can measure the degree of concentration on the display of the driver while traveling, and change the display state of the display information in the vehicle according to the ability of the driver, etc. it can. Specifically, for example, as the head movement measuring unit 11 and the eye movement measuring unit 13, an imaging unit such as a camera attached to a vehicle may be used, Head posture and eye movement may be measured. Imaging means such as a camera may be divided into those used for the head movement measurement unit 11 and those used for the eye movement measurement unit 13 or may be shared. In addition, the camera may use a stereo camera in order to measure and detect the head movement and eye movement of the driver or the like in a three-dimensional manner. By detecting the head position and the head posture by the head movement measuring unit 11 provided in the vehicle as described above, the head movement data in the vehicle reference coordinate system is obtained.

  Here, in the concentration evaluation apparatus 60a according to the present embodiment, in order to evaluate the influence on the vestibular system, it is necessary to obtain the head position and head posture in the absolute coordinate system. In this case, the head position and head posture data in the absolute coordinate system can be acquired by measuring and detecting the vehicle posture by the vehicle state quantity detection means 18 attached to the vehicle and correcting the head data. The vehicle state detection means 18 may be of any type and type as long as it can detect the attitude of the vehicle, but may use a gyro sensor, for example.

  As for the visual field variation data, for example, the vehicle state angle detection unit 18 such as a gyro sensor provided in the vehicle similarly measures the vehicle turning angle, and the external field of view obtained by the vehicle turning and the visual field variation measurement unit 12 is obtained. From this relationship, visual field variation data may be acquired.

  That is, from a stereo camera or the like that is an imaging means provided in the vehicle, eye movement with the vehicle as a fixed coordinate system, that is, vehicle movement data with the driver's eye as a fixed coordinate system is obtained. Further, the vehicle state detection means 18 such as a gyro sensor obtains the movement of the vehicle with the outside world as a fixed coordinate system, that is, the movement data of the outside world with the vehicle as a fixed coordinate system. By adding these two data, it is possible to obtain the movement of the outside world with respect to the eyes of the driver or the like. The movement data of the outside world with respect to the eyes of the driver or the like thus obtained may be used as the visual field fluctuation data.

  Thus, based on the head position and head posture, eye movement, and visual field fluctuation data measured by the reflective eye movement detection means 10 including the vehicle state quantity detection means 18, the concentration degree estimation means 20 An estimation evaluation of the degree of concentration of the driver or the like may be performed. Configurations and functions of an eye movement model parameterer identification unit 30, an eye movement model output value specifying unit 40, and a display concentration degree evaluation unit 50 that are reflective eye movement model formula setting means provided in the concentration degree estimation unit 20. Since this is the same as the description in the first embodiment, the description thereof is omitted.

  FIG. 16 shows a vehicle display device 80a equipped with the concentration evaluation device 60a according to the present embodiment. As described above, the concentration evaluation device 60a only in that the concentration control device 60a according to the second embodiment includes the display control device 81 for controlling the in-vehicle display and the display device 82 constituted by a display or the like. And different. The configurations and functions of the display control means 81 and the display means 82 may be the same as those used in the vehicle display device 80 according to the first embodiment shown in FIG.

  Next, a processing flow of the concentration evaluation device 60a according to the present embodiment and the vehicle display device 80a using the same will be described with reference to FIG. FIG. 17 is a flowchart illustrating a processing flow of the vehicle display device 80a according to the present embodiment.

  In step 200, engine start and running are confirmed. This is because, for example, the engine starting and running are detected by a sensor or the like (not shown) provided in an igniter (not shown), and a confirmation signal is sent to the concentration evaluation device 60a according to the present embodiment via an engine control computer. May be sent.

  In step 210, the line-of-sight direction of the driver or the like is measured by the reflective eye movement detection means 10 such as a stereo camera, and the driver or the like confirms the scenery in front of the vehicle. That is, specific in-vehicle display information is displayed. It identifies that the user is not visually recognizing, and measures and detects the head position and head posture, eye movement, and visual field fluctuation data at that time. At that time, as described above, the vehicle motion state quantity detection means 18 such as a gyro sensor may also be used to measure or detect data in terms of an absolute coordinate system.

  In step 220, based on the data measured in step 210, the eye movement model parameter identification unit 30 determines the parameters of the reflective eye movement model of the driver or the like, and determines the reflective eye movement model of the driver during driving. create.

  Even if the driver or the like is viewing the scenery in front of the vehicle, there is a possibility that the driver may be temporarily focused on an event due to a sudden pedestrian jumping out or a signal change. The processing of 210 and step 220 may be executed a plurality of times to determine the parameters, and the reflective eye movement model formula may be determined.

  In step 230, the reflective eye movement detection means 10, such as an in-vehicle stereo camera, measures the line-of-sight direction of the driver while traveling, and visually recognizes certain in-vehicle display information, for example, information A based on the measurement result. Identify that. When the driver or the like is viewing the in-vehicle display information A, for example, as shown in FIG. 4A, the in-vehicle display information A is displayed below the normal landscape. Since the downward line of sight is included, it may be specified that the driver or the like is viewing the information A based on this.

  In step 240, the head position and head posture of the driver or the like, the eye movement, and the visual field fluctuation data when the information A that is the evaluation target of the degree of concentration is visually recognized are reflected by the vehicle motion state quantity detection means 18. It is detected by the sexual eye movement detection means 10.

  In step 250, based on the head movement and visual field fluctuation data obtained in step 240, the eye movement model output value specifying unit 40 determines the parameters in step 220, and creates an eye movement model using the reflective eye movement model formula created. Determine the output value.

  In step 260, the display concentration evaluation unit 50 compares the eye movement actual measurement data obtained in step 240 with the eye movement model output value determined in step 25, and the driver or the like visually recognizes the information A. The concentration degree evaluation value J is determined.

  Note that the concentration degree evaluation value J is obtained by calculating the concentration degree evaluation value time-series data E (t) and determining a threshold value in the same manner as described in FIGS. 7 and 8 of the first embodiment. It may be determined by dividing the function integral value above the threshold by the total integral value.

  The processing flow up to step 260 is the processing flow of the concentration degree evaluation device 60a according to the second embodiment, but the following processing is further performed in the vehicle display device 80a according to the present embodiment.

  In step 270, based on the concentration evaluation value J obtained in step 260, the amount of in-vehicle display information displayed on the display means 82 and the display intensity of the display object displayed in the vicinity thereof are determined, and the entire processing flow is performed. Exit. The display information amount and the peripheral display object strength may be determined by the concentration degree estimating means 20, and the display control means 81 may change the display contents of the display means 82 based on the determination. In 81, both determination and display content change of the display means 82 may be performed.

  Here, an example of determining the display information amount and the display intensity of the surrounding display objects will be described with reference to FIG. FIG. 18 is a diagram illustrating an application example of the display information amount and the peripheral display object strength with respect to the evaluation value J.

  In FIG. 18, for example, if the concentration evaluation value J is large and larger than a predetermined reference value J1, the driver or the like needs a large concentration with respect to the display information A, and so much. There is no room for visually recognizing information. In such a case, for example, the amount of display information may be reduced and the display may only display a large directional arrow. For example, the intensity of the peripheral display object is 1.5 * L0 if the standard value of luminance is L0, 1.5 * S0 if the standard value of size is S0, and 1 if the standard value of contrast is C0. .5 * C0, each may be displayed as being strengthened as 1.5 times the standard value. By doing in this way, a driver | operator who needs a large concentration for visual recognition of the display thing in a vehicle can perform a simple necessary minimum display, and can reduce visual burden. In addition, by displaying the surrounding information with high display intensity, it is possible to easily notice when the surrounding display information appears during driving.

  Further, when the concentration evaluation value J is at the middle level 2, which is larger than the predetermined reference value J2 and smaller than J1, the information amount is increased from the level 1, and it becomes an intersection shape or a mark in addition to the direction arrow. The presence of a building such as a gas station or a convenience store may be displayed. Regarding the intensity of the peripheral display object, the intensity may be set lower than level 1 for each of luminance, size, and contrast, and may be set to standard values L0, S0, and C0.

  Furthermore, for example, a driver who has a low concentration level evaluation value J at level 3 and does not require a high level of concentration with respect to the information A has a high information processing capability and is too burdensome to view the in-vehicle display information. It means that you are not feeling. In that case, the information regarding the driving lane in which the vehicle is traveling may be displayed in more detail, or the display intensity may be displayed with reduced display intensity so that the peripheral display is not troublesome.

  Thus, according to the display device 80a for a vehicle according to the present embodiment, display information that supports comfortable driving that is appropriate for each driver or the like according to individual differences in information processing ability of the driver or the like. Can be provided.

  In other words, for a driver with low information processing ability that requires excessive concentration for certain information, the display is kept to the minimum necessary so as not to impair driving comfort, and even when the display is viewed. It is possible to easily notice the appearance of the peripheral display. In addition, it can provide more detailed information to drivers with high information processing capabilities that require little concentration for certain information, which can be useful for driving policies, and the display strength of the surroundings is also high. The troublesomeness caused by being too strong can be eliminated.

  FIG. 19 is a functional block diagram of the vehicular display device 80b including the concentration evaluation device 60b according to the third embodiment. The functional block diagram of the vehicular display device 80b according to the third embodiment is different from FIG. 16 according to the vehicular display device according to the second embodiment only in that the concentration degree estimation unit 20 further includes a database 54. Since other components are the same as those described in the second embodiment, the description thereof is omitted.

  The database 54 is for storing and storing the concentration evaluation value J calculated by the display concentration evaluation unit 50. Here, based on the accumulated data of the concentration evaluation value J stored and stored during driving, a change in the state of concentration of the driver during driving is determined.

  In other words, in addition to the individual differences described in the second embodiment, the information processing capability of the driver and the like is caused by intra-individual variation due to fatigue, drowsiness, physical condition change, etc. due to long-time driving, even for the same driver or the like. Therefore, even information that can be processed with sufficient margin at the beginning of operation may not be processed. In addition, the road environment may change from the state of being monotonous on a monotonous road, the activation level may increase, and the information processing ability may increase.

  Accordingly, the vehicular display device 80b according to the third embodiment pays attention to the intra-personal variation of the information processing capability of the driver during driving, and the in-vehicle information corresponding to the information processing capability of the driver or the like at an arbitrary time during driving. The purpose is to provide the display amount and adjust the display intensity of the peripheral display.

  The database 54 may be provided at any position as long as it can perform the function of storing and storing the concentration evaluation value J. For example, the database 54 may be provided at the display control unit 81.

  Next, a processing flow of the vehicle display device 80b according to the present embodiment will be described with reference to FIG. FIG. 20 is a process flow diagram of the vehicular display device 80b equipped with the concentration evaluation device 60b according to the present embodiment.

  In FIG. 20, steps 300 to 360 are the same processing flow as steps 200 to 260 in the processing flow diagram of FIG. Since the specific contents are the same as those described in the second embodiment, the description thereof is omitted.

  In step 370, the concentration degree evaluation value J obtained in step 360 is stored and stored in the database 54.

  In step 380, it is determined whether or not the concentration evaluation value J for the past N database matches the current display level. That is, based on the data of the concentration evaluation value J for the past N times, it is determined whether or not the currently appropriate display level has changed and does not cause a discrepancy with the display level displayed so far.

  Here, an example of the determination method in step 380 will be described in detail with reference to FIG. FIG. 21 shows an example of the database 54 that stores the concentration degree evaluation value J. For example, it is assumed that the concentration evaluation value J for the past N times is stored in the database 54. For example, the concentration evaluation value J for N times may be stored for each display information A, B, and C. Here, referring to past data for N times, if the predetermined number or more does not match the current display level, that is, the display level that has been considered appropriate so far, the information display amount that matches the latest evaluation value J The peripheral display intensity may be changed.

For example, in the case where the current display level is level 2 in FIG. 18, if four or more of the concentration evaluation value data J _{A0 to} J _A4 for the past five display information A satisfy J> J1, the driver The display concentration level evaluation unit 50 determines that the information processing capability of the display has decreased, and the display level is reduced to 1.

  In this example, from the viewpoint of eliminating the influence of the abnormal value, the determination is made using the past N times. However, if the abnormal value is small, the determination may be made once, or the abnormal value may be determined. If there are many, the number of times N may be set to a large number.

  Returning to FIG. 20, in step 380, when the predetermined number of the past N number of concentration evaluation values J does not match the current display level, the process proceeds to step 390.

  In step 390, based on the latest concentration degree evaluation value J, the display control means 81 changes and controls the information amount of the in-vehicle display to be displayed and the display intensity of the display object displayed in the vicinity thereof, and the processing flow is performed. finish.

  On the other hand, when the past N evaluation values J coincide with the current display level in step 380, the display level is appropriate. Therefore, the process proceeds to step 391. The concentration evaluation value for the display information is measured, and the determination of the degree of coincidence with the current display level is repeated.

  By repeating such a processing flow, it is possible to track the in-person variation in the information processing capability of the driver, and to provide an in-vehicle display that always matches the driver's condition.

  The preferred embodiments of the present invention have been described in detail above. However, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the present invention. Can be added.

It is a functional block diagram which shows the main components of the concentration evaluation apparatus 60 which concerns on Example 1. FIG. It is the figure which showed the processing flow by the concentration evaluation apparatus which concerns on Example 1. FIG. It is a figure which shows the experimental environment which evaluated the degree of concentration using the concentration degree evaluation apparatus 60 which concerns on Example 1. FIG. FIG. 4 is a diagram illustrating an example of an image given to a subject. FIG. 4A is an image example in which a display object that is a target for evaluating the degree of concentration is also displayed. FIG. 4B is an image example in which only the reference task that is the reference image information is displayed. It is the figure which showed the basic model of reflective eyeball movement. It is a figure which shows the comparison result of the measured value of an eye movement output value in a reflective eye movement model, and an actual eye movement. It is a functional block diagram which shows the structure for determining the degree of concentration to display information. It is a figure which shows the calculation method of the degree-of-concentration evaluation value J. FIG. 8A is a graph illustrating the concentration degree evaluation value time series data E (t). FIG. 8B is a diagram showing a method for calculating the concentration degree evaluation function J. 4 is a measurement example of the concentration degree evaluation apparatus according to the first embodiment. 9 is a measurement example of the concentration evaluation apparatus according to the first embodiment, which is different from FIG. It is the figure which showed the example of the result of having calculated | required the concentration evaluation value J. 3 is a functional block diagram of a vehicle display device 80 according to Embodiment 1. FIG. It is the figure which showed the relational characteristic of the degree of concentration and the ease of noticing the surroundings This is experimental data showing the relationship between the peripheral display intensity and the detection rate. It is a functional block diagram of the concentration evaluation apparatus 60a which concerns on Example 2. FIG. FIG. 10 is a functional block diagram of a vehicle display device 80a according to a second embodiment. It is a flowchart which shows the processing flow of the display apparatus for vehicles 80a which concerns on Example 2. FIG. It is the figure which showed the example of application of the display information amount with respect to the evaluation value J, and a surrounding display thing intensity | strength. FIG. 10 is a functional block diagram of a vehicle display device 80b including a concentration evaluation device 60b according to a third embodiment. It is a processing flow figure of the display apparatus for vehicles 80b which concerns on Example 3. FIG. It is an example of the database 54 which stores the concentration evaluation value J.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Reflective eye movement detection apparatus 11 Head movement measurement part 12 Visual field fluctuation measurement part 13 Eye movement measurement part 14 Human part 15 Noise removal part 16 Abnormal value removal part 17 High pass filter 20 Concentration estimation means 30 Eye movement model parameter identification part (Reflective eye movement model formula setting means)
31 VOR
32 OKR
DESCRIPTION OF SYMBOLS 33 Neural integrator 40 Eye movement model output value specific | specification part 50 Display concentration evaluation part 51 Concentration evaluation value time series data determination part 52 Difference detection part 53 Low pass filter 54 Database 60, 60a, 60b Concentration evaluation apparatus 70 Chair 71 Screen 80, 80a, 80b Display device for vehicle 81 Display control means 82 Display means

Claims (5)

Reflective eye movement detecting means for detecting reflective eye movement;
A degree-of-concentration estimating means for estimating the degree of concentration based on the result of the detection of the reflective eye movement detected by the means for detecting the reflective eye movement;
A concentration evaluation apparatus characterized by comprising: The concentration degree estimating means includes a reflective eye movement model formula setting means for setting a reflective eye movement model formula based on the result of the detection of the reflective eye movement when visually recognizing the reference visual information,
When visually recognizing arbitrary visual information, the degree of concentration with respect to the visual information is estimated based on the reflective eye movement detection result detected by the reflective eye movement detection means and the reflective eye movement model formula. The concentration evaluation apparatus according to claim 1, wherein:   The concentration estimation means compares the reflective eye movement detection result detected by the reflective eye movement detection means with the output value of the reflective eye movement model formula when arbitrary visual information is visually recognized. The concentration degree evaluation apparatus according to claim 2, wherein a concentration degree with respect to the visual information is estimated.   4. The reflective eye movement detection means includes imaging means for detecting head movement and eye movement, and vehicle movement state quantity detection means for detecting vehicle movement state quantity. The concentration evaluation apparatus as described in one. The concentration evaluation apparatus according to any one of claims 1 to 4,
Display control means for changing the display state of the display information based on the degree of concentration evaluated by the concentration degree evaluation device;
And a vehicle display device.

Images