JP2017204167A - Notification control device, notification control method, and notification control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a notification control device capable of allowing a driver to intuitively comprehend required angle of the face for safety check.SOLUTION: A notification control device 200 includes: an input section 201 that receives a piece of information representing an angle of a driver's face of a vehicle; and a control unit 202 that, when the speed of the vehicle is a predetermined value or less and when the vehicle is located at a position where the driver should confirm the right and left safety, controls a predetermined unit to notify the driver of a relationship based on the angle of the face between a first range that the driver should confirm the right and left safety and a second range that the driver has confirmed the right and left safety.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a notification control device, a notification control method, and a notification control program for controlling notification of information provided to a passenger such as a vehicle.

  In recent years, in order to prevent a traffic accident, a technique for evaluating the safety confirmation behavior of a vehicle driver at an intersection has been developed. For example, Patent Document 1 detects a driver's face angle (hereinafter referred to as a face angle) at the time of safety confirmation (also referred to as left / right confirmation), and the face angle is obtained based on the shape of an intersection or the like. A technique for evaluating a driver's safety confirmation status according to whether or not an angle to be confirmed by a driver (hereinafter referred to as an essential confirmation angle) has been disclosed.

JP 2006-227905 A

  However, in the technique of Patent Document 1, the driver can understand whether or not the face angle at the time of safety confirmation exceeds the essential confirmation angle, but the face angle at the time of safety confirmation is relative to the essential confirmation angle. I cannot intuitively understand how much it is.

  An object of the present invention is to provide a notification control device, a notification control method, and a notification control program that can make a driver intuitively understand how much the face angle at the time of safety confirmation is relative to the essential confirmation angle. Is to provide.

  The notification control device according to an aspect of the present invention includes an input unit that receives information indicating a face angle of a driver of a vehicle, a vehicle speed of the vehicle is equal to or lower than a predetermined value, and the vehicle is Based on the face angle, when the driver is in a position where left / right confirmation is to be performed, the relationship between the first range in which the driver should perform left / right confirmation and the second range in which the driver has confirmed left / right is determined. A control unit that controls a predetermined device so as to notify the driver.

  A notification control method according to an aspect of the present invention includes a step of receiving information indicating a face angle of a driver of a vehicle, a vehicle speed of the vehicle being a predetermined value or less, and the vehicle is When the vehicle is in a position to be checked, the driver is notified of the relationship between the range where the driver should check left and right and the range where the driver checked left and right based on the angle of the face. And a step of controlling a predetermined device.

  The notification control program according to one aspect of the present invention includes a process of receiving information indicating a face angle of a driver of a vehicle, a vehicle speed of the vehicle being a predetermined value or less, and the vehicle being When the vehicle is in a position to be checked, the driver is notified of the relationship between the range where the driver should check left and right and the range where the driver checked left and right based on the angle of the face. And causing the computer to execute processing for controlling the predetermined device.

  According to the present invention, the driver can intuitively understand how much the face angle at the time of safety confirmation is relative to the essential confirmation angle.

The block diagram which shows the structural example of the display system which concerns on embodiment of this invention The figure which shows an example of the essential confirmation angle which concerns on embodiment of this invention The figure which shows an example of the right-and-left confirmation angle which concerns on embodiment of this invention The flowchart which shows an example of the whole operation | movement of the display control apparatus which concerns on embodiment of this invention. The flowchart which shows an example (operation example 1) of the image display control operation | movement which concerns on embodiment of this invention. The figure which shows the example of a transition of the image by the image display control operation (operation example 1) which concerns on embodiment of this invention. The flowchart which shows the image display control operation (operation example 2) which concerns on embodiment of this invention. The figure which shows the example of a transition of the image by the image display control operation (operation example 2) which concerns on embodiment of this invention. The figure which shows the example of a transition of the image by the image display control operation (operation example 2) which concerns on the modification of this invention. The figure which shows the example of a transition of the image by the image display control operation (operation example 2) which concerns on the modification of this invention. The block diagram which shows the hardware structural example of the display control apparatus which concerns on embodiment of this invention

  Embodiments of the present invention will be described below with reference to the drawings.

  First, a configuration example of the display system 10 according to the present embodiment will be described. FIG. 1 is a block diagram illustrating a configuration example of the display system 10.

  The display system 10 is used in a moving body such as a vehicle, for example. That is, the display system 10 may be an in-vehicle device or a device brought into a vehicle. In addition, although this Embodiment demonstrates the display system 10 as what was applied to the vehicle, it is not limited to a vehicle. In this embodiment, an example in which the user is a vehicle occupant, particularly a vehicle driver, is described, but the present invention is not limited thereto.

  As shown in FIG. 1, a display system 10 includes a vehicle speed detection device 100, a vehicle position detection device 101, a storage device 102, a determination device 103, a display control device 200 (an example of a notification control device), an image generation device 300, and a display medium. 400. A configuration including the image generation device 300 in the display control device 200 may be referred to as a “projection device”. Further, the projection apparatus may include a display medium 400.

  Hereinafter, each component of the display system 10 illustrated in FIG. 1 will be described.

  The vehicle speed detection device 100 detects the vehicle speed and outputs information indicating the vehicle speed (hereinafter referred to as vehicle speed information) to the display control device 200. Examples of the vehicle speed detection device 100 include a vehicle speed sensor.

  The vehicle position detection device 101 detects the position of the vehicle (current position), and outputs information indicating the position of the vehicle (hereinafter referred to as vehicle position information) to the display control device 200. Examples of the vehicle position detection device 101 include a GPS (Global Positioning System).

  The storage device 102 holds map information and outputs the map information to the display control device 200. An example of the storage device 102 is a car navigation system. The map information includes, for example, position information of roads (including intersections and T-junctions), as well as position information of buildings, traffic lights, road signs, and curve mirrors.

  The determination device 103 determines a face angle based on an image of a driver's face (hereinafter referred to as a face image) taken by a camera (not shown) mounted in the vehicle interior, and information indicating the angle (hereinafter referred to as a face image). (Referred to as face angle information) is output to the display control apparatus 200.

  In addition, since the face angle determination technique in the determination apparatus 103 is a well-known technique, the detailed description is abbreviate | omitted. The data used for determination by the determination device 103 is not limited to a face image, and may be, for example, a measurement value such as a gyro sensor attached to the driver's head. A specific example of the face angle determined by the determination device 103 will be described later with reference to FIG.

  Next, the display control apparatus 200 will be described. As illustrated in FIG. 1, the display control device 200 includes an input unit 201 and a control unit 202.

  The input unit 201 receives vehicle speed information, vehicle position information, map information, and face angle information, and outputs those information to the control unit 202.

  The input unit 201 is a connector, an input terminal, or the like when the display control device 200 is configured by hardware, and is connected to the vehicle speed detection device 100, the vehicle position detection device 101, the storage device 102, and the determination device 103. It may be a wired connection or a wireless connection. When the function of the display control device 200 is realized by a program on software, the input unit 201 is replaced with input processing.

  The control unit 202 executes various processing operations described below based on the vehicle speed information, the vehicle position information, the map information, and the face angle information received from the input unit 201.

  For example, the control unit 202 determines whether the vehicle speed is equal to or lower than a predetermined value (for example, about 10 km / h) and the vehicle is in the left / right confirmation position based on the vehicle speed information, the vehicle position information, and the map information.

  The left / right confirmation position is a position of the vehicle where the driver should perform left and right safety confirmation (hereinafter referred to as right / left confirmation) before the vehicle enters an intersection or a T-junction. Examples of the left / right confirmation position include a position in front of an uninteresting intersection where no traffic light is installed, a position in front of a T-junction where a temporary stop is required, and the like.

  The left / right confirmation position may be determined in advance in the map information (information indicating the left / right confirmation position may be included in the map information), and the intersection, T-junction, It may be set based on the position of a temporary stop road sign, a curve mirror, or the like.

  And the control part 202 performs image display control, when a vehicle speed is below a predetermined value and a vehicle exists in a left-right confirmation position. The image display control is a process of controlling the image generation apparatus 300 so as to generate a predetermined image representing a figure of a predetermined shape when displayed on the display medium 400 based on the face angle information. At the time of this processing, the control unit 202 includes, for example, information necessary for drawing a graphic (for example, the shape, color, luminance, etc. of the graphic), and control information for instructing the image generation apparatus 300 to generate an image. Output to the generation device 300.

  Although the operation of the control unit 202 has been briefly described above, the detailed operation will be described later with reference to the flowcharts of FIGS.

  The image generation device 300 generates a predetermined image representing a figure of a predetermined shape based on the control information from the control unit 202, and outputs the predetermined image to the display medium 400 (display). Thereby, the figure of a predetermined shape is displayed on the display medium 400 and visually recognized by the driver. This display example will be described later with reference to FIGS. It should be noted that the “predetermined image” and the “predetermined shape” are substantially the same, depending on conditions such as the degree of curvature of the display medium 400. The predetermined image is generated by the image generation apparatus 300, and a graphic having a predetermined shape is displayed on the display medium 400.

  For example, when the display system 10 is a head-up display (HUD) system, the image generation apparatus 300 directly projects the generated image onto the display medium 400 by a projection function. Thereby, the driver | operator can visually recognize a figure as a virtual image. At this time, the graphic may be projected onto the display medium 400 so as to be superimposed on the driver's field of view. In addition, since the principle by which a figure projected on the display medium 400 is visually recognized by a passenger as a virtual image is a known technique, a description thereof is omitted. The HUD may be, for example, a vehicle windshield, a transparent glass surface provided separately, a transparent plastic surface (combiner), or the like. The windshield may be, for example, a windshield, a vehicle side glass, or a rear glass.

  The display medium 400 is, for example, an LCD (Liquid Crystal Display), an HMD (Head-Mounted Display or Helmet-Mounted Display), a glasses-type display (Smart Glasses), a navigation display, a meter display, other dedicated displays, or a carry-in A general-purpose display such as a smartphone or a tablet may be used.

  For example, when the display system 10 is a transmissive display system, the image generation apparatus 300 outputs the generated image data to a transmissive display that transmits light (an example of the display medium 400). Thereby, the driver | operator can visually recognize a figure in a transmissive display simultaneously with visually recognizing a background. In addition, since the principle that the image data input to the transmissive display is displayed as a graphic is a known technique, the description thereof is omitted.

  The transmissive display may be, for example, a transmissive organic EL display or a transparent display using glass that emits light when irradiated with light of a specific wavelength.

  Note that the display medium 400 may be a hologram. When a hologram is used, a part of the parallel light flux group that is guided by total internal reflection of the light guide plate by using the light guide plate that totally reflects and guides the parallel light flux group that satisfies the total internal reflection condition of the light guide plate. It is also possible to make the occupant visually recognize the virtual image by injecting. In the method using the light guide plate, the image data is not directly projected as in the projector, but for the sake of convenience of explanation, it will be described by the definition of projection as in the projector method.

  In the present embodiment, the case where the image generation apparatus 300 generates a predetermined image has been described as an example. However, the predetermined image may be generated by the control unit 202 or another component not shown.

  The configuration example of the display system 10 has been described above.

  Next, an example of the essential confirmation angle used in the above-described image display control will be described with reference to FIG. The essential confirmation angle is an angle that expresses a range (an example of the first range) in which the driver should check left and right (in other words, an angle at which the driver should rotate the head when checking left and right). .

  FIG. 2 is a diagram illustrating an example of the essential confirmation angle. FIG. 2 shows a state in which the driver's head is viewed from directly above.

  In FIG. 2, the face of the driver 301 faces the forward direction of the vehicle (in other words, the vehicle length direction). The face direction of the driver 301 at this time is defined as a reference direction 302, and the angle of the direction is defined as 0 degree.

  The face angle of the driver 301 is the axis in the vertical direction of the body of the driver 301 when the head of the driver 301 is viewed from directly above (for example, the head when the body of the driver 301 is viewed from directly above). The head of the driver 301 is in the left direction (counterclockwise direction, see arrow L in the figure) or right direction, centering on the virtual axis extending through the center C of the section and extending in the vertical direction of the body of the driver 301 This is the angle of rotation in the clockwise direction (see arrow R in the figure).

  In FIG. 2, the required confirmation left angle 303 is an angle at which the driver 301 should rotate his / her head to the left when checking left / right, and the required check right angle 304 is the driver's 301 head when checking left / right. This is the angle at which the part should be rotated to the right. The essential confirmation left angle 303 and the essential confirmation right angle 304 together are the essential confirmation angle 305.

  The essential confirmation angle 305 may be a predetermined fixed value or a value calculated based on a shape such as an intersection or a T-junction.

  Heretofore, an example of the essential confirmation angle has been described.

  Next, an example of the left / right confirmation angle used in the above-described image display control will be described with reference to FIG. The left / right confirmation angle is an angle that represents the range (an example of the second range) in which the driver actually performed the left / right confirmation (in other words, the driver actually turns the head to the left / right during the left / right confirmation) Angle). The left / right confirmation angle is determined by the determination device 103.

  FIG. 3 is a diagram illustrating an example of the left / right confirmation angle. FIG. 3 shows a state in which the driver's head is viewed from directly above.

  In FIG. 3A, when the driver rotates his / her head in the right direction (see arrow R) with reference to the reference direction 302, the direction of the face of the driver 301 (hereinafter referred to as “face direction”) is a direction 401. . At this time, the determination apparatus 103 determines the angle 402 formed by the reference direction 302 and the direction 401 as the left / right confirmation angle. Then, the determination apparatus 103 outputs information indicating the angle 402 and the direction 401 to the display control apparatus 200 as face angle information.

  In FIG. 3B, when the driver rotates his / her head in the left direction (see arrow L) with reference to the reference direction 302, the face direction of the driver 301 is a direction 403. At this time, the determination apparatus 103 determines the angle 404 formed by the reference direction 302 and the direction 403 as the left / right confirmation angle. Then, the determination apparatus 103 outputs information indicating the angle 403 and the direction 401 to the display control apparatus 200 as face angle information.

  Further, for example, when the driver rotates the head facing the direction 401 shown in FIG. 3A to the direction 403 shown in FIG. 3B, the determination device 103 sets the total value of the angle 402 and the angle 404 to the left and right. It is determined as a confirmation angle. At this time, the determination apparatus 103 outputs information indicating the angle 402, the angle 404, and the direction 403 to the display control apparatus 200 as face angle information.

  Further, for example, when the driver rotates the head facing the direction 403 shown in FIG. 3B to the direction 401 shown in FIG. 3A, the determination device 103 sets the total value of the angle 404 and the angle 402 to the left and right. It is determined as a confirmation angle. At this time, the determination apparatus 103 outputs information indicating the angle 402, the angle 404, and the direction 401 to the display control apparatus 200 as face angle information.

  In the present embodiment, the case where the left / right confirmation angle is the rotation angle of the head of the driver 301 is taken as an example. However, the present invention is not limited to this, and is calculated based on the line-of-sight direction of the driver 301, for example. Any value that indicates that left-right confirmation has been performed may be used.

  Heretofore, an example of the left / right confirmation angle has been described.

  Next, an example of the overall operation of the display control apparatus 200 will be described with reference to FIG. FIG. 4 is a flowchart showing an example of the overall operation of the display control apparatus 200.

  First, the input unit 201 receives vehicle speed information, vehicle position information, and map information (step S201). Then, the input unit 201 outputs vehicle speed information, vehicle position information, and map information to the control unit 202.

  Next, the control unit 202 determines whether or not the vehicle speed indicated in the vehicle speed information is equal to or less than a predetermined value (for example, about 10 km / h) (step S202). In other words, the control unit 202 determines whether or not the vehicle is traveling slowly or stopped.

  If the vehicle speed is not less than or equal to the predetermined value (step S202: NO), that is, if the vehicle is not driving slowly or stopping, the flow returns to step S201.

  On the other hand, when the vehicle speed is equal to or lower than the predetermined value (step S202: YES), the control unit 202 determines whether or not the vehicle is at the left / right confirmation position based on the vehicle position information and the map information (step S203). As described above, the left / right confirmation position may be determined in advance in the map information, or based on the position of an intersection, a T-junction, a temporary stop road sign, a curve mirror, or the like indicated by the control unit 202 in the map information. It may be set.

  If the vehicle is not in the left / right confirmation position (step S203: NO), the flow returns to step S201.

  On the other hand, when the vehicle is in the left / right confirmation position (step S203: YES), the control unit 202 executes image display control. An example of image display control will be described later with reference to FIGS.

  Note that steps S201 to S204 described above are repeated.

  Heretofore, an example of the overall operation of the display control apparatus 200 has been described.

  Next, an example of the image display control operation of the display control device 200 (the processing operation of step S204 in FIG. 4) will be described. In this embodiment, two examples of the image display control operation (hereinafter referred to as operation example 1 and operation example 2) will be described.

(Operation example 1)
The operation example 1 will be described with reference to FIGS. 5 and 6. FIG. 5 is a flowchart showing the first operation example. FIG. 6 is a diagram illustrating an example of transition of images displayed in the operation example 1.

  First, the control unit 202 controls the image generation apparatus 300 to generate a right / left confirmation prompting image (step S501). The left / right confirmation prompting image is an image representing a message or the like that prompts the driver to perform left / right confirmation.

  Here, a display example of the right and left confirmation prompting image is shown in FIG. 6A. 6A shows, for example, that the face of the driver 301 indicates the forward direction of the vehicle (the reference direction 302 shown in FIGS. 2 and 3) when the vehicle is stopped in front of the intersection (left / right confirmation position). It shows the state of facing.

  As shown in FIG. 6A, the left / right confirmation prompting image 600 is displayed superimposed on the foreground of the vehicle and is visually recognized by the driver 301. Accordingly, the driver 301 can recognize that the vehicle has reached the left / right confirmation position (in other words, the timing at which the left / right confirmation should be performed).

  Hereinafter, the description returns to the flow of FIG.

  Next, the input unit 201 receives face angle information from the determination apparatus 103 and outputs the face angle information to the control unit 202 (step S502). Then, the control unit 202 receives face angle information from the input unit 201. Here, when the control unit 202 receives face angle information for the first time after the start of image display control, the control unit 202 stores a left / right confirmation angle (hereinafter referred to as an initial value) indicated by the face angle information.

  Next, the control unit 202 determines whether or not the left / right confirmation angle exceeds a predetermined essential confirmation angle (step S503). For example, when the control unit 202 receives face angle information for the first time after the start of image display control, the left / right confirmation angle used in the determination processing in step S503 is an initial value. Further, for example, when the face angle information is newly received after the control unit 202 receives the face angle information indicating the initial value, the left / right confirmation angle used in the determination processing in step S503 is the newly received face angle information. The value shown in.

  Here, the determination process in step S503 will be specifically described with reference to FIGS.

  For example, in the face angle information, when the left / right confirmation angle indicates the angle 402 and the face orientation indicates the direction 401 (that is, when the driver rotates the head from the reference direction 302 to the direction 401), the control unit 202 It is determined whether or not the angle 402 exceeds the required confirmation right angle 304.

  For example, when the left / right confirmation angle indicates the angle 404 and the face direction indicates the direction 403 in the face angle information (that is, when the driver rotates the head from the reference direction 302 to the direction 403), the control unit 202 Determines whether the angle 404 exceeds the required confirmation left angle 303.

  Further, for example, in the face angle information, when the left / right confirmation angle indicates the angle 402 and the angle 404 and the face direction indicates the direction 403 (that is, when the driver rotates the head from the direction 401 to the direction 403), the control is performed. The unit 202 determines whether or not the angle 404 exceeds the essential confirmation left angle 303.

  Also, for example, in the face angle information, when the left / right confirmation angle indicates the angle 402 and the angle 404 and the face direction indicates the direction 401 (that is, when the driver rotates the head from the direction 403 to the direction 401), the control is performed. The unit 202 determines whether or not the angle 402 exceeds the essential confirmation right angle 304.

  The determination process in step S503 has been described above.

  Hereinafter, the description returns to the flow of FIG.

  When the left / right confirmation angle exceeds the essential confirmation angle (step S503: YES), the flow proceeds to step S506. The process of step 506 will be described later.

  On the other hand, when the left / right confirmation angle does not exceed the essential confirmation angle (step S503: NO), the control unit 202 controls the image generation apparatus 300 to generate the direction image and the confirmed range image (step S504). The direction image is an image representing the driver's face direction (which may be referred to as a face angle). The confirmed range image is an image representing a range where the driver has actually confirmed left and right.

  Here, specific examples of the direction image and the confirmed range image will be described with reference to FIG. 6B. In this example, it is assumed that the driver 301 shown in FIG. 6A rotates his / her head in the right direction and the left / right confirmation angle does not exceed the essential confirmation angle 305 shown in FIG. The left / right confirmation angle here is an initial value.

  FIG. 6B shows a state where, for example, the driver 301 rotates the head (see FIG. 6A) facing the reference direction 302 to the right in order to confirm the right direction from the reference direction 302. In FIG. 6B, for convenience of explanation, the reference direction 302 is illustrated by a broken line, but the reference direction 302 is not visually recognized by the driver 301.

  The direction image 601a shown in FIG. 6B represents the face direction of the driver 301 when the head has finished rotating in the right direction as a straight line. This straight line indicates a direction shifted to the right by the left / right confirmation angle (initial value) with respect to the reference direction 302.

  The direction image 601a is displayed superimposed on the foreground of the vehicle and is visually recognized by the driver 301. As a result, the driver 301 can intuitively recognize (understand) the current orientation of his face.

  A confirmed range image 602a shown in FIG. 6B represents a range in which the driver 301 has confirmed right and left in a sector shape. The central angle of the sector is calculated by the control unit 202 based on the initial value.

  The confirmed range image 602a is displayed superimposed on the foreground of the vehicle and is visually recognized by the driver 301. Accordingly, the driver 301 can intuitively recognize (understand) the range in which he / she has confirmed.

  Hereinafter, the description returns to the flow of FIG.

  Next, the control unit 202 determines whether or not to continue the image display control operation (step S505).

  For example, when the driver has finished checking the range in which the left / right confirmation is to be performed (for example, when the left / right confirmation angle exceeds the required confirmation angle and confirmation completion images 603 and 604 described later are displayed), the driver displays an image. When a control operation end operation is performed, or when the vehicle moves forward at a normal vehicle speed (a vehicle speed higher than the vehicle speed during slow driving), the control unit 202 determines that the image display control operation is not continued ( Step S505: NO), the image display control operation is terminated.

  On the other hand, for example, when the driver has not completed the confirmation of the range in which the left / right confirmation is to be performed, the above-described termination operation has not been performed, and the vehicle is stopped or driving slowly, the control unit 202 displays the image It is determined that the display control operation is continued (step S505: YES). In this case, the flow returns to step S502.

  Here, each example when the flow returns from step S505 to step S502 and the control unit 202 receives new face angle information (face angle information after the face angle information indicating the initial value) will be described below.

  First, an example in which the driver 301 shown in FIG. 6B rotates his / her head to the left and the left / right confirmation angle does not exceed the required confirmation angle 305 shown in FIG. 2 will be described with reference to FIG. 6C. To do. The left-right confirmation angle here is, for example, an angle formed by the direction indicated by the direction image 601a in FIG. 6B and the direction indicated by the face angle information newly received by the control unit 202 (direction indicated by a direction image 601b described later). Suppose that FIG. 6C shows an example of an image displayed when the head of the driver 301 has finished rotating leftward from the state shown in FIG. 6B.

  In this case, the control unit 202 determines that the left / right confirmation angle indicated in the newly received face angle information does not exceed the essential confirmation angle (step S503: NO), and performs the process of step S504.

  In the process of step S504, the control unit 202 controls the image generation apparatus 300 to generate, for example, the direction image 601b and the confirmed range image 602b illustrated in FIG. 6C.

  A directional image 601b shown in FIG. 6C represents the face direction of the driver 301 (the direction indicated by the newly received face angle information) when the rotation of the head in the left direction is completed with a straight line.

  A confirmed range image 602b shown in FIG. 6C represents a range in which the driver 301 has confirmed right and left in a sector shape. The central angle of the sector is calculated by the control unit 202 based on the left / right confirmation angle indicated in the face angle information newly received by the control unit 202.

  Both the direction image 601b and the confirmed range image 602b are displayed superimposed on the foreground of the vehicle and viewed by the driver 301.

  Next, with reference to FIG. 6D, an example in which the driver 301 shown in FIG. 6B rotates his / her head in the left direction and the left / right confirmation angle exceeds the required confirmation angle 305 shown in FIG. explain. The left / right confirmation angle here is, for example, an angle formed by the direction indicated by the direction image 601a in FIG. 6B and the direction indicated by the newly received face angle information (direction indicated by a direction image 601c described later). . FIG. 6D shows a display example of an image when the head of the driver 301 has finished rotating leftward from the state of FIG. 6B, for example.

  In this case, the control unit 202 determines that the left / right confirmation angle indicated in the newly received face angle information exceeds the essential confirmation angle (step S503: YES), and completes the direction image, the confirmed range image, and the confirmation completion. The image generation apparatus 300 is controlled to generate an image (step S506). Further, the confirmation completion image is an image indicating that the left / right confirmation is completed with a graphic or a message having a predetermined shape.

  In the process of step S506, the control unit 202 controls the image generation apparatus 300 to generate, for example, the direction image 601c, the confirmed range image 602c, and the confirmation completion image 603 illustrated in FIG. 6D.

  A direction image 601c shown in FIG. 6D represents the face direction of the driver 301 (the direction indicated in the newly received face angle information) when the rotation of the head in the left direction is completed by a straight line.

  A confirmed range image 602c shown in FIG. 6D represents a range in which the driver 301 has confirmed right and left in a sector shape. The central angle of the sector is calculated by the control unit 202 based on the left / right confirmation angle indicated in the face angle information newly received by the control unit 202.

  The confirmation completion image 603 illustrated in FIG. 6D represents the upper limit position of the essential confirmation angle (for example, the essential confirmation left angle 303 illustrated in FIG. 2) in a star shape.

  The direction image 601c, the confirmed range image 602c, and the confirmation completion image 603 are superimposed on the foreground of the vehicle and displayed by the driver 301. Accordingly, the driver can intuitively recognize (understand) that the confirmation of the range to be confirmed in the left direction from the reference direction 302 is completed.

  Next, an example in which the driver 301 shown in FIG. 6D rotates his / her head in the right direction and the left / right confirmation angle exceeds the required confirmation angle 305 shown in FIG. 2 will be described with reference to FIG. 6E. explain. The left / right confirmation angle here is, for example, an angle formed by the direction indicated by the direction image 601c in FIG. 6D and the direction indicated by the newly received face angle information (direction indicated by a direction image 601d described later). . FIG. 6E shows a display example of an image when the head of the driver 301 has finished rotating in the right direction from the state of FIG. 6D, for example.

  In this case, it is determined that the left / right confirmation angle indicated in the newly received face angle information exceeds the essential confirmation angle (step S503: YES), and a direction image, a confirmed range image, and a confirmation completion image are generated. The image generation apparatus 300 is controlled (step S506).

  In the process of step S506, the control unit 202 controls the image generation apparatus 300 to generate, for example, the direction image 601d, the confirmed range image 602d, and the confirmation completion image 604 illustrated in FIG. 6E.

  The direction image 601d shown in FIG. 6E represents the face direction of the driver 301 (the direction indicated by the newly received face angle information) when the rotation of the head in the right direction is completed by a straight line.

  A confirmed range image 602d shown in FIG. 6E represents a range in which the driver 301 has confirmed right and left in a sector shape. The central angle of the sector is calculated by the control unit 202 based on the left / right confirmation angle indicated in the face angle information newly received by the control unit 202.

  The confirmation completion image 604 illustrated in FIG. 6E represents the upper limit position of the essential confirmation angle (for example, the essential confirmation right angle 304 illustrated in FIG. 2) in a star shape.

  The direction image 601d, the confirmed range image 602d, and the confirmation completion image 604 are superimposed on the foreground of the vehicle and displayed by the driver 301. Accordingly, the driver can intuitively recognize (understand) that the confirmation of the range to be confirmed in the right direction from the reference direction 302 is completed.

  As described above, each sector shown in FIGS. 6B to 6E represents a range in which the driver has confirmed left and right (corresponding to the second range), and the control unit 202 changes the face angle of the driver. Accordingly, the image generating apparatus 300 is controlled so that the area of the figure increases.

  In the above description, the case where the direction images 601a to 601d are displayed is taken as an example, but the generation and display of the direction images 601a to 601d are not essential.

  As described above, according to the operation example 1, the range in which the driver has confirmed left and right is displayed in a fan shape, and the confirmation completion image is displayed when the left and right confirmation angle exceeds the required confirmation angle. The driver can intuitively understand how much the left / right confirmation angle is relative to the essential confirmation angle (whether it is deficient or sufficient).

(Operation example 2)
In the operation example 1 described above, the case where the area of the fan shape (confirmed range image) increases according to the angle when the driver performs the left / right confirmation is described as an example. An example will be described in which a range to be confirmed is displayed in advance in a fan shape, and the area of the fan shape is reduced according to an angle when the driver performs left and right confirmation.

  The operation example 2 will be described with reference to FIGS. FIG. 7 is a flowchart showing the second operation example. FIG. 8 is a diagram illustrating a transition example of an image displayed according to the operation example 2.

  First, the control unit 202 controls the image generation device 300 so as to generate an essential confirmation range image (step S701). The essential confirmation range image is an image that represents a range in which the driver should perform left and right confirmation.

  Here, a display example of the essential confirmation range image is shown in FIG. 8A. Further, FIG. 8A shows that, for example, when the vehicle is stopped in front of the intersection (left-right confirmation position), the face of the driver 301 indicates the forward direction of the vehicle (the reference direction 302 shown in FIGS. 2 and 3). It shows the state of facing.

  As shown in FIG. 8A, the essential confirmation range image 605 is represented by a sector. The central angle of the sector is the essential confirmation angle 305 shown in FIG. The essential confirmation range image 605 is displayed superimposed on the foreground of the vehicle and is visually recognized by the driver 301. Accordingly, the driver 301 can recognize that the vehicle has reached the left / right confirmation position (in other words, the timing at which the left / right confirmation should be performed).

  When the essential confirmation range image 605 is superimposed on the foreground of the vehicle, it is preferable to display the essential confirmation range image 605 and the range where the left and right confirmations in the foreground of the vehicle should be matched as much as possible. As a result, the driver can recognize a range in which left and right confirmation should be performed.

  Hereinafter, the description returns to the flow of FIG.

  Next, the input unit 201 receives face angle information from the determination apparatus 103 and outputs the face angle information to the control unit 202 (step S702). Then, the control unit 202 receives face angle information from the input unit 201. Here, when the control unit 202 receives face angle information for the first time after the start of image display control, the control unit 202 stores a left / right confirmation angle (hereinafter referred to as an initial value) indicated by the face angle information.

  Next, the control unit 202 determines whether or not the left / right confirmation angle exceeds a predetermined essential confirmation angle (step S703). When the control unit 202 receives face angle information for the first time after the start of image display control, the left / right confirmation angle here is an initial value. Moreover, the essential confirmation angle here is the essential confirmation angle 305 shown in FIG. 2, for example.

  If the left / right confirmation angle exceeds the essential confirmation angle (step S703: YES), the flow proceeds to step S706. The process of step 706 will be described later.

  On the other hand, when the left / right confirmation angle does not exceed the essential confirmation angle (step S703: NO), the control unit 202 controls the image generation apparatus 300 to generate a direction image and update the essential confirmation range image (step). S704). Updating the required confirmation range image means deleting the confirmed range image from the currently displayed required confirmation range image (in other words, the required confirmation range image obtained by removing the confirmed range image from the displayed required confirmation range image. To generate).

  Here, a specific example of the essential confirmation range image will be described with reference to FIG. 8B. In this example, it is assumed that the driver 301 shown in FIG. 8A rotates his / her head in the right direction and the left / right confirmation angle does not exceed the essential confirmation angle 305 shown in FIG. The left / right confirmation angle here is an initial value.

  FIG. 8B shows a state where, for example, the driver 301 rotates the head (see FIG. 8A) facing the reference direction 302 in the right direction in order to confirm the right direction from the reference direction 302. In FIG. 8B, for convenience of explanation, the reference direction 302 is illustrated by a broken line, but the reference direction 302 is not visually recognized by the driver 301. Further, the direction image 601a shown in FIG. 8B is the same as that described in the first operation example, and thus description thereof is omitted here.

  The essential confirmation range image 605a shown in FIG. 8B is obtained by removing the range (for example, the confirmed range image 602a shown in FIG. 6B) in which the driver 301 has confirmed left and right from the essential confirmation range image 605 shown in FIG. 8A. Shape. In other words, the essential confirmation range image 605a represents a range in which the driver 301 has not yet confirmed left and right in a sector shape.

  The essential confirmation range image 605a is displayed superimposed on the foreground of the vehicle and is visually recognized by the driver 301. As a result, the driver 301 can intuitively recognize (understand) the range in which he / she has confirmed and the range in which he / she should check.

  Hereinafter, the description returns to the flow of FIG.

  Next, the control unit 202 determines whether or not to continue the image display control operation (step S705). The processing in step S705 is the same as step S505 in FIG. 5 described in the operation example 1, and thus description thereof is omitted here.

  Here, each example when the flow returns from step S705 to step S702 and the control unit 202 receives new face angle information (face angle information after the face angle information indicating the initial value) will be described below.

  First, an example in which the driver 301 shown in FIG. 8B rotates his / her head to the left and the left / right confirmation angle does not exceed the required confirmation angle 305 shown in FIG. 2 will be described with reference to FIG. 8C. To do. The left / right confirmation angle here is, for example, an angle formed by the direction indicated by the direction image 601a in FIG. 8B and the direction indicated by the newly received face angle information (direction indicated by the direction image 601b). FIG. 8C shows an example of display of an image when the head of the driver 301 has finished rotating leftward from the state of FIG. 8B.

  In this case, the control unit 202 determines that the left / right confirmation angle indicated in the newly received face angle information does not exceed the essential confirmation angle (step S703: NO), and performs the process of step S704.

  In the process of step S704, for example, the control unit 202 generates the direction image 601b illustrated in FIG. 8C and updates the shape of the essential confirmation range image 605a illustrated in FIG. 8B (in other words, the essential image illustrated in FIG. 8C). The image generation apparatus 300 is controlled to generate a confirmation range image 605b. Since the direction image 601b is the same as that described in the operation example 1, description thereof is omitted here.

  The essential confirmation range image 605b shown in FIG. 8C is obtained by removing the range (for example, the confirmed range image 602b shown in FIG. 6C) in which the driver 301 has confirmed left and right from the essential confirmation range image 605 shown in FIG. 8A. Shape. In other words, the essential confirmation range image 605a represents a range in which the driver 301 has not yet confirmed left and right in a sector shape.

  Both the direction image 601b and the essential confirmation range image 605b are displayed superimposed on the foreground of the vehicle and visually recognized by the driver 301.

  Next, an example in which the driver 301 shown in FIG. 8B rotates his / her head to the left and the left / right confirmation angle exceeds the required confirmation angle 305 shown in FIG. 2 will be described with reference to FIG. 8D. explain. The left / right confirmation angle here is, for example, an angle formed by the direction indicated by the direction image 601a in FIG. 8B and the direction indicated by the newly received face angle information (direction indicated by the direction image 601c). FIG. 8D shows a display example of an image when the head of the driver 301 has finished rotating leftward from the state of FIG. 8B.

  In this case, the control unit 202 determines that the left / right confirmation angle indicated in the newly received face angle information exceeds the essential confirmation angle (step S703: YES), generates a direction image and a confirmation completion image, and is essential. The image generating apparatus 300 is controlled to update the shape of the confirmation range image (step S706).

  In the process of step S706, the control unit 202 generates, for example, the direction image 601c and the confirmation completion image 603 illustrated in FIG. 8D, and updates the shape of the essential confirmation range image 605a illustrated in FIG. The image generation apparatus 300 is controlled to generate the essential confirmation range image 605c shown in 8D. Since the direction image 601c and the confirmation completion image 603 are the same as those described in the first operation example, description thereof is omitted here.

  The essential confirmation range image 605c shown in FIG. 8D is obtained by removing the range (for example, the confirmed range image 602b shown in FIG. 6C) in which the driver 301 has confirmed left and right from the essential confirmation range image 605 shown in FIG. 8A. Shape. In other words, the essential confirmation range image 605c represents a range in which the driver 301 has not yet confirmed left and right in a sector shape.

  The direction image 601c, the essential confirmation range image 605c, and the confirmation completion image 603 are displayed superimposed on the foreground of the vehicle and visually recognized by the driver 301. Accordingly, the driver can intuitively recognize (understand) that the confirmation of the range to be confirmed in the left direction from the reference direction 302 is completed.

  Next, an example in which the driver 301 shown in FIG. 8D rotates his / her head in the right direction and the left / right confirmation angle exceeds the essential confirmation angle 305 shown in FIG. 2 will be described with reference to FIG. 8E. explain. FIG. 8E shows a display example of an image when the head of the driver 301 has finished rotating in the right direction from the state of FIG. 8D.

  In this case, the control unit 202 determines that the left / right confirmation angle indicated in the newly received face angle information exceeds the essential confirmation angle (step S703: YES), generates a direction image and a confirmation completion image, and is essential. The image generating apparatus 300 is controlled to update the shape of the confirmation range image (step S706). Here, the left / right confirmation angle is, for example, an angle formed by the direction indicated by the direction image 601c in FIG. 8D and the direction indicated by the newly received face angle information (direction indicated by the direction image 601d).

  In the process of step S706, for example, the control unit 202 generates the direction image 601d and the confirmation completion image 604 illustrated in FIG. 8E and updates the shape of the essential confirmation range image 605c illustrated in FIG. The image generation apparatus 300 is controlled to delete the essential confirmation range image 605c shown in 8D. Since the direction image 601d and the confirmation completion image 604 are the same as those described in the first operation example, description thereof is omitted here.

  As shown in FIG. 8E, the range (for example, the confirmed range image 602d shown in FIG. 6E) confirmed by the driver 301 in the left-right direction is deleted. That is, all the essential confirmation range images 605 shown in FIG. 8A are erased and are not displayed.

  The direction image 601d and the confirmation completion image 604 are displayed superimposed on the foreground of the vehicle and are visually recognized by the driver 301. Accordingly, the driver can intuitively recognize (understand) that the confirmation of the range to be confirmed in the right direction from the reference direction 302 is completed.

  As described above, each of the sectors shown in FIGS. 8B to 8D represents a range in which the driver should check the left and right (corresponding to the first range), and the control unit 202 changes the driver's face angle. In response, the image generating apparatus 300 is controlled so that the area of the figure is reduced.

  In the above description, the case where the confirmation completion images 603 and 604 are displayed is taken as an example, but the generation and display of the confirmation completion images 603 and 604 are not essential. Since all the essential confirmation range images 605 shown in FIG. 8A have been deleted, the driver intuitively recognizes (understands) that the confirmation of the range to be confirmed in the left-right direction with reference to the reference direction 302 has been completed. it can.

  In the above description, the case where the direction images 601a to 601d are displayed is taken as an example, but the generation and display of the direction images 601a to 601d are not essential.

  As described above, according to the operation example 2, the range in which the driver should check the left and right is displayed in a fan shape in advance, and when the left and right confirmation angle exceeds the essential confirmation angle, all the fan shapes are erased. The person can intuitively understand how much the left / right confirmation angle is relative to the essential confirmation angle (whether it is insufficient or sufficient).

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications can be made. Hereinafter, modified examples will be described.

(Modification 1)
In the above embodiment, the direction image has a straight line shape, the confirmed range image and the required confirmation range image are fan-shaped, and the confirmation completion image is a star shape. The shape is not limited to them. The confirmation completion image may be a character string (message).

(Modification 2)
In the above embodiment, when the speed of change in the driver's face angle does not exceed a predetermined value (when the change in angle is gradual), the control unit 202 considers that the left / right confirmation by the driver has been executed, and the image Control (for example, direction image generation control, confirmed range image generation control, essential confirmation range image update control, and confirmation completion image generation control) may be executed on the generation apparatus 300. In other words, when the speed of change in the driver's face angle exceeds a predetermined value (when the change in angle is abrupt), the control unit 202 regards that the left / right confirmation by the driver has not been executed, and generates an image. Various controls for the apparatus 300 are not executed. As a result, the driver can be urged to carefully check the left and right (to slowly rotate the head).

(Modification 3)
In the operation example 2 of the above-described embodiment, when the vehicle advances from the left / right confirmation position without completing the left / right confirmation, the control unit 202 increases the essential confirmation angle and generates an essential confirmation range image corresponding to the angle. The image generation apparatus 300 may be controlled to do so. This example will be described below with reference to FIG.

  FIG. 9A shows a state where the vehicle has reached the left-right confirmation position and the sector-shaped essential confirmation range image 605d is displayed. It is assumed that the central angle of the sector is a first required confirmation angle (initial setting value) determined in advance.

  At this time, it is assumed that the vehicle moves forward from the left / right confirmation position by slowing down and approaches the intersection. In that case, for example, the control unit 202 sets a second essential confirmation angle larger than the first essential confirmation angle, and as shown in FIG. 9B, the control unit 202 has a sector shape having the second essential confirmation angle as a central angle. The image generation apparatus 300 may be controlled to generate the essential confirmation range image 605e. Accordingly, the driver can recognize that the range in which the left / right confirmation is to be performed has been expanded.

  In this modification, the case of the operation example 2 has been described as an example, but the control operation described above may be applied in the operation example 1.

(Modification 4)
The essential confirmation range image 605 of FIG. 8A described in the operation example 2 of the above embodiment is displayed even when the image display control operation is not performed, and may be used for another purpose. This example will be described below with reference to FIG.

  FIG. 10A shows a display example of the essential confirmation range image 605 when the image display control operation (operation example 2) is not performed. Moreover, FIG. 10A has shown the state where the pedestrian 900 (an example of a target object) exists in the left front of a vehicle.

  In FIG. 10A, the essential confirmation range image 605 represents the periphery of the vehicle (the positional relationship between the vehicle and the object) that is the detection range of the object detection sensor (not shown) in a fan shape.

  When the pedestrian 900 around the vehicle is detected by the object detection sensor, the control unit 202, as shown in FIG. 10A, in the essential confirmation range image 605, the range 607 corresponding to the direction in which the pedestrian 900 exists. (An example of the third range) is displayed in a different display mode (for example, color, luminance, etc.) from the range 608 (a range corresponding to a direction other than the direction in which the pedestrian 900 exists. An example of the fourth range). The image generation apparatus 300 is controlled so as to represent it. As a result, the driver can intuitively recognize the direction in which the pedestrian 900 exists.

  Thereafter, when the vehicle speed becomes equal to or less than a predetermined value and the vehicle reaches the left / right confirmation position, an image display control operation (operation example 2) is performed. FIG. 10B shows a display example of the essential confirmation range image 605 at this time.

  In FIG. 10B, the essential confirmation range image 605 represents a range in which the driver should perform left and right confirmation in a sector shape. At this time, in order to notify the driver that the meaning represented by the sector has changed from the case of FIG. 10A, a left-right confirmation reminder image 600 is displayed as shown in FIG. 10B, and the white line of the road is three-dimensionally displayed. Is displayed. Note that the notification method is not limited to this, and the fan-shaped display mode (for example, color, luminance, inclination, etc.) shown in FIG. 10B may be changed to a display mode different from the fan-shaped display shown in FIG. 10A. .

(Modification 5)
In the above embodiment, the control unit 202 determines the confirmed range image (for example, 602a to 602d illustrated in FIG. 6) or the essential confirmed range image (for example, FIG. 8) according to the speed of change of the driver's face angle. The image generating apparatus 300 may be controlled so as to change the color density or transmittance of the colors 605a to 605c) shown in FIG.

  For example, when the speed of change in the driver's face angle is less than a predetermined value (when the change in angle is gentle), the control unit 202 considers that the driver is slowly checking the left and right carefully, and the image It may be controlled to darken the color of the image or to reduce the transmittance of the image. As a result, the driver can recognize that the left / right confirmation has been performed carefully.

  Instead of the change speed of the face angle, the shade or transmittance of the color of the image may be changed according to the number of times the driver has confirmed left and right. For example, when the number of times the left / right confirmation is performed is equal to or greater than a predetermined value (for example, when the driver repeatedly confirms the same range), the control unit 202 considers that the driver slowly and carefully confirms the left / right The image may be controlled so that the color of the image is dark or the transmittance of the image is low. Note that the number of times the left / right confirmation is performed is counted as one when, for example, the driver rotates the head facing the predetermined direction to the right or left and stops the rotation.

(Modification 6)
Even in the range in which the left / right confirmation is performed once, the situation changes with the passage of time. For example, if it takes time to depart, it is necessary to confirm the left / right again. Therefore, in the above embodiment, the control unit 202 determines the confirmed range image (for example, 602a to 602d shown in FIG. 6) or the essential confirmation range image according to the elapsed time after the start of the left / right confirmation or after the end of the left / right confirmation. For example, the image generation apparatus 300 may be controlled so as to change the color density or transmittance of the colors (for example, 605a to 605c illustrated in FIG. 8).

  For example, when the elapsed time after the start of the left / right check or after the end of the left / right check exceeds a predetermined value (for example, when the left / right check is performed slowly or when the left / right check is completed, the control unit 202 moves forward. If not, it may be necessary to perform left and right confirmation, and control may be performed so that the color of the image is lightened or the transmittance of the image is high. As a result, the driver can recognize that it is necessary to confirm right and left again.

(Modification 7)
In the embodiment described above, the control unit 202 may control the image generation device 300 so as to generate an image indicating the position of an object existing around the vehicle in addition to the various images described above. An object here is a curve mirror, a traffic light, a road sign, another vehicle, a pedestrian, etc., for example. The positions of other vehicles and pedestrians are detected by, for example, an object detection sensor (not shown). Further, the position of the curve mirror, the traffic light, and the road sign may be a position indicated by the map information or a position detected by an object detection sensor (not shown).

  Thus, the driver can intuitively recognize the position of the target existing around the vehicle.

(Modification 8)
In the embodiment described above, the control unit 202 may control a travel control device (not shown) that controls the travel of the vehicle in addition to the control for the image generation device 300.

  For example, until the driver finishes checking the range in which the driver should check left and right (until the left and right check angles exceed both the required check left angle 303 and the required check right angle 304 shown in FIG. 2). Control information that prohibits starting of the vehicle may be output to the travel control device. Based on the control information, the travel control device performs control so as not to start the vehicle (for example, not to accept an accelerator pedal operation).

  Then, for example, when the driver has confirmed the range in which the driver should check the left and right (the left and right confirmation angles exceed both the required confirmation left angle 303 and the required confirmation right angle 304 shown in FIG. Control information for permitting the start of the vehicle may be output to the travel control device. Based on the control information, the travel control device performs control so that the vehicle starts (for example, accepts an operation of an accelerator pedal).

(Modification 9)
In the above embodiment, the case where an image is used as information for notifying the driver of the relationship between the range where the driver should check left and right and the range where the driver checked left and right is described as an example. However, it is not limited to images. Hereinafter, an example of a notification method other than the notification method using an image will be described.

  For example, by using a plurality of LEDs (Light Emitting Diodes) arranged side by side on a dashboard, the relationship between the range where the driver should check left and right and the range where the driver checked left and right is shown. May be notified. For example, the control unit 202 may control each LED or a control device (not shown) of each LED so that each LED is turned on or off according to the left / right confirmation angle.

  In addition, for example, even if the driver outputs a relationship between the range in which the driver should check left and right and the range in which the driver has checked left and right using sound output from a speaker mounted on the vehicle, Good. For example, when the left / right confirmation angle exceeds the required confirmation angle, the control unit 202 controls the speaker or the sound output from the speaker so as to output a sound indicating that the left / right confirmation is completed (not shown). May be controlled. Further, for example, the control unit 202 may perform control such that the pitch, timbre, size, and the like of the sound change according to the change in the left / right confirmation angle.

  Further, for example, the driver may be notified of the relationship between the range in which the driver should check the left and right and the range in which the driver has checked the left and right using the vibration of the handle or the seat. For example, the control unit 202 controls the handle or the seat or a control device (not shown) for controlling the vibration so that the handle or the seat vibrates when the left and right confirmation angle exceeds the essential confirmation angle. Also good. Further, for example, the control unit 202 may perform control such that the magnitude of vibration, the position of vibration, and the like change according to the change in the left / right confirmation angle.

  Although an example of each notification method has been described, the above-described notification methods (image, LED, sound, vibration) may be arbitrarily combined.

  In the above, each modification of embodiment was demonstrated. Each of the above-described modifications may be implemented in combination as appropriate.

  In addition, the function of each part of the display system 10 and the display control apparatus 200 in the above-described embodiments and modifications may be realized by a computer program.

  FIG. 11 is a diagram illustrating a hardware configuration of a computer that realizes the functions of the respective units by a program. The computer 1000 includes an input device 1001 such as an input button and a touch pad, an output device 1002 such as a display and a speaker, a CPU (Central Processing Unit) 1003, a ROM (Read Only Memory) 1004, and a RAM (Random Access Memory) 1005. . The computer 1000 is a reading device that reads information from a recording medium such as a hard disk device, a storage device 1006 such as an SSD (Solid State Drive), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. 1007 includes a transmission / reception device 1008 that performs communication via a network. Each unit shown in FIG. 11 is connected by a bus 1009.

  Then, the reading device 1007 reads the program from a recording medium on which a program for realizing the functions of the above-described units is recorded, and stores the program in the storage device 1006. Alternatively, the transmission / reception device 1008 communicates with a server device connected to the network, and causes the storage device 1006 to store a program for realizing the function of each unit downloaded from the server device.

  Then, the CPU 1003 copies the program stored in the storage device 1006 to the RAM 1005, and sequentially reads and executes the instructions included in the program from the RAM 1005, thereby realizing the functions of the above-described units. Further, when executing the program, the RAM 1005 or the storage device 1006 stores information obtained by various processes described in each embodiment, and is used as appropriate.

  Each functional block used in the description of each of the above embodiments may be realized as an LSI (Large Scale Integration) that is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them. The name used here is LSI, but it may also be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

  Further, the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI, or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

  Further, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. Biotechnology can be applied.

  The present invention is useful for a notification control device, a notification control method, and a notification control program for controlling notification of information provided to a passenger such as a vehicle.

DESCRIPTION OF SYMBOLS 10 Display system 100 Vehicle speed detection apparatus 101 Vehicle position detection apparatus 102 Memory | storage device 103 Judgment apparatus 200 Display control apparatus 201 Input part 202 Control part 300 Image generation apparatus 400 Display medium 1000 Computer 1001 Input apparatus 1002 Output apparatus 1003 CPU
1004 ROM
1005 RAM
1006 Storage device 1007 Reading device 1008 Transmission / reception device 1009 Bus

Claims (12)

An input unit for receiving information indicating the angle of the face of the driver of the vehicle;
When the vehicle speed is less than or equal to a predetermined value and the vehicle is in a position where the driver should check left and right, the driver should check left and right based on the angle of the face. And a control unit that controls the predetermined device so as to notify the driver of the relationship between the range and the second range in which the driver has confirmed left and right;
A notification control device. The controller is
When the speed of change of the face angle is equal to or less than a predetermined value, control for the predetermined device is executed.
The notification control apparatus according to claim 1. The predetermined device is an image generation device that generates a predetermined image based on an instruction from the control unit and outputs the image to a display medium.
The controller is
Controlling the image generation device to generate an image representing a relationship between the first range and the second range as a graphic having a predetermined shape;
The notification control apparatus according to claim 1 or 2. The controller is
Controlling the image generation device so that an area representing the second range in the graphic increases in accordance with a change in the angle of the face;
The notification control apparatus according to claim 3. The controller is
Controlling the image generating apparatus so that an area representing the first range in the graphic is reduced according to a change in the angle of the face;
The notification control apparatus according to claim 3. The controller is
Controlling the image generating device to generate an image representing an angle of the face;
The notification control apparatus according to any one of claims 3 to 5. The controller is
When the second range exceeds the first range due to a change in the angle of the face, the image generation device is controlled to generate an image indicating that the left / right confirmation is completed;
The notification control apparatus according to any one of claims 3 to 6. The controller is
According to the speed of change of the angle of the face, the number of times that the driver performs left-right confirmation, or the elapsed time after the start or end of left-right confirmation by the driver, the first range and the second Controlling the image generation device so that at least one display mode of the range of
The notification control apparatus according to any one of claims 3 to 7. The controller is
When a predetermined object existing around the vehicle is detected, a third range corresponding to the direction in which the object exists and a fourth range corresponding to a direction other than the direction in which the object exists And controlling the image generation device to generate an image that represents the figure of the predetermined shape,
When the vehicle speed of the vehicle is equal to or lower than a predetermined value and the vehicle is in a position where the driver should check left and right, the graphic display mode representing the third range and the fourth range is displayed. Controlling the image generation device to represent the first range and the second range by changing,
The notification control apparatus according to any one of claims 3 to 8. The controller is
Until the second range exceeds the first range due to the change in the angle of the face, the control information for prohibiting the start of the vehicle is output to the travel control device for controlling the travel of the vehicle,
When the second range exceeds the first range due to a change in the angle of the face, control information for permitting the vehicle to start is output to the travel control device.
The notification control apparatus according to any one of claims 1 to 9. Receiving information indicating the angle of the face of the driver of the vehicle;
When the vehicle speed of the vehicle is equal to or lower than a predetermined value and the vehicle is in a position where the driver should check left and right, a range where the driver should check left and right based on the angle of the face; Controlling the predetermined device so as to notify the driver of the relationship with the range in which the driver has confirmed left and right;
A notification control method. Receiving information indicating the angle of the face of the driver of the vehicle;
When the vehicle speed of the vehicle is equal to or lower than a predetermined value and the vehicle is in a position where the driver should check left and right, a range where the driver should check left and right based on the angle of the face; A process for controlling a predetermined device so as to notify the driver of the relationship with the range in which the driver has confirmed left and right;
Notification control program that causes a computer to execute.

Images