JP2008137521A - Alarm display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an alarm display device for urging safe operation by giving a suitable alarm display to an operator of a moving body such as a vehicle when the operator does not recognize the alarm display. <P>SOLUTION: A display part for an operation seat is provided at a position visible from the operator seated on the operation seat of the moving body and a display part for another seat is provided at a position visible from an occupant seated on at least one seat except the operation seat. An alarm display control part displays an alarm at least on the display part for the operation seat based on a status of the moving body. An alarm confirming/determining part determines that the operator has confirmed the alarm displayed on the display part for the operation seat. When the alarm confirming/determining part determines that the operator has not confirmed the alarm displayed on the display part for the operation seat, the alarm display control part displays the alarm on the display part for another seat. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a warning display device, and more particularly to a warning display device mounted on a moving body such as a vehicle.

  Conventionally, various warnings are notified to a driver who sits in a driver's seat of a vehicle and drives the vehicle according to the vehicle status. For example, when the fuel level of the vehicle is low, a fuel level warning lamp provided in an indicator panel that can be visually recognized by the driver is turned on to warn the driver that the fuel level is low. The

  Further, a vehicle warning display system that displays a warning to the driver according to the distance between the current position of the vehicle and the position of the warning target is also disclosed (see, for example, Patent Document 1). The vehicle warning display system determines whether the driver has viewed the warning display from the operating status of the brakes and turn signals of the mounted vehicle, and hides the warning display when it is determined that the driver has viewed it. I have to.

In addition, a vehicle information presentation device that displays alarm information to the driver according to the surrounding situation of the vehicle is also disclosed (for example, see Patent Document 2). The vehicle information presentation device detects the driver's line of sight to determine whether or not the driver has recognized the warning information, and controls the brightness to display the warning information when it is determined that the driver has recognized the warning information. .
JP 2006-76456 A JP 2005-135037 A

  However, warning lights and warning indications notified to the driver are difficult to see from passengers other than the driver. Therefore, it is generally difficult for an occupant other than the driver to notice that a warning lamp is turned on or a warning is displayed. On the other hand, when an elderly person or a driving beginner is a driver, the driver may not be aware that the warning light has been turned on, and may continue driving while ignoring the warning.

  Further, in the vehicle warning display system disclosed in Patent Document 1, it is determined whether or not a warning is recognized from the operation state of the driver with respect to the vehicle. If the warning is recognized, the warning is not displayed, but the driver displays a warning. If you are not aware of this, you can continue driving without ignoring the warning. The vehicle information presentation device disclosed in Patent Document 2 also detects the driver's line of sight and determines whether or not the driver has recognized the alarm information, but the driver does not notice the warning. In such a case, the driving will be continued while ignoring the warning.

  Therefore, an object of the present invention is to provide a warning display device that promotes safe driving by giving an appropriate warning display when a driver of a moving body such as a vehicle does not notice the warning display.

In order to achieve the above object, the present invention has the following features.
1st invention is a warning display apparatus which displays a warning with respect to the operator and other passenger | crew of a moving body, respectively. The warning display device includes a cockpit display unit, a passenger seat display unit, a warning display control unit, and a warning confirmation determination unit. The cockpit display unit is provided at a position that can be viewed by a pilot seated in the cockpit of the moving body. The other-seat display unit is provided at a position that is visible to a passenger who is seated in at least one seat excluding the cockpit of the moving body. The warning display control unit displays a warning on at least the cockpit display unit based on the state of the moving body. The warning confirmation determination unit determines that the driver has confirmed the warning displayed on the cockpit display unit. When the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, the warning display control unit displays the warning on the other seat display unit.

  The warning display device is provided on a moving body such as an automobile, an airplane, or a ship. The pilot is a concept including a driver of a car, a pilot of a plane, a steering of a ship, and the like. The cockpit is a concept including a driver's seat of an automobile, an airplane's cockpit, a ship's steering seat, and the like.

  According to a second invention, in the first invention, an elapsed time detector is further provided. The elapsed time detection unit detects that a predetermined time has elapsed since the warning display control unit displayed the warning. When the elapsed time detection unit detects that the predetermined time has elapsed even if the warning confirmation determination unit determines that the pilot has confirmed the warning displayed on the cockpit display unit, the warning display control unit The warning is displayed on the seat display section.

  According to a third invention, in the first invention, an elapsed time detector is further provided. The elapsed time detection unit detects that a predetermined time has elapsed since the warning display control unit displayed the warning. The warning display control unit determines that the driver has not confirmed the warning displayed on the cockpit display unit by the warning confirmation determination unit, and the elapsed time detection unit detects that a predetermined time has elapsed. The warning is displayed on the other seat display unit.

  In a fourth aspect based on the first aspect, the occupant determination unit is further provided. The occupant determination unit determines an occupant who can visually recognize the display unit for other seats. The warning display control unit displays the other seat according to the information of the occupant determined by the occupant determination unit when the warning determination determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit. The warning is displayed in the section.

  In a fifth aspect based on the fourth aspect, the occupant determination unit determines that the occupant is an occupant supporting the pilot. If the occupant determined by the occupant determination unit is an occupant supporting the pilot when the warning determination determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, The warning is displayed on the display section for other seats.

  In a sixth aspect based on the first aspect, a pilot determination unit is further provided. The pilot discriminating unit discriminates the pilot. The warning display control unit, when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, according to the information of the pilot determined by the pilot determination unit, The warning is displayed on the display unit.

  In a seventh aspect based on the sixth aspect, the driver determining unit determines that the driver needs support from another occupant. The warning display control unit, when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, the driver determined by the driver determination unit receives support from other occupants. If the driver is necessary, the warning is displayed on the display unit for other seats.

In an eighth aspect based on the first aspect, an occupant determination unit and a driver determination unit are further provided. The occupant determination unit determines that the occupant who can visually recognize the display unit for other seats is an occupant supporting the pilot. The pilot discriminating unit discriminates that the pilot needs support from another occupant. The warning display control unit, when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, the driver determined by the driver determination unit receives support from other occupants. If it is a necessary pilot and the occupant determined by the occupant determination unit is an occupant supporting the pilot, the warning is displayed on the other seat display unit.

  According to the first aspect, when the operator is not aware of the warning display, such as when concentrating on maneuvering, it is possible to notify the other passengers seated in other seats that the warning has been issued. Therefore, when the driver does not notice the warning display, it is possible to promote safe steering by giving an appropriate warning display to other occupants.

  According to the second aspect, even if the operator notices the warning display, if the predetermined time has elapsed without dealing with the warning, the warning is displayed to other passengers seated in other seats. Even in the case where the operator leaves the countermeasure for the warning, safe operation can be promoted by giving an appropriate warning display to other occupants.

  According to the third aspect of the invention, the warning is displayed to other occupants sitting in other seats when a predetermined time or more has passed without the driver noticing the warning display and not dealing with the warning. .

  According to the fourth and fifth aspects of the invention, the warning is displayed on the display unit for the other seats only when the occupant who can visually recognize the display unit for the other seats is a specific occupant (assistant to be supported). By giving a warning to an occupant who cannot support the passenger, the occupant is not made uneasy.

  According to the sixth and seventh inventions described above, the warning display is also displayed on the other-seat display section only when a pilot who needs support from another occupant is maneuvering. Warning can be displayed.

  According to the eighth aspect of the invention, the passenger who can visually recognize the display unit for the other seats is a specific passenger (assistant to be supported), and only when the driver who needs support from another passenger is operating. Since the warning display is also displayed on the seat display unit, it is possible to give an appropriate warning display only to a combination that requires and can be supported.

(First embodiment)
Hereinafter, a warning display device according to a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. Typically, the warning display device is installed in a room of a moving body such as a vehicle. For the sake of specific explanation, a warning display device provided in a vehicle cabin is used. FIG. 1 is a diagram illustrating an example in which the warning display device is provided in a vehicle cabin. FIG. 2 is a block diagram showing a configuration of the warning display device.

  In FIG. 1, a warning display device is installed in a passenger compartment of a vehicle, and gives a warning corresponding to the state of the vehicle to the driver and other occupants of the vehicle. As an example, the warning display device includes a driver seat display unit 1, a passenger seat display unit 2, and a vehicle interior imaging unit 3.

The driver seat display unit 1 is a display device provided at a position that is visible to a driver who sits in the driver's seat of the vehicle and drives the vehicle. For example, the driver seat display unit 1 includes a meter provided on an instrument panel (instrument panel) in front of the driver seat. Typically, the driver's seat display unit 1 is composed of a combination meter in which several main instruments, indicator lights, warning lights, and the like are combined in one panel. The driver's seat display unit 1 includes a head-up display (Head-Up Display) in which a half mirror (reflective glass) is provided on a part of the windshield in front of the driver's seat and a virtual image such as a warning lamp is fluorescently displayed on the half mirror.
ay; hereinafter referred to as HUD). In the present embodiment, the driver's seat display unit 1 is lit with a warning lamp, displays a warning text, and the like, and the display control is performed by the control unit 4 (see FIG. 2).

  The passenger seat display unit 2 is a display device that is provided at a position that can be viewed from an occupant seated in the passenger seat of the vehicle (hereinafter referred to as an assistant). For example, the passenger seat display unit 2 includes a liquid crystal display (passenger seat display unit 2a shown in FIG. 1) installed on a part of an instrument panel in front of the passenger seat, electronic paper, and a front passenger seat. It comprises at least one of display devices such as a HUD (passenger seat display unit 2b shown in FIG. 1) that displays a virtual image of various displays on a half mirror provided on a part of the windshield. The passenger seat display unit 2 may be configured by another display device such as a display provided between the driver seat and the passenger seat as long as it is a display device provided at a position where the passenger can visually recognize the passenger seat. It doesn't matter. Further, in the present embodiment, the warning lamp is turned on and the warning text is displayed on the passenger seat display unit 2, and the display control thereof is performed by the control unit 4 (see FIG. 2).

  The vehicle interior imaging unit 3 is an imaging device that captures an image of the front of the driver seated in the driver's seat of the vehicle and the front of the assistant seated in the passenger seat from the vehicle interior. For example, the vehicle interior imaging unit 3 includes a driver monitor camera (vehicle interior imaging unit 3a shown in FIG. 1) fixed to an instrument panel or the like in front of the driver, a central portion of the instrument panel, and a vehicle. It is comprised by the vehicle interior camera (vehicle interior imaging part 3b shown in FIG. 1) fixed to upper direction between both seats in the room. The captured image captured by the vehicle interior imaging unit 3 is output to the control unit 4 (see FIG. 2).

  In FIG. 2, the warning display device includes a control unit 4 in addition to the driver seat display unit 1, the passenger seat display unit 2, and the passenger compartment imaging unit 3 described above. The control unit 4 is configured by a general computer system or the like installed in the vehicle. The control unit 4 includes a warning display control unit 41, a passenger seat display availability determination unit 42, and an occupant determination unit 43.

  The occupant determination unit 43 recognizes a face image of the captured image captured by the vehicle interior imaging unit 3 and identifies a vehicle occupant (typically, a driver and an assistant). For example, the occupant determination unit 43 determines whether the occupant is seated in the passenger seat, whether the driver or the assistant is a registered person, the gender or age of the driver or the assistant, based on the face image recognition. Etc. to identify the vehicle occupant. Then, the occupant determination unit 43 determines whether or not a driver (supported driver to be described later) who needs to notify the assistant of warning and support driving is seated in the driver's seat. . In addition, the occupant determination unit 43 determines whether or not a subject who can display a warning on the passenger seat display unit 2 and support the driver (a support subject assistant described later) is seated in the passenger seat.

  Whether the passenger's seat display availability determination unit 42 uses the captured image obtained by the vehicle interior imaging unit 3 to capture the driver, or has the driver noticed the lighting or warning display of the warning lamp displayed on the driver's seat display unit 1? Determine whether or not. For example, the passenger seat display availability determination unit 42 analyzes the driver's line of sight from the captured image obtained by capturing the driver, and the driver sees the lighting or warning display of the warning lamp displayed on the driver seat display unit 1. In this case, it is determined that the driver has noticed the warning. When the driver is not aware of the warning, the passenger seat display availability determination unit 42 displays the warning seat display unit 2 if the driver is a supported driver and the assistant is a support assistant. set to target. On the other hand, when the driver notices a warning, the passenger seat display possibility determination unit 42 does not set the passenger seat display unit 2 as a warning display target until a predetermined time elapses after the warning is generated. Further, the passenger seat display permission / inhibition determination unit 42 determines that if the driver is a driver to be supported and the assistant is an assistant to be supported when the driver has noticed the warning and a predetermined time has elapsed since the warning occurred, the passenger seat The display unit 2 is used as a warning display target.

The warning display control unit 41 displays a predetermined warning on the driver seat display unit 1 and / or the passenger seat display unit 2 based on vehicle information obtained from a vehicle on which the warning display device is mounted. Here, the warning display control unit 41 determines whether or not to display a warning on the passenger seat display unit 2 based on the determination result of the passenger seat display availability determination unit 42.

  Next, an example of a warning display displayed on the driver seat display unit 1 and the passenger seat display unit 2 will be described with reference to FIGS. FIG. 3 is a diagram illustrating an example of a warning lamp provided in the driver seat display unit 1. FIG. 4 is a diagram illustrating an example of a warning displayed on the passenger seat display unit 2. FIG. 5 is an example of a warning light and a warning display that are turned on or displayed on the driver seat display unit 1 and the passenger seat display unit 2, respectively.

  In FIG. 3, the driver's seat display unit 1 is provided with various warning lights 11 to 19. For example, the warning lamp 11 is a remaining fuel warning lamp and lights up when the remaining fuel of the vehicle is low. The warning light 12 is a taillight / braking light disconnection warning light, and is lit when a disconnection or the like occurs in the tail lamp or stop lamp of the vehicle. The warning lamp 13 is a charging warning lamp and lights up when there is an abnormality in the charging system of the vehicle. The warning light 14 is a hydraulic pressure warning light and lights up when there is an abnormality in the oil pressure of the engine oil of the vehicle. The warning light 15 is a warning light for not wearing a seat belt, and lights up when a driver's seat or a passenger seat in the vehicle is not wearing a seat belt. The warning light 16 is a half-door warning light and lights up when any door of the vehicle is not completely closed. The warning light 17 is a brake warning light and lights up when the parking brake of the vehicle is not released or when there is an abnormality in the brake. The warning light 18 is an engine warning light and lights up when there is some abnormality in the vehicle engine or transmission. The warning lamp 19 is an exhaust temperature warning lamp and lights up when the catalyst device of the vehicle is in an overheated state. In addition, these warning lights 11-19 are some warning lights provided in the display part 1 for driver's seats, and the warning light based on a vehicle state is provided in addition.

  In FIG. 4, on the passenger seat display unit 2, the content of the warning issued to the mounted vehicle is displayed together with the display of the warning light described above. For example, in the example of FIG. 4, a brake warning light mark is displayed on the passenger seat display unit 2, and the content of the warning described as “parking brake is pulled” is displayed in text information. . As described above, the passenger seat display unit 2 may display not only the type and presence / absence of the warning but also the detailed contents of the warning.

In FIG. 5, when a brake warning is issued to the vehicle, the brake warning light on the driver seat display unit 1 is turned on. And the brake warning light mark is displayed on the passenger's seat display section 2, and “the parking brake is not pulled”, “the brake fluid is insufficient”, “the brake hydraulic pressure is abnormal”, And a warning content such as “There is an abnormality in the ABS” is displayed. When a charging warning is issued to the vehicle, the charging warning lamp of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a charging warning light mark and a warning content such as “There is an abnormality in the charging system”. When the oil pressure warning is issued to the vehicle, the oil pressure warning light of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a hydraulic warning light mark and a warning content such as “There is an abnormality in the engine oil pressure”. When an engine warning is issued to the vehicle, the engine warning light of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays an engine warning light mark and warning contents such as “the engine is abnormal” and “the transmission is abnormal”. When an SRS (Supplemental Restoration System) airbag / pretensioner warning is issued to the vehicle, the airbag / pretensioner warning light of the driver seat display unit 1 is turned on. The passenger's seat display unit 2 displays an airbag / pretensioner warning light mark and a warning such as “There is an abnormality in the SRS airbag” or “There is an abnormality in the seat belt with pretensioner”. The contents of are displayed. When an ABS (Antilock Braking System) / brake assist warning is issued to the vehicle, the ABS / brake assist warning light on the driver seat display unit 1 is lit. The passenger seat display section 2 displays the ABS / brake assist warning light mark and the warning content such as “There is an abnormality in the ABS” or “There is an abnormality in the brake assist system”. The When the fuel remaining amount warning is issued to the vehicle, the fuel remaining amount warning light of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a fuel remaining warning lamp mark and a warning content such as “the remaining fuel is low”. When the half-door warning is issued to the vehicle, the half-door warning lamp of the driver seat display unit 1 is turned on. Then, on the passenger seat display unit 2, a half-door warning light mark is displayed and a warning content such as “one of the doors is not properly closed” is displayed. When the seat belt non-wearing warning is issued to the vehicle, the seat belt non-wearing warning light of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a warning sign indicating that the seat belt is not worn, and “the driver's seat belt is not worn” or “the passenger's seat belt is not worn. The content of the warning such as “N” is displayed. When the exhaust temperature warning is issued to the vehicle, the exhaust temperature warning light of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays an exhaust temperature warning light mark and a warning content such as “the catalyst is overheated”. When a washer fluid warning is issued to the vehicle, the washer fluid warning lamp of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a washer fluid warning lamp mark and a warning content such as “insufficient washer fluid”. When an AT (Automatic Transmission) warning is issued to the vehicle, the AT warning lamp of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays an AT warning light mark and a warning content such as “AT fluid is overheating”. When the disconnection warning is issued to the vehicle, the disconnection warning lamp of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a disconnection warning lamp mark and a warning content such as “the tail lamp and stop lamp are disconnected”. When a VSC (Vehicle Stability Control) warning is issued to the vehicle, the VSC warning lamp of the driver seat display unit 1 is turned on. The passenger seat display unit 2 displays a VSC warning light mark and a warning content such as “There is an abnormality in the VSC system”.

  Note that the warning light and warning display described with reference to FIG. 5 are merely examples, and other display modes may be used. For example, when the vehicle is provided with a multi-information display, it is possible to display more detailed warning contents as character information. In addition, in the case of a vehicle that can be controlled based on peripheral information (for example, distance information with respect to an obstacle or another vehicle), various alarm information corresponding to the peripheral information may be displayed.

  With reference to FIG. 6, the criteria for displaying a warning on the passenger seat display unit 2 based on the occupant identification will be described. FIG. 6 is a diagram illustrating an example of a criterion for determining whether or not to issue a passenger seat warning according to a combination of a driver seat and a passenger seat.

  In FIG. 6, the driver is classified into a supported target driver and a non-target driver. As described above, the driver to be supported is a driver who needs driving assistance from an assistant, for example, an elderly person, a young person, a driving beginner, or the like. On the other hand, the non-target driver is a driver who does not need driving support from an assistant, and corresponds to a driver other than the driver to be supported including a skilled driver.

On the other hand, the assistant is classified into a support target assistant, a non-target assistant, and absence. The non-target assistant is a person who is difficult to support the driver, for example, a child, an unlicensed person, or the like. It should be noted that a person who does not want to worry about driving for the driver (for example, a driver's guest or lover) may be a non-target assistant. In addition, the support target assistant is an assistant who can support the driver, and corresponds to a person other than the non-target assistant including the license holder, for example.

  Then, as shown in FIG. 6, only when the driver to be supported is seated in the driver's seat and the assistant to be supported is seated in the passenger's seat, the target combination is displayed as a warning on the passenger seat. This is a combination in which the driver needs the assistance of the assistant and the assistant capable of driving support is seated in the passenger seat, and the warning corresponding to the vehicle state is also displayed on the passenger seat display unit 2. This combination allows the assistant to provide appropriate support. On the other hand, even if the driver to be supported is seated in the driver's seat, it is meaningless to display a warning corresponding to the vehicle state on the passenger seat display unit 2 when the passenger seat is absent. In addition, even if a driver to be supported is seated in the driver's seat and a non-target assistant is seated in the passenger seat, it is appropriate to display a warning corresponding to the vehicle state on the passenger seat display unit 2. Cannot support. Furthermore, when a non-target driver is seated in the driver's seat, the driving support itself is unnecessary, so that a warning corresponding to the vehicle state is displayed on the passenger seat display unit 2 without depending on the passenger in the passenger seat. Is no longer necessary.

  It should be noted that the above-described combination of front seat occupants who perform the passenger seat warning is merely an example, and other criteria may be used. For example, it may be determined that the passenger seat warning is made by distinguishing any one of the front seats of the vehicle. Specifically, if a support subject is seated in the passenger seat, the warning seat is displayed on the passenger seat. Thereby, even when a skilled person is driving, dangerous driving caused by the driver overlooking the warning can be prevented. In addition, if a driver to be supported is seated in the driver's seat, the driver's seat may be displayed as a warning.

  Next, a specific processing operation executed by the control unit 4 of the warning display device will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of an operation in which the control unit 4 performs processing. For example, each step of the flowchart shown in FIG. 7 is performed by the control unit 4 executing a predetermined program. Note that a program for executing these processes is stored in advance in a storage area (for example, a memory, a hard disk, an optical disk, etc.) provided in the control unit 4, and the warning display device is turned on. Is executed by the control unit 4.

  First, when a power supply (not shown) of the warning display device is turned on, a program stored in the storage area of the control unit 4 is executed. And the control part 4 performs each step shown in FIG. 7 based on the said program.

  In FIG. 7, the control unit 4 displays a warning on the driver seat display unit 1 based on the vehicle information acquired from the vehicle on which the warning display device is mounted (step S71), and advances the process to the next step. For example, from the vehicle, a failure warning corresponding to the vehicle situation or vehicle information indicating the surrounding situation of the vehicle is output to the warning display device. The control unit 4 turns on the warning lamp of the driver seat display unit 1 according to the vehicle information (see FIGS. 3 and 5), or performs a warning display according to the vehicle information on the driver seat display unit 1. Or

  Next, the control unit 4 determines whether or not the driver has noticed the warning displayed in step S71 (step S72). For example, the control unit 4 analyzes the driver's line of sight from the captured image obtained by the vehicle interior imaging unit 3 imaging the driver, and whether or not the driver sees the warning display displayed on the driver seat display unit 1. Determine what you have noticed according to. And control part 4 advances processing to the following step S73, when a driver notices a warning. On the other hand, when the driver is not aware of the warning, the control unit 4 advances the processing to the next step S74.

In step S <b> 73, the control unit 4 determines whether or not a predetermined time has elapsed since the warning display on the driver seat display unit 1. Here, the predetermined time determined in step S73 is set in advance according to the type of warning that has been issued. For example, for the warning that needs to be dealt with urgently, the predetermined time is set to a relatively short time with respect to a warning that does not need to be urgent (for example, a remaining fuel warning or a washer fluid warning). And control part 4 advances processing to the following step S74, when predetermined time passes. On the other hand, if the predetermined time has not elapsed, the control unit 4 advances the processing to the next step S78.

  In step S74, the control unit 4 determines the driver who is seated in the driver's seat of the vehicle. Next, the control part 4 discriminate | determines the assistant seated in the passenger seat of the vehicle (step S75), and advances a process to the next step. For example, the control unit 4 recognizes a face image of the captured image captured by the vehicle interior imaging unit 3 and identifies the driver and assistant of the vehicle. As described above, the control unit 4 determines whether the passenger is seated in the passenger seat, whether the driver or the assistant is a registered person, the gender of the driver or the assistant, according to the face image recognition. And age. Then, the control unit 4 determines whether or not the driver is a supported driver and whether or not the assistant is a supported assistant.

  Next, the control unit 4 determines whether or not to perform a passenger seat warning based on a predetermined determination condition (step S76). As an example, as described with reference to FIG. 6, the control unit 4 issues a passenger seat warning only when a supported driver is seated in the driver's seat and a supported assistant is seated in the passenger seat. Judge to do. And the control part 4 advances a process to the following step S77, when performing a passenger seat warning. On the other hand, the control part 4 advances a process to the following step S78, when not performing a passenger seat warning.

  In step S77, the control unit 4 displays a predetermined warning on the passenger seat display unit 2 in addition to the driver seat display unit 1 based on the vehicle information obtained from the vehicle on which the warning display device is mounted ( The processing proceeds to the next step S79.

  In step S78, the control unit 4 hides the warning display on the passenger seat display unit 2 and proceeds to the next step S79.

  In step S79, the control unit 4 determines whether or not the vehicle occupant has dealt with the currently displayed warning. If the currently displayed warning is not addressed, the control unit 4 returns to step S71 and repeats the process. On the other hand, when the currently displayed warning is dealt with, the control unit 4 displays the driver seat display unit 1 and the passenger seat display unit based on the vehicle information obtained from the vehicle on which the warning display device is mounted. In both cases, the warning display is canceled (step S80), and the processing according to the flowchart ends.

  Thus, according to the flowchart described above, when the driver has not confirmed the warning display on the driver's seat display unit 1 or when the driver has not dealt with the warning for a predetermined time or longer, the passenger's seat display unit 2 also A warning is displayed. Specifically, when the driver has not confirmed the warning display on the driver's seat display unit 1, the warning is immediately displayed on the passenger's seat display unit 2, and the driver can Even if the warning display is confirmed, if the warning is not addressed, the warning display is also performed on the passenger seat display unit 2. That is, when the driver is not aware of the warning display due to the driver's concentration or the like, the warning content can be notified to other passengers seated in the passenger seat. In addition, since a warning is displayed on the passenger seat display unit 2 only when a specific passenger (assistant to be supported) is seated in the passenger seat, the warning is given to the passenger who cannot support the driver. There is no feeling of anxiety. Further, according to the above-described flowchart, even when the driver notices the warning display, the warning is displayed on the passenger seat display unit 2 after a predetermined time has elapsed without dealing with the warning. Even when the user notices a warning but forgets to deal with the warning, an appropriate warning display can be given to other passengers.

(Second Embodiment)
In the warning display device according to the first embodiment described above, when the driver has not confirmed the warning display on the driver's seat display unit 1 or when the driver has not dealt with the warning for a predetermined time or longer, the passenger's seat display unit 2 also describes the manner in which a warning is displayed. As an aspect different from the first embodiment, when the driver has not confirmed the warning display of the driver seat display unit 1 and has not dealt with the warning for a predetermined time or longer, the driver seat display unit 2 A warning display device that performs warning display will be described as a second embodiment. The warning display device according to the second embodiment is different from the first embodiment only in the flowchart, and other components are the same as those in the first embodiment described with reference to FIGS. is there. Therefore, in the description of the warning display device according to the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  With reference to FIG. 8, a specific processing operation executed by the control unit 4 of the warning display device according to the second embodiment will be described. FIG. 8 is a flowchart illustrating an example of an operation in which the control unit 4 performs processing. For example, each step of the flowchart shown in FIG. 8 is performed by the control unit 4 executing a predetermined program. Note that a program for executing these processes is stored in advance in a storage area (for example, a memory, a hard disk, an optical disk, etc.) provided in the control unit 4, and the warning display device is turned on. Is executed by the control unit 4.

  First, when a power supply (not shown) of the warning display device is turned on, a program stored in the storage area of the control unit 4 is executed. And the control part 4 performs each step shown in FIG. 8 based on the said program.

  In FIG. 8, the control unit 4 displays a warning on the driver seat display unit 1 based on the vehicle information acquired from the vehicle on which the warning display device is mounted (step S91), and advances the process to the next step. For example, from the vehicle, a failure warning corresponding to the vehicle status and vehicle information indicating the vehicle surrounding status are output to the warning display device. As in step S71, the control unit 4 turns on the warning lamp of the driver seat display unit 1 according to the vehicle information (see FIGS. 3 and 5), or drives the warning display according to the vehicle information. Or go to the seat display unit 1.

  Next, the control unit 4 determines whether or not the driver has noticed the warning displayed in step S91 (step S92). For example, the control unit 4 analyzes the driver's line of sight from the captured image obtained by the vehicle interior imaging unit 3 imaging the driver, and the driver is displayed on the driver seat display unit 1 as in step S72. Judgment is made according to whether or not the warning display is seen. And the control part 4 advances a process to following step S93, when the driver | operator has not noticed the warning. On the other hand, when the driver notices a warning, the control unit 4 advances the process to the next step S98.

  In step S <b> 93, the control unit 4 determines whether or not a predetermined time has elapsed since the warning display on the driver seat display unit 1. Here, the predetermined time determined in step S93 is set in advance according to the type of warning that has been issued, as in step S93. For example, for the warning that needs to be dealt with urgently, the predetermined time is set to a relatively short time with respect to a warning that does not need to be urgent (for example, a remaining fuel warning or a washer fluid warning). And control part 4 advances processing to the following step S94, when predetermined time passes. On the other hand, if the predetermined time has not elapsed, the control unit 4 advances the processing to the next step S98.

In step S94, the control unit 4 determines a driver seated in the driver's seat of the vehicle. Next, the control unit 4 determines an assistant seated in the passenger seat of the vehicle (step S95), and determines whether or not to issue a passenger seat warning based on a predetermined determination condition (step S96). Since the processes in steps S94 to S96 are the same as the processes in steps S74 to S76, detailed description thereof is omitted. And the control part 4 advances a process to following step S97, when performing a passenger seat warning. On the other hand, the control part 4 advances a process to the following step S98, when not performing a passenger seat warning.

  In step S97, the control unit 4 displays a predetermined warning on the passenger seat display unit 2 in addition to the driver seat display unit 1 based on the vehicle information obtained from the vehicle on which the warning display device is mounted ( The process proceeds to the next step S99.

  In step S98, the control unit 4 hides the warning display on the passenger seat display unit 2 and proceeds to the next step S99.

  In step S99, the control unit 4 determines whether or not the vehicle occupant has dealt with the currently displayed warning. If the currently displayed warning is not addressed, the control unit 4 returns to step S91 and repeats the process. On the other hand, when the currently displayed warning is dealt with, the control unit 4 displays the driver seat display unit 1 and the passenger seat display unit based on the vehicle information obtained from the vehicle on which the warning display device is mounted. In both cases, the warning display is canceled (step S100), and the processing according to the flowchart ends.

  As described above, according to the flowchart of the second embodiment, when the driver has not confirmed the warning display on the driver's seat display unit 1 and has not dealt with the warning for a predetermined time or more, A warning is also displayed on the display unit 2. Specifically, if the driver does not confirm the warning display on the driver's seat display unit 1 and a predetermined time elapses, a warning is also displayed on the passenger seat display unit 2, and the driver displays the driver's seat display unit 1. If the warning display is confirmed, the warning display on the passenger seat display unit 2 is canceled. That is, when the driver is not aware of the warning display due to the driver's concentration or the like, the warning content can be notified to other passengers seated in the passenger seat. In addition, since a warning is displayed on the passenger seat display unit 2 only when a specific passenger (assistant to be supported) is seated in the passenger seat, the warning is given to the passenger who cannot support the driver. There is no feeling of anxiety.

  Note that the predetermined time handled in the processing of step S93 in the second embodiment may be set to 0 hours (that is, immediately) for all warnings. By setting the predetermined time, when the driver has not confirmed the warning display on the driver's seat display unit 1, a warning is also displayed immediately on the passenger's seat display unit 2, and the driver can display the driver's seat display unit. If the warning display of 1 is confirmed, an operation in which the warning display on the passenger seat display unit 2 is canceled becomes possible.

  In the warning display devices according to the first and second embodiments, the warning display on the passenger seat display unit 2 may be immediately hidden when the driver notices the warning display. If the warning display to be displayed on the passenger seat display unit 2 is a display format in which the assistant can understand the warning content immediately by using only the warning mark or the like, it may be immediately hidden. Also, if the warning display displayed on the passenger seat display unit 2 is a display format that makes it difficult for the assistant to immediately understand the warning content, such as text describing the detailed content of the warning, driving It may be undisplayed after a predetermined time elapses from when the person notices the warning display or when the assistant presses the confirmation button or the like.

  In the warning display devices according to the first and second embodiments, the driver and the assistant are discriminated by recognizing the captured image captured by the vehicle interior imaging unit 3 using a face image. It does not matter if it is determined.

  As a first example, a driving driver is discriminated by a smart key possessed by each driver. In this case, a supported driver and a non-target driver (see FIG. 6) are registered for each smart key, and the driver is a supported driver or a non-target driver depending on the smart key used. To distinguish.

  As a second example, it is determined whether an occupant is seated in the passenger seat according to a signal output from the passenger seat sensor. For example, the passenger seat sensor is composed of a pressure sensor or the like installed on the passenger seat surface, and it is possible to determine whether a passenger is seated or absent from the passenger seat using a signal from the passenger seat sensor. it can. In this case, since it is impossible to distinguish whether the assistant is a support target assistant or a non-target assistant, the passenger seat display availability determination unit 42 is subject to a passenger seat warning if there is a passenger in the passenger seat, and the passenger seat is absent. For example, a simple judgment standard that does not include the passenger seat warning is used.

  As a third example, a driver who is driving is determined according to a signal obtained from an operation unit provided around the driver's seat. For example, an operation key or the like that is operated when the driver is a supported driver and / or when the driver is a non-target driver is provided around the driver's seat and the operation is output from the operation key. A signal is used to distinguish whether the driver is a supported driver or a non-target driver.

  As a fourth example, an assistant is determined according to a signal obtained from an operation unit provided around the passenger seat. For example, an operation key or the like that is operated when the assistant himself is a support assistant and / or when the assistant himself is a non-assistant assistant is provided around the passenger seat, and an operation signal output from the operation key is used. Distinguish whether the assistant is a support assistant or a non-target assistant.

  By appropriately combining the first to fourth examples for discriminating these occupants and the example performed by face image recognition, the determination of the passenger seat warning performed in steps S76 and S96 can be similarly performed. Needless to say, the warning display device does not have to include the vehicle interior imaging unit 3 when the determination by the face image recognition is not performed. Further, in the case where it is determined that the passenger seat warning is performed by distinguishing any one of the front seats of the vehicle, any one of the first to fourth examples and the face image recognition is selected and the step is performed. The determination of the passenger seat warning performed in S76 and S96 may be performed.

  Further, in the above description, a mode in which a warning display is added to the passenger seat in addition to the warning display to the driver seat is used. However, a warning display unit is provided at a position where an occupant seated in a seat other than the passenger seat is visible. May be installed. For example, even if a warning display unit is installed at a position that can be seen by a passenger seated in the rear seat of a vehicle in which the warning display device is installed, the passenger seated in the rear seat may be encouraged to support the driver. It doesn't matter.

  In the above description, an example in which a warning display device is installed in a vehicle cabin and displays a warning to the driver and other occupants of the automobile is used. A warning may be displayed to the passenger. For example, a warning display device is installed in a passenger compartment of a large vehicle such as a bus or a truck to display a warning to the driver and other occupants, or is installed in a cockpit of an airplane and is operated by a driver and other occupants It can be installed on various moving bodies, such as displaying a warning with respect to the vehicle or installing it in a steering room of a ship to display a warning to a steering person and other occupants.

  The warning display device according to the present invention can notify other passengers of the warning contents when the driver does not notice the warning display, and is applied to a device such as a device that is mounted on a moving body such as a vehicle and displays the warning. it can.

The figure which shows an example in which the warning display apparatus which concerns on the 1st and 2nd embodiment of this invention was provided in the vehicle interior of the motor vehicle The block diagram which shows the structure of the warning display apparatus of FIG. The figure which shows an example of the warning lamp provided in the display part 1 for driver's seats of FIG. The figure which shows an example of the warning display displayed on the display part 2 for passenger seats of FIG. An example of a warning light and a warning display that are lit or displayed on the driver seat display unit 1 and the passenger seat display unit 2 of FIG. The figure which shows an example of the reference | standard which determines whether the passenger seat warning is performed according to the combination of the driver's seat and passenger's passenger The flowchart which shows 1st Embodiment of the operation | movement which the control part 4 of FIG. 2 performs a process. The flowchart which shows 2nd Embodiment of the operation | movement which the control part 4 of FIG. 2 performs a process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Driver's seat display part 11-19 ... Warning light 2 ... Passenger seat display part 3 ... Car interior imaging part 4 ... Control part 41 ... Warning display control part 42 ... Passenger seat display availability determination part 43 ... Passenger determination part

Claims (8)

A warning display device that displays a warning to a pilot of a moving object and another occupant,
A pilot seat display unit provided at a position visible from a pilot seated in the cockpit of the mobile body;
A display unit for other seats provided at a position visible from an occupant seated in at least one seat excluding the cockpit of the moving body;
Based on the state of the moving body, a warning display control unit that displays a warning at least on the cockpit display unit;
A warning confirmation determination unit that determines that the pilot has confirmed the warning displayed on the cockpit display unit;
The warning display control unit displays the warning on the other-seat display unit when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit. Display device. An elapsed time detection unit that detects that a predetermined time has elapsed since the warning display control unit displayed the warning;
The elapsed time detection unit detects that the predetermined time has elapsed even if the warning confirmation control unit determines that the operator has confirmed the warning displayed on the cockpit display unit. The warning display device according to claim 1, wherein, when detected, the warning is displayed on the other-seat display unit. An elapsed time detection unit that detects that a predetermined time has elapsed since the warning display control unit displayed the warning;
The warning display control unit determines that the driver has not confirmed the warning displayed on the cockpit display unit by the warning confirmation determination unit, and the elapsed time indicates that the predetermined time has elapsed. The warning display device according to claim 1, wherein when the detection unit detects, the warning is displayed on the other seat display unit. An occupant determination unit that determines an occupant who can visually recognize the display unit for other seats,
The warning display control unit, when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, according to the information of the passenger determined by the passenger determination unit, The warning display device according to claim 1, wherein the warning is displayed on the other seat display unit. The occupant determination unit determines that the occupant is an occupant supporting a pilot,
The warning display control unit supports the driver when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit. The warning display device according to claim 4, wherein the warning is displayed on the other-seat display unit if it is an occupant. A pilot discriminator for discriminating the pilot is further provided,
The warning display control unit responds to the information of the driver determined by the driver determination unit when the warning determination determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit. The warning display device according to claim 1, wherein the warning is displayed on the other seat display unit. The pilot determination unit determines that the pilot needs support from another occupant,
The warning display control unit, when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, the driver determined by the driver determination unit is another occupant The warning display device according to claim 6, wherein the warning is displayed on the other-seat display unit if the driver needs support from the other side. An occupant discriminating unit for discriminating that the occupant who can visually recognize the display unit for other seats is an occupant supporting the driver;
A pilot discriminating unit that discriminates that the pilot needs support from other passengers;
The warning display control unit, when the warning confirmation determination unit determines that the driver has not confirmed the warning displayed on the cockpit display unit, the driver determined by the driver determination unit is another occupant The warning is displayed on the other-seat display unit, if the driver needs to be supported by the passenger and the passenger determined by the passenger determination unit is a passenger supporting the driver. The warning display device described.

Images