DE112016007287B4 - Information presentation process - Google Patents

Abstract

An information presentation method comprising: receiving a captured image of a traffic sign picked up by a first vehicle and information indicating a vehicle situation of the first vehicle; generating first traffic sign information by recognizing the traffic sign contained in the picked up image; generating first classification information with reference to the information that display the vehicle situation of the first vehicle; determining a display mode of the first traffic sign information on the basis of the first traffic sign information and the first classification information; performing a control for displaying the first traffic sign information in the display mode determined in the determination; making a determination as to whether the first vehicle is driving has performed or not in accordance with the traffic sign, and accumulating a determination result of the determination, the first V traffic sign information, the first classification information and the display mode of the first traffic sign information in conjunction with one another; receiving a captured image of a traffic sign recorded by a second vehicle following the first vehicle in time series, and information indicating a vehicle situation of the second vehicle; generating second traffic sign information by recognizing the traffic sign contained in the image captured by the second vehicle; generating second classification information with reference to the information indicating the vehicle situation of the second vehicle; determining a display mode that differs from the display mode of the first traffic sign information, as the display mode of the second traffic sign information when the determination result indicates that driving in accordance with the traffic sign has not been performed, the B the determination result is assigned to a set of the first traffic sign information and the first classification information which matches a set of the second traffic sign information and the second classification information; andperforming a control for displaying the second traffic sign information in the specific display mode of the second traffic sign information.

Description

TECHNICAL AREA

The present invention relates to a technique for notifying an occupant of a vehicle of information about traffic signs captured by a camera.

STATE OF THE ART

There is usually a technique for displaying information about traffic signs picked up by a camera on a display unit in a vehicle. Such a technique is provided because, even when a navigation device is mounted on the vehicle, not all of the information on road signs placed on roads is provided as map information to the navigation device.

For example, reveals JP 2015-191281 A a traffic sign display device in which template matching is performed on a captured image outside a vehicle captured by a camera and a similarity rating is obtained for each reference template, and when it is determined that the difference between the maximum similarity rating and each of the second and subsequent similarity ratings is sufficiently large is, a symbol image of the traffic sign corresponding to the reference template that receives the maximum similarity rating is displayed on a display unit. In addition, the in JP 2015-191281 A disclosed traffic sign display device, in addition to displaying a symbol image on the display unit, a notification is also carried out by voice corresponding to the symbol image (for example “the maximum speed is 40 km / h”).

The DE 10 2016 204 325 A1 relates to a traffic sign determination device for determining a road or traffic sign to be reported to an occupant of a vehicle using both a traffic sign based on a captured image and a traffic sign based on map data. Furthermore, the DE 603 18 430 T2 a computer-based system for outputting information about a driver of a vehicle, which system is suitable for being installed in a vehicle, and a method for outputting information about a driver of a vehicle.

SUMMARY OF THE INVENTION

TECHNICAL PROBLEM

With the in JP 2015-191281 A however, there has been a problem that it is impossible to display information on road signs according to the conditions of a driver. For example, there is a case where excessive notice is given to a driver who can recognize road signs with high competence and annoys the driver, or only the symbol image of a road sign is displayed and the meaning of the road sign cannot be recognized by a driver as the driver is a foreigner or a novice. Namely, there has been a problem that it is difficult to display an adequate amount of information on road signs for every driver.

The present invention is made to solve the above problems, and it is an object of the invention to display an appropriate amount of information on road signs according to the conditions of a driver.

TROUBLESHOOTING

An information presentation method according to the present invention comprises: receiving a captured image of a traffic sign picked up by a first vehicle and information indicating a vehicle situation of the first vehicle by a communication unit; Generating first traffic sign information by recognizing the traffic sign contained in the recorded image by a character recognition unit; Generating first classification information relating to the information indicating the vehicle situation of the first vehicle by a classification unit; Determining a display mode of the first traffic sign information based on the first traffic sign information and the first classification information by a display mode determining unit; Performing a control for displaying the first traffic sign information in the display mode which is determined in the determination by a display control unit; Making a determination of whether or not the first vehicle is running according to the traffic sign and collecting a determination result of the determination, the first traffic sign information, the first classification information, and the display mode of the first traffic sign information in association with each other by a sign conformity determination unit; Receiving a captured image of a road sign captured by a second vehicle following the first vehicle in time series, and Information indicating a vehicle situation of the second vehicle through the communication unit; Generating second road sign information by recognizing the road sign included in the captured image captured by the second vehicle by the character recognition unit; Generating second classification information relating to the information indicating the vehicle situation of the second vehicle by the classification unit; When the determination result indicates that driving in accordance with the traffic sign has not been performed, the determination result is a sentence of the first, determining a display mode by the display mode determination unit, which is different from the display mode of the first traffic sign information, as the display mode of the second traffic sign information Associated with traffic sign information and the first classification information that matches a set of the second traffic sign information and the second classification information; and performing a control for displaying the second traffic sign information in the specific display mode of the second traffic sign information by the display control unit.

ADVANTAGEOUS EFFECTS OF THE INVENTION

According to the present invention, it is possible to display an adequate amount of traffic sign information according to the conditions of a driver.

Figure list

• 1 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to a first embodiment;
• 2 Fig. 13 is a diagram illustrating an accumulation example in an accumulation unit of a server device for implementing the information presentation method according to the first embodiment;
• 3A and 3B are diagrams each showing a hardware configuration example of a vehicle-mounted device for implementing the information presentation method according to the first embodiment;
• 4A and 4B are diagrams each showing a hardware configuration example of the server apparatus for implementing the information presentation method according to the first embodiment;
• 5 Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the first embodiment;
• 6 Fig. 13 is a flowchart illustrating the operation of a presentation mode determining unit of the server device for implementing the information presentation method according to the first embodiment;
• 7th Fig. 13 is a flowchart showing the accumulation processing of a conformity result of the information presentation system for implementing the information presentation method according to the first embodiment;
• 8th Fig. 13 is a diagram illustrating an example of a presentation mode set in the presentation mode determination unit of the server device for implementing the information presentation method according to the first embodiment;
• 9 Fig. 13 is a diagram illustrating an accumulation example in an accumulation unit of a server device for implementing an information presentation method according to a second embodiment;
• 10 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to a third embodiment;
• 11A and 11B 12 are diagrams each showing an accumulation example in a response information accumulation unit of a server device for implementing the information presentation method according to the third embodiment;
• 12 Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the third embodiment;
• 13 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to a fourth embodiment;
• 14th Fig. 13 is a diagram showing an accumulation example in an accumulation unit of a server device for implementing the information presentation method according to the fourth embodiment;
• 15th Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the fourth embodiment;
• 16 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to a fifth embodiment;
• 17th Fig. 13 is a diagram showing an accumulation example in an accumulation unit of a server device for implementing the information presentation method according to the fifth embodiment; and
• 18th Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the fifth embodiment.

DESCRIPTION OF THE EMBODIMENTS

In order to explain the present invention in more detail, some embodiments for carrying out the present invention are described below with reference to the accompanying drawings.

First embodiment.

1 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to a first embodiment.

The information presentation system includes a vehicle-mounted device 100 and a server device 200 . In the example of 1 illustrates a case where a vehicle-mounted device 100 with the server device 200 connected is; however, in actual use of the information presentation system, it is assumed that a plurality of the vehicle-mounted devices 100 with the server device 200 connected is.

The vehicle-mounted device 100 comprises an image capture unit 101 , a driving situation collection unit 102 , a speech recognition unit 103 , a control unit 104 , a communication unit 105 , an ad 106 and a speaker 107 .

The image capture unit 101 includes, for example, a camera or the like, and takes an image of the road ahead of a carrier vehicle that the vehicle-mounted device 100 records. The driving situation collector unit 102 collects information that shows a driving situation of the carrier vehicle. The driving situation collection unit 102 collects, for example, current position information of the host vehicle, a driving speed, a steering wheel angle, a steering wheel operating state, a braking state and the like as information indicating the driving situation of the host vehicle. The speech recognition unit 103 performs voice recognition processing for voice information indicating voice information such as conversations of occupants of the host vehicle collected by a microphone (not shown) installed in the vehicle or the like. It is assumed that the speech recognition processing of the speech recognition unit 103 a variety of languages supported. The speech recognition unit 103 can perform voice recognition processing for the voice information of conversations between all occupants of the host vehicle or voice recognition processing only for limited occupants, for example voice recognition processing only for voice information from conversations between the occupants who are seated in the driver's seat and the passenger seat of the host vehicle.

The control unit 104 performs a control to transmit one from the image capture unit 101 recorded image, information obtained by the driving situation collection unit 102 display recorded driving situation, and a voice recognition result of the voice recognition unit 103 to the server device 200 via the communication unit 105 by. In addition, the control unit records 104 Control information received from the server device 200 via the communication unit 105 be transmitted. The control unit 104 performs a control to information on the display 106 and view the information by voice from the speaker 107 in response to the captured tax information.

The communication unit 105 conducts wireless communication with a communication unit 201 the server device 200 among each other. The ad 106 displays information received from the server device 200 in response to a control instruction from the control unit 104 be transmitted. The speaker 107 gives those from the server device 200 information transmitted by voice in response to a control instruction from the control unit 104 out.

The server device 200 includes the communication unit 201 , a presentation control unit 202 , a character recognition unit 203 , a classification unit 204 , a display mode Determination unit 205 , an accumulation control unit 206 , a character conformity determination unit 207 and an accumulation unit 208 . The one with the server device 200 associated vehicle-mounted device 100 is mounted in each of several vehicles. Note that, in the present invention, a vehicle preceding the time series is referred to as the first vehicle, and a vehicle following the first vehicle of the time series is referred to as the second vehicle. That is, the second vehicle is treated as the first vehicle in the next processing. In addition, each of the first vehicles and the second vehicle does not necessarily mean a particular specific vehicle. There may be a variety of the first vehicles. In addition, the second vehicle mounts the vehicle-mounted device 100 that is a target for the display of traffic sign information in a certain display processing.

It should be noted that the server device 200 essentially performs similar processing for the first vehicle and the second vehicle in the following description. In the present invention, it is confirmed whether or not there has previously been a vehicle situation that matches a current vehicle situation, and when the vehicle does not travel in accordance with the traffic sign information under that vehicle situation, traffic sign information is displayed in a different manner from the previous one. This processing is described in detail below.

The communication unit 201 conducts wireless communication with the communication unit 105 the vehicle-mounted device 100 among each other. The presentation controller 202 outputs the captured image and the information indicating the vehicle situation from the vehicle-mounted device 100 are transmitted to the character recognition unit 203 , the classification unit 204 and the display form determining unit 205 and performs control for generating traffic sign information. In addition, the presentation control unit performs 202 a controller for outputting the generated traffic sign information to the vehicle-mounted device 100 by. The character recognition engine 203 analyzes the captured image input from the display controller 202 and, if the captured image includes a traffic sign, recognizes the traffic sign and generates the traffic sign information. The character recognition engine 203 outputs the generated traffic sign information to the display control unit 202 out.

The classification unit 204 refers to the information provided by the presentation controller 202 Display the entered vehicle situation and classify the vehicle situation. In the first embodiment, the classification unit performs 204 performs the classification based on the information indicative of the vehicle situation, thus generating classification information.

Here, the vehicle situation is a scene identified by the information indicating the vehicle situation, such as information indicating a driving situation or occupant information. In addition, the classification information is the result of the classification of the vehicle situation. The classification information indicates whether the vehicle situations of the vehicles are the same or not. It should be noted that “the vehicle situations are the same” means that the vehicle situations are the same when viewed from a certain perspective.

The information indicating the driving situation is information such as driving progress information, current position information, driving speed, vehicle operating information (steering wheel angle, steering wheel operating state, braking state and the like).

In addition, the occupant information is obtained from, for example, a device installed in the vehicle and indicates, for example, the language used by an occupant, age, gender and the like of the occupant. In addition, the passenger information can also be obtained from the operating information of the vehicle. For example, information indicating a driver's driving ability or information indicating whether the driver is in a hurry is obtained from vehicle operation information such as whether there are many abrupt accelerations and decelerations.

The travel history information is information that is also used to determine whether or not a user was traveling in accordance with a traffic sign.

The classification unit 204 outputs the classification information generated on the basis of the information about the vehicle situation described above to the presentation control unit 202 out.

The display mode determination unit 205 refers to those in the accumulation unit 208 accumulated information (details will be described later) and identifies a set of first traffic sign information and first classification information associated with a set of second traffic sign information and second classification information match. The display mode determination unit 205 relates to a conformity result associated with the identified set of the first traffic sign information and the first classification information, and determines a display mode of the second traffic sign information. Here, when a speed of the first vehicle traveling according to the traffic sign is less than a threshold value, the display mode determination unit changes 205 the display mode of the second traffic sign information to a display mode that differs from a display mode of the first traffic sign information.

That is, in a case where the first vehicle preceding the time series does not travel in accordance with the traffic sign when the display mode determination unit 205 also determines the same display mode for the second vehicle that follows the time series in consideration of the first classification information, the driver of the second vehicle may inadvertently not drive in accordance with the traffic sign, similarly to the first vehicle. Thus, the display mode determination unit changes 205 changes the display mode for the second vehicle to a display mode different from that of the first vehicle.

The presentation controller 202 transmits the from the character recognition unit 203 generated second traffic sign information and that of the display unit 205 specific display mode of the second traffic sign information to the vehicle-mounted device 100 via the communication unit 201 .

Although not described above, the communication unit perform 201 , the presentation controller 202 , the character recognition engine 203 , the classification unit 204 and the display mode determination unit 205 performs similar processing for the first vehicle. Thereby, the first traffic sign information, the first classification information, and a display result of the first traffic sign information corresponding to the first vehicle are obtained. Such processing is also performed in other embodiments.

The accumulation control unit 206 gives the captured image to the image capture unit 101 the vehicle-mounted device 100 of the first vehicle to which the first traffic sign information is displayed and information indicating the driving situation (vehicle operation information, travel history information, and the like) obtained from the driving situation collection unit 102 the same vehicle-mounted device 100 are collected to the character conformity determination unit 207 and performs a control for collecting conformity results of traffic signs.

The character conformity determination unit 207 determines, based on the captured image and the information indicating the driving situation, whether or not the first vehicle is driving according to the traffic sign. The character conformity determination unit 207 accumulates a determination result, the first classification information, the first traffic sign information displayed when the determination result is obtained, and the display mode of the first traffic sign information in the accumulation unit 208 . It should be noted that the character conformity determination unit 207 the first traffic sign information and the display mode of the first traffic sign information from the vehicle-mounted device side 100 or it can capture them from the presentation controller 202 the server device 200 to capture.

The accumulation unit 208 collects information about the vehicle.

2 Fig. 13 is a diagram showing an accumulation example in the accumulation unit 208 of the information presentation system for implementing the information presentation method according to the first embodiment.

The accumulation unit 208 collects information including, for example, classification information, displayed traffic sign information, a display mode of the traffic sign information, a compliance rate related to the traffic sign, and the like.

In the example of 2 The information of No. 1 indicates that the classification information is “Driver speaks in Y language”, the displayed traffic sign information is “Stop”, the display mode of the traffic sign information is “Show traffic sign on display”, and the compliance rate with respect to the traffic sign is “65 % "Is.

Information from No. 3 indicates that the classification information is "Driver speaks in language Y", the traffic sign information displayed is "Stop", the mode of the traffic sign information is "Show traffic signs on display and output of speech from loudspeaker" and the compliance rate in Reference to the traffic sign "90%" is. If one compares the information from No. 1 with the information from No. 3, it is pointed out that, if the driver speaks in language Y, by presenting information on the display 106 and the output of speech through the speaker 107 the traffic sign information can be effectively presented to the driver. The display mode determination unit 205 can effectively present the traffic sign information to the driver by referring to the in 2 the conformity results shown.

Next, an example of a hardware configuration of the vehicle-mounted device will be discussed 100 described.

3A and 3B are diagrams each showing the hardware configuration example of the vehicle-mounted device 100 for implementing the information presentation method according to the first embodiment.

The communication unit 105 in the vehicle-mounted device 100 is a transceiver device 110 for performing wireless communication between the vehicle-mounted device 100 and the server device 200 . The driving situation collection unit 102 , the speech recognition engine 103 and the control unit 104 in the vehicle-mounted device 100 can each have a processing circuit 120 be dedicated hardware according to 3A is, or a processor 130 to run one in memory 140 stored program according to 3B .

As in 3A shown is the processing circuit 120 when the driving situation collection unit 102 , the speech recognition engine 103 and the control unit 104 Dedicated hardware is implemented, for example, as a single circuit, composite circuit, programmed processor, parallel programmed processor, application-specific integrated circuit (ASIC), field-programmable gate array (FPGA) or a combination thereof. The functions of the driving situation collection unit 102 , the speech recognition unit 103 and the control unit 104 can be implemented by the respective processing circuits or the functions of the respective units can be implemented jointly by one processing circuit.

As in 3B are shown when implementing the driving situation collection unit 102 , the speech recognition unit 103 and the control unit 104 through the processor 130 the functions of the respective units are implemented by software, firmware or a combination of software and firmware. The software or firmware is written as a program and in memory 140 saved. The processor 130 reads and executes that in memory 140 stored program and thus implements the functions of the driving situation collection unit 102 , the speech recognition unit 103 and the control unit 104 . This means that the driving situation collection unit 102 , the speech recognition engine 103 and the control unit 104 the memory 140 for storing programs through which everyone in the 5 and 7th The step shown is executed when the programs run through the processor 130 are executed. In addition, one can also say that the programs initiate a computer, procedures or methods of the driving situation collection unit 102 , the speech recognition unit 103 and the control unit 104 execute.

The processor 130 is for example a central processing unit (CPU), a processing device, a computing device, a processor, a microprocessor, a microcomputer, a digital signal processor (DSP) or the like. For example, the memory 140 a non-volatile or volatile semiconductor memory such as a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable ROM (EPROM) or an electrical EPROM (EEPROM), a magnetic disk such as a hard disk or a be flexible disk, or an optical disk such as mini-disk, compact disk (CD), or digital versatile disk (DVD).

It should be noted that the functions of the driving situation collector unit 102 , the speech recognition unit 103 and the control unit 104 can be implemented partly by special hardware and partly by software or firmware. As described above, the processing circuit 120 in the vehicle-mounted device 100 implement the functions described above using hardware, software, firmware or a combination thereof.

Next, an example of a hardware configuration of the server device will be explained 200 described.

4A and 4B are diagrams each showing a hardware configuration example of the server device 200 for implementing the information presentation method according to the first embodiment.

The communication unit 201 in the server device 200 is a transceiver device 210 for performing wireless communication between the vehicle-mounted device 100 and the server device 200 . The presentation controller 202 , the character recognition engine 203 , the classification unit 204 , the display mode determination unit 205 , the accumulation control unit 206 and the mark conformity determination unit 207 in the Server device 200 can each have a processing circuit 220 which is special hardware, as in 4A illustrated, or a processor 230 to run one in memory 240 stored program, as in 4B shown.

When the processing circuit 220 is dedicated hardware, as in 4A is shown the processing circuit 220 for example, implemented as a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

In addition, when the processing circuit 220 through the processor 230 , as in 4B is implemented becomes a function of the processing circuit 220 implemented by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and in memory 240 saved. The processor 230 reads and executes that in memory 240 stored program and thus implements the function of the processing circuit 220 . That means the processing circuit 220 the memory 240 to save a program that anyone can use in the 5 , 6 and 7th described step in the execution of the program by the processor 230 is performed. In addition, it can also be said that the program causes a computer, a procedure or a method of the processing circuit 220 execute.

It should be noted that the function of the processing circuit 220 can be implemented partly by dedicated hardware and partly by software or firmware. As described above, the processing circuit 220 in the server device 200 implement the function described above using hardware, software, firmware, or a combination thereof.

Next, the operation of the information presentation system will be described.

5 Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the first embodiment. As the processing for displaying character information for the vehicle-mounted device 100 is common to the case of the first vehicle and the case of the second vehicle, the following exemplifies the processing for displaying character information for the vehicle-mounted device 100 of the second vehicle.

It is assumed below that the image acquisition unit 101 the vehicle device mounted on the second vehicle 100 constantly captures images, the driving situation collection unit 102 continuously collects information indicating the driving situation of the carrier vehicle and the speech recognition unit 103 continuously collects conversations in the carrier vehicle and records voice recognition results.

The control unit 104 the vehicle-mounted device 100 captures a captured image of the image capture unit 101 , Information that the driving situation of the driving situation collecting unit 102 and a voice recognition result of the voice recognition unit 103 display as occupant information and transmit it through the communication unit 105 (Step ST1 ) to the server device 200 . The communication unit 201 the server device 200 receives the captured image and that from the vehicle-mounted device 100 transmitted speech recognition result and gives it to the presentation control unit 202 (Step ST2 ) out. The presentation controller 202 gives the in step ST2 recorded image input to the character recognition unit 203 and outputs the speech recognition result to the classification unit 204 (Step ST3 ) out. The character recognition engine 203 analyzes the captured image input in step ST3 and determines whether or not a traffic sign is included in the captured image (step ST4 ). If there is no road sign (step ST4 ; NO), the processing of the flow returns to the processing in step ST1 back.

On the other hand, if a road sign is included (step ST4 ; YES), the character recognition unit performs 203 the recognition of the traffic sign and generates a second information traffic sign (step ST5 ). The second from the sign recognition unit 203 The generated traffic sign information includes an image indicating the traffic sign, information indicating a traffic rule indicated by the traffic sign, and the like. The character recognition engine 203 notifies the presentation controller 202 about the in step ST5 (Step ST6 ) generated second traffic sign information. The classification unit 204 classifies a situation of the vehicle based on the input of the voice recognition result in step ST3 and thus generates second classification information (step ST7 ).

For example, the classification unit generates 204 Speech information by identifying the language used by inmates in conversation. The one from the classification unit 204 The language information generated indicates the language in which the occupants of the vehicle speak to chat. The classification unit 204 notifies the presentation controller 202 about the second classification information in step ST8 (Step ST8 ) was generated. It should be noted that the processing in step ST7 and step ST8 parallel to the processing of step ST4 up step ST6 can be executed.

The presentation controller 202 gives the second from the character recognition unit 203 reported traffic sign information and that of the classification unit 204 reported second classification information to the presentation mode determination unit 205 and has the display mode determination unit 205 to determine a display mode for the second traffic sign information (step ST9 ). The display mode determination unit 205 refers to the accumulation unit 208 and identifies a set of first traffic sign information and first classification information that match a set of the second traffic sign information and the second classification information obtained by the presentation control unit 202 (Step ST10 ) must be entered. The display mode determination unit 205 refers to the accumulation unit 208 and acquires a compliance result associated with the identified set of the first traffic sign information and the first classification information (step ST11 ).

For example, the display mode determination unit detects 205 from the accumulation unit 208 a compliance result at the time the first traffic sign information is presented to a driver of the first vehicle who is conversing in the language specified by the presentation control unit 202 entered language information.

The display mode determination unit 205 determines the display mode of the display control unit 202 entered second traffic sign information based on that in step ST11 (Step ST12 ) recorded conformity result. The display mode determination unit 205 notifies the presentation controller 202 via the specific display mode (step ST13 ).

The presentation controller 202 transmits control information for displaying the second traffic sign information in that of the display unit 205 specific display mode to the vehicle-mounted device 100 via the communication unit 201 (Step ST14 ). The communication unit 105 the vehicle-mounted device 100 receives the from the server device 200 transmitted control information and gives the control information to the control unit 104 (Step ST15 ) out. Based on the in step ST15 entered control information is carried out by the control unit 104 processing to provide the driver with the second traffic sign information through the display 106 or the ad 106 and the speaker 107 (Step ST16 ) to represent. Thereafter, processing of the flowchart returns to processing in step ST1 and the processing described above is repeated.

Processing step ST10 to step ST12 is shown in the flowchart in 5 described in more detail. 6 Fig. 13 is a flowchart showing the operation of the display mode determination unit 205 the server device 200 of the information presentation system for implementing the information presentation method according to the first embodiment. In the flowchart of 6 it is described that the classification information is voice information.

The display mode determination unit 205 refers to those in the accumulation unit 208 accumulated conformity results and determines whether or not there is a set of the first traffic sign information and the first classification information in which the same traffic sign information as that from the presentation control unit is present 202 inputted second traffic sign information is displayed in the same language as that in the second classification information (language information) sent by the display control unit 202 (Step ST21 ) have been entered, the specified language can be spoken.

If there is such a set of the first traffic sign information and the first classification information (step ST21 ; YES), the display mode determination unit detects 205 a conformity result linked to the set of the first traffic sign information and the first classification information (step ST22 ). The display mode determination unit 205 relates to a conformity rate with respect to the traffic sign of the conformity result recorded and determines whether or not there is a conformity result whose conformity rate is equal to or greater than the threshold value (step ST23 ).

If there is a compliance score whose compliance rate is equal to or greater than the threshold (step ST23 ; YES), selects the display mode determination unit 205 select the simplest display mode among the display modes of traffic sign information about the conformity result, the conformity rates of which are equal to or greater than the threshold value (step ST24 ). The unit of determination 205 determines whether the display mode is simple or not, for example due to the number of output devices. If there is a display mode to only display on the display 106 (Number of devices: 1) perform, and a display mode to display on the display 106 and the voice output to the loudspeaker 107 (Number of devices: 2) is determined by the display mode determination unit 205 that running just the display on the display 106 is a simpler display mode. If, on the other hand, there is no conformity result whose conformity rate is equal to or greater than the threshold value (step ST23 ; NO), selects the display mode determination unit 205 select a display mode that further highlights the most highlighted display mode among the display modes of the conformity results with the same traffic sign information (step ST25 ).

If there is no such set of the first road sign information and the first classification information (step ST21 ; NO), selects the display mode determination unit 205 a predetermined display mode (step ST26 ) out. The display mode determination unit 205 determines the in step ST24 , Step ST25 or step ST26 selected display mode as the display mode for the display of the second traffic sign information (step ST27 ). Thereafter, the processing of the flowchart continues with the processing in FIG ST13 of the flowchart of 5 away.

Next, the description will be given of processing to be performed in the server device 200 Collect a compliance score indicating whether a vehicle using the vehicle-mounted device 100 mounted, drives or not in accordance with the displayed traffic sign information.

7th Fig. 13 is a flowchart showing the accumulation processing of a conformity result of the information presentation system for implementing the information presentation method according to the first embodiment. In the following, the processing for accumulating a conformity result is described as an example, regardless of whether the first vehicle, which is the vehicle assembly device 100 mounted and to which the first traffic sign information is displayed, has been driven in accordance with the traffic sign information or not.

The control unit 104 the vehicle device 100 captures information related to the driving situation of the driving situation collecting unit 102 and transmits the information through the communication unit 105 (Step ST31 ) to the server device 200 . Processing in step ST31 is executed after the first traffic sign information in the vehicle-mounted device 100 and the control unit 104 sends information that indicates the driving situation of the host vehicle for a predetermined period of time after the time in which the first traffic sign information is displayed. Here the specified period is a period that can be set accordingly. For example, the control unit records 104 Information indicating the driving situation from a time after 0 seconds from the time the control is carried out to display the first traffic sign information and for 15 seconds.

The communication unit 201 the server device 200 receives information indicating the driving situation of the first from the vehicle device 100 transmitted vehicle, and outputs the received information indicating the driving situation to the accumulation control unit 206 (Step ST32 ) out. If the information indicating the driving situation of the first vehicle is in step ST32 are input, the accumulation control unit detects 206 from the presentation controller 202 the latest information including the first classification information, the first traffic sign information, and the display mode of the first traffic sign information related to the first vehicle, that of the vehicle-mounted device 100 corresponds to (step ST33 ). The accumulation control unit 206 indicates to the character conformity determination unit 207 the in step ST33 detected information and the information indicating the driving situation in connection with each other, and has the character conformity determination unit 207 to determine whether or not driving is performed in accordance with the traffic sign (step ST34 ).

The character conformity determination unit 207 compares a driving state of the first vehicle with the first traffic sign information presented to the driver and determines whether or not driving is performed in accordance with the traffic sign (step ST35 ). The character conformity determination unit 207 refers to the determination result in step ST35 and that in the accumulation unit 208 accumulated past compliance score and calculates the compliance rate in relation to the road sign (step ST36 ). The character conformity determination unit 207 sums the in step ST36 calculated conformity rate, the first classification information, the first traffic sign information and the display mode of the first traffic sign information as a conformity result in the accumulation unit 208 (Step ST37 ).

In the accumulation processing in step ST37 , in a case where the compliance rate when the same traffic sign information is displayed in the same classification information in the same display mode is already in the accumulation unit 208 has been accumulated, only the compliance rate update is performed. On the other hand, in a case where the same classification information, the same traffic sign information or the same information on the display mode of the traffic sign information is not stored in the accumulation unit 208 are collected, a new conformity result is generated. Thereafter, processing of the flowchart returns to processing in step ST31 back and the same processing is repeated.

Then with reference to the in 6 A specific example is described in the flow chart shown.

In the following it is assumed that a second vehicle A is driving in a country x with a language X as the official language, is driving past a “stop” sign and the character recognition unit 203 a second traffic sign information is generated that shows "stop". Furthermore, it is assumed that a driver who speaks in language Y and a passenger who speaks in language Y drive the second vehicle A, and the classification unit 204 generates second classification information that is language information indicating that the driver speaks in Y language. In addition, it is assumed that the in 2 conformity results shown in the accumulation unit 208 can be accumulated. In addition, it is assumed that the threshold value of the conformity rate at the time of determining the display mode of the second traffic sign information is equal to or greater than 75% in the display form of the determination unit 205 is.

In step ST21 of the flowchart of 6 determines the display mode determination unit 205 based on the information in the accumulation unit 208 that the in 2 The conformity results shown accumulate that there is a set of the first classification information indicating that the driver speaks in language Y and the first road sign information indicating “stop” (information from No. 1 to No. 3) (step ST21 ; YES). In step ST22 detects the display mode determination unit 205 the conformity results from No. 1 to No. 3. In step ST23 determines the display mode determination unit 205 that there are conformity results (information from No. 2 and No. 3) with a conformity rate equal to or greater than 75% (step ST23 ; YES).

In step ST24 compares the display mode determination unit 205 the display mode of the information of No. 2 with the display mode of the information of No. 3, and determines that the display mode in which the display is only on the display 106 is easier, and selects the display mode of the information of No.2. In step ST27 determines the display mode determination unit 205 “Display of the traffic sign and the text description in language Y on the display”, that is, the display mode of the traffic sign information of the information from No. 2, as the display mode for the display of the second traffic sign information.

In step ST23 if there is no compliance score, its compliance rate is equal to or greater than the threshold in step ST22 detected information is determined by the display mode determination unit 205 as a display mode for the display of the second traffic sign information, a mode whose display is additionally emphasized by a further level from the display mode with the highest conformity rate.

For example, when the threshold value of the compliance rate at the time of determining the display mode is equal to or greater than 95% in the display mode determination unit 205 , in the example of 2 , is set, the compliance rate with respect to the traffic sign is less than 95% in all information from No. 1 to No. 3, and there is no compliance result whose compliance rate is equal to or greater than the threshold value. The display mode determination unit 205 determines as the display mode for displaying the second traffic sign information a display mode "display of the traffic sign on the display and output of the voice and the attention information in language Y from the speaker", its display by a further level from the display mode "display of the traffic sign on the display, output of the Voice in language Y from the speaker “of the information from No. 3, the conformity rate of which is the highest 90%, is further emphasized in the information from No. 1 to No. 3.

It is assumed that for each display strength in the display mode determining unit 205 a display mode for displaying traffic sign information is set.

8th Fig. 13 is a diagram illustrating an example of a display mode set in the display mode determination unit 205 the server device 200 to implement the Information presentation method is set according to the first embodiment.

In the display mode determination unit 205 is used as the display mode of the level traffic sign information 1 "Show traffic signs" set.

In the display mode determination unit 205 is used as the display mode of the level traffic sign information 2 "Show traffic signs and text description" set.

In the display mode determination unit 205 is used as the display mode of the level traffic sign information 3 "Show traffic signs, output voice from loudspeaker" set.

In the display mode determination unit 205 is used as the display mode of the level traffic sign information 4th "Show traffic signs, output language and warning information from the loudspeaker".

In the display mode determination unit 205 is used as the display mode of the level traffic sign information 5 "Show traffic signs, output language and alarm tone from loudspeaker" is set.

The traffic sign information display mode for the level 4th using the example of the display mode of 8th "Output of attention information" shown are described. In the display mode of the traffic sign information for the level 4th the traffic sign is shown on the display, and the voice and attention information are given by the speaker. For example, it is assumed that there is a road sign in country y, which means that “no stop” is very similar to a road sign, which means that it means “stop” in country x. If a driver who speaks the Y language of the country has often misunderstood the “stop” road sign in the X country, attention information for warning of the misunderstanding is output in the Y language.

As described above, according to the first embodiment, the following steps are included: a communication unit receives a captured image of a traffic sign picked up by a first vehicle and information indicating a vehicle situation of the first vehicle 201 ; Generating first traffic sign information by recognizing the traffic sign contained in the recorded image by a character recognition unit 203 ; Generating first classification information with reference to the information indicating the vehicle situation of the first vehicle by a classification unit 204 ; Determining a display mode of the first traffic sign information on the basis of the first traffic sign information and the first classification information by a display mode determination unit 205 ; Performing a control for displaying the first traffic sign information in the display mode which is determined in the determination by a display control unit; Making a determination as to whether the first vehicle is traveling according to the traffic sign or not and collecting a determination result of the determination, the first traffic sign information, the first classification information and the display mode of the first traffic sign information in association with each other by a sign conformity determining unit 207 ; The communication unit receives a captured image of a road sign recorded by a second vehicle that follows the first vehicle in time series, and information indicating a vehicle situation of the second vehicle 201 ; Generating second road sign information by recognizing the road sign contained in the captured image captured by the second vehicle by the character recognition unit 203 ; The classification unit generates second classification information in relation to the information indicating the vehicle situation of the second vehicle 204 ; Determining a display mode different from the display mode of the first traffic sign information as the display mode of the second traffic sign information when the determination result indicates that driving in accordance with the traffic sign has not been performed, the determination result being associated with a set of the first traffic sign information and the first classification information which matches a set of the second traffic sign information and the second classification information; and performing a control for displaying the second traffic sign information in the specific display mode of the second traffic sign information by the display control unit 202 . In this way, information that indicates a traffic rule identified by the traffic sign can be presented to the driver in an effective display mode. In addition, it is possible to help a driver who does not know what the traffic sign means or a driver who has overlooked the traffic sign.

In addition, according to the first embodiment, the following steps are included: receiving a speech recognition result obtained by recognizing speech in the first Vehicle or in the second vehicle as information that indicates the vehicle situation, through the communication unit 201 is obtained; Generation of the first classification information or the second classification information by the classification unit 204 by identifying a language used in a conversation by an occupant of the first vehicle or the second vehicle in relation to the received voice recognition result and classifying the vehicle situation of the first vehicle or the second vehicle based on the identified language; and determining a display mode for displaying traffic sign information in the language provided by the display mode determination unit 205 has been identified when driving in accordance with the traffic sign has not been performed in the past. Thereby, it is possible to cope with a misinterpretation of a road sign and a misunderstanding of a road sign caused by a system difference between countries when a driver drives in a country other than his own. For example, it is possible to cope with a case where there is the road sign in country y that means “no stop”, which is very similar to the road sign that means “stop” in country x, and the driver who is in speaks the language Y of country y, often misunderstands the “stop” traffic sign in country x. In addition, information on traffic signs can be displayed in the language in which the driver speaks, so that information can be displayed effectively.

Note that, in the first embodiment described above, a configuration is described in which the classification unit 204 the server device 200 identify the language used for conversing with the occupants of a vehicle; however, the language used for the conversation by the occupant may be used on the vehicle-mounted device side 100 be identified. In this case, the vehicle-mounted device transmits 100 the identified language to the server device 200 .

Second embodiment.

In this second embodiment, a configuration will be described in which the classification unit 204 Conversation information generated as classification information.

Since an information presentation system of the second embodiment has the same configuration as the information presentation system according to FIG 1 Has illustrated first embodiment, the representation of the block diagram is omitted.

Similar to the first embodiment, the classification unit classifies 204 the vehicle situation based on the information indicating the vehicle situation. In the second embodiment, the classification unit generates 204 Conversation information indicating the presence or absence of conversations in the second vehicle as second classification information. The classification unit 204 gives the generated second classification information, that is, second conversation information, to the display control unit 202 out.

The classification unit 204 analyzes the result of voice recognition in the information indicating the vehicle situation and detects the presence or absence of the conversation in the vehicle. For example, the classification unit classifies 204 the situation in the vehicle in “conversation is available” and “conversation is not available” and thus generates second classification information. In addition, the classification unit 204 recognize the situation of the conversation, such as the recognition of the conversation frequency, without restricting the classification of the situation in the vehicle to two categories, “conversation exists” and “conversation does not exist”. When the call frequency is recognized, the classification unit classifies 204 the situation of the conversation according to the recognized conversation frequency fine.

The display mode determination unit 205 refers to that in the accumulating unit 208 and identifies a set of the first traffic sign information and the first classification information (first conversation information) that match a set of the second traffic sign information and the second classification information (second conversation information). The display mode determination unit 205 refers to the conformity result associated with the identified set of the first traffic sign information and the first classification information (first conversation information), and determines a mode of presentation of the second traffic sign information.

Similar to the first embodiment, the accumulation unit accumulates 208 Information including, for example, classification information, displayed traffic sign information, a display mode of the traffic sign information, a compliance rate related to the traffic sign information, and the like.

9 Fig. 13 is a diagram showing an accumulation example in the accumulation unit 208 of the Server device 200 for implementing an information presentation method according to the second embodiment.

The accumulation unit 208 collects information including, for example, classification information, displayed traffic sign information, a display mode of the traffic sign information, a compliance rate related to the traffic sign, and the like.

In the example of 9 The information of No. 1 indicates that the classification information is “no conversation”, the displayed traffic sign information is “stop”, the display mode of the traffic sign information is “display traffic sign” and the compliance rate with respect to the traffic sign is “95%”.

The information of No. 2 indicates that the classification information is “conversation is present”, the displayed traffic sign information is “stop”, the display mode of traffic sign information is “display traffic sign” and the compliance rate with respect to the traffic sign is “75%”. The information of No. 3 indicates that the classification information is “conversation is present”, the displayed traffic sign information is “stop”, the display mode of the traffic sign information is “display traffic sign and output voice in Y language from speaker”, and the compliance rate with respect to the traffic sign is "90%".

If the classification unit 204 If the situation is classified as “there is a conversation”, the driver's attention can often be distracted. In such a case, the traffic sign information can be obtained by outputting the traffic sign information from the speaker 107 Not only shown on the display by voice, but also effectively presented to the driver. On the other hand, in many cases, the driver focuses when the classification unit 204 the situation is classified in "no conversation" on driving, and the road sign can be sent to the driver only by displaying the road sign on the display 106 effectively represented.

Next, description will be made of the operation in a case where the classification unit 204 generates the second conversation information (hereinafter referred to as second classification information (conversation information)) as second classification information.

The operation of the entire information presentation system according to the second embodiment is the same as that of FIG 5 of the first embodiment shown in the flow chart.

In step ST7 of the flowchart of 5 recognizes the classification unit 204 the presence or absence of conversations in the second vehicle and generates the second classification information (conversation information). It also relates to step ST10 the display mode determination unit 205 on the accumulation unit 208 and identifies a set of the first traffic sign information and the first classification information that matches a set of the second traffic sign information and the second classification information (conversation information) obtained by the presentation control unit 202 can be entered. In step ST11 refers to the display mode determination unit 205 on the accumulation unit 208 and acquires the compliance result associated with the identified set of the first traffic sign information and the first classification information.

In particular, the display mode determination unit detects 205 from the accumulation unit 208 the compliance result of the case where the first traffic sign information is presented to the driver of the first vehicle conducting the conversation.

Details of the processing of step ST10 to step ST12 in the flowchart included in 5 are identical to those of the flowchart shown in 6 the first embodiment is shown.

As a step ST21 of the flowchart of 6 refers to the display mode determination unit 205 on that in the accumulation unit 208 accumulated conformity result and determines whether or not there is a set of the first traffic sign information and the first classification information in which the same traffic sign information as that from the presentation control unit is present 202 entered second traffic sign information are displayed and in which the same conversation information as that of the display control unit 202 entered second classification information (conversation information) are included.

The accumulation processing of the conformity result of the information presentation system for implementing the information presentation method according to the second embodiment is the same as that of FIG 7th of the first embodiment shown in the flow chart.

As a step ST33 of the flowchart of 7th detects the accumulation control unit 206 from the presentation controller 202 the first classification information immediately before the conversation information of the first vehicle corresponding to the vehicle device 100 lie, the first traffic sign information and the display mode of the first traffic sign information.

As described above, according to the second embodiment, the following steps are performed: the classification unit generates the first classification information or the second classification information 204 by recognizing a conversation situation of an occupant of the first vehicle or the second vehicle in relation to the received speech recognition result, and classifying the vehicle situation of the first vehicle or the second vehicle based on the situation of the recognized conversation. As a result, the traffic sign information can be effectively presented to the driver depending on the conversation situation in the vehicle.

Third embodiment.

In this third embodiment, a configuration will be described in which the reaction of a driver after displaying traffic sign information is accumulated and the accumulated reaction is reflected in the determination of a display mode of the next traffic sign information.

10 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to the third embodiment. In a server device 200a the third embodiment becomes the server device described in the first embodiment 200a in addition, a response information accumulation unit 209 provided. In addition, instead of the presentation control unit 202 , the display mode determination unit 205 and the accumulation control unit 206 the server device described in the first embodiment 200 , a presentation control unit 202a , a display mode determination unit 205a and an accumulation control unit 206a intended.

In the following, the same portions as those of the information presentation system according to the first embodiment or corresponding portions are denoted by the same reference numerals as in the first embodiment, and their description is omitted or simplified.

In addition to the processing described in the first embodiment, the accumulation control unit performs 206a also carry out the processing described below. The accumulation control unit 206a acquires a voice recognition result obtained from the vehicle-mounted device 100 via the communication unit 201 is transmitted. The accumulation control unit 206a extracts a voice recognition result from the recorded voice recognition result which indicates discomfort of the driver. The accumulation control device 206a extracts as a result of the speech recognition that indicates discomfort of the driver, for example words that indicate complaints such as “noisy”, tutor tone or the like. The accumulation control unit 206a detected by the presentation controller 202a the first traffic sign information used in extracting the voice recognition result indicating discomfort of the driver and the display mode of the first traffic sign information, and collects them as reaction information in the reaction information accumulation unit 209 .

In a case in which the reaction information which the driver has displayed when displaying the same traffic sign information in the same display mode, namely information indicating discomfort of the driver, is already in the reaction information accumulation unit 209 have been collected, the accumulation control unit performs 206a just updated the speed at which the driver was showing discomfort. On the other hand, in a case where the reaction information that the driver has found uncomfortable in displaying the same traffic sign information in the same display mode is not stored in the reaction information accumulation unit 209 new reaction information is generated.

The accumulation control unit 206a can store the information in the response information accumulation unit 209 by integrating the reaction information of a plurality of vehicles or accumulate the information in the reaction information accumulation unit 209 accumulate to manage response information of each vehicle individually.

11A Fig. 13 is a diagram showing an accumulation example in the response information accumulation unit 209 the server device 200a for implementing the information presentation method according to the third embodiment.

The reaction information collection unit 209 For example, collects the displayed traffic sign information, the display mode (display level) of the traffic sign information when the driver showed discomfort, and the speed at which the driver showed discomfort.

The example of 11A indicates that when executing "Show the traffic sign on the display and output the voice from the loudspeaker" of the traffic sign information "Stop", the speed at which the driver showed discomfort is "30%".

The display mode determination unit 205a determines the display mode of the second traffic sign information with respect to the accumulating unit 208 based on the second traffic sign information and the second classification information of the second vehicle similar to the first embodiment. Furthermore, when the display mode determination unit 205a refers to the response information that the unit 209 accumulates, and displays the same traffic sign information as the second traffic sign information in the same display mode as that of the second traffic sign information when the speed at which the driver has shown discomfort is equal to or greater than a predetermined threshold value (e.g. equal to or greater than 30%) , performs the display mode determination unit 205a processing for lowering the level of the display mode of the determined second traffic sign information.

When the display mode of the second predetermined traffic sign information, for example, level 4th is (see 8th of the first embodiment), the display mode determination unit performs 205a the processing of the lowering of the display mode to the level 3 or stage 2 as processing to lower the level of the display mode. In the display mode, when the level becomes higher, the output of attention information or alarm sounds flashing on the display or the like is added, and the traffic sign information to be displayed is easily recognized by the driver, but some people may feel the display in this Display mode is exaggerated. The driver's reaction is recorded in the reaction information accumulation unit 209 accumulates, whereby it is possible to suppress the repetition of the display mode in which the driver felt that the display in the display mode was exaggerated in the past.

Besides the configuration described above, the driver's reaction can be accumulated individually for each vehicle. In this case, the accumulation control unit 206a acquire the first traffic sign information for each vehicle, which when extracting the voice recognition result indicating discomfort of the driver and the display mode of the first traffic sign information, and after adding information for identifying the first vehicle to the acquired information, the acquired information in the Response information accumulation unit 209 collect. The information for identifying the first vehicle is an identification number or the like of the vehicle obtained from the vehicle-mounted device side 100 is transmitted. When transmitting the voice recognition result to the server device 200 adds the vehicle-mounted device 100 adds the ID number to the voice recognition result and performs the transmission. An example of a case where the reaction information for each vehicle individually in the reaction information accumulation unit 209 to be accumulated is in 11B shown.

11B Fig. 13 is a diagram showing an accumulation example in the response information accumulation unit 209 the server device 200a for implementing the information presentation method according to the third embodiment, and illustrates a case where the response information is accumulated for each vehicle individually.

The response information accumulation unit 209 For example, accumulates the vehicle ID, the displayed traffic sign information, and the display mode (display level) of the traffic sign information when the driver showed inconvenience. The example of 11B shows that in the vehicle with the vehicle ID “1011”, when “the traffic sign is shown on the display and the voice is output from the loudspeaker” of the traffic sign information “Stop” is executed, the driver showed discomfort.

In the case of the 11B determines the display mode determination unit 205a likewise the display mode of the second traffic sign information in relation to the accumulation unit 208 based on the second traffic sign information and the second classification information of the second vehicle similarly to the first embodiment. The display mode determination unit also performs 205a a search in the response information accumulation unit 209 referring to the information for identifying the second vehicle by that from the vehicle-mounted device side 100 is transmitted. When information showing that discomfort has occurred when the same traffic sign information as the second traffic sign information is displayed in the same display mode as that of the second traffic sign information, for the second vehicle in the response information accumulation unit 209 are collected, the display mode determination unit performs 205a a Processing for lowering the level of the display mode of the determined second traffic sign information.

Next, an example of a hardware configuration of the server device will be explained 200a described.

As the diagrams each showing a hardware configuration example of the server device 200a illustrate with those in the described in the first embodiment 4A and 4B are identical, they are not shown.

In addition, the functions of the presentation control unit 202a , the representation form determining unit 205a and the accumulation control unit 206a the server device 200a those of the presentation controller 202 , the display mode determination unit 205 and the accumulation control unit 206 similar to those described in the first embodiment.

Next, the operation of the information presentation system will be described.

12 Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the third embodiment.

12 illustrates a case where the reaction information collecting unit 209 in the 11A collects displayed information and the display mode of the second traffic sign information is determined depending on the speed at which the driver showed discomfort. The following are the same steps as for the vehicle-mounted device 100 and the server device 200 according to the first embodiment identified by the same reference numbers as in FIG 5 may be used, and their description will be omitted or simplified.

When the display mode determination unit 205a the display mode of the second traffic sign information in step ST12 with reference to the response information accumulation unit 209 determined, the display mode determination unit performs 205a a search by whether the driver is in a case where the same road sign information as that in step ST5 generated second traffic sign information in the in step ST12 (Step ST41 ) specific display mode, showed discomfort or not. If the driver showed discomfort (step ST41 ; YES), the presentation mode determination unit determines 205a whether the rate at which the driver exhibited discomfort is equal to or greater than the preset threshold (step ST42 ).

If the speed at which the driver was showing discomfort is equal to or greater than the preset threshold (step ST42 ; YES), the display mode determination unit performs 205a processing for lowering the level of the display mode in step ST12 (Step ST43 ) certain second traffic sign information. Thereafter, the processing of the flowchart continues with the processing in FIG ST13 away. On the other hand, if the driver has shown no discomfort (step ST41 ; NO), or if the rate at which the driver has shown discomfort is less than the threshold (step ST42 ; NO), processing continues with step ST13 away.

As described above, according to the third embodiment, the following steps are included: receiving a voice recognition result obtained by recognizing voice in the first vehicle when traffic sign information from the communication unit 201 being represented; Extracting a voice recognition result indicating that a driver of the first vehicle is from that of the accumulation control unit 206a received speech recognition result showed discomfort, generation and accumulation of response information by the accumulation control unit 206a , in which the extracted speech recognition result, the first displayed traffic sign information and the display mode of the first traffic sign information are linked, and reducing the strength of the display of the second traffic sign information in a case where the driver showed discomfort at the time when the first traffic sign information was displayed Past is displayed by the display mode calculation unit. As a result, in a case in which the driver has shown discomfort in the display of the traffic sign information in the past, it is possible to prevent the display of the traffic sign information in the similar display mode again.

Note that, in the third embodiment described above, there is a case where the display control unit is 202a , the display mode determination unit 205a and the reaction information collection unit 209 in the server device described in the first embodiment 200 be used; however, the configuration may be in the server device described in the second embodiment 200 be used.

Fourth embodiment.

In this fourth embodiment, a configuration for mirroring a viewing state of a driver in determining a display mode of traffic sign information will be described.

13 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to the fourth embodiment. A vehicle-mounted device 100b the fourth embodiment is with an occupant image pickup unit 108 instead of the speech recognition unit described in the first embodiment 103 the vehicle-mounted device 100 Mistake. It also includes the vehicle-mounted device 100b a head-up display (HUD) 109 .

A server device 200b the fourth embodiment includes a presentation control unit 202b , a classification unit 204b , a display mode determination unit 205b and an accumulation unit 208b instead of the presentation controller 202 , the classification unit 204 , the display mode determination unit 205 and the accumulation unit 208 the server device described in the first embodiment 200 .

In the following, the same portions as those of the information presentation system according to the first embodiment or corresponding portions are denoted by the same reference numerals as in the first embodiment, and their description is omitted or simplified.

The occupant image pickup unit 108 captures an image of a driver of a host vehicle using the vehicle-mounted device 100b records. The occupant image pickup unit 108 recognizes a situation of the driver based on a recorded image of the driver. The situation of the driver as seen by the occupant image capture unit 108 is detected is, for example, a viewing direction of the driver, a direction of the driver's face, or the like. The head-up display 109 displays second traffic sign information received from the server device 200b be transmitted in a specific display mode. The vehicle-mounted device 100b includes next to the ad 106 also the head-up display 109 , and a variety of ads is included.

The ad 106 is, for example, a main display of a navigation device. The head-up display 109 is realized, for example, by projecting an image onto a windshield, on which the image is reflected, and is a display on which information that is provided along with a real landscape while driving can be recognized. The control unit 104 controls to switch an output destination of the second traffic sign information to the head-up display 109 or the ad 106 based on control information received from the server device 200b be transmitted.

The presentation controller 202b the server device 200b captures a from the image capture unit as information indicating a vehicle situation 101 captured image and information indicating the situation of the driver obtained by the occupant imaging unit 108 from the 100b side of the vehicle-mounted device via the communication unit 201 are recorded. The presentation controller 202b performs a controller for generating the second traffic sign information based on the acquired information and a controller for displaying the generated second traffic sign information to the vehicle-mounted device 100b by.

The classification unit 204b classifies the vehicle situation based on the information that the situation of the driver input of the display control unit 202 Show. In the fourth embodiment, the classification unit performs 204b the identification of a direction of view of the driver as a classification of the vehicle situation and thus generates second gaze information as second gaze information. The classification unit 204b outputs the generated second classification information, that is to say the second viewing information, to the display control unit 202b out. The display mode determination unit 205b determined with reference to an in the accumulation unit 208b accumulated conformity result indicating whether or not driving for a traffic sign has been performed in the past, a display mode of the second traffic sign information based on the second traffic sign information and that from the display control unit 202 entered second viewing information.

In particular, the display mode determination unit detects 205b a result of the past conformity in a case where the same traffic sign information as that from the character recognition unit 203 generated second traffic sign information are presented to the driver who is viewing the viewing direction indicated in the second viewing information, which is the second classification information. The display mode determination unit 205b determines the display mode of the second traffic sign information on the basis of the previous conformity result recorded.

Similar to the first embodiment, the accumulation unit accumulates 208b a conformity result detected by a first vehicle, first traffic sign information and a display mode for the first traffic sign information.

14th Fig. 13 is a diagram showing an accumulation example in the accumulation unit 208b the server device 200b for implementing the information presentation method according to the fourth embodiment.

Similar to the first embodiment, the accumulation unit accumulates 208b Information including classification information, displayed traffic sign information, a display mode of the traffic sign information, a compliance rate related to the traffic sign, and the like. The driver's display information is collected as classification information.

In the example of 14th indicates the information of No. 1 that the classification information is "left side view with respect to the traveling direction ahead of the vehicle", the displayed traffic sign information is "stop", the display mode of the traffic sign information is "display traffic signs on the main display", and the Conformity rate with regard to the traffic sign is "80%". The information of No. 2 indicates that the classification information is "Left side view in relation to the direction of travel in front of the vehicle", the traffic sign information displayed is "Stop", the mode of display of the traffic sign information is "Displayed on the display facing the direction of view" , and the compliance rate with respect to the road sign is “90%”. When the display mode determination unit 205b determines the display mode of the second traffic sign information based on the information of No. 2, the control unit becomes 104 the vehicle-mounted device 100b enabled to control the heads-up display 109 , which is located in the direction of the driver's line of sight, to cause the second traffic sign information to be displayed.

The display mode determination unit 205b refers to the accumulation unit 208b based on the in 14th displayed viewing information of the driver, whereby the traffic sign information can be effectively displayed to the driver. It should be noted that in a case where there is no display in the driver's line of sight, the control unit 104 the vehicle-mounted device 100b can make an appropriate setting, for example to output the traffic sign information by voice with the loudspeaker 107 or similar. Thus, the information display system can display the traffic sign information according to the driver's visual information.

Next, there are hardware configuration examples for the vehicle-mounted device 100b and the server device 200b described.

As the diagrams each showing a hardware configuration example of the vehicle-mounted device 100b illustrate with those in the described in the first embodiment 3A and 3B are identical, the illustrations are omitted. As the diagrams each showing a hardware configuration example of the server device 200b illustrate are the same as those in the 4A and 4B described in the first embodiment, the illustrations thereof are omitted.

The function of the occupant image capturing unit 108 the vehicle-mounted device 100b is similar to that of the image capture unit 101 , and the function of the heads-up display 109 is similar to that of the display 106 . In addition, the functions of the presentation control unit 202b , the classification unit 204b and the display mode determination unit 205b the server device 200b those of the presentation controller 202 , the classification unit 204 and the display mode determination unit described in the first embodiment 205 similar.

Next, the operation of the information presentation system will be described.

15th Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the fourth embodiment. The following are the same steps as for the vehicle-mounted device 100 and the server device 200 according to the first embodiment identified by the same reference numbers as in FIG 5 may be used, and their description will be omitted or simplified.

The control unit 104 the vehicle-mounted device 100b captures the captured image of the image capture unit 101 and that from the occupant imaging unit 108 recorded information about the situation of the driver and transmits the recorded image and the information via the communication unit 105 (Step ST51 ) to the server device 200 .

The communication unit 201 the server device 200 receives the captured image and the driver's situation information provided by the vehicle device 100b and passes them to the presentation controller 202b (Step ST52 ) out. The presentation controller 202b gives the in step ST52 recorded image input to the character recognition unit 203 and outputs the information indicating the driver's situation to the classification unit 204b (Step ST53 ) out. After that, the processing of step ST4 to step ST6 carried out.

The classification unit then classifies 204b the situation of the vehicle with reference to the information that the situation of the driver input in step ST53 and thus generates the second classification information (step ST54 ). In particular, the classification unit generates 204b by identifying the driver's line of sight, the second viewing information as second classification information (hereinafter referred to as second classification information (viewing information)). The classification unit 204 notifies the presentation controller 202b about the in step ST54 (Step ST8 ) generated second classification information. It should be noted that the processing in step ST54 and step ST8 parallel to the processing of step ST4 up step ST6 can be done.

The presentation controller 202b gives the second from the character recognition unit 203 reported traffic sign information and that of the classification unit 204b reported second classification information to the presentation mode determination unit 205b and has the display form determining unit 205b to determine the form of presentation of the second traffic sign information (step ST9 ). The display mode determination unit 205b identified, based on the accumulation unit 208b , a set of the first traffic sign information and the first classification information coincident with a set of the second traffic sign information and the second classification information obtained from the presentation control unit 202b is entered (step ST10 ), matches. The display mode determination unit 205b recorded, based on the accumulation unit 208b , a conformity result linked to the identification set of the first traffic sign information and the first classification information (step ST11 ).

For example, the display mode determination unit detects 205b from the accumulation unit 208b the compliance result in a case where the first traffic sign information is presented to the driver of the first vehicle that is specified by the presentation control unit 202b input viewing information viewed specified viewing direction.

After that, the processing of step ST12 to step ST15 carried out. Based on the control information, the control unit performs 104 the vehicle-mounted device 100b the processing to provide the driver with the second traffic sign information via at least one of the displays 106 , the head-up display 109 and the loudspeaker 107 (Step ST55 ) to represent. Thereafter, processing of the flowchart returns to processing in step ST51 and the processing described above is repeated.

Details of the processing of step ST10 to step ST12 in the flowchart included in 15th are the same as in the flowchart shown in FIG 6 the first embodiment is shown.

As a step ST21 of the flowchart of 6 determines the display mode determination unit 205 referring to that in the accumulation unit 208b accumulated conformity result as to whether there is a set of the first traffic sign information and the first classification information that matches a set of the second traffic sign information and the second classification information (display information) obtained from the presentation control unit 202b can be entered.

The cumulation processing d of the conformity result in the information presentation method according to the fourth embodiment is the same as that of the flowchart shown in FIG 7th the first embodiment is shown.

As a step ST33 of the flowchart of 7th detects the accumulation control unit 206 from the presentation controller 202b the first classification information that is immediately before the viewing information of the first vehicle corresponding to the vehicle-mounted device 100 lie, the first traffic sign information and the display mode of the first traffic sign information.

In addition to the processing described above, the occupant image pickup unit can 108 based on the direction of the driver's face detected, determine whether the driver is driving with or without a view of the road. When it is determined that the driver is driving without keeping an eye on the road, the occupant imaging unit adds 108 Information is added indicating that the driving is being carried out without keeping an eye on the road than the driver's situation. When the information indicating that driving without eyes on the road becomes the information are added, which indicate the situation of the driver, describes the classification unit 204b that driving without eyes on the road is also performed in the second classification information to be generated (viewing information).

When it is described that the driving without watching the road is performed in the second classification information (viewing information), the display mode determination unit determines 205b not the display mode in which the display is carried out on the display in the viewing direction. For example, when it is described that driving without looking at the road is performed in the second classification information (viewing information), the display mode determination unit determines 205b the display mode for performing the display on the predetermined main display or the display on the predetermined main display and the voice output from the speaker.

Thus, the display mode determination unit 205b suppress the occurrence of the situation that the driver looks at the traffic sign information displayed in a direction that the driver looks sideways and reduce the risk that the driver cannot return his line of sight to the front of the vehicle. In addition, the display mode determination unit 205b highlight the display of the traffic sign information through voice output or the like.

In addition to the processing described above, the occupant image pickup unit can 108 further recognize the driver's facial expression, an open state of the driver's eyes, and the like as the driver's situation. Based on a recognition result of the occupant image recording unit 108 can be the classification unit 204b recognize whether the driver is sleeping, whether the driver is laughing, whether the driver is angry, and the like, and add this information to the display information.

The display mode determination unit 205b determines the display mode of the second traffic sign information based on the second traffic sign information and the driver's gaze direction included in the second classification information (viewing information). Thereafter, when information indicating that the driver is sleeping is included in the second classification information (display information), the display mode determination unit changes 205b the specific display mode of the second traffic sign information. For example, the display mode determination unit changes 205b the display mode at the highest level 5 in the display level of the first in 8th illustrated embodiment.

Also, when information indicating that the driver is laughing is included in the second classification information (display information), the display mode determination unit holds 205b the specific display mode of the second traffic sign information. Further, when information indicating that the driver is angry is included in the second classification information (display information), the display mode determination unit changes 205b the level of the specific display mode of the second traffic sign information to lower it.

In addition, the display mode determination unit 205b generate the second classification information (viewing information) by identifying only whether the driver is sleeping, whether the driver is laughing, whether the driver is angry, and the like without performing the identification of the driver's gaze direction.

Furthermore, the configuration described in the third embodiment, in which the reaction of the driver is accumulated and reflected in the next determination of the presentation mode of the traffic sign information, can be applied to the information presentation system of the fourth embodiment.

The accumulation control unit 206 extracted from the driver's facial expression, the driver's eye opening degree, and the like obtained by the occupant image pickup unit 108 the facial expression that shows the driver's discomfort such as anger or frown. The accumulation control unit 206 accumulated in the in the block diagram of 10 reaction information accumulation unit shown 209 the extracted result of the facial expression showing inconvenience to the driver together with the first road sign information and the display mode of the first road sign information when the extraction result is obtained.

The display mode determination unit 205b determines the display mode of the second traffic sign information with respect to the accumulation unit 208b and then searches whether the driver has a history of discomfort with the response information accumulation unit 209 showed or not. It should be noted that since the processing operation of referencing the Response information accumulation unit 209 is the same as the third embodiment, the detailed description thereof is omitted.

In addition, the accumulation control unit 206 also in a case where a result is obtained that, in response to the driver, the facial expression is not changed after the first traffic sign information is displayed and driving is performed in accordance with the traffic sign, the response in the response information accumulation unit 209 accumulate. In such a case, the display mode determination unit 205b can be configured so that the next display mode of the traffic sign information becomes easier for the same driver.

If the driver has already seen a traffic sign before the second traffic sign information is displayed, the display mode determining unit can 205b can be configured so that the display for displaying the second traffic sign information is not changed on the basis of the second classification information (viewing direction). Furthermore, in this case, the display mode determination unit 205b can be configured to stop the voice output of the second traffic sign information or to change the display mode of the second traffic sign information to make it simpler.

In particular, the classification unit determines 204b whether the driver is viewing a road sign or not by viewing the position of the road sign on one of the image capture unit 101 compares the captured image with a viewing direction obtained from an image obtained by the occupant image capturing unit 108 was recorded at the same time as the time at which the imaging unit 101 took the picture.

If the driver of the vehicle has already seen the traffic sign before the second traffic sign information is displayed, the display mode determination unit shows 205b the second traffic sign information only on the display 106 which is the main display. Alternatively, the display mode determining unit selects 205b simpler means than the display mode of the second traffic sign information, for example a display mode of the plane 1 or level 2 in 8th the first embodiment.

It is thus possible to suppress excessive display of information for the road sign that has already been seen by the driver.

As described above, according to the fourth embodiment, the following steps are included: Receiving information indicating a situation of a driver of the first vehicle or the second vehicle as information about the vehicle situation by the communication unit 201 Generation of the first classification information or the second classification information by the classification unit 204b , by identifying a line of sight of the driver of the first vehicle or the second vehicle with respect to the received information indicating the situation of the driver of the first vehicle or the second vehicle, and by classifying the vehicle situation of the first vehicle or the second vehicle on which Based on the identified viewing direction, and changing a display position of the traffic sign information on the basis of the identified viewing direction, by the display type determination unit 205b when driving in accordance with a traffic sign has not been performed in the past. As a result, the traffic sign information can be displayed on the display arranged in the direction of the driver's line of sight, and the ability for the driver to recognize the traffic sign information can be improved.

In addition, according to the fourth embodiment, the following step is included: adding a display by voice output to the display mode of the second traffic sign information based on the identified viewing direction by the display mode determination unit 205b . As a result, the presentation of the traffic sign information can be emphasized by the voice output when the driver drives without looking at the road.

Furthermore, according to the fourth embodiment, there is provided the step of reducing the strength of the display of the second traffic sign information in a case where the response information when the first traffic sign information was displayed is not accumulated and driving in accordance with the traffic sign in the past the display mode determination unit 205b was carried out. Thereby, the next display mode of the traffic sign information can be changed to a simpler one when the driver drives in accordance with the traffic sign with his normal setting.

In addition, according to the fourth embodiment, the following step is carried out: reducing the strength of the display of the second traffic sign information when the driver of the second vehicle views the traffic sign before the display of the second traffic sign information by the display mode determination unit 205b . This makes it possible to use a suppress excessive information display of the traffic sign that has already been seen by the driver.

Fifth embodiment.

In this fifth embodiment, a configuration will be described in which classification information is generated based on information indicating a driving ability in occupant information in information about a vehicle situation.

16 Fig. 13 is a block diagram showing a configuration of an information presentation system for implementing an information presentation method according to the fifth embodiment.

A vehicle-mounted device 100c the fifth embodiment does not include the speech recognition unit 103 the vehicle-mounted device 100 described in the first embodiment.

A server device 200c The fifth embodiment includes a presentation control unit 202c , a classification unit 204c , a display mode determination unit 205c and an accumulation unit 208c , instead of the presentation controller 202 , the classification unit 204 , the display mode determination unit 205 and the accumulation unit 208 the server device described in the first embodiment 200 .

In the following, the same component parts as those of the information presentation system according to the first embodiment or corresponding parts thereof are denoted by the same reference numerals as in the first embodiment, and their description is omitted or simplified.

The presentation controller 202c the server device 200c detected from the vehicle-mounted device side 100b via the communication unit 201 a captured image and driving skill level of a driver, which are information about the vehicle situation. The presentation controller 202c performs a controller for generating second traffic sign information on the basis of the acquired information and a controller for displaying the generated second traffic sign information to the device attached to the vehicle 100c by.

The classification unit 204c classifies the vehicle situation based on the information received from the presentation control unit 202c show entered vehicle situation. In the fifth embodiment, the classification unit classifies 204c the vehicle situation of a second vehicle and generates second classification information based on a driving ability of a driver of the second vehicle, which is the vehicle situation of the second vehicle. The classification unit 204c generates the second classification information indicating, for example, “ride quality level: low”, “ride quality level: high” or the like based on the ride quality level of the driver.

The driver's driving ability is determined based on an experience of the driver estimated by analyzing a running speed, a steering wheel operating state, a braking operating state, and the like of the vehicle. The driver's ability to drive can be entered as a numerical value for the driving experience and set according to the entered numerical value.

The classification unit 204c outputs the second classification information, which is generated based on the above-described level of driving ability of the driver, to the presentation control unit 202 out.

The display mode determination unit 205c identified with reference to that in the accumulation unit 208c collected information, a set of first traffic sign information and first classification information that match a set of the second traffic sign information and the second classification information. The display mode determination unit 205c determines a display mode of the second traffic sign information with reference to a conformity result assigned to the identified set of the first traffic sign information and the first classification information. Here, when a speed of a first vehicle traveling according to the first traffic sign is less than a threshold value, the display mode determination unit changes 205c the display mode of the second traffic sign information to a display mode that differs from a display mode of the first traffic sign information.

Similar to the first embodiment, the accumulation unit accumulates 208c a determination result of the character conformity determination unit 207 and the display mode of the first traffic sign information acquired by the first vehicle.

17th Fig. 13 is a diagram showing an accumulation example for the accumulation unit 208c of the information presentation system for implementing the information presentation method according to the fifth embodiment.

The accumulation unit 208c accumulates information including, for example, classification information, displayed traffic sign information, a display mode of the traffic sign information, a conformity rate related to the traffic sign, and the like. The accumulation unit 208c accumulates the conformity result with the traffic sign according to the driving ability of the driver.

In the example of 17th The information of No. 1 indicates that the classification information is “Skill Level: Low”, the displayed traffic sign information is “Stop”, the display mode of the traffic sign information is “Show traffic sign”, and the compliance rate with respect to the traffic sign is “70% ".

The information of No. 2 suggests that the classification information “Driving ability level is:”: Low ”, the displayed traffic sign information is“ Stop ”, the display mode of the traffic sign information is“ Display traffic sign, output voice from speaker ”, and the compliance rate in relation to the traffic sign is “90%”.

The information of No. 3 indicates that the classification information is “Driving Skill Level: Low”, the displayed traffic sign information is “Stop”, the display mode of the traffic sign information is “Display traffic sign, output speech and alarm sound from speaker”, and the compliance rate in In relation to the traffic sign is “98%”.

The information of No. 4 suggests that the classification information is “Skill level is: High”, the displayed traffic sign information is “Stop”, the display mode of the traffic sign information is “Show traffic signs” and the compliance rate with respect to the traffic sign is “95% “Is.

It is assumed that in display mode the unit 205c the threshold of the conformity level that is used for the extraction of the set information when the classification information “Skill level is: Low” is 75%. In the example of 17th extracts the display mode determination unit 205c the information from No. 2 (conformity rate “90%”) and the information from No. 3 (conformity rate “98%”), whose classification information is “Skill level is: Low” and whose degree of conformity is equal to or greater than 75%. The display mode determination unit 205c compares the extracted mode of presentation of the information of No. 2 with the mode of presentation of the information of No. 3 and determines that the mode of presentation is simpler only of the voice, thereby selecting the information of No. 2.

The following are hardware configuration examples of the vehicle-mounted device 100c and the server device 200c described.

There are diagrams showing the hardware configuration examples of the vehicle-mounted device 100c and the server device 200c illustrate how the 3A and 3B and 4A and 4B described first embodiment are identical, the representation of the same is omitted.

The functions of the presentation controller 202c , the classification unit 204c and the display mode determination unit 205c the server device 200c are similar to those of the presentation controller 202 , the classification unit 204 and the display mode determination unit described in the first embodiment 205 .

Next, the operation of the information presentation system will be described.

18th Fig. 13 is a flowchart showing the operation of the presentation processing of traffic sign information of the information presentation system for implementing the information presentation method according to the third embodiment. The following are the same steps as for the vehicle-mounted device 100 and the server device 200 according to the first embodiment identified by the same reference numbers as in FIG 5 may be used, and their description will be omitted or simplified.

The control unit 104 the vehicle-mounted device 100 captures the captured image of the image capture unit 101 and from the driving situation collection unit 102 recorded information about the driving ability of the driver and transmits them via the communication unit 105 (Step ST61 ) to the server device 200 . The communication unit 201 the server device 200 receives the captured image and the driver's driving skill information from the vehicle-mounted device 100 and passes them to the presentation controller 202c (Step ST62 ) out. The presentation controller 202c gives the in step ST62 captured image input to the Character recognition unit 203 and gives the information about the driving ability of the driver input in step ST62 to the classification unit 204c (Step ST63 ) out. After that, the processing of step ST4 to step ST6 carried out.

Next, the classification unit classifies 204c the driving skill by referring to the information indicating the driving skill level of the driver input in step ST63 thereby generating the second information of the level of driving ability as second classification information (hereinafter referred to as second classification information (driving ability level information)). (Step ST64 ). After that, the processing of step ST8 to step ST16 carried out.

Details of the processing of step ST10 to step ST12 in the flowchart included in 18th are the same as in the flowchart shown in FIG 6 the first embodiment is shown.

As a step ST21 of the flowchart of 6 determines the display mode determination unit 205c referring to that in the accumulation unit 208c accumulated conformity result as to whether there is a set of the first traffic sign information and the first classification information that matches a set of the second traffic sign information and the second classification information (drivability information) obtained from the presentation control unit 202c entered or not.

The accumulation processing of the conformity result in the information presentation method according to the fifth embodiment is the same as that of the flowchart shown in FIG 7th the first embodiment is shown.

As a step ST33 of the flowchart of 7th detects the accumulation control unit 206 from the presentation controller 202b the first classification information that is information indicating the driving ability of the driver, the first traffic sign information, and the display mode of the first traffic sign information related to the first vehicle, that of the vehicle-mounted device 100 corresponds.

In the fifth embodiment, since the driver's understanding of the traffic sign is considered to be the same given the same driving ability, the manner in which the traffic sign information is displayed is changed in accordance with the driving ability. If a driver with a certain driving skill cannot understand a sign, it is very likely that a driver with a certain driving skill cannot understand similarly, in which case it is possible to make the traffic sign information more understandable for the driver to understand the traffic sign.

As described above, the invention according to the fifth embodiment further includes: receiving a driving situation of a vehicle as information indicating the vehicle situation of the first vehicle or the second vehicle by the communication unit 201 and generating classification information by the classification unit 204c by classifying the vehicle situation of the first vehicle or the second vehicle based on a level of driving ability of a driver of the first vehicle or the second vehicle estimated from the driving situation of the first vehicle or the second received vehicle. As a result, the traffic sign information can be displayed in accordance with the driver's driving ability.

It should be noted that, in the fifth embodiment described above, a configuration is described in which the driver's driving ability is used as information on the vehicle situation; however, the driving characteristics of the driver can be used as information about the vehicle situation.

The classification unit 204c estimates the driving characteristics of the driver by analyzing the driving speed, the steering wheel operating state, the braking operating state, and the like obtained from the driving situation collection unit 102 are detected, whereby second driving characteristic information is generated as second classification information. The classification unit 204c classifies the driving characteristics of the driver as "impatient and rough driving", "driving in safe driving" and the like based on the estimated driving characteristics of the driver. It should be noted that the driving characteristics of the driver through the vehicle-mounted device 100c can be estimated and the estimation result to the server device 200c can be transferred.

Using the driving characteristic of the driver as information about the vehicle situation, the information display system can display the information in a display mode which is suitable for the driving characteristics of each driver. As a result, it is possible to display information according to the characteristics of the driver so that, for example, when displaying information about “stop” by the information display system, it is necessary to display information with voice to a driver who practices rough driving while not It is necessary to present information with voice to a driver who practices safe driving, in which a temporary stop is regularly made.

It should be noted that, in the first to third embodiments described above, a configuration is described in which the voice recognition unit 103 the vehicle-mounted device 100 performs the speech recognition processing. Alternatively, the voice recognition processing can also be performed by the server devices 200 and 200a be performed.

It should be noted that, in the first through fifth embodiments described above, a configuration in which the processing for recognizing the traffic sign by the server devices 200 , 200a , 200b and 200c is carried out, is described. Alternatively, the processing for recognizing the traffic sign may be performed by the vehicle-mounted device 100 respectively.

In addition, in the present invention within the scope of the invention, the embodiments can be freely combined, and each component of each embodiment can be changed or omitted.

INDUSTRIAL APPLICABILITY

In the information display method of the present invention, since it is possible to display an appropriate amount of information of road signs according to the conditions of a driver, the method can be applied to a navigation device or the like, and effective display of navigation information can be implemented.

List of reference symbols

100, 100b, 100c:

vehicle-mounted device,

101:

Image capture unit,

102:

Driving situation detection unit,

103:

Speech recognition unit,

104:

Control unit,

105, 201:

Communication unit,

106:

Display,

107:

Speaker,

108:

Occupant image recording unit,

109:

Head-Up Display,

200, 200,200a, 200b, 200c:

Server device,

202, 202, 202b, 202c:

Presentation controller,

203:

Character recognition unit,

204, 204, 204b, 204c:

Classification unit,

205, 205, 205a, 205b, 205c:

Display mode determination unit,

206, 206, 206a:

Accumulation control device,

207:

Character conformity determination unit,

208, 208, 208b, 208c:

Accumulation unit,

209:

Response information accumulation unit.

Claims (18)

An information presentation method comprising: receiving a captured image of a traffic sign picked up by a first vehicle and information indicating a vehicle situation of the first vehicle; Generating first traffic sign information by recognizing the traffic sign contained in the recorded image; Generating first classification information with reference to the information indicating the vehicle situation of the first vehicle; Determining a display mode of the first traffic sign information on the basis of the first traffic sign information and the first classification information; Performing a control for displaying the first traffic sign information in the display mode determined in the determination; Making a determination as to whether or not the first vehicle has made a trip in accordance with the traffic sign and accumulating a determination result of the determination, the first traffic sign information, the first classification information and the display mode of the first traffic sign information in association with each other; Receiving a captured image of a traffic sign captured by a second vehicle following the first vehicle in time series and information indicating a vehicle situation of the second vehicle; Generating a second traffic sign information by recognizing the traffic sign in the includes an image captured by the second vehicle; Generating second classification information with reference to the information indicating the vehicle situation of the second vehicle; Determining a display mode different from the display mode of the first traffic sign information as the display mode of the second traffic sign information when the determination result indicates that driving in accordance with the traffic sign has not been performed, the determination result being associated with a set of the first traffic sign information and the first classification information which matches a set of the second traffic sign information and the second classification information; and carrying out a control for displaying the second traffic sign information in the specific display mode of the second traffic sign information. The information display procedure according to Claim 1 Further comprising: receiving a voice recognition result obtained by recognizing voice in the first vehicle or the second vehicle as information indicating the vehicle situation. The information display procedure according to Claim 2 , further comprising: generating the first classification information or the second classification information by identifying a language used by an occupant of the first vehicle or the second vehicle in conversation with reference to the received speech recognition result and classifying the vehicle situation of the first vehicle or the second vehicle based on the identified language. The information display procedure according to Claim 3 , further comprising: determining a display mode for displaying the second traffic sign information in the identified language when the determination result indicates that a trip has been made in accordance with the traffic sign. The information display procedure according to Claim 2 , further comprising: generating the first classification information or the second classification information by recognizing a conversation situation of an occupant of the first vehicle or the second vehicle in relation to the received speech recognition result and the vehicle situation of the first vehicle or the second vehicle based on the situation of the recognized Conversation is classified. The information display procedure according to Claim 2 further comprising: receiving a voice recognition result obtained by recognizing voice in the first vehicle when displaying the first traffic sign information; and extracting a voice recognition result indicating that a driver of the first vehicle has shown discomfort from the received voice recognition result, and generating and accumulating reaction information in which the first traffic sign information displayed when the voice recognition result is extracted and the display mode of the first traffic sign information interact are linked. The information display procedure according to Claim 6 , further comprising: reducing the strength of the display of the second traffic sign information in a case where the response information when the first traffic sign information is displayed is accumulated. The information display procedure according to Claim 1 , further comprising: receiving information indicating a situation of a driver of the first vehicle or the second vehicle as information about the vehicle situation. The information display procedure according to Claim 8 , further comprising: generating the first classification information or the second classification information by identifying a line of sight of the driver of the first vehicle or the second vehicle with reference to the information indicating the situation of the driver of the received first vehicle or the second vehicle and classifying the vehicle situation of the first vehicle or the second vehicle on the basis of the identified viewing direction. The information display procedure according to Claim 9 , further comprising changing a display position of the second traffic sign information based on the direction of the driver's gaze of the second vehicle identified when the first vehicle has not driven in accordance with a traffic sign in the past. The information display procedure according to Claim 9 , further comprising: adding a presentation by voice output to the presentation mode of the second traffic sign information based on the identified viewing direction of the driver of the second vehicle of the presentation mode. The information display procedure according to Claim 9 Further comprising: reducing the strength of the display of the second traffic sign information if the driver of the second vehicle has viewed the traffic sign before the second traffic sign information is displayed The information display procedure according to Claim 8 further comprising receiving a captured image of the driver of the first vehicle when the first traffic sign information is displayed; and extracting a facial expression of the driver of the first vehicle showing discomfort from the received image, and generating and accumulating reaction information by associating the first traffic sign information displayed when the facial expression is extracted to the display mode of the first traffic sign information. The information display procedure according to Claim 13 , further comprising: reducing the strength of the display of the second traffic sign information in a case where the response information, as the first traffic sign information was displayed, of the display mode is accumulated. The information display procedure according to Claim 13 , further comprising: reducing the strength of the display of the second traffic sign information in a case where the response information when the first traffic sign information has been displayed is not accumulated and the driving in accordance with the traffic sign has been performed in the first vehicle in the past. The information display procedure according to Claim 1 , further comprising: receiving a driving situation of the first vehicle or of the second vehicle as information indicating the vehicle situation. The information display procedure according to Claim 16 , further comprising: generating the first classification information or the second classification information by classifying the vehicle situation of the first vehicle or the second vehicle on the basis of a driving ability of a driver of the first vehicle or the second vehicle that is derived from the driving situation of the first vehicle or the received second vehicle is appreciated. The information display procedure according to Claim 16 , further comprising: generating the first classification information or the second classification information by classifying the vehicle situation of the first vehicle or the second vehicle on the basis of a driving characteristic of a driver of the first vehicle or the second vehicle derived from the driving situation of the first vehicle or the received second vehicle is appreciated.

Images