JP7057110B2 - Information presentation control device, information presentation control method and program - Google Patents

Description

The present invention relates to an information presentation control device, for example, an information presentation control device that controls information presentation to a moving passenger, an information presentation control method, and a program.

In traveling of a moving body, passengers including the driver of the moving body recognize the sign display including a road sign and a road sign (road sign, etc.) (hereinafter, also simply referred to as "sign and display") and the road sign. It is important to understand the meaning of such things. A device is used to assist the passenger in recognizing the road sign or the like by presenting the information on the road sign or the like existing around the moving body to the passenger.

For example, Patent Document 1 describes an extraction means for extracting a road sign or the like from an image captured by an in-vehicle camera, a recording means for recording an image such as a road sign, a display means for displaying a car navigation image, and a road. A road sign or the like display device including an image output means that edits an image so that an image such as a sign and a car navigation image can be displayed at the same time and outputs the image to the display means is disclosed.

Japanese Unexamined Patent Publication No. 2005-4410

What kind of information about which road sign etc. is useful for the passengers of the moving object depends on the situation. As an example of the problem, the above-mentioned road sign display device can display information that is not suitable for the situation.

The present invention has been made in view of the above points, and it is possible to present information on road signs and the like according to the situation, and it is possible to bring more appropriate and useful information to the passenger. One of the purposes is to provide an information presentation control device.

The invention according to claim 1 provides information on a detection unit for detecting a sign or a sign including a road sign or a road sign and a first sign or a sign detected by the detection unit, which are present around the moving body. The presenting control unit includes a presentation control unit that controls the presentation of the guide information including the guide information to the passenger, and the presentation control unit is the passenger for the same type of sign or sign as the first sign or sign. It is characterized in that the guide information is presented in an manner based on the degree of interest in the past.

The invention according to claim 10 is a method of causing an information presentation control device to present a guide information including a sign including a road sign or a road sign or information on the sign, and a detection unit is present in the vicinity of a moving body. The detection step for detecting the sign or the sign, and the presentation control unit controls the presentation of the guide information including the information about the first sign or the sign detected by the detection unit to the passenger of the moving object. Including the presentation control step, the presentation control unit is based on the passenger's past interest in the sign or sign of the same type as the first sign or sign in the presentation control step. It is characterized by presenting guide information.

The invention according to claim 11 is an information presentation control program executed by an information presentation control device including a computer, and is a detection for detecting a sign or a sign including a road sign or a road sign existing around a moving body. The computer is operated as a unit and a presentation control unit that controls presentation of guide information including information on a first sign or marking detected by the detection unit to a passenger, and the presentation control is performed. The unit is characterized in that the guide information is presented in an manner based on the passenger's past interest in a sign or sign of the same type as the first sign or sign.

It is a block diagram which shows an example of the structure of the information presentation control apparatus of Example 1 of this invention. It is a figure which shows an example of the display screen presented by the information presentation control apparatus of Example 1. FIG. It is a figure which shows an example of the display screen presented by the information presentation control apparatus of Example 1. FIG. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 1. FIG. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 1. FIG. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 1. FIG. It is a flowchart which shows the example of the presentation control routine by the information presentation control apparatus of Example 1. It is a block diagram which shows an example of the structure of the information presentation control apparatus of Example 2 of this invention. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 2. FIG. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 2. FIG. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 2. FIG. It is a flowchart which shows the example of the presentation control routine by the information presentation control apparatus of Example 2. It is a block diagram which shows an example of the structure of the information presentation control system of Example 3 of this invention. It is a block diagram which shows an example of the structure of the information presentation control apparatus of Example 3 of this invention. It is a block diagram which shows an example of the structure of the information presentation control server of Example 3 of this invention. It is a figure which shows an example of the information which concerns on the control in the information presentation control apparatus of Example 3. FIG. It is a flowchart which shows the example of the presentation control routine by the information presentation control system of Example 3. It is a block diagram which shows an example of the structure of the information presentation control apparatus of Example 4 of this invention. It is a figure which shows an example of the display screen presented by the information presentation control apparatus of Example 4. FIG. It is a figure which shows an example of the display screen presented by the information presentation control apparatus of Example 4. FIG. It is a figure which shows an example of the display screen presented by the information presentation control apparatus of Example 4. FIG. It is a flowchart which shows the example of the presentation control routine by the information presentation control apparatus of Example 2.

Hereinafter, preferred embodiments of the present invention will be described in detail. In the following description and the accompanying drawings, the same reference numerals are given to substantially the same or equivalent parts.

The configuration of the information presentation control device 10 according to the first embodiment of the present invention will be described with reference to FIG. The information presentation control device 10 is mounted on a moving body such as a vehicle, and guide information, which is information including information on road signs or road markings including road markings existing around the moving body, is the driver of the moving body. It is an information presentation control device that controls the presentation when it is presented to a passenger including (hereinafter, also referred to as a driver). For example, the guide information includes the content of traffic restrictions or instructions indicated by road signs or road markings. In this embodiment, an example in which the information presentation control device 10 is mounted on a vehicle will be described.

The storage unit 11 is a storage device such as a hard disk, a flash memory, an SSD (Solid State Drive), and a RAM (Random Access Memory). The storage unit 11 appropriately stores a program executed by the information presentation control device 10, data necessary for the operation of the information presentation control device 10, data generated in the operation of the information presentation control device 10, and data taken in from the outside. .. For example, the storage unit 11 stores navigation information such as map information or route information. Further, the storage unit 11 stores information including the contents of traffic restrictions and instructions indicated by the road sign or the road marking.

The control unit 13 includes a central processing unit (CPU), and performs controls necessary for the operation of the information presentation control device 10. For example, the control unit 13 reads out the map information or the route information related to the moving body on which the information presentation control device 10 is mounted from the storage unit 11, and performs the control necessary for displaying them.

The control unit 13 includes a presentation control unit 13A. The presentation control unit 13A acquires information necessary for presenting guide information, which is information including information on road signs existing around the moving body or road signs including road signs, to the passengers of the moving body. Moreover, it is a functional unit that realizes a function of generating information for presenting the guide information and supplying it to each unit. For example, the presentation control unit 13A generates information in which the road sign or the like existing around the moving body is associated with the content of the road sign or the like stored in the storage unit 11. For example, the guide information includes the content of traffic regulations or instructions indicated by road signs or road markings.

The display unit 15 is a display device such as a liquid crystal display, an organic EL display, or a head-up display (HUD), and is provided so as to be visible to passengers. The display unit 15 displays a screen showing information such as navigation information and guide information in response to an instruction from the control unit 13. For example, the display unit 15 displays map information around the area where the moving body is traveling. Further, on the display unit 15, an image of a road sign or the like existing around the moving body and characters indicating the contents of the traffic regulation indicated by the road sign or the like are displayed.

The voice output unit 16 is an audio device that outputs information displayed by the display unit 15 such as navigation information and guide information as voice. For example, a part of the route information is output by voice. Further, for example, the voice output unit 16 outputs the name and contents of the road sign or the like by voice.

The traveling information acquisition unit 17 is a group of devices including at least one device for acquiring information on traveling of a moving body. The traveling information acquisition unit 17 includes a position specifying device such as a GPS (Global Positioning System) device, and acquires information regarding the position of a moving body. Further, the traveling information acquisition unit 17 may include sensors such as an acceleration sensor and a gyro sensor, and may acquire information such as the acceleration and the traveling direction of the moving body. For example, the control unit 13 generates route information using the position information acquired by the travel information acquisition unit 17.

The operation input unit 19 is an input device such as a remote controller or a touch panel. The operation input unit 19 receives an operation input from the passenger regarding the display unit 15 or the voice output unit 16. For example, the operation input unit 19 accepts operation inputs such as an input requesting display of route information and an input of a destination.

Further, the operation input unit 19 as an operation unit accepts an operation such as input for stopping the presentation of the guide information image, which is an image when the guide information is shown by the display unit 15. Further, the operation input unit 19 as an operation unit may accept an input for changing or stopping the volume of the guide information voice which is a voice related to a road sign or the like notified by the voice output unit 16. ..

The peripheral photographing unit 21 is an image pickup device such as an in-vehicle camera, and supplies image data obtained by photographing the surroundings of a moving object to the control unit 13. For example, the peripheral photographing unit 21 photographs the landscape in front of the moving body and supplies the image data to the control unit 13. The control unit 13 generates navigation information including the image from the image data of the image taken by the peripheral photographing unit 21 and displays it on the display unit 15.

Further, the control unit 13 detects the road sign or the like from the image data of the landscape in front of the moving body including the road sign or the like photographed by the peripheral photographing unit 21. The control unit 13 analyzes the image data by, for example, template matching, and detects road signs and the like included in the image. In this case, the peripheral photographing unit 21 functions together with the control unit 13 as a detecting unit for detecting a road sign or the like existing around the moving body. The peripheral photographing unit 21 may be provided with a plurality of cameras, and may be configured and arranged so as to be able to capture images in a plurality of directions such as the front and side of the automobile.

The vehicle interior monitor unit 23 is a device such as a camera for photographing the vehicle interior of the vehicle or a sensor for detecting changes in the vehicle interior. For example, the vehicle interior monitor unit 23 supplies the control unit 13 with data obtained by observing the direction or movement of the driver's line of sight or the movement of the body such as the head of the vehicle. Further, it may be possible to identify the driver from the image of the camera taken in the vehicle interior.

For example, the presentation control unit 13A may obtain the length of time (sign gaze time) from the data relating to the direction or movement of the driver's line of sight to the driver's gaze on a road sign or the like existing around the moving body. can. Further, for example, the presentation control unit 13A obtains the length of time (guide gaze time) in which the driver gazes at the guide information displayed on the display unit 15 from the data regarding the direction or movement of the driver's line of sight. Can be done.

The driver identification information acquisition unit 25 is a recognition device capable of recognizing passengers including the driver. For example, the driver identification information acquisition unit 25 may be a device that recognizes a terminal carried by a passenger, such as a smartphone or a wearable device. Further, the driver identification information acquisition unit 25 may be a biometric authentication device capable of recognizing veins, fingerprints, or the like.

For example, when the driver gets on the vehicle, the driver identification information acquisition unit 25 detects the identification information of the smartphone carried by the driver and supplies it to the control unit 13. For example, the identification information is an identification number unique to a terminal such as IMEI (International Mobile Equipment Identifier).

For example, when the driver first gets on the vehicle, the identification information detected for the first time by the driver identification information acquisition unit 25 is stored in the storage unit 11. Then, when the driver gets on the vehicle again, the driver identification information acquisition unit 25 detects the identification information of the smartphone again. The presentation control unit 13A collates with the identification information of the driver stored in the storage unit 11 and identifies the driver. That is, the driver identification information acquisition unit 25 and the presentation control unit 13A function as specific units for identifying the driver.

As described above, the gaze time is the length of time that the driver gazes at the road sign or the like or the length of time that the driver gazes at the guide information corresponding to the road sign or the like by the vehicle interior monitor unit 23. Data is retrieved. The gaze time is an index of the degree of interest of the driver in the road sign or the like. For example, the degree of interest indicating the degree of interest of the driver can be calculated based on the gaze time.

For example, if the driver does not understand or is not familiar with road signs, the degree of interest is considered to be high. For example, when the degree of interest is high, the driver needs guide information corresponding to the road sign, that is, information including the content of traffic regulation indicated by the road sign, etc. Can be considered high. On the other hand, when the degree of interest is low, the driver does not need much guide information corresponding to the road sign or the like, and it can be considered that the degree of need is low.

For example, when the presentation control unit 13A displays the guide information on the display unit 15, the guide information is presented to the driver in a manner based on the degree of interest of the driver. It is possible to present according to the situation. For example, when the degree of interest in a road sign or the like is high, a guide information screen corresponding to the road sign or the like is displayed in a larger and more conspicuous manner. When the degree of interest is low, the guide information screen is displayed in a less conspicuous manner.

FIG. 2A shows an example in which guide information is displayed on the display screen 30 of the display unit 15 in a less conspicuous (not emphasized) manner. In FIG. 2A, the image 31 in front of the moving body is displayed. The image 31 in front of the moving object includes a road sign 31A. Then, the guide information 32 corresponding to the road sign 31A is displayed below the image 31 in front of the road. The guide information 32 includes an image 32A indicating the road sign 31A and characters 32B indicating the contents of the road sign 31A. In addition to the guide information, the navigation information area 33 such as map information may be displayed in a part of the display screen 30.

FIG. 2B shows an example in which guide information is displayed on the display screen 30 of the display unit 15 in a more conspicuous (emphasized) manner than in FIG. 2A. In FIG. 2B, as in FIG. 2A, the image 31 in front of the moving body and the area 33 of the navigation information are displayed. The image 31 in front of the moving object includes a road sign 31A. Then, the guide information 34 corresponding to the road sign 31A is displayed below the image 31 in front of the road.

In FIG. 2B, the guide information 34 includes an image 34A indicating the road sign 31A and a character 34B indicating the content of the road sign 31A. Image 34A is displayed with greater emphasis than image 32A in FIG. 2A. As the character 34B, a character larger than the character 32B in FIG. 2A is used and displayed in a more emphasized manner. Further, as in the case of FIG. 2A, the area 33 of the navigation information is displayed.

FIG. 3A shows an example of marker detection data which is information used by the presentation control unit 13A for controlling the presentation of guide information. The sign detection data is stored in the storage unit 11, for example, and information corresponding to the road sign or the like is added each time a new road sign or the like is detected.

In FIG. 3A, the "date and time" when the road sign or the like is detected, the "details of the road sign or the like" and the "type" which are detailed information of the road sign or the like are described in association with each other. Some road signs and the like have numbers indicating restrictions such as speed. For example, road signs and the like that differ only in numbers indicating restrictions on maximum speed, minimum speed, height, maximum width, weight, time, and the like may be treated as the same type. Further, for example, signs that differ only in the number or direction of the displayed arrows and that have the same meaning in other cases may be treated as the same type.

In FIG. 3A, the "type" treats road signs and the like having different numbers only as the same type. For example, in FIG. 3A, "maximum speed" is described in the "type" column for "maximum speed 60 km", "maximum speed 80 km", and "maximum speed 40 km".

In addition, "driver identification information", which is driver identification information when each of the road signs and the like is detected, and "gaze time (sec)" of the driver are described. The gaze time is, for example, the time at which the image is gazed when the guide information is presented as an image. Further, for example, when the guide information is not presented, it may be the time when the road sign or the like existing in front of the moving body is watched.

That is, in FIG. 3A, the gaze time of the driver corresponding to the road sign and the like detected from the image acquired by the peripheral photographing unit 21 and the identification information of the driver are stored in association with each other.

FIG. 3B shows an example in which the average value of the gaze time of the driver A in a predetermined period is calculated for each type of road sign or the like based on the sign detection data, and the degree of interest is given based on the calculation result. .. In FIG. 3B, when the average gaze time is less than 0.5 sec, the degree of interest is "low", when the average gaze time is 0.5 sec or more and less than 1 sec, the degree of interest is "medium", and the average gaze time is 1 sec or more. An example in which the degree of interest is given with the case as the degree of interest "high" is shown.

In FIG. 3B, the average gaze time of the type “maximum speed” is 0.8 sec, and the degree of interest “medium” is given. In addition, the average gaze time of the type "pedestrian only" is 0.4 sec, and the degree of interest "low" is given, and the average gaze time of the type "height limit" is 1.2 sec, and the degree of interest is "high". Is given.

FIG. 3C shows an example of a criterion for determining the presentation mode according to the degree of interest when the presentation control unit 13A controls the presentation of guide information in a mode based on the degree of interest in FIG. 3B. According to the criterion of FIG. 3C, when the degree of interest is "low", the guide information is not presented. When the degree of interest is "medium", the guide information is normally presented and controlled in an inconspicuous and unemphasized manner as shown in FIG. 2A. When the degree of interest is "high", the emphasis presentation control of the guide information is performed in a more conspicuous and emphasized manner as shown in FIG. 2B.

For example, when the guide information is notified by the voice output unit 16, when the degree of interest is "high", a loud voice or a strange notification sound is produced as compared with the case where the degree of interest is "medium". It may be notified in the accompanying manner. Further, when the guide information is presented by the HUD, even if the control is performed to lower the transmittance when the degree of interest is "high" as compared with the case where the degree of interest is "medium". good.

Regarding the degree of interest, for example, when the value of the degree of interest is less than the first predetermined value (first predetermined value), the presentation control unit 13A does not cause the guide information to be presented. Further, when the degree of interest is equal to or higher than the first predetermined value and is less than the second predetermined value (second predetermined value) larger than the first predetermined value, the guide information is presented in an inconspicuous presentation mode. You may usually present it. Then, when the degree of interest is equal to or higher than the second predetermined value, the guide information may be emphasized and presented in a more conspicuous manner.

[Presentation control routine RT1]
The presentation control routine RT1 executed by the presentation control unit 13A in the information presentation control device 10 will be described with reference to FIG. The presentation control unit 13A starts the presentation control routine RT1 when the accessory power supply (hereinafter referred to as ACC power supply) of the vehicle on which the information presentation control device 10 is mounted is turned on. The presentation control unit 13A may start the presentation control routine RT1 when the engine of the vehicle is started or the vehicle starts running.

When the presentation control unit 13A starts the presentation control routine RT1, the presentation control unit 13A executes the authentication of the passenger (step S11). In step S11, the presentation control unit 13A acquires an identification number unique to the terminal carried by the driver driving the vehicle from the driver identification information acquisition unit 25, and stores this in the storage unit 11. Recognize the driver by collating with the information. When the identification number is not stored in the storage unit 11, such as when the driver first gets on the vehicle, the identification number acquired in step S11 is newly registered by storing it in the storage unit 11.

After the execution of step S11, the presentation control unit 13A causes the peripheral photographing unit 21 to start photographing around the vehicle and start acquiring an image around the vehicle (step S12). After the execution of step S12, the presentation control unit 13A determines whether or not a road sign or the like has been detected (step S13). When the presentation control unit 13A determines in step S13 that the road sign or the like has not been detected (step S13: NO), the presentation control unit 13A executes step S13 again and determines again whether or not the road sign or the like has been detected.

The presentation control unit 13A determines in step S13 that a road sign or the like has been detected (step S13: YES), and determines whether or not to present guide information corresponding to the detected road sign or the like (step). S14). In step S14, the presentation control unit 13A determines whether or not a certain number or more of past information (FIG. 3A) corresponding to the detected road sign or the like of the same type as the detected road sign or the like is stored in the storage unit 11. judge. In step S14, if it is determined that more than a certain number of information including the driver's gaze time when the same type of road sign or the like is detected in the past is not accumulated as the sign detection information, the guide information should be presented. Is determined to be.

Further, when the presentation control unit 13A determines in step S14 that a certain number or more of the marker detection data is accumulated, the driver's past gaze time or the driver obtained from the gaze time from the marker detection data is in the past. Refer to the past degree of interest shown in. For example, in step S14, when the referenced degree of interest is "low" (FIG. 3C), it is determined that the guide information should not be presented. Further, for example, when the degree of interest is less than a predetermined threshold value (less than a first predetermined value), it is determined that the guide information should not be presented.

In step S14, the presentation control unit 13A determines that the guide information should be presented (step S14: YES), and determines whether or not to emphasize the guide information (step S15). For example, the presentation control unit 13A determines in step S15 whether or not the degree of interest referred to in step S14 is “high” (FIG. 3C). Further, for example, when it is determined in step S14 that the label detection data is not accumulated in a certain number or more, it may be determined in step S15 to highlight.

When the presentation control unit 13A determines in step S15 that the guide information is not emphasized and presented (step S15: NO), the presentation control unit 13A causes the display unit 15 to normally present the guide information (step S16). For example, in step S16, guide information is presented in an inconspicuous manner as shown in FIG. 2A.

When the presentation control unit 13A determines in step S15 that the guide information is emphasized and presented (step S15: YES), the presentation control unit 13A causes the display unit 15 to emphasize and present the guide information (step S17). For example, in step S17, guide information is presented in an emphasized manner as shown in FIG. 2B.

After executing step S16 or step S17, the presentation control unit 13A determines whether or not the confirmation of the guide information by the driver has been completed (step S18). For example, in step S18, the presentation control unit 13A acquires data regarding the direction of the driver's line of sight from the vehicle interior monitor unit 23, and determines whether or not the confirmation has been completed. For example, if the presentation control unit 13A deviates from the display screen of the display unit 15 on which the guide information image is displayed in step S18, the confirmation is completed. It is determined that it has been done.

Further, for example, in step S18, when the driver's line of sight is not directed at all or is continuously directed to the guide information image, the presentation control unit 13A waits until the guide information image is displayed. After a certain period of time has passed, it is determined that the confirmation has been completed. In step S18, when the operation input unit 19 accepts the operation of stopping the display of the guide information image, it may be determined that the confirmation of the guide information is completed. Further, the degree of interest may be calculated based on the time until the operation is accepted.

When the presentation control unit 13A determines in step S18 that the confirmation of the guide information has not been completed (step S18: NO), the presentation control unit 13A repeats step S18. When the presentation control unit 13A determines in step S18 that the confirmation of the guide information is completed (step S18: YES), the presentation control unit 13A ends the presentation of the guide information (step S19).

The presentation control unit 13A accumulates the sign detection information after the execution of step S19 or when it is determined in step S14 that the guide information should not be presented (step S14: NO) (step S20). For example, the sign detection information includes the date and time when the road sign or the like was detected in the present presentation control routine RT1, the details of the road sign or the like, the type of the road sign or the like, and the time when the driver gazed at the road sign or the guide information ( Gaze time) and driver identification information are included. In step S20, the presentation control unit 13A stores the sign detection information in the storage unit 11.

After the execution of step S20, the presentation control unit 13A returns to the beginning of the presentation control routine RT1 and repeats the presentation control routine RT1.

As described above, in the presentation control routine RT1, the presentation control unit 13A presents the presentation mode of the guide information based on the past degree of interest of the driver. However, after the presentation, the driver's current degree of interest in the road sign or the like detected in step S13 of this routine is determined by the gaze time of the road sign or the guide information, and the aspect based on the current degree of interest. You may change to and present the guide information.

That is, the presentation control unit 13A may change the mode based on the driver's past interest level to the mode based on the driver's current level of interest in the detected road sign or the like and present the guide information.

For example, even if it is determined in step S14 that the guide information should not be presented (step S14: NO), the driver pays close attention to the road sign or the like detected in step S13 for a long time, and the degree of interest is high. When it is determined that the degree of interest is high (for example, the degree of interest is "medium (1)" or "high (2)"), for example, step S16 or step S17 may be executed to present the guide information.

Further, for example, even when it is determined in step S15 that the emphasis presentation is not performed and the normal presentation is made (for example, the degree of interest is "medium (1)"), the driver can use the road sign or the like or the guide information normally displayed. If it is determined that the degree of interest is high for a long time, the guide information may be emphasized and presented by executing step S17.

As described in detail above, according to the information presentation control device 10 of the first embodiment, how much the driver needs for guide information including the contents of road signs and the like detected while the moving body is traveling. That is, the degree of interest in road signs, etc. of the driver is adopted as an index of how useful it is for the driver to present the guide information to the driver, and the guide information is provided to the driver in a manner based on the degree of interest. can do. Therefore, information presentation control that can provide useful information to the driver in an appropriate manner according to the situation such as how much the driver understands each of the road signs and how familiar he / she is. Equipment can be provided.

The configuration of the information presentation control device 40 according to the second embodiment of the present invention will be described with reference to FIG. Similar to the information presentation control device 10 of the first embodiment, the information presentation control device 40 is mounted on a moving body such as a vehicle and includes information on a road sign or a road sign including a road marking existing around the moving body. When the guide information, which is information, is presented to passengers including the driver (hereinafter, also referred to as a driver) of the moving body, it is an information presentation control device that controls the presentation. For example, the guide information includes the content of traffic restrictions or instructions indicated by road signs or road markings. In this embodiment, an example in which the information presentation control device 40 is mounted on the vehicle will be described.

As shown in FIG. 5, the information presentation control device 40 differs from the information presentation control device 10 in that it does not have the vehicle interior monitor unit 23 and has the presentation control unit 13B. In other respects, it has a similar configuration. In this embodiment, the presentation control unit 13B totals the number of detections, which is the number of times a road sign or the like is detected.

FIG. 6A shows an example of the sign detection data table TB2 used by the presentation control unit 13B to control the presentation of guide information in the second embodiment. The label detection data table TB2 is stored in the storage unit 11. Every time a road sign or the like is newly detected, the sign detection information corresponding to the road sign or the like is added to the sign detection data table TB2. The sign detection information includes information such as the date and time when the road sign or the like was detected, details such as the name and description items of the detected road sign or the like, and driver identification information.

In FIG. 6A, the "date and time" when the road sign or the like is detected, the "details of the road sign or the like" which is detailed information such as the name and description items of the road sign or the like, and the "type" of the road sign or the like are associated with each other. It is listed in time series. In FIG. 6A, as the “type”, as in the case of the sign detection data table TB1 of the first embodiment, road signs and the like having the same name but different displayed numbers and the like are treated as the same type.

Further, in FIG. 6A, "driver identification information", which is driver identification information when each of the road signs and the like is detected, is described in association with each other. As described above, in FIG. 6A, the road sign or the like detected from the image acquired by the peripheral photographing unit 21 and the driver's identification information are stored in association with each other.

FIG. 6B shows the result of the presentation control unit 13B totaling the number of detections, which is the number of times the road sign or the like is detected when the driver A gets on the vehicle and travels, based on the sign detection data table TB2. ing. In FIG. 6B, the "integrated detection number" indicates the number of detections for each "type" per 10 hours of traveling time, which is the time during which the same driver has driven the vehicle.

The cumulative number of detections may be the number of detections per other predetermined traveling time. Further, for example, it may be the total number of detections per mileage, which is the distance traveled by the driver driving the vehicle, or the total number of detections since the driver first boarded the vehicle. In this way, the presentation control unit 13B aggregates the number of detections for each type of road sign or the like for each driver.

Further, FIG. 6B shows an example of the result of calculating the encounter frequency, which is the frequency at which the driver A encounters various road signs and the like from the cumulative number of detections. In FIG. 6B, when the cumulative detection number is less than 3, the encounter frequency is low “1 (low)”, and when the cumulative detection number is 3 or more and less than 20, the encounter frequency is medium “2 ( Middle) ”, and an example calculated as“ 3 (high) ”, which is considered to be a high encounter frequency when the cumulative number of detections is 20 or more, is shown.

The encounter frequency is calculated as the total number of detections per travel time, the number of detections per mileage, or the number of detections since the driver first boarded the vehicle for each type of road sign, etc. Is also good. Further, the encounter frequency may be calculated as a ratio of the number of detections for each type to the total number of detections of road signs and the like. Further, the encounter frequency may be calculated by combining these calculation methods.

In FIG. 6B, the cumulative detection number of the type "maximum speed" is 50, so the encounter frequency is "3 (high)", and the cumulative detection number of "pedestrian only" is 18, so the encounter frequency is "2 (medium)". Since the encounter frequency of "with rotary" is 1, it is calculated as the encounter frequency of "1 (low)".

In addition, the type of road sign and the like detected and the frequency of encounters differ depending on the route on which the driver gets on the vehicle and travels. For example, when the encounter frequency is low, it is considered that the driver tends to be unfamiliar with, unfamiliar with, or has a low level of understanding of the road sign or the like with a low encounter frequency. On the other hand, when the frequency of encounters is high, it is considered that the driver is familiar with, familiar with, or has a high degree of understanding of the road signs and the like with high frequency of encounters.

Therefore, when the frequency of encounters is low, the driver needs to have guide information corresponding to the road sign, that is, information including the content of traffic regulation indicated by the road sign, etc. Can be considered expensive. On the other hand, when the encounter frequency is high, the driver does not need much guide information corresponding to the road sign or the like, and it can be considered that the necessity is low.

FIG. 6C shows an embodiment based on the encounter frequency of FIG. 6B, in which the presentation control unit 13B displays the guide information as an image on the display screen of the display unit 15 to control the presentation of the guide information. An example of the judgment criteria is shown. According to the criterion of FIG. 6C, when the encounter frequency is "3 (high)", the guide information is not presented.

Further, when the encounter frequency is "2 (medium)", the guide information is normally presented and controlled in an inconspicuous and unemphasized normal mode as illustrated in FIG. 2A in Example 1. When the encounter frequency is "1 (low)", the emphasis presentation control of the guide information is performed in a more conspicuous and emphasized manner as illustrated in FIG. 2B in Example 1.

In this way, when the presentation control unit 13B displays the guide information on the display unit 15, it is necessary for the driver of the guide information by controlling to present the guide information in an manner based on the encounter frequency of the driver. It is possible to present according to the degree.

When the presentation control unit 13B notifies the guide information by the voice output unit 16, the presentation control unit 13B compares the case where the encounter frequency is "1 (low)" with the case where the encounter frequency is "2 (medium)". Then, it may be notified in a mode accompanied by a loud voice or a strange notification sound. Further, when the presentation control unit 13B presents the guide information by the HUD, when the encounter frequency is "1 (low)", the encounter frequency is "2 (medium)", as compared with the case where the encounter frequency is "2 (medium)". Control may be performed to lower the transmittance so that the guide information is more easily recognized.

In FIGS. 6B and 6C, an example in which the presentation control unit 13B calculates the encounter frequency as “1 (low)”, “2 (medium)”, and “3 (high)” has been described, but this is not the case. The encounter frequency may be calculated as any other numerical value.

That is, the presentation control unit 13B determines that the guide information should not be presented when the value of the encounter frequency is equal to or higher than the first predetermined value (first predetermined value), and the encounter frequency is less than the first predetermined value. However, when the value is equal to or higher than the second predetermined value (second predetermined value) smaller than the first predetermined value, the guide information is usually presented in an inconspicuous presentation mode, and the encounter frequency is the second predetermined value. When it is less than the value, the control for highlighting the guide information in a more conspicuous manner is given as an example of the control of the presentation mode.

Further, in the above, an example in which the encounter frequency is calculated by dividing the encounter frequency into three stages using the two predetermined values of the first predetermined value and the second predetermined value as threshold values has been described, but the present invention is not limited to this, and the predetermined value is one or more. It may be 3 or more. That is, it suffices if the judgment criteria for deciding the presentation of the guide information according to the encounter frequency are defined.

For example, in addition to "1 (low)", "2 (medium)", and "3 (high)", the encounter frequency is higher than "3 (high)" and is greater than or equal to the first predetermined value. You may define "4 (extremely high)". When the encounter frequency is "3 (high)", the guide information is not presented because it is familiar, but when the encounter frequency is "4 (extremely high)", it is important. Guide information may be presented as a road sign or the like.

[Presentation control routine RT2]
The presentation control routine RT2 executed by the presentation control unit 13B in the information presentation control device 40 will be described with reference to FIG. 7. The presentation control unit 13B starts the presentation control routine RT2 by starting the engine of the vehicle on which the information presentation control device 40 is mounted. The presentation control unit 13B may start the presentation control routine RT2 when the accessory power supply (hereinafter referred to as ACC power supply) of the vehicle is turned on.

When the presentation control unit 13B starts the presentation control routine RT2, the presentation control unit 13B executes the authentication of the passenger (step S31). In step S31, the presentation control unit 13B acquires the passenger identification information from the driver identification information acquisition unit 25 and authenticates the passenger.

For example, in step S31, the presentation control unit 13B acquires an identification number unique to the terminal carried by the driver driving the vehicle from the driver identification information acquisition unit 25, and stores this in the storage unit 11. The driver is recognized by collating with the identification information. When the identification number is not stored in the storage unit 11, such as when the driver first gets on the vehicle, the identification number acquired in step S31 is newly registered by storing it in the storage unit 11.

After the execution of step S31, the presentation control unit 13B causes the peripheral photographing unit 21 to start photographing around the vehicle and start acquiring an image around the vehicle (step S32). After the execution of step S32, the presentation control unit 13B determines whether or not a road sign or the like has been detected (step S33). When the presentation control unit 13B determines in step S33 that the road sign or the like has not been detected (step S33: NO), the presentation control unit 13B executes step S33 again and determines again whether or not the road sign or the like has been detected.

The presentation control unit 13B determines in step S33 that a road sign or the like has been detected (step S33: YES), and determines whether or not to present guide information corresponding to the detected road sign or the like (step). S34). In step S34, the presentation control unit 13B stores in the storage unit 11 a certain number or more of the sign detection information (FIG. 6A) of the driver corresponding to the road sign of the same type as the detected road sign or the like. Judge whether or not. In step S34, if it is determined that the information including the detected number is not accumulated in a certain number or more, it is determined that the guide information should be presented.

Further, when the presentation control unit 13B determines in step S34 that a certain number or more of information including the detected number is accumulated, the presentation control unit 13B determines the encounter frequency that the driver has encountered the same type of road sign or the like in the past. calculate. Then, based on the encounter frequency, it is determined whether or not the guide information should be presented.

For example, in step S34, the presentation control unit 13B should not present the guide information when the calculated encounter frequency is “3 (high)” (FIG. 6C) or when it is equal to or higher than the first predetermined value. Is determined. For example, the presentation control unit 13B should present guide information when the encounter frequency is "2 (medium)" or "1 (low)" or less than a predetermined threshold value (less than the first predetermined value). Is determined.

In step S34, the presentation control unit 13B determines that the guide information should be presented (step S34: YES) and determines whether or not to emphasize the guide information (step S35). For example, the presentation control unit 13B determines in step S35 whether or not the encounter degree calculated in step S34 is “1 (low)” (FIG. 6C). Further, for example, when it is determined in step S34 that the label detection information is not accumulated in a certain number or more, it may be determined in step S35 to highlight.

When the presentation control unit 13B determines in step S35 that the guide information is not emphasized and presented (step S35: NO), the presentation control unit 13B causes the display unit 15 to normally present the guide information (step S36). For example, in step S36, the guide information is continuously presented for a predetermined time in an inconspicuous manner as shown in FIG. 2A.

When the presentation control unit 13B determines in step S35 that the guide information is emphasized and presented (step S35: YES), the presentation control unit 13B causes the display unit 15 to emphasize and present the guide information (step S37). For example, in step S37, the guide information is continuously presented for a predetermined time in the emphasized manner as shown in FIG. 2B.

After executing step S36 or step S37, the presentation control unit 13B ends the presentation of the guide information by the display unit 15 (step S38). In addition, when the operation input unit 19 accepts the operation of stopping the display of the guide information image in step S38, the presentation control unit 13B ends the presentation of the guide information even if the predetermined time has not elapsed. You may let me. Further, the history of accepting the operation may be described and stored together with the sign detection information.

The presentation control unit 13B accumulates the sign detection information after the execution of step S38 or when it is determined in step S34 that the guide information should not be presented (step S34: NO) (step S39). For example, the sign detection information includes the date and time when the road sign or the like was detected in the present presentation control routine RT2, the details of the road sign or the like, the type of the road sign or the like, the cumulative number of detections, and the driver identification information. For example, the presentation control unit 13B stores the sign detection information in the storage unit 11 in step S39.

After the execution of step S39, the presentation control unit 13B determines whether or not the engine of the vehicle is turned on (step S40). When the presentation control unit 13B determines in step S40 that the engine is ON (step S40: YES), the presentation control unit 13B returns to step S33 and determines again whether or not a road sign or the like has been detected.

When it is determined in step S40 that the engine is not turned on (step S40: NO), the presentation control unit 13B ends the presentation control routine RT2.

The information presentation control device 40 of the present embodiment may have the vehicle interior monitor unit 23 as in the case of the first embodiment, and can acquire data such as the movement of the driver's line of sight and obtain the inside of the vehicle interior. It may be possible to identify the driver from the captured camera image.

As described above in detail, according to the information presentation control device 40 of the present embodiment, the number of detected road signs and the like detected while the moving body is traveling is totaled to calculate the encounter frequency, and the moving body travels. The frequency of encounters as an index showing how much the driver needs the guide information including the contents of the road signs detected in the vehicle, that is, how useful it is for the driver to present the guide information to the driver. Can be used. Then, the guide information can be provided to the driver in an manner based on the encounter frequency. Therefore, to provide an information presentation control device capable of providing useful information to the driver in an appropriate manner according to the situation of how much the driver has encountered each of the road signs and the like. Can be done.

The configuration of the presentation control system 100 including the information presentation control device 50 according to the third embodiment of the present invention will be described with reference to FIGS. 8, 9A and 9B. As shown in FIG. 8, the presentation control system 100 includes an information presentation control device 50 and an information presentation control server 60 as an information processing device. The information presentation control device 50 is mounted on the vehicle M.

The information presentation control device 50 and the information presentation control server 60, which is an external device of the information presentation control device 50, can transmit and receive data (communication connection) to and from each other via a network (communication path). For example, a communication protocol such as TCP / IP is used for the transmission / reception. Further, the network can be constructed by a mobile communication network, wireless communication such as Wi-Fi (registered trademark), and Internet communication including wired communication.

The information presentation control server 60 can transmit and receive data to and from each of the plurality of information presentation control devices 50 mounted on the plurality of vehicles M.

FIG. 9A shows the configuration of the information presentation control device 50. As shown in FIG. 9A, the information presentation control device 50 differs from the information presentation control device 40 of the second embodiment in that it has a communication unit 51 and a presentation control unit 13C. , In other respects, it is configured in the same way.

The communication unit 51 is a network adapter such as a NIC (Network Interface Card) for transmitting / receiving data to / from the outside according to the instruction of the presentation control unit 13C. For example, the communication unit 51 transmits the identification information of the driver who is on the vehicle M. Further, when the road sign or the like is detected while the vehicle M is traveling, the communication unit 51 transmits the sign detection information which is the information about the road sign or the like. The sign detection information includes details such as the name and display content of the detected road sign or the like, or the type of the detected road sign or the like.

For example, information about the road sign or the like is transmitted to the information presentation control server 60 using a communication protocol such as TCP / IP. Further, the communication unit 51 receives information regarding the presentation of the guide information including the information regarding the road sign and the like to the driver of the vehicle M.

When the presentation control unit 13C receives the information related to the presentation, the presentation control unit 13C controls the display unit 15 or the voice output unit 16 according to the content of the instruction included in the information to provide the driver with the guide information.

FIG. 9B shows the configuration of the information presentation control server 60. The server communication unit 61 is a network adapter such as a NIC, and transmits / receives data to / from one or a plurality of vehicle Ms. The server communication unit 61 receives the identification information of the driver on the vehicle M and the sign detection information regarding the road sign or the like detected while the vehicle M is traveling.

The server storage unit 62 is a storage device such as a hard disk, a flash memory, an SSD (Solid State Drive), and a RAM (Random Access Memory). The server storage unit 62 stores various programs such as an operating system and software for the server.

Further, the server storage unit 62 stores the driver history database (driver history DB) 62A. The driver history DB 62A stores driver history information, which is information indicating the history of each driver encountering a road sign or the like when boarding one or a plurality of vehicles M. For example, the driver history information includes the aggregated result of the number of detections for each type such as a road sign.

The server control unit 63 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, and the like, and functions as a computer. The server control unit 63 realizes various functions by reading and executing various programs stored in the server storage unit 62. The server control unit 63 includes a server presentation control unit 63A.

The server presentation control unit 63A controls the presentation or notification of the guide information based on the driver history information stored in the driver history DB 62A. For example, the server presentation control unit 63A acquires the driver identification information and the detected sign detection information such as a road sign from the server communication unit 61 and adds them to the driver history information to total the number of detections. For example, the number of detections is totaled for each type of road sign or the like. The server presentation control unit 63A functions as a totaling unit that totals the number of detected road signs and the like for each type.

Further, when the server presentation control unit 63A acquires the sign detection information from the server communication unit 61, the server presentation control unit 63A calculates the encounter frequency from the aggregated result of the number of detections included in the driver history information corresponding to the sign detection information, and determines the encounter frequency. Based on this, it is determined whether or not the guide information corresponding to the detected road sign or the like should be presented. The server presentation control unit 63A causes the information presentation control device 50 to transmit data including the result of the determination from the server communication unit 61.

FIG. 10 shows an example of the sign detection data table TB3 stored in the driver history DB 62A as the driver history information. In FIG. 10, information regarding the detection of road signs and the like detected when the driver A is boarded in different vehicles M1, M2, and M3 is shown in chronological order.

As shown in FIG. 10, road signs and the like of the same type are detected even when boarding different vehicles. For example, a road sign of the type "road construction in progress" is detected while boarding the vehicle M2, and then detected while boarding the vehicle M3.

Further, as in the case of the first and second embodiments, those having the same name but different numbers or the like displayed on the road sign or the like may be treated as the same type. For example, in FIG. 10, road signs having a "maximum speed of 60 km" and a "maximum speed of 80 km" are described as the same type "maximum speed".

Based on the driver history information shown in FIG. 10, the server presentation control unit 63A aggregates the number of detected road signs and the like, calculates the encounter frequency at which the driver A encounters the road sign and the like, and based on the encounter frequency, Determine the mode of presentation of guide information. The encounter frequency is, for example, "3 (high)" when it is equal to or more than the first predetermined value, and is less than the first predetermined value and equal to or more than the second predetermined value, as in the case shown in FIG. 6B in Example 2. In some cases, it can be calculated as "2 (medium)", and in the case of less than the second predetermined value, it can be calculated as "1 (low)".

For example, the presentation mode may be determined that the guide information should not be presented when the encounter frequency is "3 (high)", as in the case shown in FIG. 6C in Example 2. In addition, guide information is provided by normal presentation, which is an inconspicuous presentation mode when the encounter frequency is "2 (medium)", and by emphasized presentation, which is a conspicuous presentation mode when the encounter frequency is "1 (low)". It may be determined that it should be presented.

[Presentation control routine RT3]
The presentation control routine RT3 executed in the presentation control system 100 will be described with reference to FIG. The broken line in FIG. 11 schematically shows the state of data transmission / reception. Further, in FIG. 11, the routine executed by the information presentation control device 50 is shown as the routine RT3A, and the routine executed by the information presentation control server 60 is shown as the routine RT3B.

The presentation control unit 13C of the information presentation control device 50 starts the routine RT3A by starting the engine of the vehicle M. The presentation control unit 13C may start the routine RT3A when the ACC power supply of the vehicle M is turned on.

When the presentation control unit 13C starts the routine RT3A, the driver identification information of the vehicle M is acquired from the driver identification information acquisition unit 25, and the communication unit 51 is controlled to be transmitted to the information presentation control server 60 (step S51A). In step S51A, the driver identification information is transmitted by the communication unit 51 together with the device ID of the information presentation control device 50. In step S51A, the communication unit 51 functions as a transmission unit.

For example, in step S51A, the presentation control unit 13C acquires an identification number unique to the terminal carried by the driver from the driver identification information acquisition unit 25 and transmits it together with the device ID of the information presentation control device 50.

For example, in step S51A, the driver identification information acquisition unit 25 may acquire the driver identification information by biometric authentication such as fingerprint authentication or iris authentication. Further, the driver identification information acquisition unit 25 may acquire password input information from the driver and provide it to the presentation control unit 13C in addition to the biometric authentication information.

For example, the device ID is an identifier in the communication protocol used between the information presentation control device 50 and the information presentation control server 60. Further, the information transmitted in step 51A may include a vehicle ID which is identification information of the vehicle M.

The server presentation control unit 63A of the information presentation control server 60 starts the routine RT3B when the information presentation control server 60 is started. When the server presentation control unit 63A starts the routine RT3B, the server presentation control unit 63A waits for the reception of the driver identification information (step S51B).

After executing step S51B, the server presentation control unit 63A determines whether or not the driver identification information has been received (step S52B). In step S52B, the server presentation control unit 63A determines whether or not the information including the driver identification information and the device ID of the information presentation control device 50 has been received by the server communication unit 61. In step S52B, the server communication unit 61 functions as a receiving unit.

When the server presentation control unit 63A determines that the driver identification information has not been received (step S52B: NO), the server presentation control unit 63A waits for the reception for a certain period of time, and then executes step S52B again.

When the server presentation control unit 63A determines that the driver identification information has been received (step S52B: YES), the server presentation control unit 63A determines whether or not the driver identification information has already been registered in the driver history DB 62A of the server storage unit 62 (step). S53B). The determination in step S53B is made depending on whether or not the driver identification information received in step S52B is described in the sign detection data table TB3.

When the server presentation control unit 63A determines in step S53B that the driver identification information is not registered (step S53B: NO), the server presentation control unit 63A newly registers the driver identification information received in step S52B (step S54B). The registration in step S54B is performed by a process of newly describing and storing the received driver identification information in the sign detection data table TB3.

After the execution of step S51A, the presentation control unit 13C causes the peripheral photographing unit 21 to start photographing the surroundings of the vehicle and start acquiring an image of the surroundings of the vehicle (step S52A). After executing step S52A, the presentation control unit 13C determines whether or not a road sign or the like has been detected (step S53A). When the presentation control unit 13C determines in step S53A that the road sign or the like has not been detected (step S53A: NO), the presentation control unit 13C executes step S53A again and determines again whether or not the road sign or the like has been detected.

When the presentation control unit 13C determines in step S53A that a road sign or the like has been detected (step S53A: YES), the presentation control unit 13C transmits the detected sign detection information such as the road sign to the information presentation control server 60 (step S54A). ).

The server presentation control unit 63A waits for the sign detection information when it is determined in step S53B that the driver identification information is registered (step S53B: YES) or after the execution of step S54B (step S55B). After that, the server presentation control unit 63A determines whether or not the sign detection information has been received (S56B).

When the server presentation control unit 63A determines in step S56B that the sign detection information has not been received (step S56B: NO), the server presentation control unit 63A repeats step S56B. In step S56B, the server presentation control unit 63A determines that the sign detection information has been received (step S56B: YES) and determines whether or not the guide information should be presented (step S57B).

In step S57B, from the driver history information stored in the driver history DB 62A, the calculation of the encounter frequency (FIG. 6B) and the determination of the presentation mode based on the encounter frequency (FIG. 6C) are performed as in the second embodiment. For example, in step S57B, the server presentation control unit 63A determines that the guide information should not be presented when the encounter frequency is equal to or higher than the first predetermined value (first predetermined value), and the encounter frequency is the first. If it is less than a predetermined value, it is determined that the guide information should be presented.

Further, the server presentation control unit 63A may determine in step S57B that the guide information should be presented when the driver history information is not accumulated in a certain number or more.

When the server presentation control unit 63A determines in step S57B that the guide information should be presented (step S57B: YES), the server presentation control unit 63A requests the guide information output (presentation request), which is information including information for requesting the output of the guide information. ) Is transmitted to the information presentation control device 50 (step S58B). For example, in step S58B, the server presentation control unit 63A generates information including information requesting output of the guide information and information indicating the presentation mode of the guide information, and causes the server communication unit 61 to transmit the information. In step S58B, the server communication unit 61 functions as a transmission unit.

After executing step S54A, the presentation control unit 13C determines whether or not the guide information output request has been received (step S55A). In step S55A, the presentation control unit 13C determines whether or not the communication unit 51 has received the guide information output request. In step S55A, the communication unit 51 functions as a receiving unit. For example, in step S55A, the presentation control unit 13C repeats the determination of whether or not the guide information output request has been received for a predetermined time.

When the presentation control unit 13C determines in step S55A that the guide information output request has been received (step S55A: YES), the presentation control unit 13C presents the guide information (step S56A). For example, the presentation control unit 13C causes the display screen of the display unit 15 to display the guide information for a predetermined time in step S56A. Further, the mode of presentation in step 56A may be performed by an inconspicuous normal presentation mode or a conspicuous emphasized presentation mode according to the instruction included in the guide information output request. Further, for example, the presentation control unit 13C may have the voice output unit 16 output the voice read out from the guide information in step S56A.

The presentation control unit 13C ends the presentation of the guide information after the execution of step S56A (step S57A). The presentation control unit 13C determines whether or not the engine of the vehicle M is ON when it is determined that the guide information output request has not been received after the execution of step S57A or in step S55A (step S55A: NO). (Step S58A).

When the presentation control unit 13C determines in step S58A that the engine is ON (step S58A: YES), the presentation control unit 13C returns to step S53A and determines again whether or not a road sign or the like has been detected.

When the presentation control unit 13C determines in step S58A that the engine is not turned on (step S58A: NO), the presentation control unit 13C transmits the travel end information indicating that the vehicle M has finished traveling to the information presentation control server 60. (Step S59A). The presentation control unit 13C ends the routine RT3A after executing step S59A.

After executing step S58B, the server presentation control unit 63A determines whether or not the travel end information of the vehicle M has been received (step S59B). When the server presentation control unit 63A determines in step S59B that the travel end information has not been received (step S59B: NO), the server presentation control unit 63A returns to step S55B and waits for the sign detection information again. The server presentation control unit 63A determines in step S59B that the travel end information has been received (step S).
59B: YES) and the routine RT3B is terminated.

In this embodiment, the case where the information presentation control server 60 determines whether or not the guide information should be presented has been described, but the present invention is not limited to this. The determination may be made by the presentation control unit 13C of the information presentation control device 50. For example, the server presentation control unit 63A of the information presentation control server 60 may transmit information including the number of detected road signs and the like or the frequency of encounters to the information presentation control device 50 instead of the guide information output request.

In this case, the presentation control unit 13C of the information presentation control device 50 may total the number of detections, and based on the number of detections or the frequency of encounters, determines whether or not the guide information should be presented and determines the presentation mode. You may go. It suffices if the number of detections for each driver for a plurality of vehicles is aggregated in the driver history DB 62A and the encounter frequency can be calculated by the server presentation control unit 63A or the presentation control unit 13C.

As described above in detail, according to the presentation control system 100 of the third embodiment, the frequency of encounters that a driver traveling on a different vehicle has encountered in the past is determined by the difference between the vehicles in the information presentation control server 60. Regardless, it can be aggregated for each type of road sign, etc. Then, the guide information can be presented to the driver in an manner based on the encounter frequency that differs for each driver.

Therefore, for example, by using a rental vehicle such as car sharing or a rental car, one driver has an opportunity to board multiple vehicles, and even if the driver does not always board the same vehicle, the driver may use a road sign, etc. The frequency of encounters with each driver can be aggregated for each driver, and guide information can be presented based on the frequency of encounters for each driver.

Therefore, it is possible to provide an information presentation control device and an information presentation control server that can provide information useful to the driver in an appropriate manner for the driver.

The information presentation control device 70 according to the fourth embodiment will be described below with reference to the accompanying drawings. FIG. 12 shows the configuration of the information presentation control device 70. The information presentation control device 70 is configured in the same manner as the information presentation control device 40 according to the second embodiment, and is different from the presentation control unit 13A in that it has a presentation control unit 13D capable of different control.

The information presentation control device 70 is mounted on a vehicle capable of switching between automatic driving and manual driving with respect to the driving mode. As used herein, the term "autonomous driving" refers to a mode of driving that does not require human involvement. Further, in the present specification, the manual operation represents a mode of operation (non-automatic operation) in which a human needs to be involved, and includes a partial manual operation. Partial manual operation refers to an operation mode in which at least part of the operation or confirmation of the surroundings needs to be performed by a human and requires some human involvement.

Further, in the present specification, a vehicle that can be switched between automatic driving and manual driving is a vehicle that can be driven in an automatic driving mode and has bad environmental conditions such as surrounding road conditions or weather. Or, it refers to a vehicle that can be driven in the manual driving mode when the automatic driving is canceled by the driver's intention. For example, a vehicle capable of driving at level 3 or higher in the SAE J3016 standard falls under this category.

The presentation control unit 13D controls the presentation of guide information including information on road signs and the like, based on whether or not the driving mode of the vehicle is automatic driving. Specifically, the presentation control unit 13D provides information on the explanation of traffic rules, penalties for violating traffic rules, more types of road signs, etc. while driving in the automatic driving mode (during automatic driving). The guide information is presented in a manner showing detailed contents including more information such as.

During operation in the manual operation mode (during manual operation), the presentation control unit 13D causes the presentation control unit 13D to present simple guide information including less information such as only the name of a road sign or the like. Whether or not the driving is automatic is determined, for example, by acquiring information from the vehicle.

For example, among the types of road signs and the like, which type of guide information is to be presented can be selected by setting a predetermined criterion. For example, when the vehicle is not in automatic driving (non-automatic driving), the presentation control unit 13D causes the presentation control unit 13D to present guide information for non-automatic driving regarding a type of road sign or the like that satisfies the first criterion. Further, for example, when the vehicle is in automatic driving, the presentation control unit 13D provides guide information for automatic driving for a type of sign or sign that satisfies the second standard, which is a standard that is easier to meet than the first standard. May be presented.

For example, as the predetermined criterion, the degree of interest of the passenger in the road sign or the like as in the cases of the first to third embodiments or the frequency of the passenger encountering the road sign or the like can be used. For example, guide information corresponding to a type of road sign having a higher degree of interest than a predetermined value or a type of road sign having an encounter frequency lower than a predetermined value may be displayed. Then, by setting the predetermined value low during automatic operation and setting the predetermined value high during manual operation, guide information including more information is presented during automatic operation, and during manual operation. Can present guide information that contains less information.

The function of the presentation control unit 13D is the information presentation control device 10 (FIG. 1) in the first embodiment, the information presentation control device 40 (FIG. 5) in the second embodiment, or the presentation control system 100 (FIG. 8, FIG. 8) in the third embodiment. It can also be realized in FIG. 9A).

Therefore, in the information presentation control device 70, as an index indicating the degree of necessity required for passengers including the driver, the degree of interest of the driver in the road sign or the like or the frequency of encountering the road sign or the like is the encounter frequency. May be adopted and the guide information may be presented to the driver in a manner based on the degree of interest or the frequency of encounters.

FIG. 13A shows an example of a display screen including guide information displayed on the display screen 30 of the display unit 15 during automatic operation in the fourth embodiment. In FIG. 13A, the image 31 in front of the vehicle is displayed. The image 31 in front of the vehicle includes a road sign 31A indicating the maximum speed. The guide information 35 corresponding to the road sign 31A is displayed below the image 31 in front of the vehicle.

The guide information 35 includes an image 35A showing the road sign 31A and characters 35B showing the detailed contents of the road sign 31A. The character 35B indicates not only the name of the road sign 31A but also the meaning displayed by the road sign 31A. In addition to the guide information 35, the navigation information area 33 such as map information may be displayed in a part of the display screen 30.

FIG. 13B shows another example of the display screen including the guide information displayed on the display screen 30 of the display unit 15 during the automatic operation in the fourth embodiment. In FIG. 13B, the image 36 in front of the vehicle is displayed. The image 36 in front of the vehicle includes a road sign 36A indicating a pause. The guide information 37 corresponding to the road sign 36A is displayed below the image 36 in front of the vehicle.

The guide information 37 includes an image 37A showing the road sign 36A and characters 37B showing the detailed contents of the road sign 36A. The character 37B indicates not only the name of the road sign 36A but also the detailed contents including the meaning to be displayed and the penalties.

Further, when the guide information 37 in FIG. 13B is presented, the voice read out from the character 37B may be output from the voice output unit 16. For example, the guide information 37A is displayed on the display screen 30 with the voice "This is a stop sign. It is a violation even if you drive slowly. The number of violation points is 2 and the penalty for a normal car is 7,000 yen." ..

Detailed information as illustrated in FIG. 13B may be used for driver learning. In addition to the guide information, the navigation information area 38 such as map information may be displayed in a part of the display screen 30.

FIG. 13C shows another example of the quiz mode display screen displayed on the display screen 30 of the display unit 15 during automatic operation in the fourth embodiment. The quiz mode is used, for example, to confirm the learning result or comprehension level of the driver. In FIG. 13C, an image of a road sign and a problem of selecting the correct meaning of the road sign are displayed. For example, the driver can learn about road signs and the like during automatic driving that does not need to be involved in driving, and can be useful for recognizing road signs when switching to manual driving.

[Presentation control routine RT4]
As an example of the routine executed in the fourth embodiment, the presentation control routine RT4 executed by the presentation control unit 13D will be described with reference to FIG. The presentation control unit 13D starts the presentation control routine RT4 by starting the engine of the vehicle equipped with the information presentation control device of the fourth embodiment. The presentation control unit 13D may start the presentation control routine RT4 when the ACC power supply of the vehicle is turned on.

When the presentation control unit 13D starts the presentation control routine RT4, the presentation control unit 13D executes authentication of passengers including the driver of the vehicle (step S61). In step S61, the presentation control unit 13D acquires the passenger identification information from the driver identification information acquisition unit 25 and authenticates the passenger.

For example, in step S61, the presentation control unit 13D acquires the identification number of the terminal carried by the driver or the biometric information of the driver, and collates it with the identification information stored in the storage unit 11 and registered in advance. Authenticate the driver. If the driver's identification information is not stored in the storage unit 11, the identification information acquired in step S61 is stored in the storage unit 11 and newly registered.

After the execution of step S61, the presentation control unit 13D causes the peripheral photographing unit 21 to start photographing the surroundings of the vehicle and start acquiring an image of the surroundings of the vehicle (step S62). After the execution of step S62, the presentation control unit 13D determines whether or not a road sign or the like has been detected (step S63). When the presentation control unit 13D determines in step S63 that the road sign or the like has not been detected (step S63: NO), the presentation control unit 13D executes step S63 again and determines again whether or not the road sign or the like has been detected.

The presentation control unit 13D determines in step S63 that a road sign or the like has been detected (step S63: YES), and determines whether or not the driving mode of the vehicle is the automatic driving mode (step S64).

When the presentation control unit 13D determines in step S64 that the mode is not the automatic operation mode (step S64: NO), the presentation control unit 13D displays the guide information in a simple manner that does not include detailed information (non-automatic operation guide information presentation mode). ) Control (step S65). In step S65, the presentation control unit 13D displays the guide information for a certain period of time in a simple manner as shown in FIG. 2A, for example, in the first embodiment.

In step S64, the presentation control unit 13D controls to present detailed guide information including a lot of information (automatic driving guide information presentation mode) when it is determined that the mode is automatic driving mode (step S64: YES) (step S64: YES). Step S66). In step S66, the presentation control unit 13D causes, for example, present detailed guide information as shown in FIG. 13A or detailed guide information accompanied by voice as shown in FIG. 13B for a certain period of time. Further, in step S66, the presentation control unit 13D causes the presentation control unit 13D to present detailed guide information including the quiz mode as shown in, for example, 13C for a certain period of time.

In the presentation control in steps S65 and S66, the presentation control unit 13D may further control the presentation mode of the guide information based on the degree of interest or the frequency of encounters. For example, it may be determined that the guide information is not presented when the degree of interest is low or the frequency of encounters is high.

The presentation control unit 13D saves the history related to the presentation of the guide information after the execution of step S65 or step S66 (step S67). In step S67, the presentation control unit 13D stores the sign detection information including the detected date and time of the newly detected road sign or the like in the storage unit 11. Further, in step S67, the presentation control unit 13D may store information such as whether or not the content of the presented guide information is detailed or the driver's comprehension level in the storage unit 11.

After the execution of step S67, the presentation control unit 13D determines whether or not the engine of the vehicle is turned on (step S68). When the presentation control unit 13D determines in step S68 that the engine is ON (step S68: YES), the presentation control unit 13D returns to step S63 and determines again whether or not a road sign or the like has been detected.

When the presentation control unit 13D determines in step S68 that the engine is not turned on (step S68: NO), the peripheral photographing unit 21 ends the photographing around the vehicle and ends the presentation control routine RT4. ..

As described above in detail, the information presentation control device or the information presentation control system according to the fourth embodiment of the present invention mounted on a vehicle capable of switching the operation mode between automatic driving and non-automatic driving. According to this, it is possible to provide the driver with detailed information including more information regarding road signs and the like in the automatic driving mode in which the driver does not need to be involved in driving.

It is possible to provide the driver with an opportunity to check or learn about the contents indicated by road signs and related rules and penalties, and maintain knowledge about road signs even if the driver uses the automatic driving mode. Allows you to do.

Therefore, according to the information presentation control device or the information presentation control system of the fourth embodiment, it is possible to present information on road signs and the like in an appropriate amount and mode according to the situation of whether or not the automatic driving mode is set. It is possible to bring useful information to the passengers.

10, 40, 50, 70 Information presentation control device 11 Storage unit 13 Control unit 13A Presentation control unit 15 Display unit 16 Audio output unit 17 Driving information acquisition unit 19 Operation input unit 21 Peripheral photography unit 23 Vehicle interior monitor unit 25 Driver recognition information Acquisition unit 51 Communication unit 60 Information presentation control server 61 Server communication unit 62 Server storage unit 62A Driver history DB
63 Server control unit 63A Server presentation control unit

Claims (12)

A detection unit that detects signs or markings including road signs or road markings that exist around the moving object, and
A presentation control unit for controlling the presentation of guide information including information on the first sign or marking detected by the detection unit to the passengers of the moving object is provided.
The presentation control unit presents the guide information in an manner based on the passenger's past interest in the sign or sign of the same type as the first sign or sign .
The presentation control unit is an information presentation control device, characterized in that the degree of interest is calculated based on the time when the passenger gazes at the image when the guide information is presented as an image . The presentation control unit is based on the degree of interest of the passenger in the guide information when the guide information is presented in the past before the time when the presentation control is performed with respect to the first sign or the sign. The information presentation control device according to claim 1, wherein the guide information corresponding to the sign or the sign of 1 is presented. The information presentation control device according to claim 1 or 2, wherein the presentation control unit does not present the guide information when the degree of interest is less than the first predetermined value. The presentation control unit emphasizes the presentation when the degree of interest is greater than or equal to the second predetermined value higher than the first predetermined value and more than when the degree of interest is greater than or equal to the first predetermined value and less than the second predetermined value. The information presentation control device according to claim 3, further comprising the embodiment. The presentation control unit calculates the degree of interest based on the time when the passenger gazes at the sign or sign of the same type in the past before the time when the presentation control is performed with respect to the first sign or sign. The information presentation control device according to any one of claims 1 to 4, which is characterized. An operation unit for receiving an operation for stopping the presentation of the guide information is provided.
One of claims 1 to 4, wherein the presentation control unit calculates the degree of interest based on the time from the presentation of the guide information to the acceptance of the operation by the operation unit. The information presentation control device described in. Equipped with a specific part for identifying the passenger
The present invention according to any one of claims 1 to 6 , wherein the presentation control unit presents the guide information in an manner based on the degree of interest of one passenger specified by the specific unit. Information presentation control device. The presentation control unit is characterized in that the mode based on the past degree of interest is changed to the mode based on the degree of interest of the passenger with respect to the first sign or sign, and the guide information is presented. The information presentation control device according to any one of claims 1 to 7 . A method of presenting guide information including information on a sign or a sign including a road sign or a road sign by an information presentation control device.
A detection step in which the detection unit detects the sign or marking existing around the moving object.
The presentation control unit includes a presentation control step for controlling the presentation of the moving object to the passenger of the guide information including the information regarding the first sign or marking detected by the detection unit.
In the presentation control step, the presentation control unit presents the guide information in an manner based on the passenger's past interest in the sign or sign of the same type as the first sign or sign .
The presentation control unit is an information presentation control method, characterized in that the degree of interest is calculated based on the time when the passenger gazes at the image when the guide information is presented as an image . An information presentation control program executed by an information presentation control device equipped with a computer.
A detection unit that detects signs or markings including road signs or road markings that exist around the moving object, and
A presentation control unit that controls the presentation of guide information including information on the first sign or marking detected by the detection unit to the passengers of the moving object.
To make the computer function as
The presentation control unit presents the guide information in an manner based on the passenger's past interest in the sign or sign of the same type as the first sign or sign .
The presentation control unit is an information presentation control program characterized in that the degree of interest is calculated based on the time when the passenger gazes at the image when the guide information is presented as an image . A computer-readable recording medium comprising the program according to claim 10 . A detection unit that detects signs or markings including road signs or road markings that exist around the moving object, and
A presentation control unit that controls the presentation of guide information including information on the first sign or marking detected by the detection unit to the passengers of the moving object, and a presentation control unit.
An operation unit for receiving an operation for stopping the presentation of the guide information is provided.
The presentation control unit presents the guide information in an manner based on the passenger's past interest in the sign or sign of the same type as the first sign or sign.
The presentation control unit is an information presentation control device, characterized in that the degree of interest is calculated based on the time from the presentation of the guide information to the acceptance of the operation by the operation unit.

Images