JP2018036728A - Driving support device and driving support method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a driving support device and a driving support method capable of performing more suitable driving support when recognizing a road sign.SOLUTION: A driving support device comprises a sign recognition part, a situation recognition part, an information processing part, and a notification part. The sign recognition part recognizes an installed road sign. The situation recognition part recognizes a peripheral situation of the installed road sign. The information processing part processes information provided by the road sign recognized by the sign recognition part in accordance with the situation recognized by the situation recognition part. The notification part performs notification of the information processed by the information processing part.SELECTED DRAWING: Figure 1

Description

  Embodiments described herein relate generally to a driving support apparatus and a driving support method.

  Conventionally, when a road sign is recognized from a captured image of an in-vehicle camera that images the front of the vehicle, driving assistance is performed by displaying the recognized road sign image and the image indicating the meaning of the recognized road sign in characters. There is a driving support device (see, for example, Patent Document 1). According to such a driving assistance device, even when it is difficult to recognize the road sign with the naked eye, the road sign can be well notified.

JP 2014-160408 A

  However, when a road sign is recognized, it may not be sufficient as driving assistance to display a recognized road sign image or an image showing the meaning of the recognized road sign in characters. Therefore, an object of the present embodiment of the present invention is to provide a driving support device and a driving support method that can perform more appropriate driving support when a road sign is recognized.

  The driving support device according to the embodiment includes a sign recognition unit, a situation recognition unit, an information processing unit, and a notification unit. The sign recognition unit recognizes the installed road sign. The situation recognition unit recognizes the situation around the installed road sign. The information processing unit processes the information provided by the road sign recognized by the sign recognition unit according to the situation recognized by the situation recognition unit. The notification unit notifies the information processed by the information processing unit.

  The driving support apparatus and driving support method according to the embodiment can perform more appropriate driving support when a road sign is recognized.

FIG. 1 is a block diagram illustrating an example of the configuration of the driving support apparatus according to the embodiment. FIG. 2 is an explanatory diagram illustrating an example of driving assistance according to the embodiment. FIG. 3 is an explanatory diagram illustrating an example of driving assistance according to the embodiment. FIG. 4 is an explanatory diagram illustrating an example of driving assistance according to the embodiment. FIG. 5 is an explanatory diagram illustrating an example of driving assistance according to the embodiment. FIG. 6 is an explanatory diagram illustrating an example of driving assistance according to the embodiment. FIG. 7 is a flowchart illustrating processing executed by the control unit of the driving support apparatus according to the embodiment.

  Hereinafter, a driving support device and a driving support method according to an embodiment will be described in detail with reference to the accompanying drawings. In addition, this invention is not limited by this embodiment. FIG. 1 is a block diagram illustrating an example of a configuration of a driving support apparatus 1 according to the embodiment.

  The driving support device 1 is a device that is mounted on a vehicle and performs driving support related to the recognized road sign when the road sign is recognized. As shown in FIG. 1, the driving support device 1 is connected to a navigation device 41, a camera 42, a sensor 43, and an input / output device 5. The driving support device 1 is connected to the weather information providing device 61 and the road information providing device 62 via the communication network 6. The navigation device 41 is also connected to the input / output device 5.

  The navigation device 41 is provided in a vehicle (hereinafter simply referred to as “vehicle”) on which the driving support device 1 is mounted. The navigation device 41 stores map information, and registers the destination input from the input / output device 5 in the map information when the user inputs a destination using the input / output device 5.

  Then, the navigation device 41 uses the map information and GPS (Global Positioning System) to output a map image and sound for guiding the route from the current position to the destination to the input / output device 5 to perform route guidance. .

  Moreover, the map information memorize | stored in the navigation apparatus 41 contains the installation location of the road sign in a map, and the information regarding the road sign installed in each installation location. Then, the navigation device 41 outputs to the driving support device 1 information on the current position and road signs installed on the travel route ahead of the vehicle (traveling direction) at the current position.

  The camera 42 is provided at a position where the front (traveling direction) of the vehicle can be imaged, and outputs information of the captured image to the driving support device 1. The sensor 43 is, for example, an illuminance sensor, and outputs information indicating the illuminance of light that illuminates the vehicle and the brightness around the vehicle to the driving support device 1.

  The input / output device 5 includes a display 51 and a speaker 52, and is provided at a position where the user can visually recognize and operate the vehicle, for example, in the center of the dashboard. The display 51 is, for example, a TFT (Thin Film Transistor) liquid crystal display device having a touch panel function. The display 51 displays, for example, an image indicating the current position of the vehicle input from the navigation device 41, information related to driving support input from the driving support device 1, and the like.

  The display 51 outputs various information input by the user using the touch panel function to the navigation device 41 and the driving support device 1. The speaker 52 outputs, for example, a voice for guiding a route input from the navigation device 41, a voice for driving support input from the driving support device 1, and the like.

  The communication network 6 is a wireless communication network that provides FM (Frequency Modulation) multiplex broadcasting, radio wave beacons, optical beacons, and the like to the driving support device 1. The weather information providing device 61 and the road information providing device 62 are provided in a predetermined information providing facility.

  The weather information providing device 61 transmits real-time weather information to the driving support device 1 via the communication network 6. For example, the weather information providing device 61 transmits information such as the date and time, weather, temperature, humidity, precipitation per unit time, and snowfall at the current position of the vehicle to the driving support device 1.

  The road information providing device 62 transmits real-time road information to the driving support device 1. For example, the road information providing device 62 may perform construction, congestion, accidents, broken cars, disasters, and regulations according to these situations (for example, road closure, lane regulation, speed regulation, chain regulation, etc.) on the surrounding road at the current position of the vehicle. ) Is transmitted to the driving support device 1.

  The driving support device 1 includes a control unit 2 and a storage unit 3. The storage unit 3 is, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, or a storage device such as an HDD (Hard Disk Drive) or an optical disk.

  The storage unit 3 stores information such as a driving support program 31, sign information 32, text voice information 33, driver information 34, and area information 35. The driving support program 31 is a program executed when the control unit 2 performs driving support related to a road sign. The sign information 32 is information in which information of an image image having the same shape, color, and design as each road sign is associated with information provided by each road sign.

  The character voice information 33 includes information on a character string such as a plurality of phrases used when the control unit 2 performs driving support, and information on a voice uttering the character string. The driver information 34 and the area information 35 are information that the user inputs using the input / output device 5. The driver information 34 includes, for example, information on the cumulative score imposed on the driver due to an accident violation, and information indicating a tendency (for example, careful driving, rough driving, etc.) of the driver. The area information 35 is information indicating an area (for example, a living area) in which the user runs the vehicle on a daily basis.

  The control unit 2 includes, for example, a microcomputer having a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), an input / output port, and various circuits.

  The control unit 2 includes a plurality of processing units that function when the CPU executes the driving support program 31 stored in the ROM using the RAM as a work area. Specifically, the control unit 2 includes a sign recognition unit 21, a communication unit 22, a situation recognition unit 23, a date acquisition unit 24, an information processing unit 25, and a notification unit 26.

  Each of the plurality of processing units may be partially or entirely configured by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

  The sign recognition unit 21 is a processing unit that recognizes a road sign installed in front of the vehicle. Specifically, the sign recognition unit 21 reads the sign information 32 from the storage unit 3 when information of a captured image obtained by capturing the front of the vehicle from the camera 42 is input.

  Then, the sign recognition unit 21 performs pattern matching on the image information of each road sign included in the sign information 32 with the information on the captured image, and recognizes the road sign that matches the image image as the installed road sign. .

  In addition, the sign recognition unit 21 is a road sign installed in front of the vehicle based on the current position input from the navigation device 41 and information on the road sign installed in the travel route ahead of the vehicle (traveling direction) at the current position. Can also be recognized. Then, the sign recognition unit 21 outputs an image image of the recognized road sign and information provided by the road sign (information indicating the meaning of the road sign) to the information processing unit 25.

  The communication unit 22 is connected to the weather information providing device 61 and the road information providing device 62 via the communication network 6 so as to be capable of wireless communication, and receives various information transmitted from the weather information providing device 61 and the road information providing device 62. Then, the data is output to the situation recognition unit 23 and the date / time acquisition unit 24.

  Specifically, the communication unit 22 receives, in real time, information such as weather, temperature, humidity, precipitation per unit time, and snowfall at the current position of the vehicle from the weather information providing device 61, and the received information Is output to the situation recognition unit 23. Further, the communication unit 22 receives information indicating the current date and time from the weather information providing device 61 and outputs the received information to the date and time acquisition unit 24.

  In addition, the communication unit 22 receives, in real time, information related to construction, traffic jams, accidents, broken cars, disasters, and regulations according to these situations at the current location of the vehicle from the road information providing device 62. The information is output to the situation recognition unit 23. If the road information providing device 62 is configured to transmit the current date and time, the communication unit 22 outputs information indicating the current date and time received from the road information providing device 62 to the date and time acquisition unit 24.

  The situation recognition unit 23 is installed in front of the vehicle based on the information of the captured image input from the camera 42, the information input from the sensor 43, and the weather information and road information input from the communication unit 22. Recognize the situation around road signs.

  Then, when the situation recognizing unit 23 recognizes a situation that affects the running of the vehicle such as heavy rain, snow, road freezing, traffic jam, road construction, and traffic accident, for example, information indicating the recognition result is displayed. Output to the information processing unit 25.

  In addition, the situation recognizing unit 23 allows the user to recognize the road sign installed in front of the vehicle with the naked eye based on the illuminance of the light that illuminates the vehicle input from the sensor 43 and the information indicating the brightness around the vehicle. Recognize whether or not. Then, when the user recognizes that the road sign cannot be recognized with the naked eye, the situation recognition unit 23 outputs information indicating the recognition result to the information processing unit 25.

  The date acquisition unit 24 acquires information indicating the current date and time input from the communication unit 22, and outputs the acquired information to the information processing unit 25. When the navigation device 41 has a clock function, the date and time acquisition unit 24 may acquire information indicating the current date and time from the navigation device 41. When the date and time acquisition unit 24 itself has a clock function, the clock function The current date and time may be acquired using.

  The information processing unit 25 processes the information input from the sign recognition unit 21 according to the information input from the situation recognition unit 23 and the date acquisition unit 24 and outputs the processed information to the notification unit 26. The information processing unit 25 has an image processing function, and provides an image image of a road sign input from the sign recognition unit 21 according to information input from the situation recognition unit 23 and the date and time acquisition unit 24. The image of the simulated sign to be processed is processed and output to the notification unit 26.

  The information processing unit 25 processes the information indicating the meaning of the road sign input from the sign recognition unit 21 into information according to the information input from the situation recognition unit 23 and the date and time acquisition unit 24. Further, the information processing unit 25 performs processing for converting the processed information into a character string and a voice by using the character voice information 33. Then, the information processing unit 25 outputs the processed information to the notification unit 26.

  In addition, the information processing unit 25 may receive a recognition result recognized from the situation recognition unit 23 as a situation where the user cannot recognize the road sign with the naked eye. In such a case, the information processing unit 25 outputs an image image of the road sign recognized by the sign recognition unit 21, a character string indicating the meaning of the road sign, and audio information to the notification unit 26.

  The notification unit 26 outputs the information of the simulated sign and the image image of the road sign, the character string, and the voice information input from the information processing unit 25 to the input / output device 5. Let's report.

  At this time, the notification unit 26 acquires the display position of the road sign in the map image being displayed on the display 51 from the navigation device 41. And the alerting | reporting part 26 matches the display position of the road sign recognized by the sign recognition part 21, the information of the simulated sign and the image image of the road sign, and the character string and the voice information to the input / output device 5 in association with each other. To output and notify. An example of notification that the notification unit 26 causes the input / output device 5 to perform will be described later with reference to FIGS.

  In this way, the driving assistance device 1 recognizes the installed road sign and recognizes the situation around the road sign. Then, the driving assistance device 1 processes and notifies the information provided by the recognized road sign according to the recognized situation.

  Thereby, the driving assistance device 1 is more appropriate than the driving assistance that simply displays an image of the recognized road sign or an image showing the meaning of the recognized road sign in characters when the road sign is recognized. Driving assistance.

  In addition, the notification unit 26 can notify all road signs recognized by the sign recognition unit 21, but selectively notifies some road signs according to the user's preference. It can also be done.

  For example, when the driver information 34 is stored in the storage unit 3, the notification unit 26 reads out the driver information 34 from the storage unit 3, and performs notification regarding the road sign selected according to the driver information 34. Make it.

  For example, when the driver information 34 includes information indicating that the cumulative score imposed on the driver due to an accident violation is relatively high or information indicating that the driving is rough, the notification unit 26 selects the information to be notified. There can be relatively many road signs. In such a case, for example, the notification unit 26 can preferentially perform notification regarding a road sign having a high degree of risk when the road sign is not observed.

  On the other hand, the notification unit 26 is selected as the notification target when the driver information 34 includes information indicating that the cumulative score imposed on the driver due to the accident violation is relatively low or information indicating that driving is cautious. It is possible to reduce the number of road signs to be relatively small.

  In addition, when the area information 35 is stored in the storage unit 3, the notification unit 26 reads out the area information 35 from the storage unit 3 and makes a notification regarding the road sign selected according to the area information 35.

  Specifically, the notification unit 26 performs notification once every time the same road sign is recognized a predetermined number of times for a road sign that is included in the user's living area included in the area information 35 and has a relatively large number of places. Can be made. On the other hand, the alerting | reporting part 26 can be alert | reported whenever a road sign is recognized about the road sign with few places installed in a user's living area.

  Next, a specific example of driving support performed by the driving support device 1 will be described with reference to FIGS. 2-6 is explanatory drawing which shows an example of the driving assistance which concerns on embodiment. In addition, the figure shown by (a) in each figure of FIGS. 2-6 has shown the captured image of the camera 42. FIG. 2 to 6, the diagrams shown by (b) and (c), and the diagrams shown by (d) and (e) in FIG. 6 show driving assistance images displayed on the display 51. Yes.

  The driving support device 1 may receive a captured image shown in FIG. 2A from the camera 42 while the vehicle is traveling on a snowy road under an elevated road. Here, a road sign 70 with a height limit of 3.5 m is shown in the captured image. However, the road ahead of the vehicle is covered with snow, and the height distance from the snow surface to the overpass is only 2.0 m. In such a case, for example, if the height of the vehicle is 3.0 m, an accident may occur in which the vehicle comes into contact with the overhead.

  Therefore, when the captured image shown in FIG. 2A is input, the driving support device 1 first recognizes a road sign 70 having a height limit of 3.5 m. Subsequently, the driving support device 1 recognizes a situation where snow is being accumulated around the road sign 70 having a height limit of 3.5 m.

  Then, the driving assistance device 1 processes the information of the height limit of 3.5 m provided by the road sign 70 into information of the height limit of 2 m according to the recognized surrounding situation and notifies the information. For example, as shown in FIG. 2 (b), the driving support device 1 displays “height restriction” from a location where a road sign 70 having a height restriction of 3.5 m is installed in a map image indicating the current position of the vehicle. 2m "is displayed as a pop-up 71 for driving support. Note that the driving support device 1 can also output a voice “height limit is 2 m” simultaneously with the display of the balloon 71.

  Further, for example, as shown in FIG. 2 (c), the driving support device 1 has a high position at a location where a road sign 70 having a height limit of 3.5 m is installed in a map image indicating the current position of the vehicle. It is also possible to display an image image 72 of a simulated sign having a thickness limit of 2.0 m. Thereby, the driving assistance device 1 can suppress the occurrence of an accident in which the vehicle contacts the elevated.

  Further, for example, the driving support device 1 may receive a captured image shown in FIG. 3A from the camera 42 while the vehicle is traveling in heavy rain exceeding a predetermined amount of precipitation. Here, a road sign 73 with a maximum speed of 60 km / h is shown in the captured image. In such a case, even if the vehicle is traveling at a speed of 60 km / h, because of heavy rain, for example, a slip accident may occur.

  Therefore, when the captured image shown in FIG. 3A is input, the driving support device 1 first recognizes the road sign 73 having a maximum speed of 60 km / h. Subsequently, the driving assistance device 1 recognizes a situation in which heavy rain exceeding a predetermined amount of precipitation has occurred around the road sign 73.

  Then, the driving assistance device 1 processes the information of the maximum speed of 60 km / h provided by the road sign 73 into information of the maximum speed of 40 km / h according to the recognized surrounding situation and notifies the information. For example, as shown in FIG. 3B, the driving support device 1 displays “safe driving speed 40 km from a location where a road sign 73 having a maximum speed of 60 km / h is installed in a map image indicating the current position of the vehicle. / H ”is displayed as a driving support character string pop-up 74. Note that the driving support device 1 can also output a voice “Safe driving speed is 40 km / h” simultaneously with the display of the balloon 74.

  Further, for example, as shown in FIG. 3C, the driving support device 1 has a maximum speed at a location where a road sign 73 having a maximum speed of 60 km / h is installed in a map image indicating the current position of the vehicle. It is also possible to display an image 75 of a simulated sign at 40 km / h. Thereby, the driving assistance apparatus 1 can suppress generation | occurrence | production of the slip accident by heavy rain.

  As described above, when the road sign is recognized, the driving support device 1 recognizes the weather condition around the road sign, and processes and notifies the information provided by the road sign according to the weather condition. Thereby, the driving assistance apparatus 1 can perform the driving assistance regarding the road sign according to the weather condition around the road sign.

  In addition, when the driving assistance device 1 recognizes a road sign related to traffic regulation and recognizes deterioration of weather conditions, the driving assistance device 1 performs processing to strengthen the regulation content of the traffic regulation. Thereby, the driving assistance apparatus 1 can suppress generation | occurrence | production of the traffic accident accompanying the deterioration of a weather condition.

  Further, for example, the driving support apparatus 1 may receive a captured image shown in FIG. 4A from the camera 42 while traveling on a road where vehicles are congested. Here, the captured image includes a road sign 76 in the direction and direction indicating that the Osaka direction is going straight and the Kobe direction is turning left. In such a case, since the straight road is congested, if the vehicle goes straight, it will get caught in the traffic. In such a case, a person who turns left may arrive early in Osaka.

  Therefore, when the captured image shown in FIG. 4A is input, the driving support device 1 first recognizes the road sign 76 in the direction and direction. Subsequently, the driving assistance device 1 recognizes a situation where the straight road is congested.

  And the driving assistance device 1 has the information that the direction of Osaka provided by the road sign 76 in the direction and direction goes straight, and the direction of Kobe turns to the left. It is processed and notified to the information that it is preferable.

  For example, as shown in FIG. 4 (b), the driving support device 1 says that “the direction of Osaka during traffic jams is a left turn” from the location where the road sign 76 is installed in the map image indicating the current position of the vehicle. A character string balloon (pop-up) 77 for driving assistance is displayed. Note that the driving support device 1 can also output a voice saying “Osaka direction is left when traffic is congested” simultaneously with the display of the balloon 77.

  In addition, as shown in FIG. 4C, for example, the driving support device 1 is located in a map image showing the current position of the vehicle in the Osaka area while avoiding traffic congestion at a location where the road sign 76 is installed. It is also possible to display an image image 78 of a simulated sign indicating a detour to be guided. Thereby, the driving assistance apparatus 1 can guide the road where traffic congestion can be avoided to the user of the vehicle.

  Further, for example, the driving support device 1 may receive a captured image shown in FIG. 5A from the camera 42 while the vehicle is traveling in front of an intersection on a three-lane road. Here, the captured image includes a road sign 79 indicating that the left lane is a left turn lane, the center lane is a straight lane, and the right lane is a right turn lane, and a signboard under construction installed before the intersection of the right lane. It is reflected. In such a case, the driver of the vehicle cannot know whether or not the vehicle can turn left.

  Therefore, when the captured image shown in FIG. 5A is input, the driving assistance device 1 firstly shows a road sign indicating that the left lane is a left turn lane, the center lane is a straight lane, and the right lane is a right turn lane. 79 is recognized. Subsequently, the driving assistance device 1 recognizes a situation where the right lane is under construction.

  Then, the driving assistance device 1 determines that the left lane provided by the road sign 79 is a left turn lane, a center lane is a straight lane, and a right lane is a right turn lane. , The right lane is processed into information of the right turn lane and notified.

  For example, as shown in FIG. 5 (b), the driving support device 1 says that “the left turn / straight line lane is the central lane” from the location where the road sign 79 is installed in the map image indicating the current position of the vehicle. A character string balloon (pop-up) 80 for driving assistance is displayed. Note that the driving support device 1 can also output a voice “the left turn / straight line is the center lane” simultaneously with the display of the balloon 80.

  Further, as shown in FIG. 5C, for example, the driving support device 1 has a center lane that goes straight on the left turn lane on the right side of the map image showing the current position of the vehicle, and a right side. It is also possible to display an image image 81 of a simulated sign indicating that the lane is a right turn lane. Thereby, the driving assistance device 1 can inform the user that a left turn is possible.

  As described above, when the driving support apparatus 1 recognizes the road sign, the driving support apparatus 1 recognizes the road condition around the road sign, and processes and notifies the information provided by the road sign according to the road condition. Thereby, the driving assistance apparatus 1 can perform the driving assistance regarding the road sign according to the road condition around the road sign.

  In addition, when the driving support device 1 recognizes information related to road guidance and recognizes deterioration of road conditions, the driving assistance device 1 performs processing to change the road guidance destination to a guidance destination that avoids roads with deteriorated road conditions. . Thereby, the driving assistance apparatus 1 can eliminate the dissatisfaction that the deterioration of the road condition gives to the driver of the vehicle.

  Further, for example, the driving support device 1 may receive a captured image shown in FIG. 6A from the camera 42 while the vehicle is traveling. Here, in the captured image, a road sign 82 indicating a time-limited parking section in which parking is possible for 60 minutes from 8:00 to 20:00 is shown. In such a case, the vehicle driver cannot know whether or not parking is currently possible unless a relatively small character is recognized on the road sign 82.

  Therefore, when the captured image shown in FIG. 6A is input, the driving support device 1 first recognizes a road sign 82 indicating a time-limited parking section in which parking is possible for 60 minutes from 8:00 to 20:00. . Subsequently, the driving support device 1 acquires the current date and time. And the driving assistance device 1 processes and notifies the information that parking is possible for 60 minutes from 8:00 to 20:00 provided by the road sign 82 according to the current date and time.

  For example, as shown in FIG. 6B, when the time is 21:00, the driving assistance apparatus 1 “parking prohibition from the location where the road sign 82 is installed in the map image indicating the current position of the vehicle. A driving support character string balloon (pop-up) 83 is displayed. Note that the driving support device 1 can output a voice “parking prohibited section” simultaneously with the display of the balloon 83.

  In addition, as shown in FIG. 5C, for example, when the time is 21:00, the driving support device 1 has a location where the road sign 82 is installed in the map image indicating the current position of the vehicle. It is also possible to display an image 84 of a simulated sign indicating that it is a parking prohibited section.

  Further, as shown in FIG. 6D, when the time is 10:00, the driving support apparatus 1 “parks from the location where the road sign 82 is installed in the map image indicating the current position of the vehicle. A driving support character string balloon (pop-up) 85 is displayed. Note that the driving support device 1 can also output a voice “This is a parking available section” simultaneously with the display of the balloon 85.

  Further, as shown in FIG. 5E, for example, when the time is 10 o'clock, the driving support device 1 is located at a place where the road sign 82 is installed in the map image indicating the current position of the vehicle. It is also possible to display an image image 86 of a simulated sign indicating that it is a parking available section. Thereby, the driving assistance device 1 can inform the user whether or not parking is currently possible.

  As described above, when the driving support device 1 recognizes a road sign limited to the date and time, the driving support apparatus 1 acquires the current date and time, processes and provides information provided by the road sign according to the current date and time. As a result, the driving assistance device 1 can provide the user with the information provided by the date and time limited road sign in an easy-to-understand manner.

  Next, with reference to FIG. 7, the process which the control part 2 of the driving assistance device 1 performs is demonstrated. FIG. 2 is a flowchart illustrating processing executed by the control unit 2 of the driving support apparatus 1 according to the embodiment. When the driving support device 1 is powered on, the control unit 2 repeatedly executes the process shown in FIG. 7 at a predetermined cycle (for example, 100 msec cycle).

  Specifically, as shown in FIG. 7, the control unit 2 first determines whether or not a road sign installed in front of the vehicle has been detected (step S101). And when it determines with the control part 2 not detecting a road sign (step S101, No), a process is complete | finished.

  Moreover, when it determines with the control part 2 having detected the road sign (step S101, Yes), the detected road sign is recognized (step S102). Subsequently, the control unit 2 recognizes the situation around the recognized road sign (step S103).

  Then, the control unit 2 determines whether or not the road sign recognized in step S102 is a date-only sign (step S104). When it is determined that the sign is not a date-limited sign (No at Step S104), the control unit 2 processes the information provided by the recognized road sign according to the recognized situation (Step S105), and the process proceeds to Step S106. Move.

  If the control unit 2 determines that the sign is limited to the date and time (Yes in step S104), the control unit 2 processes the information provided by the recognized road sign according to the current date and time (step S107), and the process proceeds to step S106. Move. In step S106, the control unit 2 notifies the processed information and ends the process.

  As described above, the driving support apparatus according to the embodiment includes a sign recognition unit, a situation recognition unit, an information processing unit, and a notification unit. The sign recognition unit recognizes the installed road sign. The situation recognition unit recognizes the situation around the installed road sign. The information processing unit processes the information provided by the road sign recognized by the sign recognition unit according to the situation recognized by the situation recognition unit. The notification unit notifies the information processed by the information processing unit. Thereby, the driving assistance device can perform more appropriate driving assistance when the road sign is recognized.

  The situation recognition unit recognizes the weather situation. Thereby, the driving assistance apparatus can perform driving assistance related to the road sign according to the weather conditions around the road sign.

  In addition, the information processing unit performs processing for strengthening the regulation contents of the traffic regulation when the road sign related to the traffic regulation is recognized by the sign recognition unit and the deterioration of the weather situation is recognized by the situation recognition unit. Thereby, the driving assistance device can perform driving assistance related to the road sign according to the weather conditions around the road sign.

  The situation recognition unit recognizes the road situation. Thereby, the driving assistance regarding the road sign according to the road condition around the road sign can be performed.

  In addition, the information processing unit, when the road sign related to the road guidance is recognized by the sign recognition unit and the deterioration of the road situation is recognized by the situation recognition unit, the road guidance destination is the road where the road situation has deteriorated. Processing to avoid the guide. Thereby, the driving assistance device can eliminate the dissatisfaction that the deterioration of the road condition gives to the driver of the vehicle.

  The driving support device further includes a date acquisition unit that acquires the current date. Then, when the road sign limited to the date and time is recognized by the sign recognition unit, the information processing unit provides information provided by the road sign recognized by the sign recognition unit according to the current date and time acquired by the date and time acquisition unit. Process. As a result, the driving support device can provide the user with the information provided by the road sign limited to the date and time in an easy-to-understand manner.

  In addition, the notification unit displays information processed by the information processing unit at a position where the road sign recognized by the sign recognition unit is installed on the map around the current position displayed by the display unit. Thereby, the user of the driving support device can easily recognize the positional relationship between the display position of the information on the road sign processed and displayed by the information processing unit and the current position.

  The information processing unit processes the information of the road sign image recognized by the sign recognition unit into a simulated sign image that provides information according to the situation recognized by the situation recognition unit. Thereby, the user of a driving assistance device can recognize intuitively the meaning which the information processed by the information processing part shows.

  In addition, the structure which changes the degree of the traffic regulation which a road sign provides according to the difference in driver | operator information may be sufficient as the driving assistance apparatus which concerns on embodiment. When notifying the processed information regarding the road sign by voice, the driving support device may be configured to change the tone of the voice according to the degree of danger when the road sign is not observed. Thereby, the driving assistance apparatus can perform more various alert | reports about the road sign to recognize.

  In addition, the driving support device may be configured to display the processed information on a HUD (Head Up Display) or a windshield display, for example, in conjunction with the voice when the processed information regarding the road sign is notified by voice. Good. Thereby, the user can receive provision of the processed information regarding the road sign from the driving support device without greatly diverting the line of sight from the front of the vehicle.

  Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the present invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

DESCRIPTION OF SYMBOLS 1 Driving assistance device 2 Control part 3 Memory | storage part 5 Input / output device 6 Communication network 21 Sign recognition part 22 Communication part 23 Status recognition part 24 Date and time acquisition part 25 Information processing part 26 Notification part 31 Driving support program 32 Sign information 33 Character voice information 34 Driver Information 35 Area Information 41 Navigation Device 42 Camera 43 Sensor 51 Display 52 Speaker 61 Weather Information Providing Device 62 Road Information Providing Device

Claims (9)

A sign recognition unit for recognizing installed road signs,
A situation recognition unit for recognizing the situation around the installed road sign;
An information processing unit that processes information provided by a road sign recognized by the sign recognition unit according to a situation recognized by the situation recognition unit;
A driving support device, comprising: a notification unit that performs notification of information processed by the information processing unit. The situation recognition unit
The driving support device according to claim 1, wherein a weather condition is recognized. The information processing unit
When a road sign related to traffic regulation is recognized by the sign recognition unit and the deterioration of the weather situation is recognized by the situation recognition unit, processing for strengthening the regulation content of the traffic regulation is performed. The driving support device according to claim 2. The situation recognition unit
The driving support device according to any one of claims 1 to 3, wherein a road situation is recognized. The information processing unit
When a road sign related to road guidance is recognized by the sign recognition unit, and when a worsening of the road situation is recognized by the situation recognition unit, a guidance destination for avoiding a road with a worse road situation as the guidance destination of the road guidance The driving support device according to claim 4, wherein the processing is performed. A date acquisition unit for acquiring the current date and time,
The information processing unit
When the road sign limited to the date and time is recognized by the sign recognition unit, the information provided by the road sign recognized by the sign recognition unit is processed according to the current date and time acquired by the date and time acquisition unit. The driving support apparatus according to any one of claims 1 to 5, wherein The notification unit
The information processed by the information processing unit is displayed at a position where the road sign recognized by the sign recognition unit is installed on a map around the current position displayed by the display unit. The driving assistance apparatus as described in any one of -6. The information processing unit
The information of the road sign image recognized by the sign recognition unit is processed into a simulated sign image that provides information according to the situation recognized by the situation recognition unit. The driving assistance device according to any one of the above. A sign recognition process for recognizing installed road signs,
A situation recognition step of recognizing the situation around the installed road sign;
An information processing step for processing information provided by the road sign recognized by the sign recognition step according to the situation recognized by the situation recognition step;
And a notifying step of notifying information processed by the information processing step.

Images