WO2017208494A1 - Appareil de commande d'affichage de véhicule, système d'affichage de véhicule, procédé de commande d'affichage de véhicule, et programme - Google Patents
Appareil de commande d'affichage de véhicule, système d'affichage de véhicule, procédé de commande d'affichage de véhicule, et programme Download PDFInfo
- Publication number
- WO2017208494A1 WO2017208494A1 PCT/JP2017/002945 JP2017002945W WO2017208494A1 WO 2017208494 A1 WO2017208494 A1 WO 2017208494A1 JP 2017002945 W JP2017002945 W JP 2017002945W WO 2017208494 A1 WO2017208494 A1 WO 2017208494A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- video data
- display control
- unit
- display
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 24
- 238000012545 processing Methods 0.000 claims abstract description 52
- 230000000007 visual effect Effects 0.000 claims description 20
- 230000033228 biological regulation Effects 0.000 claims description 7
- 238000013459 approach Methods 0.000 claims description 6
- 230000007423 decrease Effects 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 20
- 238000012986 modification Methods 0.000 description 11
- 230000004048 modification Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000003708 edge detection Methods 0.000 description 2
- 230000009118 appropriate response Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the present invention relates to a vehicle display control device, a vehicle display control method, and a program.
- Patent Document 1 discloses a captured image in which a mark is superimposed on a captured image of a rear (rear side) of a vehicle captured by a camera at or near the position of another vehicle in the captured image. Describes a vehicle rear side photographing device that displays on a display such that the rate of change in the size of the mark in the vehicle is greater than the rate of change in the inter-vehicle distance between the vehicle and another vehicle.
- the present embodiment has been made in view of the above background, and provides a vehicle display control device, a vehicle display control system, a vehicle display control method, and a program capable of accurately grasping the operation of a rear vehicle. With the goal.
- the present embodiment is a vehicle display control device, a video data acquisition unit that acquires video data from a rear camera that captures the rear of the vehicle, a recognition unit that recognizes another vehicle in the video data, and the recognition unit
- a position information acquisition unit that acquires information on a change in position of the other vehicle recognized by the image data
- an image processing unit that superimposes a movement locus of the other vehicle based on the information on the change of position on the image data
- a display control unit for displaying video data on which the movement locus is superimposed on a rear view monitor for displaying a video behind the vehicle.
- the present embodiment is a vehicle display control method, the step of acquiring video data from a rear camera that captures the rear of the vehicle, the step of recognizing other vehicles in the video data, Acquiring information relating to a change in position of the recognized other vehicle in the video data, superimposing a movement locus of the other vehicle based on the information relating to the change in position on the video data, and Displaying video data on which the movement locus is superimposed on a rear view monitor for displaying video.
- the present embodiment is a program for vehicle display control, a processing procedure for acquiring video data from a rear camera that captures the rear of the vehicle, a processing procedure for recognizing another vehicle in the video data, and the recognition
- the computer executes a processing procedure for displaying video data on which the movement locus is superimposed on a rear view monitor for displaying video.
- FIG. 1 is a block diagram illustrating a schematic configuration of a vehicle display control apparatus according to a first embodiment; It is a figure which shows an example of the video data acquired by the back camera.
- FIG. 4 is clipped video data cut out from the video data in FIG. 3. It is a figure which shows an example of the video data (cutout video data) with which the locus
- FIG. 4 is a block diagram illustrating a schematic configuration of a vehicle display control apparatus according to a second embodiment; It is a figure which shows the relationship between vehicle travel speed and a period interval.
- FIG. It is a figure shown about the case where the locus
- FIG. It is a figure which shows an example of the period interval with respect to the running speed of a vehicle, and the number of display outlines.
- FIG. 1 It is a figure which shows an example of the period interval with respect to the environment where the vehicle is drive
- FIG. 6 is a block diagram illustrating a schematic configuration of a vehicle display control apparatus according to a third embodiment; It is a flowchart which shows the example of the flow of a process which displays a warning screen on a display part. It is a flowchart which shows another example of the flow of a process which displays a warning screen on a display part. It is a flowchart which shows another example of the flow of a process which displays a warning screen on a display part.
- FIG. 6 is a block diagram showing a schematic configuration of a vehicle display control apparatus according to a fourth embodiment; It is a figure which shows an example of the prescription
- FIG. 1 is a diagram illustrating an example of an arrangement of a vehicle (automobile) 1 in a driver's cab.
- the cab of the vehicle 1 has a general configuration, and a steering wheel 50, a dashboard 51, a windshield 52, a center console 54, a cluster panel that displays the traveling speed of the vehicle, the engine speed, and the like. 57, and the like.
- the center console 54 is often provided with a display unit 55 for displaying a navigation screen or the like.
- the rear view monitor 53 is disposed at the same position as a rear view mirror for rear confirmation in a general vehicle, that is, near the upper center of the windshield 52.
- FIG. 2 is a block diagram illustrating a schematic configuration of the vehicle display control apparatus 10.
- the vehicle display control apparatus 10 includes a video data acquisition unit 11, a recognition unit 12, a position information acquisition unit 13, an image processing unit 14, a display control unit 15, and a cutout processing unit 16. And comprising.
- the video data acquisition unit 11 acquires video data from the rear camera 56 that captures the rear of the vehicle 1.
- the recognition unit 12 collates the recognition dictionary 17 and recognizes another vehicle in the video data acquired by the video data acquisition unit 11.
- the recognition dictionary 17 is a database that stores image data groups of how the vehicle 1 having several representative shapes is viewed from various directions. Note that the recognition dictionary 17 may be stored in a storage unit included in the vehicle display control device 10, stored in a storage device inside or outside the vehicle display control device 10 and the vehicle 1, and usable via a network. It may be.
- the position information acquisition unit 13 acquires information regarding a change in position in the video data of the other vehicle recognized by the recognition unit 12.
- the image processing unit 14 superimposes the movement trajectory of the other vehicle based on the information related to the position change in the video data of the other vehicle recognized by the recognition unit 12 on the video data.
- the display control unit 15 displays video data in which the movement trajectory of the other vehicle is superimposed on the rear view monitor 53 for displaying the video behind the vehicle 1.
- the cutout processing unit 16 cuts out the video data into a display range to be displayed on the rear view monitor 53.
- the image processing unit 14 performs edge detection processing on the video data of the other vehicle recognized by the recognition unit 12 to extract the contour line of the other vehicle.
- a threshold is set for the length and thickness of the contour line in order to exclude unnecessary lines and lines indicating the fine structure in the video data of other vehicles. It is good also as a contour line of other vehicles using a contour line.
- the rear camera 56 generally includes a wide-angle lens, for example, a horizontal field angle of 120 to 180 degrees. For this reason, the cutout processing unit 16 performs cutout processing for setting an appropriate display range on the rear view monitor 53 on the video data captured by the rear camera 56.
- FIG. 3 is a diagram illustrating an example of video data acquired by the rear camera 56.
- FIG. 4 is clipped video data cut out from the video data in FIG. As shown in FIGS. 3 and 4, the cutout section 16 in the video data A is cut out by the cutout processing unit 16, and cutout video data C is acquired.
- the recognition unit 12 may recognize other vehicles in the video data acquired by the video data acquisition unit 11 at predetermined time intervals. For example, when the rear camera 56 acquires the video behind the vehicle 1 at a frame rate of 30 fps (frame per second), the recognition unit 12 recognizes another vehicle every 20 frames for the acquired video data. To do. In this case, the predetermined interval is 20 seconds / 30 seconds.
- FIG. 5 is a diagram showing an example of video data (cut-out video data) on which the trajectory of another vehicle is superimposed.
- the contour images 61 a and 61 b of the other vehicle 60 at the time before the current time are superimposed on the video data (cutout video data) as a movement locus.
- the contour image 61a is the contour image of the other vehicle recognized one time before the current time, that is, 20 seconds before 30/30.
- the contour image 61b is the contour image of the other vehicle recognized two times before the current time, that is, 40 seconds before 30 minutes.
- the driver can predict in which direction the other vehicle will move.
- the number of contour images (number of display contours) of other vehicles to be superimposed on the video data (cutout video data) is not limited to 2, and any number may be superimposed as long as it is 1 or more.
- the display control unit 15 generates a contour image in which the shape of the contour is processed when generating a contour image of another vehicle.
- the extracted contour line of the other vehicle may be colored so that the contour image superimposed on the video data is more easily recognized.
- the contour line in the moving direction of the other vehicle may be deleted from the extracted contour line of the other vehicle. Specifically, when the other vehicle 60 is moving in the right direction with respect to the video data as in the example shown in FIG. 5, the contour video 61 a and the contour video 61 b indicating the contour are respectively displayed on the left half and the left end portion. Only a contour line may be used. Furthermore, it is good also as an outline which becomes thin gradually from the moving direction opposite side of another vehicle to a moving direction.
- the driver of the vehicle 1 can accurately grasp the operation of the rear vehicle by superimposing the movement trajectory of the other vehicle on the video data acquired by the rear camera and displaying it on the rear view mirror.
- FIG. 6 is a block diagram illustrating a schematic configuration of the vehicle display control apparatus 110.
- the vehicle display control device 110 has basically the same configuration as the vehicle display control device 10 described with reference to FIG. 2 in the first embodiment, except that the situation acquisition unit 18 is provided. is there.
- the status acquisition unit 18 acquires the status of the vehicle 1 (see FIG. 1) via CAN (CAN: Controller Area Network), various sensors, a navigation system, and the like.
- CAN Controller Area Network
- the period interval in which the recognition unit 12 recognizes another vehicle in the video data acquired by the video data acquisition unit 11 is varied according to the status of the vehicle 1 acquired by the status acquisition unit 18.
- the situation of the vehicle 1 may be a vehicle traveling speed. That is, the situation acquisition unit 18 acquires information related to the traveling speed of the vehicle 1 from a speed sensor or the like.
- FIG. 7 is a diagram illustrating an example of the relationship between the vehicle traveling speed and the period interval.
- the image processing unit 14 sets the period interval to 20 frames when the traveling speed V of the vehicle 1 is less than 40 km / h (V ⁇ 40 km / h), and 40 km / h or more and less than 80 km / h (40 km).
- / H ⁇ V ⁇ 80 km / h) the period interval is 15 frames
- the period interval is 5 frames. shorten.
- the rear camera 56 acquires the video behind the vehicle 1 at a frame rate of 30 fps, one frame in the period interval is 1/30 second.
- the number of contour images 61 (number of display contours) of the other vehicle 60 superimposed on the video data (cutout video data) may be changed according to the period interval.
- the number of display contours is 2 as shown in FIG. 8, when it is 15 frames, the number of display contours is 3 as shown in FIG. 9, and when it is 5 frames, it is FIG.
- the number of display contours is set to four.
- FIG. 11 shows a list of period intervals and display contour numbers with respect to the traveling speed of the vehicle 1. The faster the traveling speed, the more difficult it is for the driver of the vehicle 1 to notice the sudden approach of another vehicle. By doing so, the driver of the vehicle 1 can grasp the operation of the rear vehicle more accurately. be able to.
- the situation of the vehicle 1 may be an environment (traveling environment) in which the vehicle 1 is traveling. That is, the situation acquisition unit 18 acquires information related to the travel environment from a navigation system or the like.
- FIG. 12 is a diagram illustrating an example of the period interval and the number of display contours with respect to the traveling environment. As shown in FIG. 12, if the driving environment is an urban area, the interval is 20 frames and the number of display contours is 2. If the driving environment is a suburb, the interval is 15 frames and the number of display contours is 3. In the case of a dedicated road, the interval is 5 frames and the number of display contours is 4. That is, the image processing unit 14 varies the period interval and the number of display contours according to the traveling environment. The difficulty of the driver of the vehicle 1 noticing suddenly approaching another vehicle changes depending on the driving environment. By doing so, the driver of the vehicle 1 can grasp the operation of the rear vehicle more accurately. Can do.
- the situation of the vehicle 1 may be a legal speed on a road on which the vehicle 1 is traveling. That is, the situation acquisition unit 18 acquires the legal speed on the road on which the vehicle 1 is traveling from a navigation system or the like.
- FIG. 13 is a diagram illustrating an example of the period interval and the number of display contours with respect to the legal speed on the road on which the vehicle 1 is traveling. As shown in FIG. 13, when the legal speed VL of the road on which the vehicle 1 is traveling is less than 40 km / h (VL ⁇ 40 km / h), the interval is 20 frames, the number of display contours is 2, and 40 km / h.
- the period interval is 15 frames and the number of display contours is 3, and when 80 km / h or more (80 km / h ⁇ VL), the period The interval is 5 frames and the number of display contours is 4. That is, the image processing unit 14 shortens the period interval and increases the number of display contours as the legal speed VL increases. The higher the legal speed on the road on which the vehicle 1 is traveling, the more the vehicle 1 travels at a higher speed, so it becomes difficult for the driver of the vehicle 1 to notice the sudden approach of another vehicle. By doing so, the driver of the vehicle 1 can grasp the operation of the rear vehicle more accurately.
- the situation of the vehicle 1 may be a relative speed of the other vehicle recognized by the recognition unit 12 with respect to the vehicle 1. That is, the situation acquisition unit 18 acquires the relative speed of the other vehicle recognized by the recognition unit 12 with respect to the vehicle 1 from a relative speed detection sensor or the like.
- FIG. 14 is a diagram illustrating an example of the period interval and the number of display contours with respect to the relative speed. As shown in FIG. 14, when the relative speed VR is less than 10 km / h (VR ⁇ 10 km / h), the period interval is 20 frames, the number of display contours is 2, and 10 km / h or more and less than 20 km / h (10 km / h).
- the period interval is 15 frames and the number of display contours is 3, and when 20 km / h or more (20 km / h ⁇ VR), the period interval is 5 frames and the number of display contours is 4 To do. That is, the image processing unit 14 shortens the period interval and increases the number of display contours as the relative speed VR is higher. The faster the relative speed, the more difficult it is for the driver of the vehicle 1 to notice the sudden approach of another vehicle. By doing so, the driver of the vehicle 1 can grasp the operation of the rear vehicle more accurately. be able to.
- the relative speed is a relative speed when the speed of the rear vehicle is higher than that of the vehicle 1.
- the situation of the vehicle 1 may be a degree of difficulty in viewing (bad visibility) in the surrounding environment of the vehicle 1. That is, the situation acquisition unit 18 acquires the degree of difficulty in viewing in the surrounding environment of the vehicle 1. Specifically, the situation acquisition unit 18 acquires information on the surrounding environment of the vehicle 1 (weather, daytime / nighttime, presence / absence of fog) from a navigation system or the like, and determines the degree of visual difficulty in the surrounding environment of the vehicle 1. .
- FIG. 15 is a diagram illustrating an example of the period interval and the number of display contours with respect to the degree of visual difficulty in the surrounding environment of the vehicle 1. As shown in FIG.
- the interval is 20 frames and the number of display contours is 2, which is slightly high (night and clear to cloudy, Or, in the case of daytime and fog, or in the daytime and rain), the interval interval is 15 frames and the number of display contours is 3, and in the case of high (night and fog or night and rain), the interval interval is 5 frames and the display contour. Equation 4 is assumed. That is, the image processing unit 14 shortens the period interval and increases the number of display contours as the degree of visual difficulty in the surrounding environment of the vehicle 1 is higher. The higher the degree of visual difficulty in the surrounding environment of the vehicle 1, the harder the driver of the vehicle 1 is aware of the sudden approach of another vehicle. In this way, the driver of the vehicle 1 can operate the rear vehicle. It can be grasped more accurately.
- the situation of the vehicle 1 may be the continuous travel time of the vehicle 1. That is, the situation acquisition unit 18 acquires the continuous travel time of the vehicle 1 from CAN or the like.
- FIG. 16 is a diagram illustrating an example of the period interval and the number of display contours with respect to the continuous travel time of the vehicle 1. As shown in FIG.
- the interval is 20 frames, the number of display contours is 2, and the time is 1 hour or more and less than 3 hours (1 hr ⁇ T If ⁇ 3 hr), the period interval is 15 frames and the number of display contours is 3, and if 3 hours or more (3 hr ⁇ T), the period interval is 5 frames and the number of display contours is 4. That is, the image processing unit 14 shortens the period interval and increases the number of display contours as the continuous running time of the vehicle 1 is longer. The longer the continuous operation time is, the more likely the driver's judgment of the vehicle 1 becomes dull due to fatigue. By doing so, the driver of the vehicle 1 can more accurately grasp the operation of the rear vehicle. .
- the continuous running time mentioned here excludes a short stop time due to a temporary stop or a signal wait, for example, a stop of less than 5 minutes.
- FIG. 17 is a block diagram illustrating a schematic configuration of the vehicle display control device 210.
- the vehicle display control apparatus 210 includes a video data acquisition unit 11, a recognition unit 12, a position information acquisition unit 213, an image processing unit 214, a display control unit 15, and a cutout processing unit 16. And a warning target vehicle determination unit 219 and a vehicle operation determination unit 220.
- the vehicle operation determination unit 220 determines whether or not the vehicle 1 is operating.
- the operation of the vehicle 1 means a state in which the vehicle 1 can be driven if the accelerator of the vehicle 1 is stepped on, for example, a state in which the engine is operating or an ignition switch is on.
- the video data acquisition unit 11 acquires video data from the rear camera 56 that captures the rear of the vehicle 1 when the vehicle 1 is operating.
- the warning target vehicle determination unit 219 determines whether or not the other vehicle recognized by the recognition unit 12 is a warning target. Specifically, when the relative speed of the other vehicle recognized by the recognition unit 12 with respect to the vehicle 1 is equal to or higher than the specified relative speed and the other vehicle approaches the vehicle 1, the warning target vehicle determination unit 219 May be determined to be a warning target.
- the warning target vehicle determination unit 219 acquires the relative speed of the other vehicle recognized by the recognition unit 12 with respect to the vehicle 1 from a relative speed detection sensor or the like.
- the warning target vehicle determination unit 219 determines that the other vehicle is a warning target when the inter-vehicle distance between the other vehicle recognized by the recognition unit 12 and the vehicle 1 is less than the specified inter-vehicle distance. Good.
- the warning target vehicle determination unit 219 acquires the inter-vehicle distance between the other vehicle recognized by the recognition unit 12 and the vehicle 1 from a millimeter wave radar or the like.
- the position information acquisition unit 213 acquires information related to a change in position in the video data of another vehicle that is determined to be a warning target by the warning target vehicle determination unit 219.
- the image processing unit 214 superimposes the movement trajectory of the other vehicle on the video data based on the information on the change in position in the video data of the other vehicle determined to be the warning target by the warning target vehicle determination unit 219.
- the image processing unit 214 performs edge detection processing on the video data of the other vehicle determined to be the warning target by the warning target vehicle determination unit 219, thereby extracting the contour line of the other vehicle.
- a threshold is set for the length and thickness of the contour line in order to exclude unnecessary lines and lines indicating the fine structure in the video data of other vehicles. It is good also as a contour line of other vehicles using a contour line.
- FIG. 18 is a flowchart illustrating an example of a flow of processing for displaying a warning screen on the display unit 55.
- the vehicle operation determination unit 220 determines whether or not the vehicle 1 is operating (step S2101).
- the recognition unit 12 determines whether or not another vehicle has been recognized (step S2102).
- step S2102 If it is determined in step S2102 that the other vehicle has been recognized (in the case of YES), the warning target vehicle determination unit 219 determines whether the relative speed of the other vehicle with respect to the vehicle 1 is equal to or higher than the specified relative speed (step S2103).
- step S2103 If it is determined in step S2103 that the relative speed of the other vehicle to the vehicle 1 is equal to or greater than the specified relative speed (in the case of YES), the display control unit 15 starts the display of the warning screen or updates the display of the warning screen (Ste S2104). Following step S2104, the recognizing unit 12 determines whether or not the other vehicle still exists in the video captured by the rear camera 56 (step S2106).
- step S2103 If it is determined in step S2103 that the relative speed of the other vehicle to the vehicle 1 is not equal to or greater than the specified relative speed (in the case of NO), the warning target vehicle determination unit 219 determines that the inter-vehicle distance between the other vehicle and the vehicle 1 is less than the specified inter-vehicle distance. It is determined whether or not (step S2105). If it is determined in step S2105 that the inter-vehicle distance between the other vehicle and the vehicle 1 is less than the specified inter-vehicle distance (in the case of YES), the process proceeds to step S2104. If it is determined in step S2105 that the inter-vehicle distance between the other vehicle and the vehicle 1 is not less than the specified inter-vehicle distance (in the case of NO), the process proceeds to step S2106 described above.
- step S2106 If it is determined in step S2106 that the other vehicle is still present in the image captured by the rear camera 56 (YES), the process returns to step S2103. If no other vehicle is present in the image captured by the rear camera 56 in step S2106 (in the case of NO), the display control unit 15 determines whether the warning screen is being displayed (step S2107).
- step S2108 the display control unit 15 cancels the display of the warning screen (step S2108).
- step S2109 the vehicle operation determination unit 220 determines whether or not the vehicle 1 is operating (step S2109). If the vehicle 1 is operating in step S2109 (in the case of YES), the process returns to step S2102. If the vehicle 1 is not operating in step S2109 (NO), the process is terminated.
- FIG. 19 is a flowchart illustrating another example of the flow of processing for displaying a warning screen on the display unit 55.
- the warning target vehicle determination unit 219 determines whether or not the relative speed of the other vehicle with respect to the vehicle 1 is equal to or higher than the specified relative speed (In step S2103), it is determined whether the inter-vehicle distance between the other vehicle and the vehicle 1 is less than the specified inter-vehicle distance (step S2105).
- the warning target vehicle determination unit 219 determines whether or not the relative speed of the other vehicle with respect to the vehicle 1 is equal to or higher than the specified relative speed.
- the warning target vehicle determination unit 219 determines whether the relative speed of the other vehicle with respect to the vehicle 1 is equal to or higher than the specified relative speed. Only the determination (step S203) may be performed. The other steps are the same as those described with reference to FIG.
- FIG. 20 is a flowchart illustrating yet another example of the flow of processing for displaying a warning screen on the display unit 55.
- step S2102 when it is determined in step S2102 that the other vehicle has been recognized, it is determined whether the relative speed of the other vehicle with respect to the vehicle 1 is equal to or higher than the specified relative speed (step S2103), and the distance between the other vehicle and the vehicle 1 It is determined whether the distance is less than the specified inter-vehicle distance (step S2105).
- step S2103 the relative speed of the other vehicle with respect to the vehicle 1 is equal to or higher than the specified relative speed
- step S2105 the distance between the other vehicle and the vehicle 1
- the warning target vehicle determination unit 219 determines that the inter-vehicle distance between the other vehicle and the vehicle 1 is less than the specified inter-vehicle distance. Only the determination (step S303) may be performed. The other steps are the same as those described with reference to FIG.
- the warning target vehicle determination unit 219 determines whether the other vehicle recognized by the recognition unit 12 is a warning target based on the relative speed of the other vehicle with respect to the vehicle 1. It is determined by determining whether or not the speed is greater than the relative speed and / or determining whether or not the inter-vehicle distance between the other vehicle and the vehicle 1 is less than the specified inter-vehicle distance.
- the display control unit 15 causes the display unit 55 to display a warning screen when it is determined that the other vehicle is a warning target.
- the warning screen is displayed on the display unit 55 only when it is determined that the other vehicle is a warning target, so that the driver can timely indicate that the rear vehicle has approached. It is possible to grasp and to take an appropriate response to the approaching rear vehicle.
- Embodiment 4 of the present invention will be described below with reference to the drawings. It should be noted that portions common to Embodiments 1 to 3 are denoted by common reference numerals, and description thereof is omitted.
- the configuration of the vehicle display control device according to the present embodiment is basically the same as that of the vehicle display control device 210 described with reference to FIG. 17 in the third embodiment.
- the flow of processing for displaying a warning screen on the display unit 55 is the same as that described with reference to FIG. 18 in the third embodiment.
- the flow of processing for displaying the warning screen on the display unit 55 is the same as that of the modification 6 shown in FIG. 19 or the modification shown in FIG. 7 may be the same.
- FIG. 21 is a block diagram showing a schematic configuration of the vehicle display control device 310.
- the vehicle display control device 310 according to the present embodiment includes a situation acquisition unit 318. This point is different from the vehicle display control device 210 described with reference to FIG. 17 in the first embodiment.
- the status acquisition unit 318 acquires the status of the vehicle 1 (see FIG. 1) via CAN (CAN: Controller Area Network), various sensors, a navigation system, and the like. Depending on the situation of the vehicle 1 acquired by the situation acquisition unit 318, the warning target vehicle determination unit 219 varies the specified relative speed and / or the specified inter-vehicle distance.
- CAN Controller Area Network
- the situation of the vehicle 1 may be a vehicle traveling speed. That is, the situation acquisition unit 318 acquires information related to the traveling speed of the vehicle 1 from a speed sensor or the like.
- FIG. 22 is a diagram illustrating an example of the specified relative speed and the specified inter-vehicle distance with respect to the vehicle travel speed. As illustrated in FIG. 22, the warning target vehicle determination unit 219 determines the specified relative speed when the traveling speed V of the vehicle 1 is 20 km / h or more and less than 40 km / h (20 km / h ⁇ V ⁇ 40 km / h).
- the specified relative speed is 210 km / h, 80 km / h or more (80 km / h ⁇ V).
- the specified relative speed may be set to 5 km / h, and the specified relative speed may be decreased as the traveling speed of the vehicle 1 increases.
- the warning target vehicle determination unit 219 is defined when the traveling speed V of the vehicle 1 is 20 km / h or more and less than 40 km / h (20 km / h ⁇ V ⁇ 40 km / h).
- the inter-vehicle distance is 210 m, 40 km / h or more and less than 80 km / h (40 km / h ⁇ V ⁇ 80 km / h)
- the specified inter-vehicle distance is 30 m, 80 km / h or more (80 km / h ⁇ V)
- the specified inter-vehicle distance may be increased as the traveling speed of the vehicle 1 is increased, for example, the specified inter-vehicle distance is 50 m.
- the traveling speed of the vehicle 1 the less the judgment is made because the driver is in a tense state and easily fatigues. For this reason, as the traveling speed of the vehicle 1 increases, it is necessary for the driver to make an appropriate determination with a margin for the approaching rear vehicle. If the specified relative speed is reduced, the driver can grasp the approaching rear vehicle at an earlier time, and thus can make an appropriate determination with a margin for the approaching rear vehicle. Similarly, if the specified inter-vehicle distance is increased, the driver can grasp the approaching rear vehicle at an earlier time, so that he / she can make an appropriate judgment with more margin for the approaching rear vehicle. become. Therefore, the warning target vehicle determination unit 219 can take an appropriate determination with more margin for the approaching rear vehicle by changing the specified relative speed and / or the specified inter-vehicle distance based on the vehicle traveling speed. It becomes like this.
- the number of contour images 61 (the number of display contours) of the other vehicle 60 to be superimposed on the video data (cutout video data) may be changed according to the vehicle traveling speed acquired by the situation acquisition unit 318. As shown in FIG. 22, when the traveling speed V of the vehicle 1 is 20 km / h or more and less than 40 km / h (20 km / h ⁇ V ⁇ 40 km / h), the number of display contours is set to 2, 40 km / h or more.
- the number of display contours is 3, and when the speed is 80 km / h or more (80 km / h ⁇ V), the number of display contours is 4. .
- the situation of the vehicle 1 may be an environment (traveling environment) in which the vehicle 1 is traveling. That is, the situation acquisition unit 318 acquires information related to the travel environment from a navigation system or the like.
- FIG. 23 is a diagram illustrating an example of the specified relative speed and the specified inter-vehicle distance with respect to the traveling environment. As shown in FIG. 23, the warning target vehicle determination unit 219 has a specified relative speed of 15 km / h when the driving environment is an urban area, a specified relative speed of 210 km / h when the driving environment is a suburb, an expressway, etc. The specified relative speed is 5 km / h in the case of an automobile-only road.
- the warning target vehicle determination unit 219 determines that the specified inter-vehicle distance is 210 m when the driving environment is an urban area, the specified inter-vehicle distance is 30 m when the driving environment is a suburb, and an automobile such as an expressway. In the case of a dedicated road, the specified inter-vehicle distance is 50 m.
- the traveling speed of the vehicle 1 is faster than when the driving environment is a suburb or a city area. Further, when the traveling environment is in the suburbs, the traveling speed of the vehicle 1 is faster than in the case of an urban area.
- the traveling speed of the vehicle 1 is increased, the driver is in a tense state and is easily fatigued, so that the judgment power is reduced. For this reason, as the traveling speed of the vehicle 1 increases, it is necessary for the driver to make an appropriate determination with a margin for the approaching rear vehicle. If the specified relative speed is reduced, the driver can grasp the approaching rear vehicle at an earlier time, and thus can make an appropriate determination with a margin for the approaching rear vehicle.
- the warning target vehicle determination unit 219 can make an appropriate determination with more margin for the approaching rear vehicle by changing the specified relative speed and / or the specified inter-vehicle distance based on the driving environment. become.
- the number of contour images 61 (the number of display contours) of the other vehicle 60 to be superimposed on the video data (cut-out video data) may be changed according to the traveling environment acquired by the situation acquisition unit 318. As shown in FIG. 23, when the driving environment is an urban area, the number of displayed contours is 2, when the driving environment is a suburb, the number of displayed contours is 3, and when the driving environment is an automobile-only road such as an expressway, the display is performed. Set the number of contours to 4. By doing in this way, the driver
- the situation of the vehicle 1 may be a degree of difficulty in viewing (bad visibility) in the surrounding environment of the vehicle 1. That is, the situation acquisition unit 318 acquires the degree of difficulty in viewing in the surrounding environment of the vehicle 1. Specifically, the situation acquisition unit 318 acquires information on the surrounding environment of the vehicle 1 (weather, daytime / nighttime, presence / absence of fog) from a navigation system or the like, and determines the degree of visual difficulty in the surrounding environment of the vehicle 1. .
- FIG. 24 is a diagram illustrating an example of the specified relative speed and the specified inter-vehicle distance with respect to the degree of visual difficulty in the surrounding environment of the vehicle 1. As shown in FIG.
- the warning target vehicle determination unit 219 sets the specified relative speed to 15 km / h, which is slightly high (nighttime) when the degree of visual difficulty in the surrounding environment of the vehicle 1 is low (daytime and clear to cloudy).
- the specified relative speed is 210 km / h, and in case of high (nighttime and foggy, nighttime and rain), the specified relative speed is 5 km. / H.
- the specified relative speed may be decreased as the degree of visual difficulty in the surrounding environment of the vehicle 1 is higher.
- the warning target vehicle determination unit 219 sets the specified inter-vehicle distance to 210 m, which is slightly higher (nighttime) when the degree of visual difficulty in the surrounding environment of the vehicle 1 is low (daytime and clear to cloudy).
- the specified inter-vehicle distance is 30 m. . That is, the specified inter-vehicle distance may be increased as the degree of visual difficulty in the surrounding environment of the vehicle 1 is higher.
- the warning target vehicle determination unit 219 makes an appropriate determination with more margin to the approaching rear vehicle by changing the specified relative speed and / or the specified inter-vehicle distance based on the degree of visual difficulty. You can take it.
- the number of contour images 61 of the other vehicle 60 to be superimposed on the video data (cutout video data) (the number of display contours) is changed according to the degree of visual difficulty in the surrounding environment acquired by the situation acquisition unit 318.
- the degree of visual difficulty in the surrounding environment of the vehicle 1 is low (daytime and sunny to cloudy)
- the number of display contours is set to 2 and is slightly higher (night and sunny to cloudy, daytime and fog). If there is or is daytime and rain, the display contour number is 3, and if it is high (night and fog or night and rain), the display contour number is 4.
- the present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the spirit of the present invention.
- the present invention is not limited to this, and the video data acquired by the center console or the like is displayed. Also good.
- the video data acquired by the rear camera is subjected to the processing for cutting out the range to be displayed on the display unit, but the rear camera is configured to acquire video data that matches the display range of the display unit. Also good. In this case, the cutting process becomes unnecessary.
- Processing in each part of the vehicle display control apparatus can be realized by causing a computer or the like to execute a program. More specifically, in the vehicle display control device, the program stored in the program memory is loaded into the main storage device, and the program is executed under the control of the CPU.
- the program can be stored using various types of non-transitory computer readable media and supplied to a computer.
- Non-transitory computer readable media include various types of tangible storage media.
- non-transitory computer-readable media examples include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-R, CD-R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)).
- the program may be supplied to the computer by various types of temporary computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves.
- the temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.
- the processing in each part of the vehicle display control device is not limited to being realized by software by a program, but may be realized by any combination of hardware, firmware, and software.
- the vehicle display control apparatus and at least one of the display unit and the rear camera may be combined to form one vehicle display system.
- the vehicle display control apparatus can be used as an image display apparatus implemented in a passenger car, for example.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Traffic Control Systems (AREA)
Abstract
L'invention concerne un appareil de commande d'affichage de véhicule (10) comprenant : une unité d'acquisition de données vidéo (11) qui acquiert des données vidéo d'une caméra arrière (56) installée pour photographier l'arrière d'un véhicule ; une unité de reconnaissance (12) qui reconnaît un autre véhicule dans les données vidéo ; une unité d'acquisition d'informations de position (13) qui acquiert des informations relatives à un changement de position dans les données vidéo de l'autre véhicule reconnu par l'unité de reconnaissance (12) ; une unité de traitement d'image (14) qui superpose, sur les données vidéo, le lieu de déplacement de l'autre véhicule sur la base des informations relatives au changement de position ; et une unité de commande d'affichage (15) qui amène un moniteur de vue arrière (53) destiné à afficher la vidéo de l'arrière du véhicule (1) à afficher les données vidéo sur lesquelles le lieu de déplacement a été superposé.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016108426A JP2017216557A (ja) | 2016-05-31 | 2016-05-31 | 車両用表示制御装置、車両用表示システム、車両表示制御方法及びプログラム |
JP2016-108426 | 2016-05-31 | ||
JP2016-179168 | 2016-09-14 | ||
JP2016179168A JP2018046384A (ja) | 2016-09-14 | 2016-09-14 | 車両用表示制御装置、車両用表示システム、車両表示制御方法及びプログラム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017208494A1 true WO2017208494A1 (fr) | 2017-12-07 |
Family
ID=60478113
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/002945 WO2017208494A1 (fr) | 2016-05-31 | 2017-01-27 | Appareil de commande d'affichage de véhicule, système d'affichage de véhicule, procédé de commande d'affichage de véhicule, et programme |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2017208494A1 (fr) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019004078A1 (fr) * | 2017-06-27 | 2019-01-03 | パナソニックIpマネジメント株式会社 | Dispositif d'affichage d'image périphérique et dispositif de commande d'affichage |
CN113412510A (zh) * | 2019-02-15 | 2021-09-17 | Jvc建伍株式会社 | 图像调整系统、图像调整装置以及图像调整方法 |
US11373400B1 (en) | 2019-03-18 | 2022-06-28 | Express Scripts Strategic Development, Inc. | Methods and systems for image processing to present data in augmented reality |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09293199A (ja) * | 1996-04-25 | 1997-11-11 | Matsushita Electric Ind Co Ltd | 安全走行支援装置 |
JP2007172035A (ja) * | 2005-12-19 | 2007-07-05 | Fujitsu Ten Ltd | 車載画像認識装置、車載撮像装置、車載撮像制御装置、警告処理装置、画像認識方法、撮像方法および撮像制御方法 |
JP2008258822A (ja) * | 2007-04-03 | 2008-10-23 | Denso Corp | 車両周辺監視装置 |
JP2009205386A (ja) * | 2008-02-27 | 2009-09-10 | Nikon Corp | 車載カメラシステムおよびその制御方法 |
JP2012064080A (ja) * | 2010-09-17 | 2012-03-29 | Denso Corp | 車両用障害物等検出装置 |
WO2014076841A1 (fr) * | 2012-11-19 | 2014-05-22 | パイオニア株式会社 | Appareil d'affichage, procédé de commande, programme et support d'enregistrement |
-
2017
- 2017-01-27 WO PCT/JP2017/002945 patent/WO2017208494A1/fr active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09293199A (ja) * | 1996-04-25 | 1997-11-11 | Matsushita Electric Ind Co Ltd | 安全走行支援装置 |
JP2007172035A (ja) * | 2005-12-19 | 2007-07-05 | Fujitsu Ten Ltd | 車載画像認識装置、車載撮像装置、車載撮像制御装置、警告処理装置、画像認識方法、撮像方法および撮像制御方法 |
JP2008258822A (ja) * | 2007-04-03 | 2008-10-23 | Denso Corp | 車両周辺監視装置 |
JP2009205386A (ja) * | 2008-02-27 | 2009-09-10 | Nikon Corp | 車載カメラシステムおよびその制御方法 |
JP2012064080A (ja) * | 2010-09-17 | 2012-03-29 | Denso Corp | 車両用障害物等検出装置 |
WO2014076841A1 (fr) * | 2012-11-19 | 2014-05-22 | パイオニア株式会社 | Appareil d'affichage, procédé de commande, programme et support d'enregistrement |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019004078A1 (fr) * | 2017-06-27 | 2019-01-03 | パナソニックIpマネジメント株式会社 | Dispositif d'affichage d'image périphérique et dispositif de commande d'affichage |
CN113412510A (zh) * | 2019-02-15 | 2021-09-17 | Jvc建伍株式会社 | 图像调整系统、图像调整装置以及图像调整方法 |
US11373400B1 (en) | 2019-03-18 | 2022-06-28 | Express Scripts Strategic Development, Inc. | Methods and systems for image processing to present data in augmented reality |
US11727683B2 (en) | 2019-03-18 | 2023-08-15 | Express Scripts Strategic Development, Inc. | Methods and systems for image processing to present data in augmented reality |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11189250B2 (en) | Display control device and display control method | |
US11220274B2 (en) | Vehicle display control device | |
US10595176B1 (en) | Virtual lane lines for connected vehicles | |
JP7416176B2 (ja) | 表示装置 | |
JP6346614B2 (ja) | 情報表示システム | |
EP3367362B1 (fr) | Procédé d'aide au stationnement et dispositif d'aide au stationnement | |
JPWO2017068701A1 (ja) | 駐車スペース検出方法および装置 | |
US20170043720A1 (en) | Camera system for displaying an area exterior to a vehicle | |
CN108482367B (zh) | 一种基于智能后视镜辅助驾驶的方法、装置及系统 | |
US11414099B2 (en) | Dynamic stop time threshold selection for hands-free driving | |
CN105264547A (zh) | 用于运行显示装置的方法,计算机程序产品,显示装置 | |
WO2017208494A1 (fr) | Appareil de commande d'affichage de véhicule, système d'affichage de véhicule, procédé de commande d'affichage de véhicule, et programme | |
JP2009012608A (ja) | 車両用照明装置 | |
CN111634232A (zh) | 控制装置 | |
JP6448714B2 (ja) | 情報表示システム | |
JP2024103486A (ja) | 車両用表示制御装置及び車両用表示装置 | |
US20200231091A1 (en) | Display system, vehicle control apparatus, display control method, and storage medium for storing program | |
JP5259277B2 (ja) | 運転支援装置 | |
JP7537393B2 (ja) | 制御装置、表示方法及びプログラム | |
WO2021186807A1 (fr) | Dispositif de traitement d'informations, véhicule et procédé de traitement d'informations | |
US11345288B2 (en) | Display system, vehicle control apparatus, display control method, and storage medium for storing program | |
JP2022140026A (ja) | 画像処理装置、画像処理方法およびプログラム | |
US11052822B2 (en) | Vehicle control apparatus, control method, and storage medium for storing program | |
EP4112387A1 (fr) | Dispositif de traitement d'image, système d'affichage, procédé de traitement d'image et support d'enregistrement | |
JP2017216557A (ja) | 車両用表示制御装置、車両用表示システム、車両表示制御方法及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17806056 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17806056 Country of ref document: EP Kind code of ref document: A1 |