WO2016051447A1 - 情報表示制御システムおよび情報表示制御方法 - Google Patents
情報表示制御システムおよび情報表示制御方法 Download PDFInfo
- Publication number
- WO2016051447A1 WO2016051447A1 PCT/JP2014/075810 JP2014075810W WO2016051447A1 WO 2016051447 A1 WO2016051447 A1 WO 2016051447A1 JP 2014075810 W JP2014075810 W JP 2014075810W WO 2016051447 A1 WO2016051447 A1 WO 2016051447A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- feature
- display control
- difficult
- vehicle
- information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 28
- 238000001514 detection method Methods 0.000 claims abstract description 18
- 238000000605 extraction Methods 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 3
- 239000002131 composite material Substances 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 20
- 238000004891 communication Methods 0.000 description 10
- 238000009825 accumulation Methods 0.000 description 2
- 230000004397 blinking Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09626—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages where the origin of the information is within the own vehicle, e.g. a local storage device, digital map
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096708—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
- G08G1/096716—Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control where the received information does not generate an automatic action on the vehicle control
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096733—Systems involving transmission of highway information, e.g. weather, speed limits where a selection of the information might take place
- G08G1/096758—Systems involving transmission of highway information, e.g. weather, speed limits where a selection of the information might take place where no selection takes place on the transmitted or the received information
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
- G08G1/096766—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
- G08G1/096783—Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is a roadside individual element
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/165—Anti-collision systems for passive traffic, e.g. including static obstacles, trees
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/304—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images
- B60R2300/305—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using merged images, e.g. merging camera image with stored images merging camera image with lines or icons
Definitions
- the present invention relates to an information display control system for displaying an image on a display of a vehicle.
- Patent Document 1 discloses a technique for superimposing and displaying a pre-photographed image of the vehicle surroundings when there is a region of low clarity in the image of the vehicle surroundings displayed on the vehicle display device.
- Patent Document 2 discloses a technique for displaying a lane guide indicating the shape of the traveling lane of the host vehicle on a display device that displays an image through the windshield of the vehicle.
- Patent Document 2 when there is an obstacle such as a gutter along the traveling lane of the own vehicle, the lane guide indicating the shape of the traveling lane of the own vehicle is displayed in a color different from the usual, thereby Techniques have been proposed to inform the driver of the existence of things.
- the “feature” in the present specification indicates a concept indicating all objects existing in the real world, for example, a plane such as a road marking (traffic sign, lane marking, etc.) drawn on a road. Something special is also included.
- the present invention has been made to solve the above-described problems, and an object thereof is to provide an information display control system that allows a driver to recognize the position of a feature that is difficult to visually recognize.
- An information display control system includes a display control unit that displays an image on a display device of a host vehicle, a host vehicle position acquisition unit that acquires position information of the host vehicle, and feature data that includes position information of the feature.
- a display data control unit, and a display control unit that detects a difficult-to-view feature detection unit that detects a difficult-to-view feature that is in a position that is visible from the host vehicle but is difficult to view.
- the driver recognize the position of a feature that is difficult to visually recognize, and to support driving.
- FIG. 1 is a block diagram showing a configuration of an information display control system according to Embodiment 1.
- FIG. 6 is a diagram for explaining the operation of the information display control apparatus according to Embodiment 1.
- FIG. 6 is a diagram for explaining the operation of the information display control apparatus according to Embodiment 1.
- FIG. 6 is a diagram for explaining the operation of the information display control apparatus according to Embodiment 1.
- FIG. 6 is a diagram for explaining the operation of the information display control apparatus according to Embodiment 1.
- FIG. 6 is a diagram for explaining an operation of an information display control apparatus according to Embodiment 2.
- FIG. FIG. 10 is a diagram for explaining a modification example of the operation of the information display control device according to the second embodiment.
- FIG. 10 is a block diagram showing a configuration of an information display control system according to Embodiment 3.
- FIG. 10 is a block diagram showing a configuration of an information display control system according to Embodiment 3.
- FIG. 10 is a block diagram showing a configuration of an information display control system according to Embodiment 4.
- FIG. 10 is a diagram for explaining an operation of an information display control apparatus according to a fourth embodiment. 14 is a flowchart showing an operation of the information display control apparatus according to the fourth embodiment.
- FIG. 10 is a block diagram illustrating a configuration of an information display control system according to a fifth embodiment.
- FIG. 10 is a block diagram showing a configuration of an information display control system according to Embodiment 6. It is a figure for demonstrating the example of the method which shows the position of the feature using the image displayed on a display. It is a figure for demonstrating the example of the method which shows the position of the feature using the image displayed on a transmissive display.
- FIG. 1 is a block diagram showing the configuration of the information display control system according to the first embodiment.
- the information display control system includes an information display control device 10, a display 20, a map information storage device 21, and an in-vehicle camera 22.
- the display 20, the map information storage device 21, and the vehicle-mounted camera 22 are configured to be externally attached to the information display control device 10, but they may be configured integrally with the information display control device 10. .
- the display device 20 is composed of, for example, a liquid crystal display device.
- the display device 20 is mounted on the vehicle, but the display device 20 does not have to be fixed in the vehicle like the display unit of the instrument panel, and is portable and can be brought into the vehicle.
- Display devices eg, television terminals, smartphones, tablet terminals, etc.).
- the map information storage device 21 is a storage medium such as a hard disk or a removable medium in which map information is stored.
- the map information stored in the map information storage device 21 includes not only road network data but also feature data including position information of features existing in each place and information on the type of the feature. Shall.
- the map information storage device 21 may be a server that provides map information to the information display control device 10 via a communication network such as the Internet.
- the in-vehicle camera 22 is a photographing device that photographs the surroundings of a vehicle (hereinafter referred to as “own vehicle”) on which the information display control device 10 and the display device 20 are mounted.
- the information display control device 10 is a control device that controls the operation of the display device 20, and includes a display control unit 11, a vehicle position acquisition unit 12, a feature data acquisition unit 13, and a difficult-to-view feature detection unit 14. .
- the information display control device 10 is configured using a computer, and the display control unit 11, the vehicle position acquisition unit 12, the feature data acquisition unit 13, and the difficult-to-view feature detection unit 14 operate according to a program. It is realized by doing.
- the display control unit 11 causes the display 20 to display a desired image by generating an image signal for displaying the image on the display 20.
- the display control unit 11 can acquire an image captured by the in-vehicle camera 22 and cause the display 20 to display the image.
- the own vehicle position acquisition unit 12 acquires the position information of the own vehicle.
- the vehicle position acquisition unit 12 receives a signal transmitted from a GNSS (Global Navigation Satellite System) such as GPS (Global Positioning System) and acquires absolute position (latitude, longitude) information.
- GNSS Global Navigation Satellite System
- GPS Global Positioning System
- absolute position latitude, longitude
- the machine is representative, a speed sensor, a direction sensor, etc. for acquiring information on relative position (position change) may be included.
- the vehicle position acquisition unit 12 can also improve the accuracy of the position information of the vehicle by map matching processing using map information stored in the map information storage device 21.
- the own vehicle position acquisition unit 12 does not necessarily have a function of calculating the position of the own vehicle, and the position information of the own vehicle from another device (for example, a navigation device) that handles the position information of the own vehicle. May be obtained.
- the feature data acquisition unit 13 uses the vehicle position information acquired by the vehicle position acquisition unit 12 and the map information stored in the map information storage device 21 to determine the vicinity of the vehicle (for example, a certain distance from the vehicle position). Within the range), and detect the detected feature data.
- the difficult-to-view feature detection unit 14 is based on the position information of the feature included in the feature data acquired by the feature data acquisition unit 13 and the image (photographed image) around the host vehicle captured by the in-vehicle camera 22. Then, a feature that is in a position that is visible from the host vehicle but is difficult to see (hereinafter referred to as “a feature that is difficult to see”) is detected. Specifically, the difficult-to-view feature detection unit 14 extracts and analyzes an image of a position where the feature exists from an image around the host vehicle captured by the in-vehicle camera 22, and the feature is detected by the in-vehicle camera 22. Make sure that it is clearly shot. If not photographed clearly, the feature is detected as a feature that is difficult to view.
- the display control unit 11 obtains the positional relationship between the vehicle and the difficult-to-view feature from the location information of the own vehicle and the location information included in the feature data of the difficult-to-view feature, and then determines the difficult-to-view feature.
- An image indicating the position of the vehicle is superimposed on an image around the vehicle photographed by the vehicle-mounted camera 22 and displayed on the display 20. Further, the display control unit 11 determines the content (shape, pattern, color, etc.) of the image indicating the position of the difficult-to-view feature according to the type of the feature.
- the in-vehicle camera 22 captures an image in front of the traveling direction of the host vehicle
- the display control unit 11 includes the in-vehicle camera 22 among the difficult-to-view features detected by the difficult-to-view feature detecting unit 14. It is assumed that an image indicating the position of a difficult-to-view feature existing in the shooting range (that is, in front of the traveling direction of the host vehicle) is displayed on the display 20 (the difficult-to-view feature detecting unit 14 is forward of the traveling direction of the host vehicle). May detect only difficult-to-view features in
- the image indicating the presence of the difficult-to-view feature is combined with the portion of the image around the vehicle where the difficult-to-view feature is present and displayed on the display device 20. It shall indicate the position of a difficult-to-view feature.
- FIG. 17 conceptually shows the method.
- the ground surface S is a plane including the X axis and the Y axis.
- the display controller 11 captures the image F1 indicating the presence of the feature F with the in-vehicle camera 22.
- the synthesized image is combined with the portion corresponding to the position P1 (x1, y1) in the image M of the ground surface S. If this method is used, in the image displayed on the display 20, the position of the image F1 coincides with the position of the feature F, so that the driver of the own vehicle can recognize the difficult-to-view feature from the display position of the image F1.
- the presence position can be recognized accurately.
- the information display control device 10 detects the presence of a difficult-to-view feature in front of the traveling direction of the host vehicle, the information display control device 10 superimposes an image indicating the position of the difficult-to-view feature on the image captured by the in-vehicle camera 22. Operates to display.
- the difficult-to-view feature detecting unit 14 detects the road R1, the center line C1, the outer lines E1, E2, and the side grooves G1, G2 as difficult-to-view features. Then, as shown in FIG.
- the in-vehicle camera 22 has photographed the display control unit 11 as an image showing the positions of the road R1, the center line C1, the outer lines E1, E2, and the side grooves G1, G2, which are difficult-to-view features. It is superimposed on the image (FIG. 4) and displayed on the display 20.
- the images showing the positions of the center line C1, the outer lines E1, E2 and the side grooves G1, G2 are assumed to have the same positions and shapes of the actual features on the screen of the display 20, but The position and shape of the image indicating the position may not match the actual feature.
- the image indicating the position of the road R1 is the outline of the road R1.
- the driver of the vehicle can easily recognize the width of the road R1 and the positions of the center line C1, the outer lines E1, E2 and the side grooves G1, G2 by looking at the image displayed on the display 20 (FIG. 5). it can.
- FIG. 6 is a flowchart showing the operation of the information display control apparatus 10 according to the first embodiment.
- the operation described with reference to FIGS. 2 to 5 is realized by the information display control device 10 performing the process shown in FIG.
- the operation of FIG. 6 is performed when the user performs an operation for ending the operation on the information display control device 10 or when an instruction to end the operation is input to the information display control device 10 from another device.
- the process ends.
- the display control unit 11 When the information display control device 10 is activated, the display control unit 11 first acquires an image around the host vehicle taken by the in-vehicle camera 22 (step S11), and displays the image on the display 20 (step S12). ). Then, the own vehicle position acquisition unit 12 acquires the position information of the own vehicle (step S13), and the feature data acquisition unit 13 acquires the feature data of the features existing around the own vehicle from the map information storage device 21. (Step S14).
- step S15 the vehicle surrounding image captured by the vehicle-mounted camera 22 based on the feature data (position information of the feature) acquired by the feature data acquisition unit 13 by the difficult-to-view feature detection unit 14 (location of the feature) Is analyzed), it is confirmed whether or not there are difficult-to-view features in the vicinity of the vehicle (step S15). If there is no difficult-to-view feature around the host vehicle (NO in step S15), the process returns to step S11.
- step S15 the display control unit 11 displays an image showing the positions of the difficult-to-view features in the captured images around the vehicle (in step S12). It is superimposed on the displayed image) and displayed on the display 20 (step S16). Then, it returns to step S11. That is, the processes in steps S11 to S16 are repeatedly executed.
- FIG. 7 is a block diagram showing the configuration of the information display control system according to the second embodiment.
- This information display control system has a configuration in which a travel obstacle feature extraction unit 14a is provided in the information display control device 10 with respect to the configuration of the first embodiment (FIG. 1).
- the travel obstacle feature extraction unit 14a extracts features that may become obstacles to traveling of the vehicle (hereinafter referred to as “travel obstacle feature”) from among the difficult-to-view features detected by the difficult-to-view feature detection unit 14. .
- travel obstacle feature features having a step with the road R1 such as the side grooves G1 and G2 are travel obstacle features.
- each feature is a traveling obstacle feature can be determined from the type of the feature indicated by the feature data (for example, a three-dimensional feature such as a side ditch or a median strip can be determined as a traveling obstacle feature).
- the feature data may include information indicating whether or not each feature is a travel obstacle feature.
- the display control unit 11 includes an image that warns the presence of the travel obstacle feature in the image indicating the position of the travel obstacle feature extracted by the travel obstacle feature extraction unit 14a.
- the difficult-to-view feature detection unit 14 detects the road R1, the center line C1, the outer lines E1, E2, and the side grooves G1, G2 as difficult-to-view features.
- the traveling obstacle feature extracting unit 14a extracts the side grooves G1 and G2 that are the traveling obstacle features from them.
- the display control unit 11 uses an image including an image that warns the existence (a graphic including a symbol “!”) As an image showing the side grooves G1 and G2. Thereby, it is possible to make the driver recognize the existence of the traveling obstacle feature more reliably.
- the image that warns of the presence of the traveling obstacle feature is not limited to that shown in FIG. 8, but may be a specific character, figure, color, pattern, dynamic image (for example, blinking image), or the like. It is only necessary that the image showing the travel obstacle feature is more conspicuous than the image showing the difficult-to-view feature.
- the information display control device 10 displays only the image indicating the position of the travel obstacle feature detected by the travel obstacle feature extraction unit 14a on the captured image around the vehicle. It may be. By not displaying an image showing features other than the traveling obstacle feature, the image showing the traveling obstacle feature can be made more conspicuous.
- the difficult-to-view feature detection unit 14 may detect a difficult-to-view feature based on information acquired by various sensors (on-vehicle sensors) mounted on the host vehicle.
- FIG. 10 is a configuration example of the information display control system in that case, and is a configuration in which an in-vehicle sensor 23 is further connected to the information display control device 10 with respect to the configuration of the first embodiment (FIG. 1) ( The in-vehicle sensor 23 may be built in the information display control device 10).
- the difficult-to-view feature detection unit 14 uses the feature data acquisition unit 13 based on information indicating the state of the surrounding environment of the vehicle acquired from the in-vehicle sensor 23 (for example, an illuminance sensor, a rain sensor, a fog sensor, etc.). It is determined whether or not each feature detected by is difficult to see. For example, it is conceivable to determine a feature that is located at a certain distance or more from the host vehicle as a difficult-to-view feature during rain or heavy fog. Since other processes may be the same as those in the first embodiment, description thereof is omitted.
- the in-vehicle sensor 23 for example, an illuminance sensor, a rain sensor, a fog sensor, etc.
- the difficult-to-view feature detecting unit 14 can detect the difficult-to-view feature based on information acquired through communication with each distribution facility.
- FIG. 11 is a block diagram showing the configuration of the information display control system in that case.
- the information display control device 10 is connected to a communication device 24 that communicates with information distribution facilities (the communication device 24 may be built in the information display control device 10).
- the information display control device 10 acquires information on difficult-to-view features from the information distribution facility through communication using the communication device 24.
- the difficult-to-view feature detection unit 14 compares the position information of the difficult-to-view feature acquired by the communication device 24 from the distribution facility with the position information of the surroundings of the vehicle detected by the feature data acquisition unit 13. By doing so, it is determined whether or not each feature is a feature that is difficult to view.
- Other processes may be the same as those in the first embodiment.
- methods using the in-vehicle camera 22, the in-vehicle sensor 23, or the communication device 24 may be combined with each other.
- a method using the communication device 24 may be performed in an area where information distribution facilities are prepared, and a method using the in-vehicle camera 22 or the in-vehicle sensor 23 may be performed in other areas.
- FIG. 12 is a block diagram illustrating a configuration of the information display control system according to the fourth embodiment.
- the display 20 is replaced with a transmissive display 25 in the configuration of the first embodiment (FIG. 1). Further, in the system, an image captured by the in-vehicle camera 22 is not input to the display control unit 11.
- the transmissive display 25 is a type of display (for example, a head-up display) that directly displays information in the driver's field of view by displaying information on a windscreen or a transparent screen that the driver can see through.
- Embodiments 1 to 3 in order to indicate the position of a difficult-to-view feature, it is necessary to superimpose an image indicating the position on the image captured by the in-vehicle camera 22.
- the transmissive display 25 since the scene seen through the windshield from the driver is the background of the screen, the position of the difficult-to-view feature is shown in the actual scene without using the image taken by the in-vehicle camera 22. Images can be superimposed.
- an image indicating the presence of a difficult-to-view feature is displayed on the transmissive display 25 so as to be superimposed on the position where the difficult-to-view feature is present when viewed from the driver of the vehicle.
- FIG. 18 conceptually shows the method.
- the ground surface S is a plane including the X axis and the Y axis.
- the display control unit 11 displays the image F1 indicating the presence of the feature F on the transmissive display 25. Is displayed at the intersection of a straight line connecting the position E of the driver's eyes and the position P1 (x1, y1). If this method is used, since the image F1 appears to be superimposed on the position where the feature F exists, the driver can accurately recognize the position where the difficult-to-view feature exists from the display position of the image F1. Can do.
- FIG. 14 is a flowchart showing the operation of the information display control apparatus 10 according to the fourth embodiment.
- the above operation is realized by the information display control device 10 performing the process shown in FIG.
- the operation in FIG. 14 is performed when the user performs an operation for ending the operation on the information display control device 10 or when an instruction to end the operation is input from another device to the information display control device 10.
- the process ends.
- the own vehicle position acquisition unit 12 acquires the position information of the own vehicle (step S21), and the feature data acquisition unit 13 detects the features of the features existing around the own vehicle. Data is acquired from the map information storage device 21 (step S22).
- step S23 the vehicle surrounding image captured by the vehicle-mounted camera 22 based on the feature data (position information of the feature) acquired by the feature data acquisition unit 13 by the difficult-to-view feature detection unit 14 (location of the feature) Is analyzed), it is confirmed whether or not there are difficult-to-view features in the vicinity of the vehicle (step S23). If there is no difficult-to-view feature around the host vehicle (NO in step S23), the process returns to step S21.
- the display control unit 11 uses the transmission type display 25 to display an image indicating the position of the difficult-to-view features. Is displayed in the field of view (step S24). To the driver, an image showing the position of the difficult-to-view feature is superimposed on the actual scene. Then, it returns to step S21. That is, the processes in steps S21 to S24 are repeatedly performed.
- FIG. 14 shows an example in which the transmissive display 25 is applied to the information display control system of the first embodiment, but the transmissive display 25 is also applied to the various information display control systems shown in the second and third embodiments. Is applicable.
- FIG. 15 is a block diagram showing the configuration of the information display control system according to the fifth embodiment.
- the information display control device 10 is provided with an eye point estimation unit 17 in contrast to the configuration of the fourth embodiment (FIG. 12).
- the eye point estimation unit 17 estimates the position (eye point) of the driver's eyes with respect to the screen of the transmissive display 25 (for example, the windshield).
- the eye point estimation unit 17 may use any method for estimating the position of the driver's eyes.
- the eye point estimation unit 17 analyzes and estimates an image obtained by capturing the driver's face with a camera (driver monitoring camera) installed in the driver's seat. A way to do this is considered.
- a simple one that estimates the position of the driver's eyes from the position of the seat of the driver's seat (the position and height of the seat surface, the inclination angle of the backrest, etc.) may be used.
- the display control unit 11 determines the display position on the screen of the transmissive display 25 of the image indicating the position of the difficult-to-view feature, and the eye position of the driver estimated by the eye point estimation unit 17. Determine based on. As a result, an image indicating the position of the difficult-to-view feature can be displayed at a more accurate position in the driver's field of view.
- FIG. 16 is a block diagram showing the configuration of the information display control system according to the sixth embodiment.
- This information display control system has a configuration in which a display target setting unit 18 and a display condition setting unit 19 are provided in the information display control device 10 with respect to the configuration of the first embodiment (FIG. 1).
- the display target setting unit 18 and the display condition setting unit 19 are user interfaces that can be operated by the user, and the user uses the display target setting unit 18 to set the type of a feature whose position is to be displayed on the display image.
- the display condition setting unit 19 can be used to set conditions for displaying an image showing the position of the feature.
- the display target setting unit 18 and the display condition setting unit 19 may be a device (such as a remote controller) externally attached to the information display control device 10.
- the display control unit 11 superimposes only the image indicating the type of feature set in the display target setting unit 18 among the difficult-to-view features on the display device 20 by superimposing the captured image around the vehicle. To display. Further, only when the condition set in the display condition setting unit 19 is satisfied, an image indicating the position of the feature is displayed on the display 20.
- the object whose position is indicated by the display image and the condition for displaying the image according to the preference of the user. For example, an unnecessary image can be displayed by restricting the target feature whose position is indicated by the display image to only a traffic sign or limiting the size of the range for displaying the image indicating the position of the feature. And the visibility of each displayed image can be improved.
- FIG. 16 shows a configuration in which the display target setting unit 18 and the display condition setting unit 19 are provided in the information display control device 10 with respect to the information display control system of the first embodiment.
- the present invention can also be applied to various information display control systems shown in Embodiments 2 to 5.
- 10 information display control device 11 display control unit, 12 own vehicle position acquisition unit, 13 feature data acquisition unit, 14 difficult-to-view feature detection unit, 14a travel obstacle feature extraction unit, 17 eye point estimation unit, 18 display target Setting unit, 19 display condition setting unit, 20 display device, 21 map information storage device, 22 in-vehicle camera, 23 in-vehicle sensor, 24 communication device, 25 transmissive display.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Image Processing (AREA)
Abstract
Description
図1は、実施の形態1に係る情報表示制御システムの構成を示すブロック図である。図1のように、情報表示制御システムは、情報表示制御装置10、表示器20、地図情報記憶装置21および車載カメラ22から構成される。ここでは、表示器20、地図情報記憶装置21および車載カメラ22が、情報表示制御装置10に外付けされた構成を示すが、それらは情報表示制御装置10と一体的に構成されていてもよい。
図7は、実施の形態2に係る情報表示制御システムの構成を示すブロック図である。この情報表示制御システムは、実施の形態1の構成(図1)に対し、情報表示制御装置10に走行障害地物抽出部14aを設けた構成となっている。
実施の形態1では、視認困難地物検出部14が、自車の位置情報と車載カメラ22が撮影した車両周囲の画像とに基づいて、視認困難地物を検出する構成を示したが、視認困難地物の検出は、他の方法で行われてもよい。ここでは、その幾つかの例を示す。
図12は、実施の形態4に係る情報表示制御システムの構成を示すブロック図である。この情報表示制御システムは、実施の形態1の構成(図1)に対し、表示器20を透過型表示器25に置き換えたものとなっている。また、当該システムでは、車載カメラ22が撮影した画像は、表示制御部11に入力されていない。
図15は、実施の形態5に係る情報表示制御システムの構成を示すブロック図である。この情報表示制御システムは、実施の形態4の構成(図12)に対し、情報表示制御装置10にアイポイント推定部17を設けたものである。
地物には様々なものが含まれているため、地図データに含まれている全ての地物の位置を示す画像を制限なく表示器(または透過型表示器)に表示させると、個々の地物の位置を認識しにくくなることが考えられる。そこで、本実施の形態では、表示画像で位置を示す対象とする地物の種別や、画像を表示するための条件を、ユーザが任意に設定できるようにする。
Claims (13)
- 自車の表示器に画像を表示させる表示制御部と、
前記自車の位置情報を取得する自車位置取得部と、
地物の位置情報を含む地物データを取得する地物データ取得部と、
前記自車から視認可能な位置にあるが視認困難な状態の地物である視認困難地物を検出する視認困難地物検出部と、
を備え、
前記表示制御部は、前記地物データに含まれる地物の位置情報および前記自車位置取得部が取得した前記自車の位置情報に基づいて、視認困難地物の位置を示す画像を前記表示器に表示させる
ことを特徴とする情報表示制御システム。 - 前記表示制御部は、前記自車の周囲を撮影した画像を取得し、視認困難地物の位置を示す画像を前記自車の周囲の画像に合成して前記表示器に表示させる
請求項1に記載の情報表示制御システム。 - 前記表示制御部は、視認困難地物の存在を示す画像を、前記自車の周囲の画像におけるその視認困難地物が存在する位置の部分に合成して、前記表示器に表示させる
請求項2に記載の情報表示制御システム。 - 前記表示器は、前記自車の運転者が見通せる透過型表示器である
請求項1に記載の情報表示制御システム。 - 前記表示制御部は、視認困難地物の存在を示す画像を、前記運転者から見てその視認困難地物が存在する位置に重畳して見えるように、前記透過型表示器に表示させる
請求項4に記載の情報表示制御システム。 - 前記透過型表示器の画面に対する前記運転者の目の位置を推定するアイポイント推定部をさらに備え、
前記表示制御部は、視認困難地物の位置を示す画像の表示位置を、前記アイポイント推定部が推定した前記運転者の目の位置に基づいて決定する
請求項4に記載の情報表示制御システム。 - 視認困難地物のうちから自車の走行の障害となり得る地物である走行障害地物を抽出する走行障害地物抽出部をさらに備え、
前記表示制御部は、前記走行障害地物抽出部が抽出した走行障害地物の位置を示す画像を前記表示器に表示させる
請求項1に記載の情報表示制御システム。 - 走行障害地物の位置を示す画像は、その走行障害地物の存在を警告する画像を含んでいる
請求項7に記載の情報表示制御システム。 - 前記視認困難地物検出部が視認困難地物として検出する地物には、道路、車線および路面標示のうちの1以上が含まれる
請求項1に記載の情報表示制御システム。 - 前記視認困難地物検出部は、各地物が自車から視認困難か否かを、自車の周辺環境の状態を示す情報から判断する
請求項1に記載の情報表示制御システム。 - 画像によって位置を示す対象とする地物の種別をユーザが設定可能な表示対象設定部をさらに備え、
前記表示制御部は、視認困難地物のうち前記表示対象設定部に設定された種別の地物を示す画像のみを前記表示器に表示させる
請求項1に記載の情報表示制御システム。 - 地物の位置を示す画像を表示するための条件をユーザが設定可能な表示条件設定部をさらに備え、
前記表示制御部は、前記表示条件設定部に設定された条件が満たされる場合に、地物の位置を示す画像を前記表示器に表示させる
請求項1に記載の情報表示制御システム。 - 車両用の情報表示制御システムにおける情報表示制御方法であって、
前記情報表示制御システムの自車位置取得部が、自車の位置情報を取得し、
前記情報表示制御システムの視認困難地物検出部が、前記自車から視認可能な位置にあるが視認困難な状態の地物である視認困難地物を検出し、
前記情報表示制御システムの地物データ取得部が、前記視認困難地物の位置情報を取得し、
前記情報表示制御システムの表示制御部が、前記視認困難地物の位置情報および前記自車の位置情報に基づいて、前記視認困難地物の位置を示す画像を表示器に表示させる
ことを特徴とする情報表示制御方法。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE112014007007.6T DE112014007007T5 (de) | 2014-09-29 | 2014-09-29 | Informationsanzeige-Steuersystem und Verfahren zum Steuern einer Anzeige einer Information |
CN201480082234.3A CN106716514A (zh) | 2014-09-29 | 2014-09-29 | 信息显示控制系统及信息显示控制方法 |
JP2016551128A JP6415583B2 (ja) | 2014-09-29 | 2014-09-29 | 情報表示制御システムおよび情報表示制御方法 |
PCT/JP2014/075810 WO2016051447A1 (ja) | 2014-09-29 | 2014-09-29 | 情報表示制御システムおよび情報表示制御方法 |
US15/317,522 US20170120819A1 (en) | 2014-09-29 | 2014-09-29 | Information display control system and method of controlling display of information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2014/075810 WO2016051447A1 (ja) | 2014-09-29 | 2014-09-29 | 情報表示制御システムおよび情報表示制御方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016051447A1 true WO2016051447A1 (ja) | 2016-04-07 |
Family
ID=55629548
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/075810 WO2016051447A1 (ja) | 2014-09-29 | 2014-09-29 | 情報表示制御システムおよび情報表示制御方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20170120819A1 (ja) |
JP (1) | JP6415583B2 (ja) |
CN (1) | CN106716514A (ja) |
DE (1) | DE112014007007T5 (ja) |
WO (1) | WO2016051447A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018211591A1 (ja) * | 2017-05-16 | 2018-11-22 | 三菱電機株式会社 | 表示制御装置および表示制御方法 |
JP2020024643A (ja) * | 2018-08-09 | 2020-02-13 | 日本精機株式会社 | 車両用表示装置、車両用表示装置の制御方法、車両用表示装置の制御プログラム |
JPWO2021029016A1 (ja) * | 2019-08-13 | 2021-02-18 | ||
CN113272177A (zh) * | 2018-11-15 | 2021-08-17 | 法雷奥开关和传感器有限责任公司 | 用于提供关于环境的至少一部分的视觉信息的方法、计算机程序产品、移动通信设备和通信系统 |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101677644B1 (ko) * | 2014-09-02 | 2016-11-29 | 엘지전자 주식회사 | 이동 단말기 및 이의 제어 방법 |
DE112018007423B4 (de) * | 2018-05-24 | 2021-07-22 | Mitsubishi Electric Corporation | Fahrzeuganzeigesteuervorrichtung |
FR3082320B1 (fr) * | 2018-06-06 | 2022-05-27 | Valeo Comfort & Driving Assistance | Dispositif d'affichage pour l'aide a la conduite |
DE102020212562B3 (de) | 2020-10-05 | 2021-11-11 | Volkswagen Aktiengesellschaft | Fahrspurbezogene visuelle Assistenzfunktion einer Head-Up-Displayeinrichtung für ein Kraftfahrzeug |
CN115830838A (zh) * | 2022-11-23 | 2023-03-21 | 浙大城市学院 | 一种工程机械智能控制系统 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006350617A (ja) * | 2005-06-15 | 2006-12-28 | Denso Corp | 車両用走行支援装置 |
JP2007183764A (ja) * | 2006-01-05 | 2007-07-19 | Hitachi Ltd | 車載装置 |
JP2010257253A (ja) * | 2009-04-24 | 2010-11-11 | Denso Corp | 車両用表示装置 |
WO2013171962A1 (ja) * | 2012-05-18 | 2013-11-21 | 日産自動車株式会社 | 車両用表示装置、車両用表示方法及び車両用表示プログラム |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4321821B2 (ja) * | 2005-01-28 | 2009-08-26 | アイシン・エィ・ダブリュ株式会社 | 画像認識装置及び画像認識方法 |
JP2008309529A (ja) * | 2007-06-12 | 2008-12-25 | Panasonic Corp | ナビゲーション装置、ナビゲーション方法、及びナビゲーション用プログラム |
-
2014
- 2014-09-29 US US15/317,522 patent/US20170120819A1/en not_active Abandoned
- 2014-09-29 JP JP2016551128A patent/JP6415583B2/ja active Active
- 2014-09-29 DE DE112014007007.6T patent/DE112014007007T5/de not_active Ceased
- 2014-09-29 WO PCT/JP2014/075810 patent/WO2016051447A1/ja active Application Filing
- 2014-09-29 CN CN201480082234.3A patent/CN106716514A/zh active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006350617A (ja) * | 2005-06-15 | 2006-12-28 | Denso Corp | 車両用走行支援装置 |
JP2007183764A (ja) * | 2006-01-05 | 2007-07-19 | Hitachi Ltd | 車載装置 |
JP2010257253A (ja) * | 2009-04-24 | 2010-11-11 | Denso Corp | 車両用表示装置 |
WO2013171962A1 (ja) * | 2012-05-18 | 2013-11-21 | 日産自動車株式会社 | 車両用表示装置、車両用表示方法及び車両用表示プログラム |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018211591A1 (ja) * | 2017-05-16 | 2018-11-22 | 三菱電機株式会社 | 表示制御装置および表示制御方法 |
JPWO2018211591A1 (ja) * | 2017-05-16 | 2019-11-14 | 三菱電機株式会社 | 表示制御装置および表示制御方法 |
US11248926B2 (en) | 2017-05-16 | 2022-02-15 | Mitsubishi Electric Corporation | Display control device and display control method |
JP2020024643A (ja) * | 2018-08-09 | 2020-02-13 | 日本精機株式会社 | 車両用表示装置、車両用表示装置の制御方法、車両用表示装置の制御プログラム |
JP7279314B2 (ja) | 2018-08-09 | 2023-05-23 | 日本精機株式会社 | 車両用表示装置、車両用表示装置の制御方法、車両用表示装置の制御プログラム |
CN113272177A (zh) * | 2018-11-15 | 2021-08-17 | 法雷奥开关和传感器有限责任公司 | 用于提供关于环境的至少一部分的视觉信息的方法、计算机程序产品、移动通信设备和通信系统 |
CN113272177B (zh) * | 2018-11-15 | 2024-01-26 | 法雷奥开关和传感器有限责任公司 | 用于提供关于环境的至少一部分的视觉信息的方法、计算机程序产品、移动通信设备和通信系统 |
JPWO2021029016A1 (ja) * | 2019-08-13 | 2021-02-18 | ||
WO2021029016A1 (ja) * | 2019-08-13 | 2021-02-18 | 本田技研工業株式会社 | ガイド表示方法 |
JP7212788B2 (ja) | 2019-08-13 | 2023-01-25 | 本田技研工業株式会社 | ガイド表示方法 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2016051447A1 (ja) | 2017-04-27 |
JP6415583B2 (ja) | 2018-10-31 |
DE112014007007T5 (de) | 2017-06-08 |
CN106716514A (zh) | 2017-05-24 |
US20170120819A1 (en) | 2017-05-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6415583B2 (ja) | 情報表示制御システムおよび情報表示制御方法 | |
US11967109B2 (en) | Vehicle localization using cameras | |
US10748426B2 (en) | Systems and methods for detection and presentation of occluded objects | |
US9507345B2 (en) | Vehicle control system and method | |
CA2999955C (en) | Vehicular display device | |
US10891859B1 (en) | Displaying sensor data and supplemental data as a mask for autonomous vehicles | |
US10996070B2 (en) | Route guidance apparatus and method | |
WO2012131871A1 (ja) | 情報表示装置、制御方法、プログラム、及び記憶媒体 | |
US20180037162A1 (en) | Driver assistance system | |
US10488658B2 (en) | Dynamic information system capable of providing reference information according to driving scenarios in real time | |
US11325470B2 (en) | Method, device and computer-readable storage medium with instructions for controlling a display of an augmented-reality head-up display device for a transportation vehicle | |
CN109050401B (zh) | 一种增强现实的驾驶显示方法和装置 | |
US10922976B2 (en) | Display control device configured to control projection device, display control method for controlling projection device, and vehicle | |
US10996469B2 (en) | Method and apparatus for providing driving information of vehicle, and recording medium | |
JP2008021234A (ja) | 運転支援画像表示システム及び車載装置 | |
JP6257491B2 (ja) | 車両用照射制御システムおよび画像照射の制御方法 | |
JP6448274B2 (ja) | 情報表示制御システムおよび情報表示制御方法 | |
US20200167969A1 (en) | Assistance system for a vehicle | |
JP4600391B2 (ja) | 表示装置、表示システム及び表示方法 | |
US10864856B2 (en) | Mobile body surroundings display method and mobile body surroundings display apparatus | |
JP2014229100A (ja) | 車両用表示装置 | |
JP4725503B2 (ja) | 車載装置、運転支援システム及び運転支援方法 | |
JP2014074627A (ja) | 車両用ナビゲーションシステム | |
JP2011191264A (ja) | 表示制御装置、方法およびプログラム | |
JP2020190942A (ja) | 表示制御装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14903042 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016551128 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15317522 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 112014007007 Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14903042 Country of ref document: EP Kind code of ref document: A1 |