Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/204—Image signal generators using stereoscopic image cameras
  • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
  • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
  • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
  • G02B27/01—Head-up displays
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T15/00—3D [Three Dimensional] image rendering
  • G06T15/10—Geometric effects
  • G06T15/20—Perspective computation
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T19/00—Manipulating 3D models or images for computer graphics
  • G06T19/006—Mixed reality
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/20—Image signal generators
  • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
  • H04N13/30—Image reproducers
  • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
  • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
  • B60K2360/20—Optical features of instruments
  • B60K2360/21—Optical features of instruments using cameras
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2200/00—Indexing scheme for image data processing or generation, in general
  • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2200/00—Indexing scheme for image data processing or generation, in general
  • G06T2200/21—Indexing scheme for image data processing or generation, in general involving computational photography
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10004—Still image; Photographic image
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10016—Video; Image sequence
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10028—Range image; Depth image; 3D point clouds
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30248—Vehicle exterior or interior
  • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
  • G06T2219/004—Annotating, labelling
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
  • G06T2219/20—Indexing scheme for editing of 3D models
  • G06T2219/2004—Aligning objects, relative positioning of parts
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
  • G06T2219/20—Indexing scheme for editing of 3D models
  • G06T2219/2008—Assembling, disassembling

Definitions

• the invention relates to a method and a device for driver information.
• the invention relates to a method and apparatus for outputting personalized information to a driver of a motor vehicle having the features of the independent claims.
• optical, acoustic or haptic output devices To output information to a driver of a motor vehicle, it is known to use optical, acoustic or haptic output devices. In the first place, these devices are used to output information about the driving state of the motor vehicle, for example an optical speedometer (tachometer) or a haptic warning before leaving a lane. Since the issuing of such information involves the danger of distracting the driver from what is happening around the motor vehicle, such expenditure must always be cautious. In certain cases, statutory requirements must also be observed, for example, in some countries operating a navigation system while driving is not permitted.
• An inventive method for driver information comprises steps of
• the display area comprises a surface of an object displayed on the image.
• the method may perform recognition of objects in the image and provide a surface of a detected object as a display area. This makes it easy to find a coherent display area.
• the surface of the object can hold little or no relevant information for the guidance of the motor vehicle, so that overlaying with the personalized information represents virtually no information loss for the driver.
• advertisement information on the surface of the object may be blended by the personalizing information.
• the representation of the inserted information is aligned in perspective to a position and extent of the surface of the object with respect to the motor vehicle.
• the output of the personalized information can thus be made in accordance with the perceptible objects of the environment, so that the information recording by the driver can be facilitated.
• the information can be obtained from a source outside the motor vehicle.
• the information can be obtained, for example by means of wireless data transfer, from a computer or a computer network, which provides the personalized information to the driver.
• calendar or contact information, reminders or personalized advertising can be discreetly brought to the driver's attention.
• the method comprises determining a driving situation of the motor vehicle and selecting the information to be inserted as a function of the driving situation. If, for example, a driving situation requires increased attention from the driver due to its complexity, the personalized information may be limited to brief and urgently marked messages. However, if the driving situation is simple, such as driving at a constant speed on a low-traffic freeway in daylight and good visibility, the information may also be more complex or changed more frequently.
• the driving situation can be determined, for example, on the basis of a driving purpose, a time of day or a driving speed. An information overload of the driver can be prevented even better.
• the personalized information can be output to suit the driving situation, so that, for example, a current schedule can be output on a work journey, but personalized weather information of the destination can be output on a holiday trip.
• a computer program product comprises program code means for carrying out the described method when the computer program product runs on a processor or is stored on a computer-readable medium.
• the computer program product can, in particular, run on a processing device which is integrated into the motor vehicle and possibly also controls another system, for example a navigation system.
• the computer program product may also be removable on a motor vehicle
• Computer run as an output device alternatively an integrated Output device or an output device that is permanently installed in the vehicle, can be used.
• An inventive system for driver information comprises a recording device for scanning an image of an exterior of a motor vehicle, a determining device for determining personalized information, which are directed to a driver of the motor vehicle, processing means for determining a contiguous display area in the image and for inserting the Information in the image in the area of the display surface, and an output device for outputting the image to the driver.
• the system is permanently installed in the motor vehicle.
• it is possible, in particular, to facilitate networking with other systems of the motor vehicle in order, for example, to allow an improved or easier determination of the driving situation of the motor vehicle.
• the output device comprises a so-called head-up display.
• Such an optical output device allows an overlay of the immediately visually perceptible environment with a generated image.
• an overlay can only take place in subregions of the environment, for example by means of an alphanumeric output.
• a context-sensitive overlay of visually perceptible objects with other information is referred to as augmented reality. This technique can be used advantageously to carry out the inventive output to the driver.
• the system preferably comprises a receiving device for receiving the information from a source outside the motor vehicle.
• the receiving device may in particular comprise a unidirectional or bidirectional digital data interface which is connected to a computer or a computer network, for example the Internet.
• FIG. 1 is a system for driver information
• FIGS. 2 to 4 show examples of an overlay of visually perceptible information with output personalized information
• FIG. 5 is a flowchart of a method for execution on the system of FIG.
• FIG. 1 shows a system 100 for driver information.
• a processing device 110 On board a motor vehicle 105 there are a processing device 110, a first camera 15, a second camera 120, an interface 125, a receiving device 130 and an output device 135.
• a processing device 110 On board a motor vehicle 105 there are a processing device 110, a first camera 15, a second camera 120, an interface 125, a receiving device 130 and an output device 135.
• a processing device 110 On board a motor vehicle 105 there are a processing device 110, a first camera 15, a second camera 120, an interface 125, a receiving device 130 and an output device 135.
• a receiving device 130 On board a motor vehicle 105 there are a processing device 110, a first camera 15, a second camera 120, an interface 125, a receiving device 130 and an output device 135.
• not all of the elements shown must be present. as will be explained in more detail below.
• the processing device 110 preferably comprises a programmable microcomputer.
• the processing device 110 is installed permanently on board the motor vehicle 105, wherein the processing device 110, in conjunction with the devices connected to it, can take on further processing and control tasks.
• the processing device 1 10 may be part of a navigation or entertainment system on board the motor vehicle 105.
• the first camera 1 15 and the second camera 120 which may also be replaced by a stereo camera, are adapted to provide images or a combined image of an exterior of the motor vehicle 105.
• a viewing angle of the cameras 115 and 120 as closely as possible corresponds to a viewing angle of a driver of the motor vehicle 105.
• the cameras 1 15 and 120 are preferably aligned in the direction of travel forward and also offset from each other, so that from images that at the same time with the two Cameras 1 15, 120 were recorded for the purpose of tion of depth information can be superimposed.
• the determination of depth information in the combined image can take place either in the cameras 1 15, 120 or the stereo camera which replaces them or by means of the processing device 110.
• only a single camera 115 is provided and depth information of the image provided by this camera 15 can be determined, for example, by a geometric distance estimation.
• the optional interface 125 is configured to provide data indicative of a driving condition of the motor vehicle 105.
• data may include a position, a speed, an acceleration, a planned route, a time of day, an outside temperature, lighting conditions, and other parameters that are significant to the operation of the motor vehicle 105.
• the processing device 1 10 can determine the driving state of the motor vehicle 105.
• the receiving device 130 is also optional and configured to receive personalized information directed to a driver of the motor vehicle 105.
• the receiving device 130 may be wired or wirelessly connected to a data memory on board the motor vehicle 105, for example, with a mobile phone or a personal computer, for example for the management of appointments.
• the receiving device 130 may also be configured to wirelessly receive data from a network.
• This network may include, for example, a cellular network, which may be connected to the Internet.
• the receiving device 130 is also configured to transmit a request for personalized data from the processing device 110 to another computer, which then provides this data.
• the output device 135 is an optical output device, preferably with support of a multicolor output.
• the output device 135 is installed so that the driver of the motor vehicle 105 can easily read it.
• the output device 135 comprises a freely viewable display, such as a liquid crystal display.
• the output device 135 comprises a so-called head-up display, which is set up to store information in the viewing position. the area of the driver.
• the field of view of the cameras 1 15 and 120 includes the driver's main field of vision, so that the directly perceptible optical information from the surroundings of the motor vehicle 105 can be superimposed on the basis of the images provided by the cameras 1 15, 120 by means of the output device 135.
• the superimposition determines which objects in the environment of the motor vehicle 105 are visible to the driver and which are completely or partially superimposed by information of the image.
• Figures 2 to 5 show examples of an overlay optically perceptible
• an area 200 which lies in front of the motor vehicle 105 and which can be viewed by the driver of the motor vehicle 105 when looking in the direction of travel.
• an image 205 is taken, which was taken by means of the cameras 1 15, 120 and processed by means of the processing device 1 10 of FIG.
• the image 205 is preferably displayed in the region 200 in such a way that directly perceptible objects and representations of these objects in the image 205 are congruent with one another from the region 200, so that additional information of the image 205 falls on predetermined areas of the field of vision of the driver.
• the image 205 is not completely reproduced to the driver but only includes additional information that is superimposed on directly visible objects.
• an object 210 In each representation of FIGS. 2 to 4, an object 210, an area 215 of the respective object 210, and a graphical representation of information 220 are shown.
• the processing device 110 performs an object recognition on the image 205 in each case.
• one or more surfaces 215 may be determined, on the basis of which a contiguous display area 220 is determined.
• several areas 215 of one or more objects 210 can be combined.
• the object 210 comprises a guardrail.
• the display area 220 corresponds to the visible surface of the guardrail, and the information 225 shown on the display area 220 relates, for example, to a due travel booking that the driver of the motor vehicle 105 has to do.
• the object 210 is a truck and the surface 215 is the rear boundary surface thereof.
• the illustrated personalized information 225 relates, for example, to a due ticket order of the driver of the motor vehicle 105, which are superimposed on the boundary surface.
• the object 210 is an area of the road ahead of the motor vehicle 105 and the surface of the road forms the display area 220.
• the illustrated personalized information 225 relates, for example, to general product information presented to the driver.
• FIG. 5 shows a flow chart of a method 500 for driver information of the driver of the motor vehicle 105 from FIG. 1.
• the method 500 is set up in particular for execution on the processing device 110 of the system 100 from FIG.
• the method 500 includes steps 505 to 550, wherein in the simplest possible embodiment, only those steps are shown, which are shown thick outlined. The remaining steps are optional and may be omitted in other embodiments.
• steps 505 and 510 an image 205 is made whenever possible simultaneously by means of the cameras 1 15 and 120. If only one camera 115 is used, then steps 505 and 510 coincide.
• an object recognition is performed to detect objects 210 displayed on the image 205. If the image 200 was recorded by means of the two cameras 115, 120 or by means of a stereo camera, then a determination of depth information in the image 200 can be performed beforehand and the object recognition in step 515 can additionally be based on the depth information.
• a contiguous display area in the image 205 is determined.
• individual surfaces of the objects determined in step 515 can be used.
• a surface 215 of an object 210 or multiple surfaces 215 of one or more objects 210 may together form the display surface 220.
• personalized information directed to the driver of the motor vehicle 105 is obtained.
• this personalized information is received by the receiving device 130 of FIG.
• a driving condition of the motor vehicle 105 may be determined.
• a step 535 personalized information to be displayed is selected on the basis of the information obtained in step 525.
• the selection may be made based on the driving condition of the motor vehicle 105 determined in step 530.
• step 540 the information selected for display on the display area 220 selected in step 535 may be enlarged, reduced, rotated, or distorted in perspective.
• step 545 the information is inserted into the image 205 and subsequently output to the driver of the motor vehicle 105 in a step 550. Examples of possible expenses can be found in FIGS. 2 to 4.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Computer Graphics (AREA)
• Transportation (AREA)
• Chemical & Material Sciences (AREA)
• Combustion & Propulsion (AREA)
• Mechanical Engineering (AREA)
• Geometry (AREA)
• Computer Hardware Design (AREA)
• General Engineering & Computer Science (AREA)
• Software Systems (AREA)
• Optics & Photonics (AREA)
• Computing Systems (AREA)
• Traffic Control Systems (AREA)
• Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
• Instrument Panels (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=47191714

Family Applications (1)

Country Status (6)

Families Citing this family (7)

Family Cites Families (31)

• 2012
  • 2012-01-05 DE DE102012200133A patent/DE102012200133A1/de active Pending
  • 2012-11-06 CN CN201280066102.2A patent/CN104039580B/zh active Active
  • 2012-11-06 EP EP12787679.5A patent/EP2800671A1/de not_active Withdrawn
  • 2012-11-06 JP JP2014550658A patent/JP6104279B2/ja active Active
  • 2012-11-06 US US14/370,650 patent/US20150296199A1/en not_active Abandoned
  • 2012-11-06 WO PCT/EP2012/071925 patent/WO2013102508A1/de active Application Filing

Non-Patent Citations (2)

Also Published As

Similar Documents

Legal Events