CN112677740A - 处理挡风玻璃使其隐形的装置和方法 - Google Patents
处理挡风玻璃使其隐形的装置和方法 Download PDFInfo
- Publication number
- CN112677740A CN112677740A CN202011109840.3A CN202011109840A CN112677740A CN 112677740 A CN112677740 A CN 112677740A CN 202011109840 A CN202011109840 A CN 202011109840A CN 112677740 A CN112677740 A CN 112677740A
- Authority
- CN
- China
- Prior art keywords
- area
- invisible
- windshield
- invisible area
- road information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000013507 mapping Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000009795 derivation Methods 0.000 claims 1
- 238000000605 extraction Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 230000005611 electricity Effects 0.000 description 4
- 241001465754 Metazoa Species 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000010813 municipal solid waste Substances 0.000 description 3
- 239000004983 Polymer Dispersed Liquid Crystal Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 210000003608 fece Anatomy 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000006996 mental state Effects 0.000 description 2
- 230000002996 emotional effect Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/40—Instruments specially adapted for improving the visibility thereof to the user, e.g. fogging prevention or anti-reflection arrangements
- B60K35/415—Glare prevention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/37—Details of the operation on graphic patterns
- G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/176—Camera images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/77—Instrument locations other than the dashboard
- B60K2360/785—Instrument locations other than the dashboard on or in relation to the windshield or windows
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on an electrochromic effect
- G02F1/163—Operation of electrochromic cells, e.g. electrodeposition cells; Circuit arrangements therefor
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/10—Automotive applications
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Optics & Photonics (AREA)
- Mechanical Engineering (AREA)
- Chemical & Material Sciences (AREA)
- Transportation (AREA)
- Combustion & Propulsion (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Ophthalmology & Optometry (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Instrument Panels (AREA)
- Traffic Control Systems (AREA)
Abstract
本发明提供处理挡风玻璃使其隐形的装置和方法,通过处理挡风玻璃中与预设为在车辆行驶时期望乘客不可见的路面场景的位置相匹配的区域来保护乘客。为此,将与预设的期望乘客不可见的实际路面场景相匹配的挡风玻璃区域处理为保护乘客的隐形区域,从而防止乘客视觉识别该场景。然而,当由于在挡风玻璃上处理或显示的隐形区域而导致车辆行驶所需的道路信息被遮挡时,安全驾驶受到严重干扰,从而使实际的道路信息覆盖在隐形区域上。
Description
相关申请的交叉引用
本申请要求享有于2019年10月17日提交的申请号为10-2019-0129480的韩国专利申请的优先权和权益,其全部内容通过引用合并于此。
技术领域
本发明涉及一种用于在挡风玻璃上显示信息的技术,并且更具体地,涉及一种挡风玻璃的隐形处理,从而为驾驶员和乘客提供视觉关怀,驾驶安全和舒适的行程。
背景技术
存在用于在车辆的前窗(挡风玻璃)上显示图像的技术。例如,存在一种技术,其具有使用图像投影仪向挡风玻璃发射预定图像以在车辆的挡风玻璃上显示图像的概念,以及具有用于调节从图像投影仪发射的图像的光透射率和反射率的膜(例如,聚合分散液晶(PDLC))。
此外,存在使用电致变色膜的显示技术。该显示技术是利用电致变色膜的性质的相对较新的显示技术,该电致变色膜的性质根据是否施加功率而变得不透明或透明。
同时,在驾驶过程中,有时会目睹许多场景,例如路毙的动物、人身事故、乱扔的垃圾、粪便等。这些场景使驾驶员和随行乘客感到厌恶、恐惧或不满,并且最重要的是,这些场景会对需要以舒适稳定的精神状态驾驶的驾驶员和想要享受舒适旅程的乘客造成负面影响。因此,这些场景妨碍了安全驾驶,并使驾驶员和乘客经历不舒服和不愉快的行程。
发明内容
本发明旨在提供一种用于保护驾驶员和乘客(以下称为“乘客”)的技术,该技术通过防止乘客看到挡风玻璃内的区域来保护乘客,该区域与路面上的场景的位置相匹配,该场景为期望在车辆行驶时不被乘客看到的区域。
为了解决这些问题,挡风玻璃内的与预先定义为乘客不希望看到的实际道路场景相匹配的区域(例如,路毙的动物、人身事故、废物(诸如垃圾)、粪便等)被处理为用于保护乘客的隐形区域,从而防止乘客从视觉上识别出该场景(例如,模糊处理、透明度/密度调整、马赛克处理、块处理等)。然而,当由于在挡风玻璃中处理或显示隐形区域而遮挡道路信息(例如,交通标志、信号灯、车道边线、中心线、印刷在路面上的标志等)时,严重妨碍了安全驾驶,因此实际的道路信息覆盖在隐形区域上。
为了实施以上描述,将诸如透明液晶显示器(LCD)或有机发光二极管(OLED)的显示器应用于挡风玻璃,使得可以在挡风玻璃的部分区域中直接显示存在于隐形区域中的隐形区域和道路信息。可替代地,将电致变色膜施加到挡风玻璃上,使得可以选择性地将隐形区域处理为隐形,并且可以使用投影仪等将道路信息图像输出(投影)在经过处理的隐形区域上。
可以用照相机获取实际道路上所呈现的道路信息图像,并发送到应用于挡风玻璃的透明LCD或OLED,以覆盖并显示在隐形区域上或使用投影仪等投影到电致变色膜上。
可选地,由于隐形区域随着车辆行驶而移动,因此优选地根据车辆的行驶方向对隐形区域进行处理以移动其在挡风玻璃中的位置。
可选地,考虑到驾驶员和随行乘客的视线位置之间的差异,期望识别驾驶员的视线和随行乘客的视线,并且相对于驾驶员的视线和随行乘客的视线处理或显示要在挡风玻璃内移动的隐形区域的位置。在这种情况下,可以通过使用车辆中的照相机识别眼动跟踪和坐姿(面部和眼睛位置)来执行视线识别。在此,随行乘客是指坐在乘客座位上的乘客(或坐在后座上的乘客)。
根据下面参考附图详细描述的实施例,本发明的上述配置和操作将变得更加显而易见。
附图说明
通过参考附图详细描述本发明的示例性实施例,本发明的上述和其他目的、特征和优点对于本领域普通技术人员将变得更加显而易见,其中:
图1示出了本发明的基本实施例的框图;
图2和图3示出了挡风玻璃上显示的隐形区域;
图4和图5示出了在隐形区域中覆盖和显示的道路信息;
图6示出了图1中的基本实施例的改进示例的框图;
图7和图8示出了隐形区域的移动显示;
图9示出了改进实施例的框图;
图10和图11示出了在不同视线位置处显示驾驶员的隐形区域和随行乘客的隐形区域;以及
图12示出了另一改进实施例的框图。
具体实施方式
从下面参考附图详细描述的实施例中,本发明的优点和特征以及实现方法将变得清楚。然而,本发明可以以许多不同的形式来实施,并且不应解释为限于在此阐述的实施例。而是,提供这些实施例以使得本公开是透彻和完整的,并且将本发明的范围充分传达给本发明所属技术领域的普通技术人员。本发明由权利要求书限定。同时,这里使用的术语目的是为了描述实施例,而不是意图限制本发明。如本文所用,单数形式也包括复数形式,除非上下文另外明确指出。本文所使用的术语“包括”或“包含”不排除存在或增加除所述元件、步骤、操作和/或装置之外的一个或多个其他元件、步骤、操作和/或装置。
在下文中,将参考附图详细描述本发明的示例性实施例。给每个附图的元素添加附图标记,即使在不同附图中示出了相同的元素,相同的元素也可以尽可能使用相同的附图标记。此外,在描述本发明时,当相关的已知配置或功能模糊了本发明的要旨时,将省略其详细描述。
图1示出了本发明的基本实施例的框图。
首先,获取路面信息(10)。可以使用车辆的外部摄像机来获取路面信息(10)作为图像信息。除此之外,还可以使用车辆对一切(vehicle-to-everything,V2X)方法以位置信息(诸如全球定位系统(global positioning system,GPS))或坐标信息的形式接收路面信息。
从路面信息中提取隐形处理对象(20),即,被定义为乘客不可见的场景。可以通过将预设的隐形处理对象图像的特征转换成数据库来执行从路面信息中提取隐形处理对象的操作。此外,可以使用诸如深度学习之类的机器学习。
计算所提取的隐形处理对象应在挡风玻璃中显示的隐形区域,并通过映射至挡风玻璃的显示区域来导出隐形区域显示位置(30)。
接下来,在映射到挡风玻璃中的隐形区域显示位置的区域中显示隐形区域(40)。可以以两种方式来实现在挡风玻璃中映射的隐形区域显示位置处的隐形区域的显示。
第一种方式是将诸如透明液晶显示器(Liquid Crystal Display,LCD)或有机发光二极管(Organic Light-Emitting Diode,OLED)之类的显示器应用于挡风玻璃,并在LCD或OLED上直接显示映射的隐形区域的方法。例如,模糊、镶嵌或块处理的图像直接显示在透明LCD或OLED上。参照图2,当通过应用于挡风玻璃100的透明LCD或OLED 110可以看见车辆前方的场景时,显示经过模糊处理的隐形区域120。
第二种方式将电致变色膜附着到挡风玻璃,将电致变色膜的电施加部分分割成多个子部分,并且调节每个子部分的色调强度,从而显示隐形区域。参照图3,可以看出,在施加到挡风玻璃100的电致变色膜130中存在分段的电施加子部分132,并且将电施加到位于分段的电施加子部分132之间的映射位置处的隐形区域140,使得隐形区域140通过电致变色作用的强度调节来显示。
再次参照图1,从路面信息提取道路信息(50)(例如,诸如交通标志,信号,车道边界,中心线和印刷在道路上的标志的基本或辅助驾驶信息),该道路信息存在于与隐形处理对象相对应的区域中。当所获取的路面信息是图像时,可以使用诸如字母识别,字符识别,深度学习等技术来提取道路信息。当路面信息是通过V2X获得的位置信息时,可以将与隐形处理对象相对应的位置的属性信息包括在位置信息中,从而可以使用该属性信息。
最后,所提取的道路信息被覆盖并显示在挡风玻璃上显示的隐形区域中(60)。如在图2的情况下,参照图4,应用于挡风玻璃100的透明LCD或OLED显示器110可以与隐形区域120的显示一起显示道路信息150(在该示例中,为中心线)。同时,在将电致变色膜130应用于图1中的挡风玻璃100的情况下,如图5所示,由于分别安装在车辆中的投影仪(未示出)或等效装置的电致变色作用,道路信息的图像160(即,中心线)可以通过强度调节投影和显示在隐形处理区域140中。
图6示出了图1的基本实施例的改进示例的框图。
当车辆向前行驶时,由于隐形区域靠近车辆,需要再次执行映射,以便根据车辆的行驶方向在挡风玻璃内将隐形区域移动到适当位置,以处理隐形区域使其对驾驶员持续不可见。为此,在计算和对隐形区域进行位置映射(30)之后,添加组件70,该组件重新计算提取的隐形处理对象区域并重新映射到挡风玻璃内的区域以改变映射位置。
当获取的路面信息10是从外部摄像机获取的图像信息时,为了连续地跟踪隐形处理对象的运动,映射位置改变组件70可以连续地从相应图像的多个改变的信息中提取隐形处理对象,并针对每个提取的对象执行区域重新计算和位置重新映射。当获取的路面信息10是通过V2X获取的位置数据时,映射位置改变部件70可以根据车辆从位置数据中所包括的隐形处理对象的固定位置的运动来计算相对位置变化。
图7示出了当将透明LCD或OLED显示器110应用于挡风玻璃100时,随着隐形区域120靠近车辆的前部,隐形区域120'移动到挡风玻璃100的底部并且面积增大。
图8示出了当将电致变色膜130应用于挡风玻璃100时,随着处理的隐形区域140靠近车辆的前部,处理的隐形区域140′被移动到挡风玻璃100的底部并且面积增大。
图9是图1和图6的实施例的改进实施例的框图,并且改进的实施例可以被添加到图1或图6。
在以上实施例中,在作为驾驶员的前提下描述了乘客。然而,考虑到驾驶员和随行乘客的视线位置不同,提出了本实施例,以便通过识别驾驶员的视线和随行乘客的视线来考虑驾驶员和随行乘客的视线位置不同,并且处理或显示要在挡风玻璃内移动的隐形区域的位置。
在该实施例中,乘客视线识别组件80包括,通过追踪驾驶员的眼睛并使用照相机或传感器(未示出)确定坐姿(面部和眼睛的位置)来识别驾驶员的视线的功能,和通过追踪随行乘客的眼睛并确定坐姿来识别随行乘客的视线的功能。在此,随行乘客是指坐在乘客座位上的乘客(或坐在后座上的乘客)。
图10示出了当将透明LCD或OLED显示器110应用于挡风玻璃100时所显示的隐形区域,根据驾驶员200和随行乘客300的视线识别结果,在不同的视线位置形成隐形区域,作为驾驶员200的隐形区域120和随行乘客300的隐形区域125。
图11示出了当将电致变色膜130应用于挡风玻璃100时,根据驾驶员200和随行乘客300视线识别结果,在不同的视线位置形成隐形区域,作为驾驶员200的隐形区域140和随行乘客300的隐形区域145。
图12示出了另一改进实施例,并且该另一改进实施例可以被添加到图1、图6或图9。
另一改进实施例,其中,除了显示针对隐形区域120和140以及道路信息150和160的信号之外,还将信号发送至车辆安装的音频、视频、导航(Audio,Video,Navigation,AVN)或平视显示器(head-up display,HUD),然后在其上显示。特别地,该实施例可以是能够响应于车辆信息娱乐或自动驾驶的实施例。
根据本发明,可以减少在驾驶过程中由于诸如动物路毙、人身事故、垃圾和粪便之类的场景而引起的驾驶员和随行乘客的厌恶、不适或恐惧感,从而使得驾驶员以舒适和稳定的精神状态驾驶,并且使得随行乘客享受舒适的旅程,从而本发明可以有助于车辆的安全驾驶并提高情绪品质。
尽管已经参照示例性实施例详细描述了本发明,但是本领域技术人员可以理解,可以以不同于本文描述的内容,且不脱离技术精神或必要特征的其他特定形式来实现本发明。应当理解,上述实施例在所有方面均不是限制性的而是示例性的。本发明的范围由所附权利要求书而不是说明书来限定,并且应该解释为,从所附权利要求书及其等效物的含义和范围得到的所有替换或修改都落入本发明的技术范围内。
Claims (16)
1.一种处理挡风玻璃使其隐形的装置,其特征在于,包括:
隐形区域显示部分,其用于在挡风玻璃内的区域中显示隐形区域,所述隐形区域与预设的乘客不可见的路面场景相匹配;以及
道路信息显示部分,其用于覆盖并显示存在于所述隐形区域中呈现的道路信息,所述道路信息由所述隐形区域显示部分显示在挡风玻璃上的所述隐形区域中。
2.根据权利要求1所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的透明显示装置上显示所述隐形区域和所述道路信息。
3.根据权利要求1所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的电致变色膜上显示所述隐形区域和所述道路信息。
4.根据权利要求1所述的装置,其特征在于,还包括第一隐形区域移动部分,其用于根据车辆的移动来移动所述隐形区域在所述挡风玻璃中的显示位置。
5.根据权利要求1所述的装置,其特征在于,还包括第二隐形区域移动部分,其用于识别驾驶员的视线和随行乘客的视线,并且相对于驾驶员的视线和随行乘客的视线中的每一者移动所述隐形区域在所述挡风玻璃中的显示位置。
6.一种处理挡风玻璃使其隐形的装置,其特征在于,包括:
路面信息获取部分,用于获取路面信息;
隐形处理目标提取部分,用于从获取的所述路面信息中提取预设的乘客不可见的路面场景;
隐形区域计算部分和位置映射部分,用于计算所述挡风玻璃中的由提取的所述隐形处理对象所占据的隐形区域,并对所述隐形区域进行映射,以获得所述隐形区域在所述挡风玻璃中的显示位置;
隐形区域显示部分,用于在映射到所述挡风玻璃中的位置的区域中显示所述隐形区域;
道路信息提取部分,用于从获取的所述路面信息中提取道路信息,所述道路信息存在于与所述隐形处理对象相对应的区域中;以及
道路信息显示部分,用于将提取出的所述道路信息覆盖和显示在所述挡风玻璃中的所述隐形区域中。
7.根据权利要求6所述的装置,其特征在于,还包括:隐形区域变更部分,用于重新计算所述隐形区域的显示位置,所述隐形区域由所述隐形区域计算和位置映射部分相对于隐形处理对象区域所映射,所述隐形处理对象区域由所述隐形处理对象提取部分提取;将所述隐形区域的所述显示位置重新映射到所述挡风玻璃中的所述区域,从而变更所述隐形区域的所述显示位置。
8.根据权利要求6所述的装置,其特征在于,还包括驾驶员和乘客隐形区域导出部分,其包括识别驾驶员的视线和乘客的视线的功能,并且用于根据所述驾驶员的视线和所述乘客的视线的识别结果将所述隐形区域分别导出为所述驾驶员的隐形区域和所述乘客的隐形区域,所述乘客的隐形区域不同于所述驾驶员的隐形区域。
9.根据权利要求6所述的装置,其特征在于,所述路面信息获取部分使用车辆的外部相机获取所述路面信息。
10.根据权利要求6所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的透明显示装置上显示所述隐形区域和所述道路信息。
11.根据权利要求6所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的电致变色膜上显示所述隐形区域和所述道路信息。
12.一种处理挡风玻璃使其隐形的方法,其特征在于,包括:
在挡风玻璃内的区域中显示隐形区域,所述隐形区域与预设的乘客不可见的路面场景相匹配;以及
在所述隐形区域的显示中,在所述挡风玻璃上显示的所述隐形区域中叠加并显示存在于所述隐形区域的所述道路信息。
13.根据权利要求12所述的方法,其特征在于,在所述隐形区域的显示和所述道路信息的显示中,所述隐形区域和所述道路信息显示在所述挡风玻璃包括的透明显示装置上。
14.根据权利要求12所述的方法,其特征在于,在所述隐形区域的显示和所述道路信息的显示中,所述隐形区域和所述道路信息显示在所述挡风玻璃包括的电致变色膜上。
15.根据权利要求12所述的方法,其特征在于,还包括根据车辆的驾驶来移动所述隐形区域在所述挡风玻璃中的显示位置。
16.根据权利要求12所述的方法,其特征在于,还包括识别驾驶员的视线和随行乘客的视线,并且相对于驾驶员的视线和随行乘客的视线中的每一者,移动所述隐形区域在所述挡风玻璃中的显示位置。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020190129480A KR20210045896A (ko) | 2019-10-17 | 2019-10-17 | 윈드실드 불가시 처리장치 및 방법 |
KR10-2019-0129480 | 2019-10-17 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112677740A true CN112677740A (zh) | 2021-04-20 |
CN112677740B CN112677740B (zh) | 2024-06-25 |
Family
ID=75268721
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011109840.3A Active CN112677740B (zh) | 2019-10-17 | 2020-10-16 | 处理挡风玻璃使其隐形的装置和方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US11393433B2 (zh) |
KR (1) | KR20210045896A (zh) |
CN (1) | CN112677740B (zh) |
DE (1) | DE102020127023A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024065799A1 (en) * | 2022-09-30 | 2024-04-04 | Intel Corporation | Vehicle passenger display modification |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20230121260A1 (en) * | 2021-10-15 | 2023-04-20 | Hyundai Mobis Co., Ltd. | System for controlling vehicle display based on occupant's gaze |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130207771A1 (en) * | 2011-06-23 | 2013-08-15 | Rain Bird Corporation | Methods and systems for irrigation and climate control |
US20130307771A1 (en) * | 2012-05-18 | 2013-11-21 | Microsoft Corporation | Interaction and management of devices using gaze detection |
CN106526849A (zh) * | 2015-09-15 | 2017-03-22 | 福特全球技术公司 | 挡风玻璃显示系统 |
US20170269370A1 (en) * | 2016-03-18 | 2017-09-21 | Fuji Jukogyo Kabushiki Kaisha | Display control device for vehicle |
CN107199947A (zh) * | 2016-03-18 | 2017-09-26 | 株式会社斯巴鲁 | 车辆用显示控制装置 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101520660B1 (ko) | 2008-05-07 | 2015-05-15 | 엘지전자 주식회사 | 차량용 영상장치 |
US10565961B1 (en) * | 2018-07-25 | 2020-02-18 | Honeywell International Inc. | Dynamic contrast equalization for see through displays in varying light conditions |
KR102559573B1 (ko) | 2018-11-21 | 2023-07-25 | 현대모비스 주식회사 | 차량용 디스플레이 장치 |
-
2019
- 2019-10-17 KR KR1020190129480A patent/KR20210045896A/ko not_active Application Discontinuation
-
2020
- 2020-10-14 DE DE102020127023.2A patent/DE102020127023A1/de active Pending
- 2020-10-16 US US17/072,405 patent/US11393433B2/en active Active
- 2020-10-16 CN CN202011109840.3A patent/CN112677740B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130207771A1 (en) * | 2011-06-23 | 2013-08-15 | Rain Bird Corporation | Methods and systems for irrigation and climate control |
US20130307771A1 (en) * | 2012-05-18 | 2013-11-21 | Microsoft Corporation | Interaction and management of devices using gaze detection |
CN106526849A (zh) * | 2015-09-15 | 2017-03-22 | 福特全球技术公司 | 挡风玻璃显示系统 |
US20170269370A1 (en) * | 2016-03-18 | 2017-09-21 | Fuji Jukogyo Kabushiki Kaisha | Display control device for vehicle |
CN107199947A (zh) * | 2016-03-18 | 2017-09-26 | 株式会社斯巴鲁 | 车辆用显示控制装置 |
CN107199948A (zh) * | 2016-03-18 | 2017-09-26 | 株式会社斯巴鲁 | 车辆用显示控制装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024065799A1 (en) * | 2022-09-30 | 2024-04-04 | Intel Corporation | Vehicle passenger display modification |
Also Published As
Publication number | Publication date |
---|---|
DE102020127023A1 (de) | 2021-04-22 |
US11393433B2 (en) | 2022-07-19 |
US20210118411A1 (en) | 2021-04-22 |
KR20210045896A (ko) | 2021-04-27 |
CN112677740B (zh) | 2024-06-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6694112B2 (ja) | Ar表示装置及びar表示方法 | |
JP7332726B2 (ja) | ヒートマップを使用したドライバーの注目の検出 | |
CN109427199B (zh) | 用于辅助驾驶的增强现实的方法及装置 | |
CN107199948B (zh) | 车辆用显示控制装置 | |
DE102013110332B4 (de) | Visuelles leitsystem | |
US20120235805A1 (en) | Information display apparatus and information display method | |
US9267808B2 (en) | Visual guidance system | |
US20160185219A1 (en) | Vehicle-mounted display control device | |
US20050071082A1 (en) | Route guidance apparatus, method and program | |
JP2019095213A (ja) | 重畳画像表示装置及びコンピュータプログラム | |
US10274727B2 (en) | Device controlling range of vision | |
JP2008001182A (ja) | 車両用視覚情報呈示装置及び車両用視覚情報呈示方法 | |
KR20170048781A (ko) | 차량용 증강현실 제공 장치 및 그 제어방법 | |
JP6838626B2 (ja) | 表示制御装置、及び表示制御プログラム | |
US20190141310A1 (en) | Real-time, three-dimensional vehicle display | |
CN112677740B (zh) | 处理挡风玻璃使其隐形的装置和方法 | |
EP3456574B1 (en) | Method and system for displaying virtual reality information in a vehicle | |
JP2023109754A (ja) | Ar表示装置、ar表示方法、およびプログラム | |
CN113165510B (zh) | 显示控制装置、方法和计算机程序 | |
US20210268961A1 (en) | Display method, display device, and display system | |
JP2024103486A (ja) | 車両用表示制御装置及び車両用表示装置 | |
US20240101138A1 (en) | Display system | |
EP3666578B1 (en) | Vehicle display device | |
US20210241723A1 (en) | Augmented reality system | |
EP3457363A1 (en) | Method and system for displaying priority information in a vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |