CN112677740B - 处理挡风玻璃使其隐形的装置和方法 - Google Patents

处理挡风玻璃使其隐形的装置和方法 Download PDF

Info

Publication number
CN112677740B
CN112677740B CN202011109840.3A CN202011109840A CN112677740B CN 112677740 B CN112677740 B CN 112677740B CN 202011109840 A CN202011109840 A CN 202011109840A CN 112677740 B CN112677740 B CN 112677740B
Authority
CN
China
Prior art keywords
area
windshield
invisible
stealth
sight
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011109840.3A
Other languages
English (en)
Other versions
CN112677740A (zh
Inventor
安成晙
金泰勋
李昇桓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Mobis Co Ltd
Original Assignee
Hyundai Mobis Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Mobis Co Ltd filed Critical Hyundai Mobis Co Ltd
Publication of CN112677740A publication Critical patent/CN112677740A/zh
Application granted granted Critical
Publication of CN112677740B publication Critical patent/CN112677740B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/40Instruments specially adapted for improving the visibility thereof to the user, e.g. fogging prevention or anti-reflection arrangements
    • B60K35/415Glare prevention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60Instruments characterised by their location or relative disposition in or on vehicles
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37Details of the operation on graphic patterns
    • G09G5/377Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • H04N13/383Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/149Instrument input by detecting viewing direction not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/176Camera images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77Instrument locations other than the dashboard
    • B60K2360/785Instrument locations other than the dashboard on or in relation to the windshield or windows
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22Display screens
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0141Head-up displays characterised by optical features characterised by the informative content of the display
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • GPHYSICS
    • G02OPTICS
    • G02FOPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
    • G02F1/00Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
    • G02F1/01Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour 
    • G02F1/15Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour  based on an electrochromic effect
    • G02F1/163Operation of electrochromic cells, e.g. electrodeposition cells; Circuit arrangements therefor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/12Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00Specific applications
    • G09G2380/10Automotive applications

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Transportation (AREA)
  • Combustion & Propulsion (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Instrument Panels (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明提供处理挡风玻璃使其隐形的装置和方法,通过处理挡风玻璃中与预设为在车辆行驶时期望乘客不可见的路面场景的位置相匹配的区域来保护乘客。为此,将与预设的期望乘客不可见的实际路面场景相匹配的挡风玻璃区域处理为保护乘客的隐形区域,从而防止乘客视觉识别该场景。然而,当由于在挡风玻璃上处理或显示的隐形区域而导致车辆行驶所需的道路信息被遮挡时,安全驾驶受到严重干扰,从而使实际的道路信息覆盖在隐形区域上。

Description

处理挡风玻璃使其隐形的装置和方法
相关申请的交叉引用
本申请要求享有于2019年10月17日提交的申请号为10-2019-0129480的韩国专利申请的优先权和权益,其全部内容通过引用合并于此。
技术领域
本发明涉及一种用于在挡风玻璃上显示信息的技术,并且更具体地,涉及一种挡风玻璃的隐形处理,从而为驾驶员和乘客提供视觉关怀,驾驶安全和舒适的行程。
背景技术
存在用于在车辆的前窗(挡风玻璃)上显示图像的技术。例如,存在一种技术,其具有使用图像投影仪向挡风玻璃发射预定图像以在车辆的挡风玻璃上显示图像的概念,以及具有用于调节从图像投影仪发射的图像的光透射率和反射率的膜(例如,聚合分散液晶(PDLC))。
此外,存在使用电致变色膜的显示技术。该显示技术是利用电致变色膜的性质的相对较新的显示技术,该电致变色膜的性质根据是否施加功率而变得不透明或透明。
同时,在驾驶过程中,有时会目睹许多场景,例如路毙的动物、人身事故、乱扔的垃圾、粪便等。这些场景使驾驶员和随行乘客感到厌恶、恐惧或不满,并且最重要的是,这些场景会对需要以舒适稳定的精神状态驾驶的驾驶员和想要享受舒适旅程的乘客造成负面影响。因此,这些场景妨碍了安全驾驶,并使驾驶员和乘客经历不舒服和不愉快的行程。
发明内容
本发明旨在提供一种用于保护驾驶员和乘客(以下称为“乘客”)的技术,该技术通过防止乘客看到挡风玻璃内的区域来保护乘客,该区域与路面上的场景的位置相匹配,该场景为期望在车辆行驶时不被乘客看到的区域。
为了解决这些问题,挡风玻璃内的与预先定义为乘客不希望看到的实际道路场景相匹配的区域(例如,路毙的动物、人身事故、废物(诸如垃圾)、粪便等)被处理为用于保护乘客的隐形区域,从而防止乘客从视觉上识别出该场景(例如,模糊处理、透明度/密度调整、马赛克处理、块处理等)。然而,当由于在挡风玻璃中处理或显示隐形区域而遮挡道路信息(例如,交通标志、信号灯、车道边线、中心线、印刷在路面上的标志等)时,严重妨碍了安全驾驶,因此实际的道路信息覆盖在隐形区域上。
为了实施以上描述,将诸如透明液晶显示器(LCD)或有机发光二极管(OLED)的显示器应用于挡风玻璃,使得可以在挡风玻璃的部分区域中直接显示存在于隐形区域中的隐形区域和道路信息。可替代地,将电致变色膜施加到挡风玻璃上,使得可以选择性地将隐形区域处理为隐形,并且可以使用投影仪等将道路信息图像输出(投影)在经过处理的隐形区域上。
可以用照相机获取实际道路上所呈现的道路信息图像,并发送到应用于挡风玻璃的透明LCD或OLED,以覆盖并显示在隐形区域上或使用投影仪等投影到电致变色膜上。
可选地,由于隐形区域随着车辆行驶而移动,因此优选地根据车辆的行驶方向对隐形区域进行处理以移动其在挡风玻璃中的位置。
可选地,考虑到驾驶员和随行乘客的视线位置之间的差异,期望识别驾驶员的视线和随行乘客的视线,并且相对于驾驶员的视线和随行乘客的视线处理或显示要在挡风玻璃内移动的隐形区域的位置。在这种情况下,可以通过使用车辆中的照相机识别眼动跟踪和坐姿(面部和眼睛位置)来执行视线识别。在此,随行乘客是指坐在乘客座位上的乘客(或坐在后座上的乘客)。
根据下面参考附图详细描述的实施例,本发明的上述配置和操作将变得更加显而易见。
附图说明
通过参考附图详细描述本发明的示例性实施例,本发明的上述和其他目的、特征和优点对于本领域普通技术人员将变得更加显而易见,其中:
图1示出了本发明的基本实施例的框图;
图2和图3示出了挡风玻璃上显示的隐形区域;
图4和图5示出了在隐形区域中覆盖和显示的道路信息;
图6示出了图1中的基本实施例的改进示例的框图;
图7和图8示出了隐形区域的移动显示;
图9示出了改进实施例的框图;
图10和图11示出了在不同视线位置处显示驾驶员的隐形区域和随行乘客的隐形区域;以及
图12示出了另一改进实施例的框图。
具体实施方式
从下面参考附图详细描述的实施例中,本发明的优点和特征以及实现方法将变得清楚。然而,本发明可以以许多不同的形式来实施,并且不应解释为限于在此阐述的实施例。而是,提供这些实施例以使得本公开是透彻和完整的,并且将本发明的范围充分传达给本发明所属技术领域的普通技术人员。本发明由权利要求书限定。同时,这里使用的术语目的是为了描述实施例,而不是意图限制本发明。如本文所用,单数形式也包括复数形式,除非上下文另外明确指出。本文所使用的术语“包括”或“包含”不排除存在或增加除所述元件、步骤、操作和/或装置之外的一个或多个其他元件、步骤、操作和/或装置。
在下文中,将参考附图详细描述本发明的示例性实施例。给每个附图的元素添加附图标记,即使在不同附图中示出了相同的元素,相同的元素也可以尽可能使用相同的附图标记。此外,在描述本发明时,当相关的已知配置或功能模糊了本发明的要旨时,将省略其详细描述。
图1示出了本发明的基本实施例的框图。
首先,获取路面信息(10)。可以使用车辆的外部摄像机来获取路面信息(10)作为图像信息。除此之外,还可以使用车辆对一切(vehicle-to-everything,V2X)方法以位置信息(诸如全球定位系统(global positioning system,GPS))或坐标信息的形式接收路面信息。
从路面信息中提取隐形处理对象(20),即,被定义为乘客不可见的场景。可以通过将预设的隐形处理对象图像的特征转换成数据库来执行从路面信息中提取隐形处理对象的操作。此外,可以使用诸如深度学习之类的机器学习。
计算所提取的隐形处理对象应在挡风玻璃中显示的隐形区域,并通过映射至挡风玻璃的显示区域来导出隐形区域显示位置(30)。
接下来,在映射到挡风玻璃中的隐形区域显示位置的区域中显示隐形区域(40)。可以以两种方式来实现在挡风玻璃中映射的隐形区域显示位置处的隐形区域的显示。
第一种方式是将诸如透明液晶显示器(Liquid Crystal Display,LCD)或有机发光二极管(Organic Light-Emitting Diode,OLED)之类的显示器应用于挡风玻璃,并在LCD或OLED上直接显示映射的隐形区域的方法。例如,模糊、镶嵌或块处理的图像直接显示在透明LCD或OLED上。参照图2,当通过应用于挡风玻璃100的透明LCD或OLED 110可以看见车辆前方的场景时,显示经过模糊处理的隐形区域120。
第二种方式将电致变色膜附着到挡风玻璃,将电致变色膜的电施加部分分割成多个子部分,并且调节每个子部分的色调强度,从而显示隐形区域。参照图3,可以看出,在施加到挡风玻璃100的电致变色膜130中存在分段的电施加子部分132,并且将电施加到位于分段的电施加子部分132之间的映射位置处的隐形区域140,使得隐形区域140通过电致变色作用的强度调节来显示。
再次参照图1,从路面信息提取道路信息(50)(例如,诸如交通标志,信号,车道边界,中心线和印刷在道路上的标志的基本或辅助驾驶信息),该道路信息存在于与隐形处理对象相对应的区域中。当所获取的路面信息是图像时,可以使用诸如字母识别,字符识别,深度学习等技术来提取道路信息。当路面信息是通过V2X获得的位置信息时,可以将与隐形处理对象相对应的位置的属性信息包括在位置信息中,从而可以使用该属性信息。
最后,所提取的道路信息被覆盖并显示在挡风玻璃上显示的隐形区域中(60)。如在图2的情况下,参照图4,应用于挡风玻璃100的透明LCD或OLED显示器110可以与隐形区域120的显示一起显示道路信息150(在该示例中,为中心线)。同时,在将电致变色膜130应用于图1中的挡风玻璃100的情况下,如图5所示,由于分别安装在车辆中的投影仪(未示出)或等效装置的电致变色作用,道路信息的图像160(即,中心线)可以通过强度调节投影和显示在隐形处理区域140中。
图6示出了图1的基本实施例的改进示例的框图。
当车辆向前行驶时,由于隐形区域靠近车辆,需要再次执行映射,以便根据车辆的行驶方向在挡风玻璃内将隐形区域移动到适当位置,以处理隐形区域使其对驾驶员持续不可见。为此,在计算和对隐形区域进行位置映射(30)之后,添加组件70,该组件重新计算提取的隐形处理对象区域并重新映射到挡风玻璃内的区域以改变映射位置。
当获取的路面信息10是从外部摄像机获取的图像信息时,为了连续地跟踪隐形处理对象的运动,映射位置改变组件70可以连续地从相应图像的多个改变的信息中提取隐形处理对象,并针对每个提取的对象执行区域重新计算和位置重新映射。当获取的路面信息10是通过V2X获取的位置数据时,映射位置改变部件70可以根据车辆从位置数据中所包括的隐形处理对象的固定位置的运动来计算相对位置变化。
图7示出了当将透明LCD或OLED显示器110应用于挡风玻璃100时,随着隐形区域120靠近车辆的前部,隐形区域120'移动到挡风玻璃100的底部并且面积增大。
图8示出了当将电致变色膜130应用于挡风玻璃100时,随着处理的隐形区域140靠近车辆的前部,处理的隐形区域140′被移动到挡风玻璃100的底部并且面积增大。
图9是图1和图6的实施例的改进实施例的框图,并且改进的实施例可以被添加到图1或图6。
在以上实施例中,在作为驾驶员的前提下描述了乘客。然而,考虑到驾驶员和随行乘客的视线位置不同,提出了本实施例,以便通过识别驾驶员的视线和随行乘客的视线来考虑驾驶员和随行乘客的视线位置不同,并且处理或显示要在挡风玻璃内移动的隐形区域的位置。
在该实施例中,乘客视线识别组件80包括,通过追踪驾驶员的眼睛并使用照相机或传感器(未示出)确定坐姿(面部和眼睛的位置)来识别驾驶员的视线的功能,和通过追踪随行乘客的眼睛并确定坐姿来识别随行乘客的视线的功能。在此,随行乘客是指坐在乘客座位上的乘客(或坐在后座上的乘客)。
图10示出了当将透明LCD或OLED显示器110应用于挡风玻璃100时所显示的隐形区域,根据驾驶员200和随行乘客300的视线识别结果,在不同的视线位置形成隐形区域,作为驾驶员200的隐形区域120和随行乘客300的隐形区域125。
图11示出了当将电致变色膜130应用于挡风玻璃100时,根据驾驶员200和随行乘客300视线识别结果,在不同的视线位置形成隐形区域,作为驾驶员200的隐形区域140和随行乘客300的隐形区域145。
图12示出了另一改进实施例,并且该另一改进实施例可以被添加到图1、图6或图9。
另一改进实施例,其中,除了显示针对隐形区域120和140以及道路信息150和160的信号之外,还将信号发送至车辆安装的音频、视频、导航(Audio,Video,Navigation,AVN)或平视显示器(head-up display,HUD),然后在其上显示。特别地,该实施例可以是能够响应于车辆信息娱乐或自动驾驶的实施例。
根据本发明,可以减少在驾驶过程中由于诸如动物路毙、人身事故、垃圾和粪便之类的场景而引起的驾驶员和随行乘客的厌恶、不适或恐惧感,从而使得驾驶员以舒适和稳定的精神状态驾驶,并且使得随行乘客享受舒适的旅程,从而本发明可以有助于车辆的安全驾驶并提高情绪品质。
尽管已经参照示例性实施例详细描述了本发明,但是本领域技术人员可以理解,可以以不同于本文描述的内容,且不脱离技术精神或必要特征的其他特定形式来实现本发明。应当理解,上述实施例在所有方面均不是限制性的而是示例性的。本发明的范围由所附权利要求书而不是说明书来限定,并且应该解释为,从所附权利要求书及其等效物的含义和范围得到的所有替换或修改都落入本发明的技术范围内。

Claims (15)

1.一种处理挡风玻璃使其隐形的装置,其特征在于,包括:
隐形区域显示部分,其用于在挡风玻璃内的区域中显示隐形区域,所述隐形区域与预设的乘客不可见的路面场景相匹配;
道路信息显示部分,其用于覆盖并显示存在于所述隐形区域中呈现的道路信息,所述道路信息由所述隐形区域显示部分显示在挡风玻璃上的所述隐形区域中;以及
驾驶员和乘客隐形区域导出部分,其包括识别驾驶员的视线和乘客的视线的功能,并且用于根据所述驾驶员的视线和所述乘客的视线的识别结果将所述隐形区域分别导出为所述驾驶员的隐形区域和所述乘客的隐形区域,所述乘客的隐形区域不同于所述驾驶员的隐形区域。
2.根据权利要求1所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的透明显示装置上显示所述隐形区域和所述道路信息。
3.根据权利要求1所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的电致变色膜上显示所述隐形区域和所述道路信息。
4.根据权利要求1所述的装置,其特征在于,还包括第一隐形区域移动部分,其用于根据车辆的移动来移动所述隐形区域在所述挡风玻璃中的显示位置。
5.根据权利要求1所述的装置,其特征在于,还包括第二隐形区域移动部分,其用于识别驾驶员的视线和随行乘客的视线,并且相对于驾驶员的视线和随行乘客的视线中的每一者移动所述隐形区域在所述挡风玻璃中的显示位置。
6.一种处理挡风玻璃使其隐形的装置,其特征在于,包括:
路面信息获取部分,用于获取路面信息;
隐形处理目标提取部分,用于从获取的所述路面信息中提取预设的乘客不可见的路面场景;
隐形区域计算和位置映射部分,用于计算所述挡风玻璃中的由提取的隐形处理目标所占据的隐形区域,并对所述隐形区域进行映射,以获得所述隐形区域在所述挡风玻璃中的显示位置;
隐形区域显示部分,用于在映射到所述挡风玻璃中的位置的区域中显示所述隐形区域;
道路信息提取部分,用于从获取的所述路面信息中提取道路信息,所述道路信息存在于与所述隐形处理目标相对应的区域中;
道路信息显示部分,用于将提取出的所述道路信息覆盖和显示在所述挡风玻璃中的所述隐形区域中;以及
驾驶员和乘客隐形区域导出部分,其包括识别驾驶员的视线和乘客的视线的功能,并且用于根据所述驾驶员的视线和所述乘客的视线的识别结果将所述隐形区域分别导出为所述驾驶员的隐形区域和所述乘客的隐形区域,所述乘客的隐形区域不同于所述驾驶员的隐形区域。
7.根据权利要求6所述的装置,其特征在于,还包括:隐形区域变更部分,用于重新计算所述隐形区域的显示位置,所述隐形区域由所述隐形区域计算和位置映射部分相对于隐形处理目标区域所映射,所述隐形处理目标区域由所述隐形处理目标提取部分提取;将所述隐形区域的所述显示位置重新映射到所述挡风玻璃中的区域,从而变更所述隐形区域的所述显示位置。
8.根据权利要求6所述的装置,其特征在于,所述路面信息获取部分使用车辆的外部相机获取所述路面信息。
9.根据权利要求6所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的透明显示装置上显示所述隐形区域和所述道路信息。
10.根据权利要求6所述的装置,其特征在于,所述隐形区域显示部分和所述道路信息显示部分在所述挡风玻璃包括的电致变色膜上显示所述隐形区域和所述道路信息。
11.一种处理挡风玻璃使其隐形的方法,其特征在于,包括:
识别驾驶员的视线和乘客的视线,根据所述驾驶员的视线和所述乘客的视线的识别结果将隐形区域分别导出为所述驾驶员的隐形区域和不同于所述驾驶员的隐形区域的所述乘客的隐形区域;
在挡风玻璃内的区域中显示隐形区域,所述隐形区域与预设的乘客不可见的路面场景相匹配;以及
在所述隐形区域的显示中,在所述挡风玻璃上显示的所述隐形区域中叠加并显示存在于所述隐形区域的道路信息。
12.根据权利要求11所述的方法,其特征在于,在所述隐形区域的显示和所述道路信息的显示中,所述隐形区域和所述道路信息显示在所述挡风玻璃包括的透明显示装置上。
13.根据权利要求11所述的方法,其特征在于,在所述隐形区域的显示和所述道路信息的显示中,所述隐形区域和所述道路信息显示在所述挡风玻璃包括的电致变色膜上。
14.根据权利要求11所述的方法,其特征在于,还包括根据车辆的驾驶来移动所述隐形区域在所述挡风玻璃中的显示位置。
15.根据权利要求11所述的方法,其特征在于,还包括识别驾驶员的视线和随行乘客的视线,并且相对于驾驶员的视线和随行乘客的视线中的每一者,移动所述隐形区域在所述挡风玻璃中的显示位置。
CN202011109840.3A 2019-10-17 2020-10-16 处理挡风玻璃使其隐形的装置和方法 Active CN112677740B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2019-0129480 2019-10-17
KR1020190129480A KR20210045896A (ko) 2019-10-17 2019-10-17 윈드실드 불가시 처리장치 및 방법

Publications (2)

Publication Number Publication Date
CN112677740A CN112677740A (zh) 2021-04-20
CN112677740B true CN112677740B (zh) 2024-06-25

Family

ID=75268721

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011109840.3A Active CN112677740B (zh) 2019-10-17 2020-10-16 处理挡风玻璃使其隐形的装置和方法

Country Status (4)

Country Link
US (1) US11393433B2 (zh)
KR (1) KR20210045896A (zh)
CN (1) CN112677740B (zh)
DE (1) DE102020127023A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230121260A1 (en) * 2021-10-15 2023-04-20 Hyundai Mobis Co., Ltd. System for controlling vehicle display based on occupant's gaze
WO2024065799A1 (en) * 2022-09-30 2024-04-04 Intel Corporation Vehicle passenger display modification

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101520660B1 (ko) 2008-05-07 2015-05-15 엘지전자 주식회사 차량용 영상장치
US9703275B2 (en) * 2011-06-23 2017-07-11 Rain Bird Corporation Methods and systems for irrigation and climate control
US9823742B2 (en) * 2012-05-18 2017-11-21 Microsoft Technology Licensing, Llc Interaction and management of devices using gaze detection
GB2542348B (en) * 2015-09-15 2019-04-17 Ford Global Tech Llc Windscreen display system
JP6259482B2 (ja) * 2016-03-18 2018-01-10 株式会社Subaru 車両用表示制御装置
JP6272375B2 (ja) * 2016-03-18 2018-01-31 株式会社Subaru 車両用表示制御装置
US10565961B1 (en) * 2018-07-25 2020-02-18 Honeywell International Inc. Dynamic contrast equalization for see through displays in varying light conditions
KR102559573B1 (ko) 2018-11-21 2023-07-25 현대모비스 주식회사 차량용 디스플레이 장치

Also Published As

Publication number Publication date
US11393433B2 (en) 2022-07-19
US20210118411A1 (en) 2021-04-22
CN112677740A (zh) 2021-04-20
DE102020127023A1 (de) 2021-04-22
KR20210045896A (ko) 2021-04-27

Similar Documents

Publication Publication Date Title
CN110419063B (zh) Ar显示装置和ar显示方法
CN109427199B (zh) 用于辅助驾驶的增强现实的方法及装置
DE102014117854B4 (de) Vorrichtung und Verfahren zur Anzeige von Informationen eines Head-up-Displays (HUD)
US10868976B2 (en) Method for operating smartglasses in a motor vehicle, and system comprising smartglasses
DE102013110332B4 (de) Visuelles leitsystem
CN107199948B (zh) 车辆用显示控制装置
CN112677740B (zh) 处理挡风玻璃使其隐形的装置和方法
DE102014219575A1 (de) Verbesserte 3-Dimensionale (3-D) Navigation
DE102014219567A1 (de) Dreidimensionale (3-d) navigation
CN112292630B (zh) 用于运行用于机动车的视野显示设备的方法
US10274726B2 (en) Dynamic eyebox correction for automotive head-up display
US20190141310A1 (en) Real-time, three-dimensional vehicle display
JP2008001182A (ja) 車両用視覚情報呈示装置及び車両用視覚情報呈示方法
KR20170048781A (ko) 차량용 증강현실 제공 장치 및 그 제어방법
EP3456574B1 (en) Method and system for displaying virtual reality information in a vehicle
JP6838626B2 (ja) 表示制御装置、及び表示制御プログラム
CN114489332B (zh) Ar-hud输出信息的显示方法及系统
DE102014211803A1 (de) Augmented-Reality-System für ein Kraftfahrzeug
JP7561910B2 (ja) Ar表示装置、ar表示方法、およびプログラム
CN110831840B (zh) 用于在避让障碍物时辅助机动车使用者的方法、驾驶员辅助装置和机动车
CN114667474A (zh) 用于车辆的智能玻璃
KR102593383B1 (ko) 운송 수단을 위한 증강 현실 헤드 업 디스플레이 장치의 디스플레이 제어
JPWO2020105685A1 (ja) 表示制御装置、方法、及びコンピュータ・プログラム
CN114253016B (zh) 智能挡风玻璃控制方法、装置、设备和存储介质
JP2021135933A (ja) 表示方法、表示装置及び表示システム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant