CN110678353B - 在vr眼镜中外部地显示车辆内部空间的拍摄图像 - Google Patents

在vr眼镜中外部地显示车辆内部空间的拍摄图像 Download PDF

Info

Publication number
CN110678353B
CN110678353B CN201880034032.XA CN201880034032A CN110678353B CN 110678353 B CN110678353 B CN 110678353B CN 201880034032 A CN201880034032 A CN 201880034032A CN 110678353 B CN110678353 B CN 110678353B
Authority
CN
China
Prior art keywords
vehicle
image
image data
external server
glasses
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880034032.XA
Other languages
English (en)
Other versions
CN110678353A (zh
Inventor
T·穆勒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Audi AG
Original Assignee
Audi AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi AG filed Critical Audi AG
Publication of CN110678353A publication Critical patent/CN110678353A/zh
Application granted granted Critical
Publication of CN110678353B publication Critical patent/CN110678353B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/85—Arrangements for transferring vehicle- or driver-related data
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G06T3/047—Fisheye or wide-angle transformations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/177—Augmented reality
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/55—Remote control arrangements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/589—Wireless data transfers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/592—Data transfer involving external databases
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77—Instrument locations other than the dashboard
    • B60K2360/797—Instrument locations other than the dashboard at the vehicle exterior
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
    • B60R25/305—Detection related to theft or to other events relevant to anti-theft systems using a camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/51—Housings

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

本发明涉及一种用于显示车辆的内部空间的至少一个图像(13)的方法，其中，借助处于车辆中的至少一个摄像机(12)来拍摄车辆内部空间的至少一个图像(13)，将与车辆相关的、所述至少一个图像(13)的图像数据传输给外部的服务器(16)，允许对于外部的服务器(16)而言在与车辆相关的图像数据方面被授权的使用者(10)访问所述图像数据，并且借助VR‑眼镜(17)将所述图像数据(18、19)展示给使用者(10)，其中，在由VR‑眼镜显示的图像中以颜色对借助数值方法识别出的物体进行强调。

Description

在VR眼镜中外部地显示车辆内部空间的拍摄图像
技术领域
本发明涉及的是在VR眼镜中显示车辆内部空间的拍摄图像的方法和系统。
背景技术
现实增强设备将基于计算机产生的附加信息与看得见的和/或拍摄到的周围环境相叠加。在虚拟显示领域中，附加信息被插入或位置适当地补入到环境图像中。这可以例如通过数据眼镜来实现，在数据眼镜中使用者仍旧具有其视场中的周围环境。而与此相反，在虚拟现实中使用者与其实际的周围环境脱离联接。视觉设备为此可能由例如VR-眼镜(Virtual Reality：VR)构成。VR-眼镜令使用者能够看到真实的或者人造地产生的图像，这些图像无需源于其实际的物理环境。借助例如获取头部和/或眼睛的运动的方法能够影响视觉输出单元中所显示的图像信息。
文献DE 10 2013 016 245 A1公开了一种用于识别和输出周围环境中真实但不可见的物体的方法和装置。人眼不能识别的物体上均存在各自的标记，借助在可见光的波长范围内的反射光线能够通过摄像机探测到这些标记并且能够实现各个物体的辨认。处理单元针对被辨认的物体生成附加信息，所述附加信息被插入到输出图像中，若有必要还会显现在数据眼镜中。
文献DE 10 2013 019 563 A1公开了一种向智能设备例如数据眼镜提供周围环境信息的方法。安装在车辆中的识别系统检测到智能设备的存在并且向其使用者提供关于周围环境的信息。所述环境在此是智能设备的使用者附近的环境并且能够包括车辆内部空间。
文献DE 10 2014 013 961 A1公开了一种虚拟现实眼镜，在其中假如使用者经历的是虚拟的空气流动环境，例如行车风，则额外配备的风扇将令眼镜的使用者获得尽可能贴近现实的行驶感受。在此，虚拟现实眼镜主要被用于显示处于虚拟车辆中的驾驶者的周围环境，尤其即还显示了虚拟的车辆内部空间。
发明内容
在开头两个文献中的共同点是，为了获得与车辆的内部空间相关的信息，使用者均需位于车辆中或至少位于车辆的附近。在前述最后一个文献中仅展示了虚拟的而不是现实的、真实的车辆内部空间。
基于这种背景，本发明的任务在于，提供一种能够在虚拟现实中外部地显示车辆内部空间的方法。另外，本发明的任务还在于，提供一种用于执行这种方法的相应的系统。
为了完成上述任务，提出了一种用于显示车辆内部空间的至少一个图像的方法，在所述方法中借助处于车辆中的至少一个摄像机来拍摄车辆内部空间的至少一个图像，将与车辆相关的/对应于确定车辆的、所述至少一个图像的图像数据传输给外部的服务器，允许相对于外部的服务器在与车辆相关的所述图像数据方面被授权的使用者访问所述图像数据，并且借助VR-眼镜将所述图像数据作为图像展示给使用者。有利的是将多个摄像机布置在车辆中、尤其是车辆内部空间中，以及有利地将其定位成在必要时能实现车辆内部空间的360°环视。尤其有优势的是，在车辆中设有足够多的摄像机，以便能够覆盖座位区域以及地板区域。
在本发明方法的一种实施形式中，通过至少一个在车辆中不可见地安装的摄像机来拍摄车辆内部空间的至少一个图像。可以设想，所述至少一个摄像机在必要时以不引人注目或不可见的方式、也就是说隐藏式地整合在车辆内部空间装饰结构的一个构件中。
为了覆盖尽可能多的周围环境，有利的是将鱼眼物镜或任意可能的广角镜头实现形式用作所述至少一个摄像机的物镜。由此引起的光学失真能够通过多种数值方法来计算或修正，以便后期观看所拍摄的图像。为此设有一个计算单元，所述计算单元可以被布置在车辆中且与外部的服务器保持通信连接，除此以外也可以被整合在所述外部的服务器中。
根据本发明，由至少两张被至少两个存在于两个不同位置上的摄像机拍摄的图像计算出车辆内部空间的合成图像。合成图像的计算在此能够通过处在车辆中的计算单元来实现。在此，该计算单元在设计构造方面可以与之前说过的计算单元相同。
有利的是，对从车辆内部空间获得的图像或图像数据进行压缩，所述图像或图像数据在下一步本发明方法中借助处在车辆中的通信单元传输给外部的服务器。为此可以使用已知的用于图像数据压缩的数值方法，所述数值方法在同样处在车辆中的计算单元中运行。在外部的服务器上，被接收到的且与车辆相关的图像数据能够被重新解压缩以便进行进一步的处理。上文中所提到的布置在车辆中的计算单元可以是被设计用于运行上述运算操作的计算单元。
在本发明方法的一种实施形式中，将数值方法应用于存储在外部服务器上的图像数据以识别至少一个物体。已知的图案识别和/或边缘检测方法在此被用于辨认位于车辆内部空间中的物品。也可以利用拍摄未使用过的、也就是说新出厂的车辆内部空间通过图像匹配来辅助实现所述辨认。
在本发明方法的这种实施形式的扩展方案中，将至少一个待识别的物体设定为在由例如钱包、钥匙串、智能设备、太阳镜、手提包以及手套构成的列表中。所述列表是任意的，必要时也可以由使用者来配置、尤其是扩充。可以设想，为了简化和/或加快辨认过程需要在系统侧提供所述列表中的相应物体的几何形状描述和/或特定于物体的参数。
在本发明方法的这种实施形式的进一步的扩展方案中，被识别出的物体在VR-眼镜所显示的图像中进行标记，优选地用颜色进行强调，被识别出的物体可以来自于上述列表，或者例如相对于未使用过的(也就是说新出厂的)车辆内部空间而显露出来。
可以设想，上述这些方法步骤可以在预定的时间间隔下进行重复，例如每隔10分钟、30分钟或60分钟重复一次，或者应外部的请求而开始。并未处在车辆中或车辆旁的使用者由此能够在由外部的服务器提供的车辆内部空间画面中借助VR-眼镜来寻找可能落在车辆内部空间中的物品。在配备有运动检测的VR-眼镜中能够相应于实际搜寻立即实现在车辆内部空间中的虚拟寻找。这意味着，佩戴VR-眼镜的使用者在转动其头部时能够虚拟地察看车辆内部空间并搜寻物体。
另外提出了一种在VR-眼镜中显示车辆内部空间的图像的系统，所述系统包括至少一个安装在车辆内部空间中的摄像机、位于车辆中的通信装置、与车辆的通信装置保持通信连接的外部服务器、以及与外部服务器保持通信连接的VR-眼镜，其中所述系统被设计用于运行上述方法。
在本公开的内容中，通信连接被理解成如下连接，通过该连接能够在相应的连接对象之间，此处例如在外部服务器和车辆之间或在VR-眼镜和外部服务器之间，传输或交换数据。
本发明的其他优点和设计方案由说明书和附图给出。
应该理解的是：上文中所述的以及下文中将要述及的特征在未背离本发明范围的条件下不仅能够以相应所述组合的形式进行应用，还能够以其他的组合形式或单独地应用。
附图说明
图1示出的是本发明方法的一种实施形式的概念的示意图。
具体实施方式
图1示出了本发明方法的一种实施形式的概念的示意图。在车辆11的车辆内部空间中设有必要时被不可见地安装的摄像机12，该摄像机生成例如车辆11的前部、中部仪表盘区域的图像13并且将所述图像13或与其相关联的图像数据传输给计算单元14。假如摄像机12是可动的或在车辆11中装有多个具有不同视角的摄像机，那么就能够生成甚至将车辆内部空间全部获取的图像。依据这些图像能够通过计算单元14汇编出合成的图像。与这些图像相联系的图像数据能够通过例如同样在计算单元14中运行的数值方法进行压缩。另外，这些图像数据是与车辆相关的/对应于确定车辆的，且通过车辆11的通信装置15被传输给充当后端的具有大容量存储器的外部服务器16。在此通过例如无线网络来实现所述传输。当在车辆中不发生上述传输时，只要存在足够多的图像或图像画面，也能够在外部服务器16上将图像数据18合成为车辆11的完整的内部空间画面。另外，在外部服务器16上还能够通过所谓的图像处理领域的数值方法来实现图像数据18的处理。为此还采用了所谓的物体识别、即在图像中获取物体的方法，由此能够在系统侧对物体例如太阳镜进行搜寻并且在图像数据18中突显出图示19。最后使用者10能够借助VR-眼镜17观看图像数据18，其中VR-眼镜17从外部服务器16获得所述图像数据18。由此，使用者10无需处于车辆11的附近，即能够例如从家中查看：可能丢失的物品、例如使用者的太阳镜是否被遗忘在了车辆11中。突出显示的图示19可能使得这一点变得更为容易。

Claims (7)

1.一种用于显示车辆的内部空间的至少一个图像(13)的方法，其中借助设于车辆中的至少一个摄像机(12)来拍摄车辆内部空间的至少一个图像(13)，将所述至少一个图像(13)的图像数据传输给外部服务器(16)，其中，将用于识别至少一个物体的数值方法应用于存储在所述外部服务器(16)上的图像数据，其中，允许对于所述外部服务器(16)而言在与车辆相关的所述图像数据方面被授权的使用者(10)访问所述图像数据，并且借助虚拟现实眼镜(17)将所述图像数据(18、19)展示给所述使用者(10)，其中，由至少在车辆(11)内的两个位置上存在的摄像机(12)相应地拍摄至少两个图像并且由拍摄到的所述至少两个图像计算出车辆内部空间的合成图像，所述合成图像由设于车辆(11)中的计算单元(14)生成。
2.根据权利要求1所述的方法，其中，通过在车辆(11)中不可见安装的至少一个摄像机来拍摄车辆内部空间的所述至少一个图像(13)。
3.根据权利要求1所述的方法，其中，选择鱼眼物镜作为所述至少一个摄像机(12)的镜头。
4.根据权利要求1所述的方法，其中，从车辆内部空间获得的图像数据以被压缩的方式传输给外部服务器(16)。
5.根据权利要求1所述的方法，其中，待识别的所述至少一个物体从下列物体中选择：钱包、钥匙串、智能设备、太阳镜、手提包、手套。
6.根据权利要求5所述的方法，其中，在所述虚拟现实眼镜(17)中显示的图像中以颜色突显出识别出的物体(19)。
7.一种用于显示车辆的内部空间的至少一个图像(13)的系统，其包括至少一个安装在车辆内部空间中的摄像机(12)、设于车辆中的通信装置(15)、与车辆的所述通信装置(15)相连接且具有用于在所存储的图像数据中识别至少一个物体的数值方法的外部服务器(16)，以及与所述外部服务器(16)相连接的虚拟现实眼镜(17)，其中所述系统被设计用于运行根据上述权利要求中任一项所述的方法。
CN201880034032.XA 2017-05-24 2018-05-18 在vr眼镜中外部地显示车辆内部空间的拍摄图像 Active CN110678353B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102017208806.0A DE102017208806B3 (de) 2017-05-24 2017-05-24 Externe Darstellung von Bildaufnahmen eines Fahrzeuginnenraums in einer VR-Brille
DE102017208806.0 2017-05-24
PCT/EP2018/063070 WO2018215332A1 (de) 2017-05-24 2018-05-18 Externe darstellung von bildaufnahmen eines fahrzeuginnenraums in einer vr-brille

Publications (2)

Publication Number Publication Date
CN110678353A CN110678353A (zh) 2020-01-10
CN110678353B true CN110678353B (zh) 2021-05-28

Family

ID=62196604

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880034032.XA Active CN110678353B (zh) 2017-05-24 2018-05-18 在vr眼镜中外部地显示车辆内部空间的拍摄图像

Country Status (6)

Country Link
US (1) US11356641B2 (zh)
EP (1) EP3630522B1 (zh)
CN (1) CN110678353B (zh)
DE (1) DE102017208806B3 (zh)
ES (1) ES2868049T3 (zh)
WO (1) WO2018215332A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200034904A1 (en) * 2018-07-30 2020-01-30 Stephen Barone System and method for displaying wheel styles and artwork on vehicles
CN109849788B (zh) * 2018-12-29 2021-07-27 北京七鑫易维信息技术有限公司 信息提供方法、装置及系统
DE102021204095A1 (de) 2021-04-26 2022-10-27 Volkswagen Aktiengesellschaft Bedieneinheit, Daten-Brille und Bedienelement
CN115393380B (zh) * 2022-08-01 2023-07-04 北京城市网邻信息技术有限公司 车内全景图像显示方法、装置、电子设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013016245A1 (de) * 2013-10-01 2014-06-26 Daimler Ag Verfahren und Vorrichtung zur Erkennung und Ausgabe von realen nicht sichtbaren Objekten einer Umgebung
DE102013019563A1 (de) * 2013-11-22 2015-05-28 Audi Ag Verfahren zum Bereitstellen von Information über eine Umgebung an einem Smart-Gerät
CN105151001A (zh) * 2015-09-24 2015-12-16 廖勇 一种汽车视觉监控智能安防系统
DE102014013961A1 (de) * 2014-09-19 2016-03-24 Audi Ag Virtual-Reality-Brille, System mit einer Virtual-Reality-Brille und Verfahren zum Betreiben einer Virtual-Reality-Brille

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7596242B2 (en) * 1995-06-07 2009-09-29 Automotive Technologies International, Inc. Image processing for vehicular applications
US7477758B2 (en) * 1992-05-05 2009-01-13 Automotive Technologies International, Inc. System and method for detecting objects in vehicular compartments
DE19634184A1 (de) 1996-08-23 1998-02-26 Ralph Eberhart System zur Überwachung des Fahrgastraumes eines Kraftfahrzeuges
DE29819117U1 (de) * 1998-10-27 2000-03-09 Schiesler Peter Uwe Vorrichtung zur Innenraum- und Notfallüberwachung von Fahrzeugen, insbesondere von Taxis o.dgl.
US7433494B2 (en) * 2002-09-19 2008-10-07 Denso Corporation Moving body detecting apparatus
US20040257208A1 (en) * 2003-06-18 2004-12-23 Szuchao Huang Remotely controllable and configurable vehicle security system
JP4858381B2 (ja) * 2007-09-19 2012-01-18 株式会社デンソー 車内忘れ物防止装置
US20100182425A1 (en) * 2009-01-21 2010-07-22 Mazda Motor Corporation Vehicle interior state recognition device
DE102010010179A1 (de) * 2010-03-04 2011-09-08 Kathrin Graser System zur Überwachung von Personen und Gegenständen
US8979159B2 (en) * 2011-11-16 2015-03-17 Flextronics Ap, Llc Configurable hardware unit for car systems
US9105051B2 (en) * 2011-11-16 2015-08-11 Flextronics Ap, Llc Car location
US11632520B2 (en) * 2011-11-14 2023-04-18 Aaron Chien LED light has built-in camera-assembly to capture colorful digital-data under dark environment
US20130200991A1 (en) * 2011-11-16 2013-08-08 Flextronics Ap, Llc On board vehicle media controller
US9449488B2 (en) * 2011-12-29 2016-09-20 Intel Corporation Object recognition and notification
WO2014072972A1 (en) 2012-11-08 2014-05-15 Maimoni Iris System and method for determining whether items have been left in vehicles
US9454220B2 (en) * 2014-01-23 2016-09-27 Derek A. Devries Method and system of augmented-reality simulations
DE102015003884A1 (de) 2015-03-26 2016-09-29 Audi Ag Kraftfahrzeugsimulationsanordnung zur Simulation einer virtuellen Umgebung mit zumindest einem Teil eines virtuellen Kraftfahrzeugs und Verfahren zum Einstellen einer Kraftfahrzeugsimulationsanordnung
DE102015004749A1 (de) 2015-04-11 2016-10-13 Audi Ag Verfahren zum Betreiben einer Virtual-Reality-Brille und System mit einer Virtual-Reality-Brille
DE102015011815A1 (de) * 2015-09-09 2017-03-09 Audi Ag Verfahren zum Vorschlagen einer Positionierung mindestens eines Gegenstands
US10366290B2 (en) * 2016-05-11 2019-07-30 Baidu Usa Llc System and method for providing augmented virtual reality content in autonomous vehicles
US10017156B2 (en) * 2016-08-30 2018-07-10 Nzube Etonye Vehicle security system
DE102016120116A1 (de) * 2016-10-21 2018-04-26 Connaught Electronics Ltd. Verfahren zur Zurverfügungstellung eines einen Umgebungsbereich eines Kraftfahrzeugs beschreibenden Ausgangsbildes sowie vernetztes System
JP2019109849A (ja) * 2017-12-20 2019-07-04 セイコーエプソン株式会社 透過型頭部装着型表示装置、表示制御方法、およびコンピュータープログラム
DE102018203405A1 (de) * 2018-03-07 2019-09-12 Zf Friedrichshafen Ag Visuelles Surround-View-System zur Überwachung des Fahrzeuginneren

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013016245A1 (de) * 2013-10-01 2014-06-26 Daimler Ag Verfahren und Vorrichtung zur Erkennung und Ausgabe von realen nicht sichtbaren Objekten einer Umgebung
DE102013019563A1 (de) * 2013-11-22 2015-05-28 Audi Ag Verfahren zum Bereitstellen von Information über eine Umgebung an einem Smart-Gerät
DE102014013961A1 (de) * 2014-09-19 2016-03-24 Audi Ag Virtual-Reality-Brille, System mit einer Virtual-Reality-Brille und Verfahren zum Betreiben einer Virtual-Reality-Brille
CN105151001A (zh) * 2015-09-24 2015-12-16 廖勇 一种汽车视觉监控智能安防系统

Also Published As

Publication number Publication date
WO2018215332A1 (de) 2018-11-29
US11356641B2 (en) 2022-06-07
EP3630522B1 (de) 2021-03-03
DE102017208806B3 (de) 2018-07-26
EP3630522A1 (de) 2020-04-08
ES2868049T3 (es) 2021-10-21
US20200151472A1 (en) 2020-05-14
CN110678353A (zh) 2020-01-10

Similar Documents

Publication Publication Date Title
CN110678353B (zh) 在vr眼镜中外部地显示车辆内部空间的拍摄图像
US11127210B2 (en) Touch and social cues as inputs into a computer
JP6411505B2 (ja) 全焦点画像を生成するための方法および装置
EP3146500B1 (en) Adaptive low-light identification
CN110192386B (zh) 信息处理设备和信息处理方法
US11094074B2 (en) Identification of transparent objects from image discrepancies
US20170330381A1 (en) Apparatus and method for selectively displaying an operational environment
WO2013028813A1 (en) Implicit sharing and privacy control through physical behaviors using sensor-rich devices
JP2020057111A (ja) 表情判定システム、プログラム及び表情判定方法
KR20110136012A (ko) 위치와 시선방향을 추적하는 증강현실 장치
US11189103B2 (en) Visual search refinement for computer generated rendering environments
US20150256764A1 (en) Active-tracking based systems and methods for generating mirror image
CN112257552B (zh) 图像处理方法、装置、设备及存储介质
CN111095364A (zh) 信息处理装置、信息处理方法和程序
WO2018087462A1 (fr) Dispositif individuel d'immersion visuelle pour personne en mouvement avec gestion des obstacles
WO2016191528A1 (en) Pre-capture de-identification (pcdi) imaging system and pcdi optics assembly
KR20150046693A (ko) 증강 현실을 이용한 차량 손상 관리 장치 및 방법
TWI542194B (zh) 立體影像處理系統、裝置與方法
CN114742740A (zh) 一种多光谱图像融合双目光波导显示智能数字孪生眼镜
US20220114748A1 (en) System and Method for Capturing a Spatial Orientation of a Wearable Device
CN109996044B (zh) 基于瞳孔追踪技术的人像识别眼镜、识别方法及可读存储介质
KR101754993B1 (ko) 증강 현실을 이용한 포토존 촬영 장치
WO2023120472A1 (ja) アバター生成装置
US20230260222A1 (en) Efficient dynamic occlusion based on stereo vision within an augmented or virtual reality application
KR101820379B1 (ko) 입체형 더블 마커 기반의 증강 현실 장치

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant