WO2018176235A1 - 头戴式显示设备及其显示切换方法 - Google Patents

头戴式显示设备及其显示切换方法 Download PDF

Info

Publication number
WO2018176235A1
WO2018176235A1 PCT/CN2017/078468 CN2017078468W WO2018176235A1 WO 2018176235 A1 WO2018176235 A1 WO 2018176235A1 CN 2017078468 W CN2017078468 W CN 2017078468W WO 2018176235 A1 WO2018176235 A1 WO 2018176235A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
display
image
screen
mixed
Prior art date
Application number
PCT/CN2017/078468
Other languages
English (en)
French (fr)
Inventor
李金鑫
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to PCT/CN2017/078468 priority Critical patent/WO2018176235A1/zh
Priority to CN201780004642.0A priority patent/CN108496107A/zh
Publication of WO2018176235A1 publication Critical patent/WO2018176235A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems

Definitions

  • the present invention relates to a display device, and more particularly to a head mounted display device and a display switching method of the head mounted display device.
  • Head-mounted display devices have gradually become popular because of their convenience and ability to achieve stereoscopic display and stereo sound.
  • VR virtual reality
  • AR augmented reality
  • head-mounted display devices have become more widely used as hardware support devices for VR technology.
  • VR virtual reality
  • AR augmented reality
  • the head-mounted display device needs to be removed.
  • the head mounted display device needs to be worn. Therefore, the user needs to frequently wear or remove the head mounted display device, resulting in inconvenience.
  • the embodiment of the invention discloses a head-mounted display device and a display switching method of the head-mounted display device, which can switch between displaying the played content or the external environment influence of the head-mounted display device as needed.
  • the head-mounted display device disclosed in the embodiment of the present invention includes a processor, a display device, and an image capturing device.
  • the camera device is disposed in front of the display device for capturing images in front of the head-mounted display device
  • the processor is used for Acquiring an image captured by the camera device in response to an external scene display trigger signal, and generating a mixed screen according to the screen currently displayed by the display device and the image, and controlling the display device to display the mixed screen.
  • the display switching method disclosed in the embodiment of the present invention is applied to a head mounted display device, the head mounted display device includes a display device and an image capturing device, and the method includes the steps of: acquiring an image capturing device in response to an external scene display trigger signal. Image; according to the currently displayed screen of the display device and the obtained image The captured image generates a mixed picture; and controls the display device to display the mixed picture.
  • the head-mounted display device and the display switching method thereof of the invention can display an external scene as needed, and it is more convenient to use without removing the head-mounted display device.
  • FIG. 1 is a block diagram showing the structure of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a mixed screen displayed by a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 4 is a structural block diagram of a head mounted display device according to another embodiment of the present invention.
  • FIG. 5 is a flowchart of a display switching method according to an embodiment of the present invention.
  • FIG. 6 is a sub-flow chart of step S503 in FIG. 5.
  • FIG. 1 is a structural block diagram of a head mounted display device 100 according to an embodiment of the invention.
  • the head mounted display device 100 includes a processor 10 and an imaging device 20.
  • FIG. 2 is a schematic diagram of a head mounted display device 100 in accordance with an embodiment of the present invention.
  • the head mounted display device 100 further includes a display device 30 disposed in front of the display device 30 of the head mounted display device 100 for capturing images in front of the head mounted display device 100.
  • the display device 30 is for providing a display screen.
  • the processor 10 is configured to acquire an image captured by the camera device 20 in response to an external display trigger signal, and generate a mixed screen according to the currently displayed screen of the display device 30 and the acquired image, and control the display device. 30 displays the mixed picture.
  • the image captured by the camera device 20 is a video frame image that changes in real time
  • the image displayed by the display device 30 may be a static image or a dynamic image composed of multiple frames.
  • the processor 10 displays the trigger signal in response to the external scene
  • the current frame image ie, one frame image captured by the current camera device 20
  • the currently displayed image of the display device 30 are acquired in real time, and the currently acquired frame image is
  • the screen currently displayed by the display device 30 is mixed to form a mixed screen, and the display device 30 is controlled to display the currently mixed mixed screen.
  • the display device 30 of the head mounted display device 100 can display a screen in which the image captured by the camera device 20 is mixed, and the outside view can be seen without the user removing the head mounted display device 100. .
  • the outside scene can also be displayed in real time.
  • the processor 10 generates a mixed screen according to the screen currently displayed by the display device 30 and the image, and includes: controlling, by the camera device 20, the background image in the display screen of the display device 30. Image instead.
  • the non-background image portion of the display screen originally displayed by the display device 30 is reserved, for example, a non-background image portion of a toolbar, a function button/icon, a text, a picture, and the like is reserved. Therefore, the mixed screen is a screen including a non-background image portion such as a toolbar, a function button/icon, a character, a picture, or the like in the display screen, with the captured image as a background.
  • FIG. 3 it is a schematic diagram of a mixed picture H1.
  • the mixed screen H1 includes an image Y1 captured by the imaging device 20 as a background and a plurality of function icons B1.
  • the image Y1 captured by the imaging device 20 is used as a background, the scene of the external environment can be seen, and the non-background image of the toolbar, function buttons/icons, characters, pictures, and the like in the display screen of the display device 30 is displayed at the same time. Partially reserved, does not affect the operation and viewing of the original display content.
  • the user of the head mounted display device 100 can perform normal operation on the display content of the head mounted display device 100, and can see the external scene, thereby achieving the effect of not affecting the current content operation while viewing the external scene.
  • the processor 10 is further configured to display the display on the display device 30.
  • at least one of the non-background image parts such as the toolbar, the function button, the text, and the picture in the display screen is subjected to at least one of enlargement, reduction, translucent, etc., so that the tool in the finally generated mixed screen is generated.
  • the non-background image portion of the column, function button, text, picture, etc. exhibits an enlarged, reduced, and/or translucent effect compared to the display screen originally displayed by the display device 30.
  • the processor 10 may include a non-background image portion in the display screen before controlling the display device 30 to display the mixed screen, and before generating the mixed screen or after generating the mixed screen. At least one of enlargement, reduction, translucency, etc.
  • the head mounted display device 100 may further include a function button 40 , and the scene display trigger signal may be generated for operating the function button 40 .
  • the user can operate the function button 40 when it is necessary to observe the surrounding scene, such that the function button 40 generates the scene display trigger signal in response to the operation to trigger the processor 10 to generate a mixed image of the image including the surrounding scene. .
  • the head mounted display device 100 further includes a sensor S1 for detecting whether there is a person around and generating the external scene display trigger signal when a nearby person is detected.
  • the sensor S1 may be an infrared sensor, an acoustic sensor, or the like.
  • the sensor S1 may also be the camera device 20, and generate the external scene display trigger signal when an image of a person is acquired.
  • the infrared sensor determines a surrounding person when detecting the thermal energy radiated by the human body and generates the external scene display trigger signal.
  • the sound sensor determines a surrounding person and generates the external scene display trigger signal when detecting a human voice.
  • the sensor S1 is the image pickup device 20
  • the image pickup device 20 determines a surrounding person when the image including the person is acquired and generates the external scene display trigger signal.
  • the exterior display trigger signal may be generated for a particular menu option displayed by the operating display device 30.
  • the processor 10 further controls the display device 30 to exit the mixed screen display in response to an exit signal, that is, the original display screen is displayed without displaying the mixed screen. Specifically, at this time, the display device 30 no longer displays the mixed screen including the image acquired by the imaging device 20, but only displays the content played by the head mounted display device 100.
  • the exit signal may be generated by operating a corresponding menu option, or may be operation specific The keys are generated. In some embodiments, the exit signal may also be generated by sensor 50 when no one is detected.
  • the head mounted display device 100 may further include an earphone device 50 for outputting a sound signal.
  • the function button 40 can be disposed on the side of the earphone device 50 to facilitate user operation.
  • the processor 10 can be a microcontroller, a microprocessor, a microcontroller, a digital signal processor, or the like.
  • the camera device 20 can be a camera.
  • the processor 10 may be disposed in the display device 20 or may be disposed in the earphone device 50.
  • the head mounted display device 100 can be a head mounted device such as a smart helmet or smart glasses.
  • FIG. 5 is a flowchart of a display switching method according to an embodiment of the present invention.
  • the method is applied to the aforementioned head mounted display device 100, and the order of execution is not limited to the order shown in FIG.
  • the method includes the steps of:
  • the image captured by the imaging device 20 is acquired in response to an external display trigger signal (S501).
  • the image captured by the camera device 20 is a video frame image that changes in real time.
  • the exterior display trigger signal may be generated for the operational function button 40, or may be generated when the sensor S1 detects a nearby person, or may be generated by operating a particular menu option.
  • a mixed screen is generated based on the screen currently displayed by the display device 30 and the acquired image (S503).
  • the step 503 includes: acquiring an image of a current frame in real time, and mixing the currently acquired frame image with a picture currently displayed by the display device 30 to form a mixed picture.
  • the display device 30 is controlled to display the mixed screen (S505).
  • the display switching method further includes the step of controlling the display device 30 to exit the display of the mixed screen in response to an exit signal (S507). Wherein, after exiting the display of the mixed screen, the display device displays the original display screen, that is, restores the original background image.
  • the display switching method further includes the steps of: performing a non-background image portion of a toolbar, a function button, a text, a picture, etc. in the display screen before controlling the display device 30 to display the mixed screen. At least one process including enlargement, reduction, translucency, and the like.
  • FIG. 6 is a sub-flowchart in step S503 in an embodiment.
  • a mixed screen including the non-background image portion of the display screen displayed by the display device 30 with the captured image as a background is generated (S5033).
  • the head-mounted display device 100 of the present invention can display an external scene as needed, and simultaneously display the external scene while displaying the contents of the original display screen without affecting the viewing and operation of the original display screen.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种头戴式显示设备(100)，包括处理器(10)、显示装置(30)及摄像装置(20)，摄像装置(20)设置于显示装置(30)的前方，用于拍摄头戴式显示设备(100)前方的影像，处理器(10)用于响应一外景显示触发信号而获取摄像装置(20)拍摄的影像，并根据显示装置(30)当前显示的画面以及影像生成一混合画面，以及控制显示装置(30)显示混合画面。该头戴式显示设备(100)及显示切换方法，能够根据需要显示外部景象，无需取下头戴式显示设备(100)，更加方便。

Description

头戴式显示设备及其显示切换方法 技术领域
本发明涉及一种显示设备，尤其涉及一种头戴式显示设备及所述头戴式显示设备的显示切换方法。
背景技术
头戴式显示设备由于便捷性，且能实现立体显示及立体声等效果，已经逐渐被人们所喜爱。近年来，随着虚拟现实(virtual reality，VR)以及增强现实(augmented reality，AR)技术的出现，头戴式显示设备作为VR技术的硬件支持设备，更加应用广泛了。目前，当用户穿戴头戴式显示设备时，只能看到头戴式显示设备显示的内容，无法看到外面的情况，当用户需要观看外部环境时，需要摘下头戴式显示设备，而用户需要再次观看头戴式显示设备显示的内容时，又需要穿戴头戴式显示设备。因此，用户需要频繁地穿戴或取下头戴式显示设备，导致了不便。
发明内容
本发明实施例公开一种头戴式显示设备及所述头戴式显示设备的显示切换方法，能够根据需要在头戴式显示设备显示播放的内容或外部环境影响中进行切换。
本发明实施例公开的头戴式显示设备，包括处理器、显示装置及摄像装置，所述摄像装置设置于显示装置的前方，用于拍摄头戴式显示设备前方的影像，所述处理器用于响应一外景显示触发信号而获取所述摄像装置拍摄的影像，并根据显示装置当前显示的画面以及所述影像生成一混合画面，以及控制所述显示装置显示所述混合画面。
本发明实施例公开的显示切换方法，应用于一头戴式显示设备中，所述头戴式显示设备包括显示装置及摄像装置，所述方法包括步骤：响应一外景显示触发信号获取摄像装置拍摄的影像；根据显示装置当前显示的画面以及所述获 取的影像生成一混合画面；以及控制所述显示装置显示所述混合画面。
本发明的头戴式显示设备及其显示切换方法，能够根据需要显示外部景象，无需取下头戴式显示设备，使用更加方便。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明一实施例中的头戴式显示设备的结构框图。
图2为本发明一实施例中的头戴式显示设备的示意图。
图3为本发明一实施例中的头戴式显示设备显示的混合画面的示意图。
图4为本发明另一实施例中的头戴式显示设备的结构框图。
图5为本发明一实施例中的显示切换方法的流程图。
图6为图5中步骤S503的子流程图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
请参阅图1，为本发明一实施例中的头戴式显示设备100的结构框图。如图1所示，所述头戴式显示设备100包括处理器10以及摄像装置20。
请一并参阅图2，为本发明一实施例中的头戴式显示设备100的示意图。所述头戴式显示设备100还包括显示装置30，所述摄像装置20设置于头戴式显示设备100的显示装置30的前方，用于拍摄头戴式显示设备100前方的影像。所述显示装置30用于提供显示画面。
所述处理器10用于响应一外景显示触发信号而获取所述摄像装置20拍摄的影像，并根据显示装置30当前显示的画面以及所述获取的影像生成一混合画面，以及控制所述显示装置30显示所述混合画面。
显然，在一些实施例中，所述摄像装置20拍摄的影像为实时变化的视频帧影像，所述显示装置30显示的画面可为静态画面，也可为多帧画面组成的动态画面。所述处理器10响应所述外景显示触发信号后，实时获取当前的帧影像(即当前摄像装置20拍摄的一帧影像)以及显示装置30当前显示的画面，并将当前获取的该帧影像与显示装置30当前显示的画面进行混合形成混合画面，并控制所述显示装置30显示当前混合成的混合画面。
从而，本申请中，所述头戴式显示设备100的显示装置30能够显示混合有摄像装置20所拍摄影像的画面，无需用户取下所述头戴式显示设备100也能看到外面的景象。而通过实时将实时拍摄的影像与当前显示的画面混合进行显示，也能实时显示外面的景象。
其中，在一些实施例中，所述处理器10根据显示装置30当前显示的画面以及所述影像生成一混合画面包括：控制将显示装置30显示画面中的背景图像用所述摄像装置20拍摄的影像代替。其中，所述显示装置30的原来显示的显示画面中的非背景图像部分进行了保留，例如工具栏、功能按键/图标、文字、图片等等非背景图像部分进行了保留。从而，所述混合画面为以所述拍摄的影像为背景的包括显示画面中的工具栏、功能按键/图标、文字、图片等非背景图像部分的画面。
例如，如图3所示，为一混合画面H1的示意图。所述混合画面H1包括作为背景的所述摄像装置20拍摄的影像Y1以及若干功能图标B1。将所述摄像装置20拍摄的影像Y1作为背景使用，可以看到外部环境的景象，同时显示装置30的原来显示的显示画面中的工具栏、功能按键/图标、文字、图片等等非背景图像部分进行了保留，不影响对原来显示内容的操作和观看。
从而，头戴式显示设备100的使用者能够对头戴式显示设备100的显示内容进行正常操作，又能够看到外部的景象，达到了既不影响当前内容操作同时可观看外部景象的效果。
在一些实施例中，所述处理器10还用于在控制所述显示装置30显示所述 混合画面之前，将显示画面中的工具栏、功能按键、文字、图片等非背景图像部分进行包括放大、缩小、半透明化等在内的至少一种处理，使得最终生成的混合画面中的工具栏、功能按键、文字、图片等非背景图像部分相比显示装置30原始显示的显示画面呈现放大、缩小、和/或半透明效果。其中，所述处理器10可在在控制所述显示装置30显示所述混合画面之前，以及在生成所述混合画面之前或生成所述混合画面之后，对显示画面中的非背景图像部分进行包括放大、缩小、半透明化等在内的至少一种处理
其中，在一些实施例中，如图1所示，所述头戴式显示设备100还可包括功能按键40，所述外景显示触发信号可为操作所述功能按键40产生。从而，用户可以在需要观察周围景象时操作所述功能按键40，使得所述功能按键40响应操作而产生所述外景显示触发信号，以触发所述处理器10生成包括周围景象的影像的混合画面。
请一并参阅图4，为头戴式显示设备100在另一实施例中的结构框图。在另一实施例中，所述头戴式显示设备100还包括传感器S1，所述传感器S1用于侦测周围是否有人，并在侦测到周围有人时产生所述外景显示触发信号。其中，所述传感器S1可为红外传感器、声音传感器等。所述传感器S1也可为所述摄像装置20，当获取到人的图像时产生所述外景显示触发信号。具体的，当所述传感器S1为红外传感器时，所述红外传感器侦测到人体辐射的热能时确定周围有人并产生所述外景显示触发信号。当所述传感器S1为声音传感器时，所述声音传感器在侦测到人的声音时确定周围有人并产生所述外景显示触发信号。当所述传感器S1为摄像装20时，所述摄像装置20获取到包括人的图像时确定周围有人并产生所述外景显示触发信号。
在其他实施例中，所述外景显示触发信号可为操作显示装置30显示的特定的菜单选项产生。
在一些实施例中，所述处理器10还响应一退出信号而控制显示装置30退出所述混合画面显示，即不显示混合画面而显示原来的显示画面。具体的，此时显示装置30不再显示包括摄像装置20获取的影像的混合画面，而仅显示头戴式显示设备100播放的内容。
其中，所述退出信号可为通过操作相应的菜单选项产生，也可为操作特定 的按键产生。在一些实施例中，所述退出信号还可为传感器50在侦测到周围无人时产生。
如图1或图2所示，所述头戴式显示设备100还可包括耳机装置50，所述耳机装置50用于输出声音信号。如图2所示，所述功能按键40可设置于耳机装置50的侧边，方便用户进行操作。
所述处理器10可为微控制器、微处理器、单片机、数字信号处理器等。所述摄像装置20可为摄像头。所述处理器10可设置于所述显示装置20中，也可以设置于耳机装置50中。
所述头戴式显示设备100可为智能头盔，智能眼镜等头戴式设备。
请参阅图5，为本发明一实施例中的显示切换方法的流程图。所述方法应用于前述的头戴式显示设备100中，执行顺序并不限于图3所示的顺序。所述方法包括步骤：
响应一外景显示触发信号获取摄像装置20拍摄的影像(S501)。在一些实施例中，所述摄像装置20拍摄的影像为实时变化的视频帧影像。所述外景显示触发信号可为操作功能按键40产生，或者可为传感器S1侦测到周围有人时产生，或者可为通过操作特定菜单选项产生。
根据显示装置30当前显示的画面以及所述获取到的影像生成一混合画面(S503)。在一些实施例中，所述步骤503包括：实时获取当前帧的影像，并将当前获取的该帧影像与显示装置30当前显示的画面进行混合形成混合画面。
控制所述显示装置30显示所述混合画面(S505)。
在一些实施例中，所述显示切换方法还包括步骤：响应一退出信号而控制显示装置30退出所述混合画面的显示(S507)。其中，在退出所述混合画面的显示后，所述显示装置显示原来的显示画面，即恢复原来的背景图像。
在一些实施例中，所述显示切换方法还包括步骤：在控制所述显示装置30显示所述混合画面之前，将显示画面中的的工具栏、功能按键、文字、图片等非背景图像部分进行包括放大、缩小、半透明化等在内的至少一种处理。
请参阅图6，为步骤S503在一实施例中的子流程图。
控制将显示装置30显示画面中的背景图像用所述摄像装置20拍摄的影像 代替(S5031)。
生成以所述拍摄的影像为背景的包括显示装置30显示的显示画面中的非背景图像部分的混合画面(S5033)。
从而，本发明的头戴式显示设备100，可根据需要显示外部景象，同时显示外部景象的同时混合显示有原来的显示画面的内容，不影响对原来显示画面的观看和操作。
以上所述是本发明的优选实施例，应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也视为本发明的保护范围。

Claims (20)

  1. 一种头戴式显示设备，包括处理器及显示装置，其特征在于，所述头戴式显示设备还包括摄像装置，所述摄像装置用于拍摄头戴式显示设备前方的影像，所述处理器用于响应一外景显示触发信号而获取所述摄像装置拍摄的影像，并根据显示装置当前显示的画面以及所述影像生成一混合画面，以及控制所述显示装置显示所述混合画面。
  2. 如权利要求1所述的头戴式显示设备，其特征在于，所述摄像装置拍摄的影像为实时变化的视频帧影像，所述处理器响应所述外景显示触发信号后，实时获取当前的帧影像，并将当前获取的该帧影像与显示装置当前显示的画面进行混合形成混合画面，并控制所述显示装置实时显示当前混合成的混合画面。
  3. 如权利要求1或2所述的头戴式显示设备，其特征在于，所述处理器控制将显示装置显示画面中的背景图像用所述摄像装置拍摄的影像代替，生成以所述拍摄的影像为背景的包括显示装置显示的显示画面中的非背景图像部分的混合画面。
  4. 如权利要求3所述的头戴式显示设备，其特征在于，所述处理器还用于在控制所述显示装置显示所述混合画面之前，将显示画面中的非背景图像部分进行包括放大、缩小、半透明化在内的至少一种处理。
  5. 如权利要求3所述的头戴式显示设备，其特征在于，所述头戴式显示设备还可包括功能按键，所述功能按键在响应操作时产生所述外景显示触发信号。
  6. 如权利要求3所述的头戴式显示设备，其特征在于，所述头戴式显示设备还包括传感器，所述传感器用于侦测周围是否有人，并在侦测到周围有人时产生所述外景显示触发信号。
  7. 如权利要求6所述的头戴式显示设备，其特征在于，所述传感器包括红外传感器、声音传感器、所述摄像装置中的至少一种，所述红外传感器侦测到人体辐射的热能时确定周围有人并产生所述外景显示触发信号，所述声音传感器在侦测到人的声音时确定周围有人并产生所述外景显示触发信号，所述摄 像装置获取到包括人的图像时确定周围有人并产生所述外景显示触发信号。
  8. 如权利要求3所述的头戴式显示设备，其特征在于，所述外景显示触发信号为操作显示装置显示的特定的菜单选项产生。
  9. 如权利要求6所述的头戴式显示设备，其特征在于，所述处理器还用于响应一退出信号而控制显示装置退出所述混合画面的显示。
  10. 如权利要求3所述的头戴式显示设备，其特征在于，所述退出信号为所述传感器侦测到周围无人时产生。
  11. 如权利要求1所述的头戴式显示设备，所述头戴式显示设备还包括耳机装置，所述耳机装置用于输出声音信号。
  12. 如权利要求1所述的头戴式显示设备，所述头戴式显示设备为智能头盔或智能眼镜。
  13. 一种显示切换方法，应用于一头戴式显示设备中，所述头戴式显示设备包括显示装置及摄像装置，其特征在于，所述方法包括步骤：
    响应一外景显示触发信号获取所述摄像装置拍摄的影像；
    根据显示装置当前显示的画面以及所述获取的影像生成一混合画面；以及
    控制所述显示装置显示所述混合画面。
  14. 如权利要求13所述的显示切换方法，其特征在于，所述步骤“响应一外景显示触发信号获取摄像装置拍摄的影像”包括：
    响应外景显示触发信号获取所述摄像装置拍摄的实时变化的视频帧影像；
    所述步骤“根据显示装置当前显示的画面以及所述获取的影像生成一混合画面”包括：
    实时获取当前的帧影像，并将当前获取的该帧影像与显示装置当前显示的画面进行混合形成混合画面。
  15. 如权利要求13或14所述的显示切换方法，其特征在于，所述步骤“根据显示装置当前显示的画面以及所述获取的影像生成一混合画面”包括：
    控制将显示装置显示的显示画面中的背景图像用所述摄像装置拍摄的影像代替；以及
    生成以所述拍摄的影像为背景的包括显示装置显示的显示画面中的非背景图像部分的混合画面。
  16. 如权利要求15所述的显示切换方法，其特征在于，在所述步骤“控制所述显示装置显示所述混合画面”之前，所述方法还包括步骤：
    将显示画面中的非背景图像部分进行包括放大、缩小、半透明化在内的至少一种处理。
  17. 如权利要求15所述的显示切换方法，其特征在于，所述方法还包括：
    响应一退出信号而控制显示装置退出所述混合画面的显示。
  18. 如权利要求15所述的显示切换方法，其特征在于，所述外景显示触发信号为传感器侦测到周围有人时产生，或者为操作功能按键产生，或者为操作特定菜单选项产生。
  19. 如权利要求17所述的显示切换方法，其特征在于，所述退出信号为传感器侦测到周围无人时产生，或者为操作特定按键产生，或者为操作特定菜单选项产生。
  20. 如权利要求17所述的显示切换方法，其特征在于，所述步骤“响应一退出信号而控制显示装置退出所述混合画面的显示”包括：
    响应所述退出信号而控制显示装置显示原来的显示画面。
PCT/CN2017/078468 2017-03-28 2017-03-28 头戴式显示设备及其显示切换方法 WO2018176235A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/078468 WO2018176235A1 (zh) 2017-03-28 2017-03-28 头戴式显示设备及其显示切换方法
CN201780004642.0A CN108496107A (zh) 2017-03-28 2017-03-28 头戴式显示设备及其显示切换方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/078468 WO2018176235A1 (zh) 2017-03-28 2017-03-28 头戴式显示设备及其显示切换方法

Publications (1)

Publication Number Publication Date
WO2018176235A1 true WO2018176235A1 (zh) 2018-10-04

Family

ID=63344786

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/078468 WO2018176235A1 (zh) 2017-03-28 2017-03-28 头戴式显示设备及其显示切换方法

Country Status (2)

Country Link
CN (1) CN108496107A (zh)
WO (1) WO2018176235A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109547773B (zh) * 2018-12-12 2021-01-08 维沃移动通信有限公司 控制方法及电子设备
DE102019101083B3 (de) * 2019-01-16 2020-07-09 Pfanner Schutzbekleidung Gmbh Vorrichtung zum Haltern eines Brillenbügelvorderteils

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030227542A1 (en) * 2001-12-20 2003-12-11 Xiang Zhang Single-computer real-time stereo augmented reality system
CN101141567A (zh) * 2006-09-08 2008-03-12 索尼株式会社 图像获取和显示设备以及图像获取和显示方法
CN101165538A (zh) * 2006-10-16 2008-04-23 索尼株式会社 成像显示设备和方法
CN103576315A (zh) * 2012-07-30 2014-02-12 联想(北京)有限公司 显示装置
CN105992986A (zh) * 2014-01-23 2016-10-05 索尼公司 图像显示装置和图像显示方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8884984B2 (en) * 2010-10-15 2014-11-11 Microsoft Corporation Fusing virtual content into real content
US8633979B2 (en) * 2010-12-29 2014-01-21 GM Global Technology Operations LLC Augmented road scene illustrator system on full windshield head-up display
US10019057B2 (en) * 2013-06-07 2018-07-10 Sony Interactive Entertainment Inc. Switching mode of operation in a head mounted display
CN105974589B (zh) * 2016-06-24 2019-08-16 上海彼茨信息科技有限公司 一种头戴式护目镜的近眼式显示器

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030227542A1 (en) * 2001-12-20 2003-12-11 Xiang Zhang Single-computer real-time stereo augmented reality system
CN101141567A (zh) * 2006-09-08 2008-03-12 索尼株式会社 图像获取和显示设备以及图像获取和显示方法
CN101165538A (zh) * 2006-10-16 2008-04-23 索尼株式会社 成像显示设备和方法
CN103576315A (zh) * 2012-07-30 2014-02-12 联想(北京)有限公司 显示装置
CN105992986A (zh) * 2014-01-23 2016-10-05 索尼公司 图像显示装置和图像显示方法

Also Published As

Publication number Publication date
CN108496107A (zh) 2018-09-04

Similar Documents

Publication Publication Date Title
US10437069B2 (en) Display control device, display control method, and computer program
US11132846B2 (en) Image generation device, image generation system, image generation method, and program for producing an augmented reality image
US20210120172A1 (en) Mobile terminal
KR20200046089A (ko) 프라이버시 스크린
US20170353788A1 (en) Directivity control system, directivity control device, abnormal sound detection system provided with either thereof and directivity control method
JP2002539742A (ja) 対話のための装置
WO2017195514A1 (ja) 画像処理装置、画像処理システム、および画像処理方法、並びにプログラム
WO2018176235A1 (zh) 头戴式显示设备及其显示切换方法
WO2018112838A1 (zh) 头戴式显示设备及其视觉辅助方法
JP5483012B2 (ja) テレビ電話機能付きテレビジョン
WO2017022769A1 (ja) ヘッドマウントディスプレイ、表示制御方法及びプログラム
WO2020105269A1 (ja) 情報処理装置、情報処理方法、及びプログラム
KR20220028951A (ko) 전자 장치 및 그 제어 방법
JPH0870398A (ja) 画像入力装置
WO2018123022A1 (ja) コンピュータプログラム、表示装置、頭部装着型表示装置、マーカ
WO2017113307A1 (zh) 头戴式显示设备及其摄像头的调节方法
US20150062354A1 (en) Method and system for capturing images with a front-facing camera
JP7403286B2 (ja) 表示装置、表示システム、表示装置の制御方法およびプログラム
WO2023182667A1 (ko) 디스플레이 장치 및 그 제어 방법
CN111158986B (zh) 一种电子设备、信息提示方法和存储介质
WO2023058451A1 (ja) 情報処理装置、情報処理方法、及びプログラム
US20240168701A1 (en) Head-mounted display control apparatus, method for controlling head-mounted display control apparatus, and non-transitory computer readable storage medium
JP2024095393A (ja) 制御装置
WO2020162035A1 (ja) 情報処理装置、情報処理方法、及びプログラム
JP6700770B2 (ja) 表示装置、その制御方法、および制御プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17902966

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17902966

Country of ref document: EP

Kind code of ref document: A1