WO2018014435A1

WO2018014435A1 - Head-mounted display and picture-in-picture display method and system therefor

Info

Publication number: WO2018014435A1
Application number: PCT/CN2016/098007
Authority: WO
Inventors: 陈江峰; 彭华军
Original assignee: 深圳纳德光学有限公司
Priority date: 2016-07-19
Filing date: 2016-09-05
Publication date: 2018-01-25
Also published as: CN106054387A

Abstract

A head-mounted display and a picture-in-picture display method and system therefor. The picture-in-picture display system comprises a video output apparatus (10), a head-mounted display mainboard (20) and a display screen (30). The head-mounted display mainboard (20) comprises a Type-c distributor module (21) electrically connected to the video output apparatus (10) via a Type-c data line, and a display screen drive module (22) electrically connected to the display screen (30). The Type-c distributor module (21) is electrically connected to the display screen drive module (22) via an HDMI cable. The Type-c distributor module (21) is also connected, via a USB data line, to an external device component at least comprising a camera (40).The system enables a user to flexibly judge and master the changing situation of the external environment during the process of watching, and at the same time, reduces the failure rate of transmitting data over a plurality of cables, thus making the head-mounted display product simpler and more aesthetic, and making the user experience better.

Description

Head mounted display and picture-in-picture display method and system thereof

Technical field

The present invention relates to the field of intelligent electronic device technology, and more particularly to a head mounted display and a picture-in-picture display method and system thereof.

Background technique

Head-mounted display is a new technology in modern display technology. The development of high-resolution micro-display technology, imaging optical design and perfection of ultra-precision manufacturing have opened up new avenues for the design of head-mounted displays, making them augmented reality. Important applications such as virtual reality and stereo display. In the head-mounted display for video viewing, the display effect and display content of the video image are very important technical links.

Among the existing head-mounted displays, a head-mounted display having functions of watching movies, games, entertainment, and the like is displayed, which displays images to the wearer's eyes in a closed visual environment, because the screen is viewed in a visually closed environment. The user cannot see the external scene during use, so when the external environment changes, especially when the user needs to respond, the user cannot detect and feedback in time.

In addition, in the existing head-mounted display, when it is required to simultaneously transmit a power signal, an HDMI data signal, and a USB data signal between the video output device and the head mounted display board, generally at least three cables, including a power line and HDMI, need to be connected. Line and USB cable to enable data communication between the video output device and the head mounted display board. Since the head-mounted display is in use, the video output portion including the video output device and the display main body portion including the head-mounted display main board are generally far apart (about 0.6-1 m), so the connection of the plurality of cables is performed. It will bring a lot of troubles to users, and there are also hidden troubles.

Summary of the invention

The technical problem to be solved by the present invention is to provide a head mounted display and a picture-in-picture display method and system thereof in view of the above-mentioned drawbacks of the prior art.

The technical solution adopted by the present invention to solve the technical problem thereof is:

A picture-in-picture display system for a head-mounted display, comprising a video output device, a head-mounted display board and a display screen; wherein the head-mounted display board comprises: a Type-c data line with the head-mounted display board a connected Type-c splitter module, and a display drive module electrically connected to the display screen, the Type-c splitter module and the display drive module being electrically connected by an HDMI cable; The -c splitter module is also connected to an external device component including at least one camera via a USB data cable.

The picture-in-picture display system of the present invention, wherein the video output device comprises:

a video playing module, configured to connect the Type-c splitter module through the Type-c data line, and connect the display driving module via the HDMI data line to drive the display screen to display a picture corresponding to the current video data;

The initialization module is configured to connect the Type-c splitter module through the Type-c data line, and initialize the camera through the USB data line;

a data acquiring module, configured to acquire, by using a USB data line, a Type-c splitter module, and a Type-c splitter module, an external image data signal collected by the camera, and determining information for obtaining whether to display a camera shooting image;

The video processing module is configured to superimpose the picture video data captured by the camera and the current picture video data by a picture-in-picture display algorithm when the determination information is YES, to obtain new video data, and display, when the determination information is no , the screen corresponding to the current video data is displayed separately.

The picture-in-picture display system of the present invention, wherein the Type-c splitter module comprises: a Type-c interface connected to the Type-c data line, a USB interface connected to the camera, and a The HDMI interface connected to the display driving module and the power output port for supplying power to the head display motherboard.

The picture-in-picture display system of the present invention, wherein the picture-in-picture display system further includes a display determination button for determining whether to perform a picture-in-picture display.

The picture-in-picture display system of the present invention, wherein the display determination button is disposed on the video output device.

The picture-in-picture display system of the present invention, wherein the display determination button is connected to the head mounted display motherboard, and the display determination button passes through the USB interface of the Type-c splitter module and the video The output device performs data transmission.

The picture-in-picture display system of the present invention, wherein the external device component further includes a sensor.

The picture-in-picture display system of the present invention, wherein the display screen driving module comprises:

An HDMI interface module is configured to connect to the Type-c splitter module to read an HDMI data signal sent by the video output device.

The invention also provides a picture-in-picture display method for a head-mounted display, which comprises the following steps:

Connect the Type-c splitter module through the Type-c data cable, and connect the display driver module via the HDMI data cable to drive the display screen to display the corresponding video data;

Connect the Type-c splitter module through the Type-c data cable and initialize the camera via the USB data cable;

Acquiring an external image data signal collected by the camera through the USB data line, a Type-c splitter module, and a Type-c splitter module;

Obtaining whether to display judgment information of the camera shooting screen;

When the determination information is YES, the screen video data captured by the camera and the current picture video data are superimposed by a picture-in-picture display algorithm to obtain new video data, and displayed;

When the determination information is no, the screen corresponding to the current video data is separately displayed.

The picture-in-picture display method of the present invention, wherein the determination information is obtained by the USB data line, the Type-c splitter module, and the Type-c splitter module.

The picture-in-picture display method of the present invention, wherein the picture taken by the camera is displayed in an upper left corner, an upper right corner, a lower left corner or a lower right corner in the current screen.

The present invention also provides a head mounted display, comprising the picture in picture display system of any of the preceding claims.

The head mounted display of the present invention, wherein the head mounted display comprises a video output portion, a display main body portion and a wearing portion; the video output device of the picture-in-picture display system is disposed in the video output portion, the head The display main board and the display screen are disposed in the display main body portion, and the external device is disposed on an outer surface of the display main body portion or disposed on the wearing portion.

The invention has the beneficial effects of: taking external picture video data by using an external camera, and connecting the video output device of the head mounted display and the head mounted display board by using a Type-c data line to pass the USB data line and the Type-c line. The module and the Type-c splitter module obtain the external image data signal collected by the camera, and then display the screen information acquired by the camera in the current screen when needed, so that the user can flexibly judge and grasp the outside during the viewing process. Environmental changes; due to the use of Type-c data cable to connect the video output device and the head-mounted display board, eliminating the trouble of communication with multiple commonly used cables (power cable, HDMI cable and USB cable), reducing multiple wires The failure rate of the cable transmission data makes the head-mounted display product more compact and beautiful, which makes the user experience better.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the prior art, the present invention will be further described in conjunction with the accompanying drawings and embodiments. For ordinary technicians, other drawings can be obtained based on these drawings without any creative work:

1 is a block diagram 1 of a picture-in-picture display system of a head mounted display in accordance with a preferred embodiment of the present invention;

2 is a block diagram 2 of a picture-in-picture display system of a head mounted display according to a preferred embodiment of the present invention;

3 is a flow chart showing a picture-in-picture display method of a head mounted display according to a preferred embodiment of the present invention;

4 is a schematic structural view of a head mounted display in accordance with a preferred embodiment of the present invention.

detailed description

The present invention will be described in detail with reference to the embodiments of the present invention. Not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any inventive effort are within the scope of the present invention.

FIG. 1 is a block diagram showing a video display device 10, a head mounted display board 20, and a display screen 30. The head mounted display board 20 includes: The Type-c splitter module 21 electrically connected to the display board 20 through the Type-c data line, and the display drive module 22 electrically connected to the display screen 30, the Type-c splitter module 21 and the display drive module 22 is electrically connected through an HDMI cable; the Type-c splitter module 21 is also connected to an external device component including at least one camera 40 via a USB data line. The solution of the embodiment captures the external picture video data by using the external camera 40, and connects the video output device 10 of the head mounted display and the head mounted display board 20 by using the Type-c data line to pass the USB data line and the Type-c line. Device The module 21 and the Type-c splitter module 21 acquire the external image data signal collected by the camera 40, and then display the screen information acquired by the camera 40 in the current screen when needed, so that the user can also flexibly judge during the viewing process. And grasping the changes of the external environment; the use of the Type-c data line to connect the video output device 10 and the head-mounted display board 20 eliminates the trouble of communication of a plurality of commonly used cables (power lines, HDMI lines, and USB lines). The failure rate of data transmission by multiple cables is reduced, making the head-mounted display product more compact and beautiful, and the user experience is better.

Further, in the above picture-in-picture display system, the Type-c splitter module 21 includes a Type-c interface connected to the Type-c data line, a USB interface connected to the camera 40, and an HDMI connected to the display drive module 22. The interface and the power supply output port for displaying the power supply of the motherboard 20. The Type-c interface is preferably a USB Type-c interface. The power supply output port is used for outputting power to the head display display board 20 for power supply. HDMI interface

Further, the picture-in-picture display system further includes a display determination button for determining whether to perform a picture-in-picture display, so that the user selects whether an external scene needs to be displayed during the video playing, without affecting the viewing process. Users can keep abreast of changes in external environmental conditions. The position and size ratio of the external scene in the current playback screen can be set according to the situation, for example, displayed in the upper left corner, the upper right corner, the lower left corner, or the lower right corner of the current playback screen.

In one embodiment, the display determination button is disposed on the video output device 10, that is, disposed on the video output portion of the head mounted display, which facilitates the video output device 10 to obtain the determination information of the display determination button.

In another embodiment, the display determination button is connected to the head mounted display board 20, and the display determination button performs data transmission with the video output device 10 via the USB interface of the Type-c splitter module 21. The judgment button to be displayed is set on the display main body portion, which is convenient for the user to operate.

In the above embodiment, the determination button may be a mechanical button or a touch button or the like.

Further, in the above picture-in-picture display system, the external device component further includes a sensor. The sensor component includes: a gesture recognition sensor, or a sensing device including a gyro sensor. A plurality of sensors transmit data to the video output device 10 via the USB interface of the Type-c splitter module 21.

Further, in the above picture-in-picture display system, the display driving module 22 includes an HDMI interface module for connecting to the Type-c splitter module 21 to read the HDMI data signal transmitted by the video output device 10. The display driving module 22 further includes: a diopter adjustment/pitch adjustment module for displaying a viewing interface of a visuosing or a slanting distance when the gaze adjustment or the pacing adjustment signal is acquired, and performing the gaze adjustment or the slanting distance adjustment a data reading module, configured to read video data to be displayed when acquiring a playback start signal for playing video; an image interface module for generating a standard timing signal corresponding to a resolution of the video data; image smoothing The filtering module is configured to perform nonlinear smoothing processing on the video data according to the standard timing signal; the determining module is configured to determine whether the video data is 3D video data or 2D video data; and the image left and right separating module is configured to use the video data as 3D video data. The 3D video data frame subjected to the nonlinear smoothing processing is divided into two parts; the image enlargement display module is configured to separately enlarge and split the two parts of the 3D video data frame, and then enlarge the two parts of the 3D video. The data frames are sent to two display screens 30 for display. It can quickly and easily complete the binocular vision and the adjustment of the pupil distance and the 3D video display of the binocular optical module of the head-mounted display, so that users with different degrees of vision and pupil distance can obtain perfect viewing effect.

Further, as shown in FIG. 2, the video output device 10 includes a video playing module 11 for connecting the Type-c splitter module 21 through a Type-c data line and connecting the display driving module 22 via an HDMI data line. To display the screen corresponding to the current video data by the display screen 30; the initialization module 12 is configured to connect the Type-c splitter module 21 through the Type-c data line, and initialize the configuration of the camera 40 via the USB data line; data acquisition The module 13 is configured to acquire the externally collected by the camera 40 through the USB data line, the Type-c splitter module 21, and the Type-c splitter module 21. The image data signal and the determination information for acquiring whether to display the image captured by the camera 40. The video processing module 14 is configured to display the picture video data captured by the camera 40 and the current picture video data by the picture-in-picture when the determination information is YES. The algorithm performs superposition processing to obtain new video data and displays it; when the judgment information is no, the screen corresponding to the current video data is separately displayed. By connecting the video output device 10 and the head mounted display board 20 by using the Type-c data line, the communication of multiple commonly used cables (power lines, HDMI lines, and USB lines) is eliminated, and the data transmission of multiple cables is reduced. The failure rate makes the head-mounted display product more compact and beautiful, which makes the user experience better.

In another embodiment of the present invention, a picture-in-picture display method for a head-mounted display is also provided. The process is as shown in FIG. 3, and includes the following steps:

Step S10, connecting the Type-c splitter module 21 through the Type-c data line, and connecting the display driving module 22 via the HDMI data line to drive the display screen 30 to display a picture corresponding to the current video data;

Step S20, connecting the Type-c splitter module 21 through the Type-c data line, and initializing the configuration of the camera 40 via the USB data line;

Step S30, acquiring an external image data signal collected by the camera 40 through the USB data line, the Type-c splitter module 21, and the Type-c splitter module 21;

Step S40: Acquire whether to display the judgment information of the photographing screen of the camera 40;

Step S50: When the determination information is YES, the screen video data captured by the camera 40 and the current picture video data are superimposed by the picture-in-picture display algorithm to obtain new video data, and displayed;

Step S60: When the determination information is no, the screen corresponding to the current video data is separately displayed.

In the above method, the external screen video data is captured by using the external camera 40, and the video output device 10 of the head mounted display and the head mounted display board 20 are connected by using the Type-c data line to pass the USB data line and the Type-c line. The module 21 and the Type-c splitter module 21 are acquired by the camera The external image data signal collected by the head 40 displays the picture information acquired by the camera 40 in the current picture when needed, so that the user can flexibly judge and grasp the external environment change during the viewing process; The data line is connected to the video output device 10 and the head mounted display board 20, which eliminates the trouble of communication of a plurality of commonly used cables (power lines, HDMI lines, and USB lines), and reduces the failure rate of data transmission by multiple cables, thereby making Head-mounted display products are more compact and beautiful, making the user experience better.

Further, in the above picture-in-picture display method, the determination information is acquired by the USB data line, the Type-c splitter module 21, and the Type-c splitter module 21.

In another embodiment of the present invention, there is also provided a head mounted display, as shown in Figure 4, comprising a picture in picture display system as in any of the preceding embodiments. The picture-in-picture display system includes: a video output device 10, a head mounted display board 20, and a display screen 30; wherein the head mounted display board 20 includes: a Type-c point electrically connected to the head mounted display board 20 via a Type-c data line. The line module 21 and the display drive module 22 electrically connected to the display screen 30, the Type-c splitter module 21 and the display drive module 22 are electrically connected by an HDMI cable; the Type-c splitter module 21 also passes The USB data cable is connected to an external device component including at least one camera 40. The solution of the embodiment captures the external picture video data by using the external camera 40, and connects the video output device 10 of the head mounted display and the head mounted display board 20 by using the Type-c data line to pass the USB data line and the Type-c line. The module module 21 and the Type-c splitter module 21 acquire the external image data signals collected by the camera 40, and then display the screen information acquired by the camera 40 in the current screen when needed, so that the user can also be flexible during the viewing process. Judging and mastering the changes of the external environment; since the Type-c data line is used to connect the video output device 10 and the head display display board 20, the communication of multiple commonly used cables (power lines, HDMI lines, and USB lines) is eliminated. It reduces the failure rate of data transmission by multiple cables, making the head-mounted display products more compact and beautiful, and making the user experience better.

Further, as shown in FIG. 4, the head mounted display includes a video output unit (not shown), a display main body unit 200, and a wearing unit 100; the video output device of the picture-in-picture display system is disposed in the video output unit, and the head mounted display The main board and the display screen are disposed in the display main body portion 200, and the external device (camera 40) is disposed on the outer surface of the display main body portion 200 or on the wearing portion 100.

It is to be understood that those skilled in the art will be able to make modifications and changes in accordance with the above description, and all such modifications and variations are intended to be included within the scope of the appended claims.

Claims

A picture-in-picture display system with a head-mounted display, comprising a video output device, a head-mounted display board and a display screen; wherein the head-mounted display board comprises: a Type-c data line with the head-mounted display board An electrically connected Type-c splitter module, and a display drive module electrically connected to the display screen, the Type-c splitter module and the display drive module being electrically connected by an HDMI cable; The Type-c splitter module is also connected to an external device component including at least one camera via a USB data cable.
The picture-in-picture display system of claim 1 wherein said video output device comprises:

a video playing module, configured to connect the Type-c splitter module through the Type-c data line, and connect the display driving module via the HDMI data line to drive the display screen to display a picture corresponding to the current video data;

The initialization module is configured to connect the Type-c splitter module through the Type-c data line, and initialize the camera through the USB data line;

a data acquiring module, configured to acquire, by using a USB data line, a Type-c splitter module, and a Type-c splitter module, an external image data signal collected by the camera, and determining information for obtaining whether to display a camera shooting image;

The video processing module is configured to superimpose the picture video data captured by the camera and the current picture video data by a picture-in-picture display algorithm when the determination information is YES, to obtain new video data, and display, when the determination information is no , the screen corresponding to the current video data is displayed separately.
The picture-in-picture display system according to claim 1, wherein the Type-c splitter module comprises: a Type-c interface connected to the Type-c data line, connected to the camera The connected USB interface, the HDMI interface connected to the display driving module, and the power output port for powering the display motherboard.
The picture-in-picture display system according to claim 3, wherein said picture-in-picture display system further comprises a display determination button for determining whether or not to perform a picture-in-picture display.
A picture-in-picture display system according to claim 4, wherein said display determination button is provided on said video output device.
The picture-in-picture display system according to claim 4, wherein the display determination button is connected to the head mounted display board, and the display determination button passes through a USB interface of the Type-c splitter module. Data transmission is performed with the video output device.
The picture-in-picture display system of claim 1 wherein said external device component further comprises a sensor.
The picture-in-picture display system according to claim 1, wherein the display screen driving module comprises:

An HDMI interface module is configured to connect to the Type-c splitter module to read an HDMI data signal sent by the video output device.
A picture-in-picture display method for a head mounted display, comprising the steps of:

Connect the Type-c splitter module through the Type-c data cable, and connect the display driver module via the HDMI data cable to drive the display screen to display the corresponding video data;

Connect the Type-c splitter module through the Type-c data cable and initialize the camera via the USB data cable;

Acquiring an external image data signal collected by the camera through the USB data line, a Type-c splitter module, and a Type-c splitter module;

Obtaining whether to display judgment information of the camera shooting screen;

When the determination information is YES, the screen video data captured by the camera and the current picture video data are superimposed by a picture-in-picture display algorithm to obtain new video data, and displayed;

When the determination information is no, the screen corresponding to the current video data is separately displayed.
The picture-in-picture display method according to claim 9, wherein the determination information is acquired by the USB data line, the Type-c splitter module, and the Type-c splitter module.
The picture-in-picture display method according to claim 9, wherein the picture taken by the camera is displayed in an upper left corner, an upper right corner, a lower left corner or a lower right corner in the current screen.
A head mounted display comprising the picture in picture display system of any of claims 1-8.
The head mounted display according to claim 12, wherein the head mounted display comprises a video output portion, a display body portion and a wearing portion; and the video output device of the picture-in-picture display system is disposed in the video output portion The head mounted display main board and the display screen are disposed in the display main body portion, and the external device is disposed on an outer surface of the display main body portion or disposed on the wearing portion.