WO2017096566A1

WO2017096566A1 - Display method, apparatus and system

Info

Publication number: WO2017096566A1
Application number: PCT/CN2015/096868
Authority: WO
Inventors: 井皓; 魏卓; 郜文美; 秦超
Original assignee: 华为技术有限公司
Priority date: 2015-12-09
Filing date: 2015-12-09
Publication date: 2017-06-15
Also published as: CN108140080B; CN108140080A

Abstract

Provided are a display method, apparatus and system. The method is applicable to a portable electronic device comprising a display screen. The portable electronic device maintains a wireless connection with a head-mounted display. The method comprises: determining that content to be displayed on the display screen comprises private information; sending to the head-mounted display a message carrying the private information and position information of the private information, wherein the message is used for triggering the head-mounted display to present, at least on the basis of the position information of the private information, the private information on the position of the private information on the display screen of the portable electronic device; and displaying the content to be displayed on the display screen in the manner of not displaying the private information.

Description

Display method, device and system

Technical field

The present invention relates to the field of communications technologies, and in particular, to a display method, apparatus, and system.

Background technique

With the continuous development of communication technology, the application of portable electronic devices has become more and more widespread. Many times, users often read, chat, or work through portable electronic devices in public.

Generally, when a user reads, chats, or an office in a public place through a portable electronic device, since there are many people in a public place, if the user views the relatively hidden content at this time, such as the user's private information, the content may be It will be seen by people around, causing the user's private information to leak.

Summary of the invention

The present invention provides a display method, apparatus and system capable of protecting a user's private information from being leaked.

In order to achieve the above object, embodiments of the present invention adopt the following technical solutions:

A first aspect provides a method of display for a portable electronic device including a display screen, the portable electronic device maintaining a wireless connection with a head mounted visual device, the method comprising:

Determining that the content to be displayed on the display screen contains private information;

Transmitting, to the head mounted visual device, a message carrying location information of the private information and the private information, the message being used to trigger the head mounted visual device to be based at least on location information of the private information Presenting the private information on a location of the private information on the display screen;

The content to be displayed is displayed on the display screen in such a manner that the private information is not displayed.

The method of display provided herein, when the portable electronic device determines that the display is to be displayed When the content includes private information, the portable electronic device can transmit the private information and the location information of the private information to the head-mounted visual device, and the private device on the display screen of the portable electronic device by the head-mounted visual device The private information is presented in the location of the information, and the portable electronic device displays the content to be displayed in a manner that does not display the private information, so that the portable electronic device can be prevented from directly displaying the private information on its display screen, thereby preventing surrounding people from seeing the information. Private information, in turn, protects the user's private information from disclosure.

Optionally, the determining includes the private information in the content to be displayed on the display screen, including:

Determining that the portable electronic device is in a private mode; or

Determining that the content to be displayed includes a preset application or a preset application interface; or

Determining that the content to be displayed contains specific content.

Wherein, the private mode may be a mode defined in advance in the portable electronic device, for example, in the private mode, the portable electronic device may automatically identify the private information in the content to be displayed, and the private information is in accordance with the first The process of the aspect is handled.

The preset application or the preset application interface (for example, a display interface in the A application or the A application) may be an application or an application interface that needs to be set as a private information processing in advance in the portable electronic device, when the portable electronic device determines to be When the display content is an application or an application interface, the portable electronic device can process the application or the application interface according to the process of the first aspect above.

The specific content may be a picture, a text, or the like including sensitive content (such as content that is not suitable for children to watch, etc.) set in the portable electronic device in advance; or may be content related to the user's privately set in the portable electronic device in advance (for example, The user's bank account number, password, friend's name or friend's phone number, etc.) are not specifically limited in this article.

In the method provided by the present disclosure, the above three methods are provided to determine that the content to be displayed on the display screen contains private information, and the display method can be applied to more application scenarios, that is, the application range of the display method. More extensive.

Optionally, the displaying on the display screen does not display the private information Showing the content to be displayed, including:

Displaying the content to be displayed in a manner of hiding the private information on the display screen; or

The content to be displayed is displayed on the display screen in such a manner that the preset content covers the private information.

The preset content may be garbled content, blank content, image or cipher text, and the like, which is different from the private content, and is not specifically limited herein.

In the display method provided herein, the private information may not be displayed by directly hiding the private information or by covering the private information with the preset content, so that the private information of the user is not directly displayed on the display screen of the portable electronic device. Therefore, it is ensured that the private information of the user is not leaked, and at the same time, the display method of the present invention can be made more flexible by not displaying the private information by the above two methods.

Optionally, after the displaying the content to be displayed in the manner that the private information is not displayed on the display screen, the method further includes:

Detecting an operation acting on the private information;

Responding to the operation when the line of sight of the user wearing the head mounted visual device falls on the display screen;

The operation is not responded when the line of sight focus of the user wearing the head mounted visual device does not fall on the display screen.

When the portable electronic device detects an operation of the user acting on the private information, if the line of sight of the user wearing the head mounted visual device falls on the display screen of the portable electronic device, the portable electronic device can respond to the operation; thus, even if The portable electronic device does not display private information. When the user looks at the display screen of the portable electronic device, it can also normally respond to the user's operation of the private information, thereby not affecting the normal use of the portable electronic device by the user. When the portable electronic device detects an operation of the user acting on the private information, if the line of sight focus of the user wearing the head mounted video device does not fall on the display screen of the portable electronic device, the portable electronic device may not respond to the operation; When the user does not look at the display screen of the portable electronic device, it can be avoided that if the other user operates on the private information, the portable electronic device can still normally respond to the operation problem, from And to ensure that the user's private information is not leaked.

Further, the method further includes: if the portable electronic device responds to the operation of the private information by the user, if the response information includes the private information in the response interface, the method further includes:

Transmitting, to the head mounted visual device, a message carrying location information of the response interface and the response interface, the message being used to trigger the headset to be based on at least location information of the response interface Presenting the response interface at a location of the response interface on the display screen;

The response interface is not displayed.

In this way, after the portable electronic device responds to the user's operation on the private information, if the response interface in response to the operation still contains private information, the portable electronic device can continue to send the response interface to the head-mounted visual device. Wearing a visual device, the portable electronic device still does not display the response interface, thereby protecting the user's private information more comprehensively and completely.

Optionally, the private information includes a screen display image, and the screen display image is a screen display image of an area where the private information is located on the display screen; or

The private information includes: content of the private information, a style of the private information, and a font, a font size, and a color of the private information.

When the portable electronic device determines that the content to be displayed includes private information, the portable electronic device may directly send the private information screenshot (for example, the above-mentioned screen display image) to the head-mounted visual device, and directly display by the head-mounted visual device. The screenshot, such a head-mounted visual device can display the private information quickly and accurately; or the portable electronic device can send the content of the private information, the style of the private information, the font, font size and color of the private information to A head-mounted visual device that displays the private information based on the information by the head-mounted visual device, so that the effect of the head-mounted visual device is more realistic, thereby ensuring display of the private information by the head-mounted visual device. effect.

A second aspect provides a method of display for a head mounted visual device including a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, the method comprising:

Receiving, by the portable electronic device, a message carrying location information of private information and the private information;

Acquiring spatial information of the portable electronic device, the spatial information being used to indicate a spatial location of the portable electronic device relative to the head mounted visual device;

The private information is presented at the location of the private information on the display screen based on the location information of the private information and the spatial information.

The display method provided herein, when the head-mounted visual device receives the private information sent by the portable electronic device and the location information of the private information, the head-mounted visual device can acquire the spatial information of the portable electronic device, and according to the The location information of the private information and the spatial information, the private information is presented on the display of the private information on the display screen of the head-mounted visual device, so that the user can only see the private information through the head-mounted visual device The portable electronic device is prevented from directly displaying the private information on its display screen, thereby preventing the surrounding person from seeing the private information, thereby protecting the user's private information from being leaked.

Further, if the portable electronic device responds to the detected action on the private information, and the response to the operation response interface includes the private information, the method further includes:

Receiving, by the portable electronic device, a message carrying location information of the response interface and the response interface;

And responsive to the location information of the response interface and the spatial information of the portable electronic device, the response interface is presented on the display screen.

For the technical effects of the optional mode, refer to the description of the technical effects of the optional mode corresponding to the optional mode in the foregoing first aspect, and details are not described herein again.

A third aspect provides a method of display for a portable electronic device including a display screen, the portable electronic device maintaining a wireless connection with a head mounted visual device, the method comprising:

Transmitting, to the head mounted visual device, a message carrying the location information of the content to be displayed and the content to be displayed, the message being used to trigger the head mounted visual device Displaying the content to be displayed on the display screen based on at least location information of the content to be displayed;

Triggering the display screen to enter a non-lock screen state.

The off-screen state of the non-lock screen refers to that the display screen of the portable electronic device is completely extinguished or the brightness is lowered, but the display screen can normally respond to the touch operation or the floating operation of the user. The normal touch operation or the floating operation of the user can be understood as: sensing the touch operation or the floating operation of the user, and identifying and processing the touch operation or the floating operation.

The display method provided herein, when the portable electronic device determines that the content to be displayed on the display screen includes private information, the portable electronic device may send the content to be displayed and the location information of the content to be displayed to the head mounted visual device. Displaying the content to be displayed on the display of the content to be displayed on the display screen of the portable electronic device by the head-mounted visual device, and the portable electronic device enters a screen-out state of the non-lock screen, so that the portable electronic device can be avoided in the The content to be displayed is displayed on the display screen, thereby preventing surrounding people from seeing the private information contained in the content to be displayed, thereby protecting the user's private information from being leaked.

Determining that the portable electronic device is in a private mode; or

Determining that the content to be displayed contains specific content.

For the description of the above-mentioned private mode, the preset application or the preset application interface, the specific content, and the technical effects brought by the optional mode, refer to the related description in the corresponding alternative manner in the above first aspect, where No longer.

Optionally, after the triggering the display screen to enter a non-lock screen state, the method further includes:

Detecting an operation acting on the private information;

Keeping the display screen in a non-lock screen state.

For a technical effect of the portable electronic device responding normally or not responding to the user's operation on the private information, refer to the related description in the corresponding alternative manner in the above first aspect, and details are not described herein again.

A fourth aspect provides a method of display for a head mounted visual device including a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, the method comprising:

Receiving, by the portable electronic device, a message carrying location information of the to-be-displayed content and the content to be displayed;

And displaying the to-be-displayed content on the display screen according to the location information of the content to be displayed and the spatial information.

The display method provided herein, when the head mounted visual device receives the content to be displayed and the location information of the content to be displayed sent by the portable electronic device, the head mounted visual device can acquire spatial information of the portable electronic device, and Determining, according to the location information of the content to be displayed and the spatial information, the content to be displayed on the display screen of the head-mounted visual device, so that the user can only pass the head-mounted visual device Seeing the content to be displayed, and avoiding the portable electronic device displaying the content to be displayed on its display screen, thereby preventing surrounding people from seeing the private information in the content to be displayed. In turn, the user's private information can be protected from being leaked.

For the technical effects of the optional mode, refer to the description of the technical effects of the optional mode corresponding to the optional mode in the foregoing third aspect, and details are not described herein again.

The spatial information of the portable electronic device in the above second and fourth aspects includes information such as the distance, direction and angle of the display screen of the portable electronic device relative to the head mounted visual device. Wherein the distance is the vertical distance of the portable electronic device relative to the head mounted visual device; the direction is the spatial orientation of the portable electronic device relative to the head mounted visual device; the angle is the angle of the portable electronic device itself relative to the horizontal plane .

When displaying the private information or the content to be displayed, the head-mounted visual device can more accurately display the private information or the content to be displayed on the display screen of the portable electronic device by combining the private information or the location information of the content to be displayed and the spatial information. The corresponding position on the top, so that the effect of the presentation is more realistic.

A fifth aspect provides a portable electronic device including a display screen, the portable electronic device maintaining a wireless connection with a head mounted visual device, the portable electronic device further comprising Various functional modules of the method described in various alternative manners of the first aspect, the functional modules being performed on the portable electronic device in order to perform the methods described in the first aspect and the various alternative manners of the first aspect Logical division.

The related description of the fifth aspect and the technical effects thereof can be referred to the related description in the above first aspect and various alternative manners, and details are not described herein again.

A sixth aspect provides a head mounted visual device, the head mounted visual device including a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, The head mounted visual device further includes various functional modules for performing the methods of the second aspect and the various alternatives of the second aspect, the functional modules are for performing the second and second aspects described above. The method described in various alternative manners, while logically dividing the head mounted visual device.

The related description of the sixth aspect and the technical effects thereof can be referred to the related description in the second aspect and its various alternative manners, and details are not described herein again.

A seventh aspect provides a portable electronic device including a display screen, the portable electronic device maintaining a wireless connection with a head mounted visual device, the portable electronic device further comprising Various functional modules of the method described in various alternative manners of the third aspect, the functional modules being performed on the portable electronic device in order to perform the methods described in the various aspects of the third aspect and the third aspect above Logical division.

The related description of the seventh aspect and the technical effects thereof can be referred to the related description in the above third aspect and various alternative manners, and details are not described herein again.

An eighth aspect provides a head mounted visual device, the head mounted visual device including a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, the head mounted visual device further Included are various functional modules for performing the methods of the fourth and fourth alternative aspects described above, which are for performing the various alternatives of the fourth and fourth aspects above Method, while logically dividing the head-mounted visual device.

The related description of the eighth aspect and the technical effects thereof can be referred to the related description in the above fourth aspect and various alternative manners, and details are not described herein again.

A ninth aspect provides a portable electronic device, the portable electronic device comprising:

One or more processors, memories, bus systems, and interface circuits, the one or more processors, the memory, and the interface circuits being coupled by the bus system;

Storing, in the memory, computer instructions, when the one or more processors execute the computer instructions, the portable electronic device performs the display according to the first aspect or any one of the optional aspects of the first aspect Methods.

A tenth aspect provides a computer readable storage medium having computer instructions stored therein, the portable electronic device performing the first aspect described above when a processor in the portable electronic device executes the computer instruction Or the method of display described in any of the alternative aspects of the first aspect.

An eleventh aspect provides a head mounted visual device, the head mounted visual device comprising:

Storing, in the memory, computer instructions, when the one or more processors execute the computer instructions, the head mounted visual device performs any of the second aspect or the second aspect of the second aspect The method of display described.

A twelfth aspect provides a computer readable storage medium, wherein the computer readable storage medium stores computer instructions, when the processor in the head mounted visual device executes the computer instruction, the head mounted The method of displaying the apparatus described in the second aspect or the second aspect of the second aspect.

A thirteenth aspect provides a portable electronic device, the portable electronic device comprising:

Storing, in the memory, computer instructions, when the one or more processors execute the computer instructions, the portable electronic device performs the display according to any one of the above third aspect or the third aspect Methods.

A fourteenth aspect provides a computer readable storage medium having computer instructions stored therein, the portable electronic device executing the third when the processor in the portable electronic device executes the computer instruction Aspect or method of display as described in any of the alternative aspects of the third aspect.

A fifteenth aspect provides a head mounted visual device, the head mounted visual device package include:

Storing, in the memory, computer instructions, when the one or more processors execute the computer instructions, the head mounted visual device performs any of the above fourth or fourth alternatives The method of display described.

A sixteenth aspect provides a computer readable storage medium, wherein the computer readable storage medium stores computer instructions, when the processor in the head mounted visual device executes the computer instruction, the head mounted The method of displaying the apparatus described in any of the above fourth aspect or the fourth aspect is performed by the device.

A seventeenth aspect provides a system for displaying, the system comprising:

The portable electronic device of the above ninth aspect, and the head mounted visual device of the eleventh aspect; or

The portable electronic device of the above-described thirteenth aspect, and the head mounted visual device of the fifteenth aspect.

In the above portable electronic device, head-mounted visual device, and display system, when the portable electronic device determines that the content to be displayed contains private information, the portable electronic device can transmit the private information to the head-mounted visual device for presentation. The portable electronic device does not display the private information, thereby preventing the surrounding people from seeing the private information, thereby protecting the user's private information from being leaked.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a number of embodiments of the present invention, and other figures may be obtained from those of ordinary skill in the art in view of these drawings.

FIG. 1 is a schematic structural diagram of a system according to an embodiment of the present disclosure;

2 is a schematic diagram 1 of a display method according to an embodiment of the present invention;

FIG. 3 is a diagram showing the presentation of private information by a head-mounted visual device according to an embodiment of the present invention; intention;

4 is a second schematic diagram of a display method according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a line of sight focus of a user according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram 3 of a display method according to an embodiment of the present disclosure;

FIG. 7 is a schematic diagram 4 of a display method according to an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a head-mounted visual device according to an embodiment of the present invention displaying a letter in a virtual keyboard in a disordered order;

FIG. 9 is a schematic diagram 1 of another display method according to an embodiment of the present disclosure;

FIG. 10 is a second schematic diagram of another display method according to an embodiment of the present disclosure;

FIG. 11 is a third schematic diagram of another display method according to an embodiment of the present disclosure;

FIG. 12 is a schematic diagram 4 of another display method according to an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram 1 of a portable electronic device according to an embodiment of the present invention; FIG.

FIG. 14 is a schematic structural diagram 2 of a portable electronic device according to an embodiment of the present disclosure;

FIG. 15 is a schematic structural diagram of a head-mounted visual device according to an embodiment of the present invention;

FIG. 16 is a schematic structural diagram 1 of another portable electronic device according to an embodiment of the present disclosure;

FIG. 17 is a second schematic structural diagram of another portable electronic device according to an embodiment of the present disclosure;

FIG. 18 is a schematic structural diagram of another head-mounted visual device according to an embodiment of the present invention;

FIG. 19 is a schematic diagram of hardware of a portable electronic device according to an embodiment of the present invention;

FIG. 20 is a schematic diagram of hardware of a head-mounted visual device according to an embodiment of the present invention;

FIG. 21 is a schematic diagram of hardware of another portable electronic device according to an embodiment of the present invention;

FIG. 22 is a schematic diagram of hardware of another head-mounted visual device according to an embodiment of the present invention.

detailed description

The terms "first" and "second" and the like in the description of the present invention and the drawings are used to distinguish different objects, and are not intended to describe a specific order of the objects. For example, the first message and the second message, etc., are used to distinguish different messages, rather than to describe the characteristic order of the messages.

In the description of the present invention, the meaning of "a plurality" means two or more unless otherwise indicated. For example, multiple processors refer to two or more processors.

Furthermore, the terms "comprises" and "comprising" and variations of the invention, as used in the description of the invention, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally includes other steps or units not listed, or alternatively Other steps or units inherent to these processes, methods, products or devices are included.

In the following description, for purposes of illustration and description However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known devices, circuits, and methods are omitted so as not to obscure the description of the invention.

The technical solutions in the embodiments of the present invention are described in detail below with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments.

For a clearer understanding of the various embodiments of the present invention, and to facilitate the reader's reading, the technical terms in the description, the claims, and the drawings of the present invention are now defined.

Augmented reality (English: augmented reality, abbreviated: AR): A technique for calculating the position and angle of a camera image in real time and adding corresponding images. The goal is to put the virtual world on the screen and interact with it in the real world.

Eye tracking: When the person's eyes look in different directions, the eyes will have subtle changes. These changes will produce extractable features. The tracking device can extract these features through image capture or scanning to track eye changes in real time. , to achieve eye tracking, that is, line of sight focus tracking. The main modules that implement the eye tracking function include an infrared module and an image acquisition module. In terms of accuracy, the infrared projection method has a relatively large advantage, and can be accurate to within 1 cm on a 30-inch screen, supplemented by blink recognition, gaze recognition, etc., which can replace the mouse and touchpad to some extent. , carry out some limited operations. In addition, the image acquisition module, such as a camera on a computer or mobile phone, can also achieve eye tracking with the support of software. For different image acquisition modules, there are also differences in accuracy, speed and stability.

Private mode: a mode defined in advance in a portable electronic device, for example, in the private mode, the portable electronic device can automatically recognize private information in the content to be displayed, and display the private information according to the display provided by the present invention. The method flow is processed; or in the private mode, the portable electronic device can treat all of its displayed content as private information and process the private information in accordance with the displayed method flow provided by the present invention.

The screen-out state of the non-lock screen means that the display screen of the portable electronic device is completely extinguished or the brightness is lowered, but the display screen can normally respond to the user's touch operation or floating operation. The touch operation or the floating operation of the normal response user can be understood as: sensing the touch operation or the floating operation of the user, and identifying and processing the touch operation or the floating operation.

Since a user views a relatively hidden content, such as a user's private information, through a portable electronic device in a public place, usually the content may be seen by a surrounding person, and thus the user's private information may be leaked.

Based on the above problem, an embodiment of the present invention provides a display method, apparatus, and system, which can prevent a user's private information from being seen by a surrounding person, thereby protecting the user's private information from being leaked.

As shown in FIG. 1 , an embodiment of the present invention provides a display system, where the system includes Portable electronic device 1 and head mounted visual device 2. Wherein, the portable electronic device 1 and the head mounted visual device 2 are two devices used by the same user, and a wireless connection has been established between the portable electronic device 1 and the head mounted visual device 2. A wireless connection has been established between the portable electronic device 1 and the head mounted visual device 2. It can be understood that the security verification has been completed between the portable electronic device 1 and the head mounted visual device 2 (ie, the two are mutually verified and matched). Process), and data transmission between the portable electronic device 1 and the head mounted visual device 2 is possible.

Optionally, in the embodiment of the present invention, the manner of wireless connection between the portable electronic device 1 and the head mounted visual device 2 includes, but is not limited to, a Bluetooth connection, an infrared connection, and a wireless fidelity (English: wireless-fidelity, abbreviation) : Wi-Fi) connection, mobile hotspot connection, and near field communication (English: near field communication, abbreviation: NFC) connection.

Optionally, in the embodiment of the present invention, the portable electronic device may be an electronic device such as a smart phone or a portable computer; wherein the portable computer may be a tablet computer (English: portable android device, abbreviated as: PAD), etc., which is not specifically limited in the present invention. .

Head-mounted display (English: head-mounted display, abbreviated: HMD) is a type of head-mounted virtual display, also known as a glasses-type display or a portable theater.

In an embodiment of the invention, the portable electronic device includes a display screen and has a private mode that can be implemented by presetting an operational option in the portable electronic device. Specifically, the opening or closing of the private mode can be implemented by the following two possible implementation manners:

In one possible implementation, the user can manually turn the private mode on or off.

In another possible implementation, when the portable electronic device detects that the head mounted visual device establishes a wireless connection with the portable electronic device, the portable electronic device automatically turns on the private mode, and detects that the portable electronic device establishes a wireless connection with the portable electronic device. The private mode is automatically turned off when the wireless connection is disconnected between the head mounted visual devices.

In the embodiment of the present invention, the head-mounted visual device includes a display screen, and the head-mounted visual device further has an augmented reality function. Augmented reality can be on portable electronic devices Rendering can also be presented on a head-mounted visual device, which is better compared to the latter.

Optionally, the head-mounted visual device can also have an eye tracking function, so that the head-mounted visual device can track the change of the user's eyeball, thereby more accurately capturing the user's portable electronic device with which the wireless connection has been established. Operation, and then more accurately use the AR function to achieve superimposed display.

In the embodiment of the present invention, when the user operates the portable electronic device, the head-mounted visual device can also detect the position of the user's finger in real time, when the user's finger is in the superimposed display mode of the head-mounted visual device. The head-mounted visual device does not display the picture on the user's finger, but still displays the picture under the user's finger. For the area of the picture that is blocked by the user's finger, the head-mounted visual device does not display. In this way, the spatial layering of the head-mounted visual device superimposed display is stronger, so that the display effect is also more realistic (ie, in reality, when the user directly operates the portable electronic device, the display on the display screen of the portable electronic device The user in the content that is blocked by the user's finger is not visible.)

Based on the system shown in FIG. 1 above, as shown in FIG. 2, an embodiment of the present invention provides a display method, where the method includes:

S101. The portable electronic device determines that the content to be displayed on the display screen includes private information.

The private information includes a screen display image (specifically, can be obtained by a screen shot), and the screen display image is a screen display image of the area where the private information is located on the display screen of the portable electronic device. Alternatively, the private information includes: the content of the private information, the style of the private information, and the font, font size, and color of the private information. Exemplarily, assuming that the content of the private information is "XXXXX", the private information may include a screen display image of an area where "XXXXX" is located on the display screen of the portable electronic device; or the private information may also include "XXXXX" , the style of "XXXXX" and the font, font size and color of "XXXXX".

In the embodiment of the present invention, the portable electronic device can save the screenshot by displaying the private information (for example, the above-mentioned screen display image) to the head-mounted visual device for superimposed display. The headset-type visual device displays the private information quickly and accurately; or the portable electronic device transmits the content of the private information, the style of the private information, the font, font size and color of the private information to the headset The superimposed display of the device can make the superimposed display effect of the head-mounted visual device more realistic, thereby ensuring the display effect of the head-mounted visual device on the private information.

A person skilled in the art can understand that the superimposed display of the head-mounted visual device in the embodiment of the present invention can be implemented by the AR function. For the description of the AR function, refer to the definition of the AR before the foregoing embodiment. Narration.

It should be noted that, in the embodiment of the present invention, the contents of the private information and the private information may indicate in some descriptions that the two may be interchanged in some descriptions. For example, when the content of the private information is "XXXXX", it can also be understood that the private information is "XXXXX".

Optionally, in S101, the method for the portable electronic device to determine that the content to be displayed on the display screen includes private information may be one of the following:

(1) The portable electronic device determines that it is in a private mode.

(2) The portable electronic device determines that the content to be displayed includes a preset application or a preset application interface.

(3) The portable electronic device determines that the content to be displayed contains specific content.

For the description of the private mode in the above (1), refer to the definition of the private mode before the foregoing embodiment, and details are not described herein again.

The preset application or the preset application interface (for example, one of the A application or the A application) in the above (2) may be an application or an application interface that needs to be set as a private information processing in advance in the portable electronic device. When the portable electronic device determines that the content to be displayed is an application or an application interface, the portable electronic device may determine that the content to be displayed contains private information.

The specific content in the above (3) may be a picture, a text, or the like including sensitive content (for example, content that is not suitable for children to watch, etc.) set in the portable electronic device in advance; or may be a user involved in the portable electronic device in advance. Private content (such as a user's bank account number, password, friend's name, or friend's phone number, etc.), the present invention does not Be specifically limited. When the portable electronic device determines that the specific content is included in the content to be displayed, the portable electronic device may determine that the content to be displayed contains private information.

In the display method provided by the embodiment of the present invention, determining that the content to be displayed on the display screen includes private information by using the foregoing three manners, the display method may be applied to more application scenarios, that is, the method of the display is A wider range of applications.

S102. The portable electronic device sends a message carrying the private information and location information of the private information to the head mounted visual device.

The message is used to trigger the head mounted visual device to present the private information on the location of the private information on the display screen of the portable electronic device based on at least the location information of the private information. The location information of the private information may be relative location information of the private information on the display screen of the portable electronic device. Specifically, the location information of the private information may be represented by its coordinates on the display screen of the portable electronic device.

S103. The portable electronic device displays the content to be displayed on the display screen in a manner that does not display the private information.

Optionally, in S103, the method for the portable electronic device to display the content to be displayed in a manner that does not display the private information on the display screen thereof may be one of the following:

(Q1) The portable electronic device displays the content to be displayed on its display screen in a manner that hides the private information.

(Q2) The portable electronic device displays the content to be displayed in a manner that the preset content covers the private information on its display screen.

In the above (Q1), the portable electronic device can hide the private information in the content to be displayed, and normally display other information (also referred to as non-private information) other than the private information in the content to be displayed, so as to ensure non-private information. normal display. The specific hidden mode can be implemented by software control, and the software control method is related to the operating system of the portable electronic device, that is, different operating systems have different software control methods. For example, assuming that the portable electronic device has an Android operating system, when the portable electronic device displays the content to be displayed, the display layer may not be created at the location of the private information, so that the portable electronic device will not be able to display the private information.

In the above (Q2), the preset content may be garbled content, blank content, Any content different from private information, such as an image or a ciphertext, is not specifically limited in the present invention. For example, if the portable electronic device has an Android operating system, the portable electronic device can load the preset content on the display layer of the location where the private information is located when the content to be displayed is displayed, so that the portable electronic device will replace the preset content. Private information is displayed.

In the display method provided by the embodiment of the present invention, through the above (Q1) and (Q2) modes, it is ensured that the user's private information is not directly displayed on the display screen of the portable electronic device, thereby ensuring that the user's private information is not It is leaked, and at the same time, the display method of the present invention can be made more flexible by implementing the above-mentioned (Q1) and (Q2) methods without displaying private information.

S104. The head-mounted visual device receives a message sent by the portable electronic device that carries the private information and the location information of the private information.

S105. The head-mounted visual device acquires spatial information of the portable electronic device.

In an embodiment of the invention, the spatial information of the portable electronic device is used to indicate the spatial location of the portable electronic device relative to the head mounted visual device. The spatial information of the portable electronic device includes information such as the distance, direction and angle of the display screen of the portable electronic device relative to the head mounted visual device. Wherein the distance is the vertical distance of the portable electronic device relative to the head mounted visual device; the direction is the spatial orientation of the portable electronic device relative to the head mounted visual device (specifically, the angle between A and B can be used Indicates that A is the connection between the portable electronic device and the head mounted visual device, B is the vertical line of the head mounted visual device, and A and B are lines in the same plane); the angle is portable electronic The angle of the device itself relative to the horizontal plane (specifically, the angle of the portable electronic device relative to the horizontal plane).

S106. The head-mounted visual device presents the private information to the location of the private information on the display screen according to the location information of the private information and the spatial information.

In the embodiment of the present invention, when displaying the private information, the head-mounted visual device can more accurately display the private information on the corresponding position on the display screen of the portable electronic device by combining the location information of the private information and the spatial information. Thereby making the effect of the presentation more realistic.

Specifically, the head mounted visual device can map the portable electronic device to the coordinate system of the head mounted visual device according to the spatial state information. That is, the head-mounted visual device determines the state of the display screen of the portable electronic device in the coordinate system of the head-mounted visual device according to the spatial state information, for example, the head-mounted visual device determines the portable electronic device. The area of the display screen in the coordinate system of the head-mounted visual device, etc., and then the head-mounted visual device presents the private information to the display of the portable electronic device according to the location information of the private information received in S104. Corresponding position on the screen (specifically, the head-mounted visual device maps the location information of the private information into the coordinate system of the head-mounted visual device, and then the head-mounted visual device presents the same in its coordinate system private information).

It should be noted that, after the head-mounted visual device determines the state of the display screen of the portable electronic device in the coordinate system of the head-mounted visual device according to the spatial state information, the head-mounted visual device is The state in which the private information to be presented is in the coordinate system of the head-mounted visual device can be determined. For example, the head-mounted visual device can determine the size of the private information to be presented in the coordinate system of the head-mounted visual device according to the distance in the spatial state information; according to the direction in the spatial state information, the private person to be presented can be determined. The position of the information in the coordinate system of the head-mounted visual device; based on the angle in the spatial state information, the shape of the area in which the private information to be presented is located in the coordinate system of the head-mounted visual device can be determined (eg, in a portable When the electronic device itself has a certain inclination angle with respect to the horizontal plane, the shape of the area where the private information is located may be deformed, etc.).

According to the display method provided by the embodiment of the present invention, when the portable electronic device determines that the content to be displayed on the display screen contains private information, the portable electronic device may transmit the private information and the location information of the private information to the head mounted visual device. Displaying the private information by the head-mounted visual device at the location of the private information on the display screen of the portable electronic device, and the portable electronic device displays the content to be displayed in a manner that does not display the private information, thus avoiding the portable electronic device Displaying this private information directly on its display prevents the surrounding people from seeing the private information, thereby protecting the user's private information from disclosure.

Illustratively, as shown in FIG. 3, a schematic diagram of a head-mounted visual device presenting private information at a corresponding location on a display screen of a portable electronic device. As shown in (a) of FIG. 3, the user does not see the private information that is not displayed by the portable electronic device (assuming that the private information in FIG. 3 is a video application); as shown in (b) of FIG. 3, the user is wearing In the case of a head-mounted visual device, private information not displayed by the portable electronic device can be seen. As can be seen from FIG. 3, the user can only see the private information that is not displayed by the portable electronic device when wearing the head-mounted visual device, thereby ensuring that the user's private information is not leaked.

Optionally, in conjunction with FIG. 2, as shown in FIG. 4, after S106, the method for displaying according to the embodiment of the present invention may further include:

S107. The portable electronic device detects an operation acting on the private information.

Exemplarily, if the private information is an application, the user's operation on the application is a click, and when the user clicks on the icon of the application, the portable electronic device can detect the action of the user clicking, and the portable electronic device can also obtain the user. The location information of the click action occurred.

S108. The portable electronic device responds to the operation when the line of sight of the user wearing the head mounted visual device falls on the display screen of the portable electronic device.

S109. The portable electronic device does not respond to the operation when the line of sight focus of the user wearing the head mounted visual device does not fall on the display screen of the portable electronic device.

When S10 and S109 are actually executed, they can only be executed one by one, for example, S108 is executed or S109 is executed. In order to clearly show that S108 and S109 can only be executed one by one, S108 and S109 are indicated by dashed boxes in FIG.

The focus of the above-mentioned user may also be referred to as the gaze point of the user's eyeball (including the left eyeball and the right eyeball). In a specific implementation, as shown in FIG. 5, the user's line of sight focus can be represented by the intersection O of the left eye line of sight of the user's left eye and the right eye line of the right eye. For example, in FIG. 5, when the intersection point O of the left eye line of sight of the left eyeball of the user wearing the head mounted visual device and the right eye line of sight of the right eye eyeball falls on the display screen of the portable electronic device, the portable electronic device Can respond to this action.

In the above S108 and S109, detecting the line of sight of the user wearing the head mounted visual device The method of whether the focus falls on the display screen of the portable electronic device can be achieved by the following two possible implementations.

A first possible implementation manner is that the head-mounted visual device detects whether the line-of-sight focus of the user wearing the head-mounted visual device falls on the display screen of the portable electronic device through the eyeball tracking technology.

A second possible implementation is that the portable electronic device detects through its front camera whether the line of sight focus of the user wearing the head mounted visual device falls on the display screen of the portable electronic device.

Optionally, after detecting that the line-of-sight focus of the user wearing the head-mounted visual device falls on the display screen of the portable electronic device, the portable electronic device can transmit the detected by the portable electronic device to the head-mounted visual device. a first message of location information of an operation of the private information, the first message being used to trigger the head mounted visual device to determine an object of the operation based on the location information of the operation; determining the operation at the head mounted visual device After the object (for example, the head-mounted visual device determines that the location indicated by the location information of the user operation is an icon of an application, the object is the application), the head-mounted visual device can carry the identifier of the object The second electronic message is sent to the portable electronic device such that the portable electronic device can respond to the user's operation by invoking a corresponding command based on the identification of the object and the action it detects acting on the object. The method for the portable electronic device to respond to the user's operation is the same as the method for the portable electronic device in the prior art to respond to the user's operation, for example, including responding to the user's click operation when the user performs a click operation, and when the user performs a double-click operation. Responding to the user's double-click operation, responding to the user's selected operation when the user performs the selected operation, and responding to the user's moving operation when the user performs the moving operation. For example, the portable electronic device can invoke an instruction to open the application in response to the user's operation based on the name of the application and the action of the user's click detected thereon, ie, the portable electronic device opens the application.

Further, the portable electronic device can simultaneously vibrate in response to the user's operation to give the user feedback to the user's operation. In the embodiment of the present invention, when responding to the operation of the user, the portable electronic device may also send information in response to the user's operation to the head-mounted visual device, so that the head-mounted visual device vibrates, thereby enabling The user is also able to feel feedback from the portable electronic device to the user's operation from the display of the head-mounted visual device.

In this embodiment, even if the portable electronic device does not display private information, it can normally respond to the user's operation of the private information, thereby not affecting the normal use of the portable electronic device by the user.

The identifier of the object may be an identifier of the object or a number of the object that can uniquely identify the object. For example, if the object operated by the user is an icon of an application, the identifier of the object may be the name of the application; if the object operated by the user is an option of an interface, the identifier of the object may be the option. Number, etc.

A person skilled in the art can understand that when the line of sight of the user wearing the head mounted visual device falls on the display screen of the portable electronic device, if the portable electronic device detects the operation of the user acting on the private information, the portable electronic device can Data interaction with the head-mounted visual device and response to the operation based on the results of the data interaction. When the user's line of sight focus wearing the head-mounted visual device does not fall on the display screen of the portable electronic device, if the portable electronic device detects the user's operation on the private information, in order to prevent other users from operating the private information The portable electronic device will not interact with the head-mounted visual device, ie the portable electronic device will not respond to the operation.

Further, if the portable electronic device can identify by the fingerprint that the user acting on the private information is a user who is authenticated by security, the portable electronic device can respond to the operation of the user acting on the private information only when the user acts on the private information; When other users act on private information, they do not respond to other users' actions on private information, so that the user's private information can be protected from being leaked more accurately.

In the embodiment of the present invention, when the portable electronic device detects the operation of the user on the private information, if the line of sight of the user wearing the head-mounted visual device falls on the display screen of the portable electronic device, the portable electronic device can ring. It should be operated; thus, even if the portable electronic device does not display private information, when the user looks at the display screen of the portable electronic device, it can normally respond to the user's operation of the private information, thereby not affecting the normal use of the portable electronic device by the user. When the portable electronic device detects the user When used for operation of private information, if the line of sight focus of the user wearing the head mounted visual device does not fall on the display screen of the portable electronic device, the portable electronic device may not respond to the operation; thus, when the user does not look at the portable electronic device When the display screen is used, it can be avoided that if other users operate on private information, the portable electronic device can still normally respond to the operation problem, thereby ensuring that the user's private information is not leaked.

Further, in conjunction with FIG. 4, after S108, after the portable electronic device responds to the user's operation on the private information, if the response interface in response to the operation includes private information, the embodiment of the present invention provides The displayed methods also include:

S110. The portable electronic device sends a message carrying the location information of the response interface and the response interface to the head mounted visual device.

The message is used to trigger the head mounted visual device to present the response interface at a location of the response interface on the display screen of the portable electronic device based at least on the location information of the response interface.

S111. The portable electronic device does not display the response interface.

S112. The head mounted visual device receives a message sent by the portable electronic device that carries the response interface and the location information of the response interface.

S113. The head mounted visual device presents the response interface on a display screen of the head mounted visual device according to the location information of the response interface and the spatial information of the portable electronic device.

The portable electronic device and the head-mounted display are described above when the portable electronic device responds to the user's action on the private information as described in S110 to S113 as shown in FIG. 6, and the response interface in response to the operation still contains private information. Data interaction and processing flow between devices and portable electronic device and head-mounted visual device when the portable electronic device determines that the content to be displayed contains private information as described above in S101 to S106 in the embodiment shown in FIG. 2 The data interaction and the processing flow are similar. For details, refer to the related description of S101 to S106 in the embodiment shown in FIG. 2, and details are not described herein again.

In the embodiment of the present invention, after the portable electronic device responds to the user's operation on the private information, if the response interface in response to the operation still contains private information, the portable electronic device may continue to send the response interface to the head-mounted display. Equipment, worn by the head The visual device is presented, and the portable electronic device still does not display the response interface, so that the user's private information can be protected more completely and completely from being leaked.

Optionally, in the embodiment of the present invention, before performing the display method provided by the embodiment of the present invention, a process of mutual authentication between the portable electronic device and the head mounted visual device may be further included.

Specifically, the method for mutual authentication between the portable electronic device and the head mounted visual device may be one of the following:

(W1) mutual authentication between the portable electronic device and the head mounted visual device using the current display interface and the current display interface

The portable electronic device detects the user operation and locks the current display interface, and notifies the head-mounted visual device, and the head-mounted visual device sends a verification code (which can be user information identifying the user identity, such as the user's fingerprint, etc.) to the portable device. After the portable electronic device verifies that the head mounted visual device is a head mounted visual device matched thereto, the portable electronic device transmits the interface information of the current display interface to the head mounted visual device, and the head mounted visual device The device obtains a screen display image of the current display interface (obtained by a screenshot), and if the head-mounted visual device determines that the interface information is consistent with the screen display image (including the displayed interface elements are consistent and the position information of the interface elements is consistent, etc.), The head mounted visual device sends an open command to the portable electronic device, and the portable electronic device executes the open command to unlock the current display interface and complete the verification process.

(W2) mutual authentication between the portable electronic device and the head mounted visual device using the current display interface and the current display interface

After the portable electronic device detects the user operation and locks the current display interface, and notifies the head-mounted visual device, after the head-mounted visual device verifies that the portable electronic device is a portable electronic device matched thereto, the head-mounted visual device acquires the current display. The screen of the interface displays an image (which can be obtained by a screenshot), and sends the screen display image to the portable electronic device, if the portable electronic device determines that the interface information of the current display interface is consistent with the screen display image (including the displayed interface elements and the interface) If the location information of the element is consistent, etc., the portable electronic device unlocks the current display interface and completes the verification process.

(W3) mutual authentication between the portable electronic device and the head mounted visual device using the user's operational information

After the head-mounted visual device verifies that the portable electronic device is a portable electronic device matched thereto, both the head-mounted visual device and the portable electronic device acquire the operation information of the user (including the type of gesture operated by the user, the operation position and the operation track, etc.) And the head-mounted visual device compares the operation information of the user obtained by itself with the operation information of the user sent by the portable electronic device, and if the two are consistent, the head-mounted visual device sends a verification pass instruction to the portable electronic device. Complete the verification process.

(W4) mutual authentication between the portable electronic device and the head mounted visual device using the user's operational information

Different from the above (W3), the operation information of the user obtained by the portable electronic device is compared with the operation information of the user transmitted by the head-mounted visual device. If the two are consistent, the verification is passed and the verification process is completed.

Optionally, the embodiment of the present invention further provides a method for displaying, wherein the head-mounted visual device determines that the content displayed on the display screen of the portable electronic device includes private information.

Exemplarily, as shown in FIG. 7, S101 to S104 in the above-described embodiment shown in FIG. 2 may be replaced by the following S11 to S15:

S11. The head-mounted visual device monitors the content displayed on the display screen of the portable electronic device.

S12. The head-mounted visual device acquires private information included in the content and location information of the private information.

S13. The head mounted visual device transmits the location information of the private information to the portable electronic device.

S14. The portable electronic device receives location information of the private information sent by the head mounted visual device.

S15. The portable electronic device displays the content to be displayed in a manner that does not display the private information according to the location information of the private information.

For the description of S11 to S15, refer to the above embodiment shown in FIG. 2. The related descriptions of S101 to S104 are not described herein again.

Optionally, in the method of displaying provided by the embodiment of the present invention, private information may appear in different application scenarios. The display method provided by the embodiment of the present invention is further described below by enumerating several common application scenarios.

Scene 1: Private information appears in the user inputting the scene in the text box.

In the first scene, when the user inputs in the text box (can input text, input expression or input picture, etc.), the private information contained in the content to be displayed determined by the portable electronic device is input by the user in the text box. Related operations (including the input information input by the user in the text box and the control information popped up when the user inputs, such as a pop-up virtual keyboard, copy, paste, etc.).

Optionally, in scenario 1, when the user inputs in the text box, if the keyboard used by the user is a virtual keyboard, the user may select the virtual keyboard through a specific gesture or action, and the head-mounted visual device detects the user's After the operation, the head-mounted visual device can transmit the area information of the selected area of the user to the portable electronic device, and the portable electronic device extracts the interface element information of the selected area of the user from the area information (ie, the interface element information is used as The above private information may specifically be content in the form of pictures, texts, etc., and the interface element information is all virtual keyboards or partial virtual keyboards), and then the portable electronic device does not display private information (the personal information is not displayed here) The method may specifically display the user input interface by displaying the user input interface in a scrambled order of the letters in the virtual keyboard of the selected area of the user, or changing the letters in the virtual keyboard of the selected area of the user, and the portable electronic device sends the interface element information. For a head mounted visual device, the head mounted visual device is provided in accordance with the above embodiment of the present invention Providing a method for displaying the interface element information on the position of the interface element information on the display screen thereof. Specifically, the portable electronic device and the head mounted visual device process the private information in the scene. In the embodiment shown in FIG. 2, the portable electronic device and the head-mounted visual device handle the private information in the same manner, and are not described herein again.

Illustratively, as shown in FIG. 8 , a head-mounted visual device according to an embodiment of the present invention displays a schematic sequence of letters in a virtual keyboard. As shown in (a) of FIG. 8, the virtual keyboard on the portable electronic device that the user sees with the naked eye is a letter disorder. The virtual keyboard displayed in sequence; as shown in (b) of FIG. 8 , the virtual keyboard on the portable electronic device that the user sees when wearing the head-mounted visual device is a virtual keyboard with normal letters arranged (ie, according to the present Some keyboards are standard.) It can be seen from FIG. 8 that the user can only see the virtual keyboard with the letters arranged on the portable electronic device only when wearing the head-mounted visual device, so that the private input by the user when inputting in the text box can be better ensured. Information is not leaked.

Scenario 2: Private information appears in a specific interface displayed by the portable electronic device

In scenario 2, when the portable electronic device displays a specific interface, the portable electronic device can transmit the information of the specific interface to the head mounted visual device, and the head mounted visual device displays the private information corresponding to the specific interface. The personal information is pre-stored in the head-mounted visual device, and the correspondence between the specific interface and the private information is pre-stored. The information of the specific interface may be an identifier of an application to which the specific interface belongs, a name of an application to which the specific interface belongs, an identifier of the specific interface, or a screenshot of the specific interface.

Further, in the second scenario, after the head-mounted visual device displays the private information, the head-mounted visual device may select all or part of the content of the private information according to the specific gesture, specific action or specific eyes of the user. Then, the entire content or part of the selected private information is presented on a specific control of the specific interface, for example, the head-mounted visual device copies or cuts the entire content or part of the selected private information to This particular interface is on a specific control.

Further, in scenario 2, after the head-mounted visual device presents all or part of the selected private information to a specific control of the specific interface, the head-mounted visual device may also establish its selection. Corresponding relationship between the entire content or part of the private information and the specific control, such that after the portable electronic device displays the specific control again, the entire content of the private information selected by the head-mounted visual device Or part of the content can be automatically displayed on the specific control, without repeating the above process, which can be convenient for the user to enhance the user experience.

Based on the above-described system shown in FIG. 1, as shown in FIG. 9, the present invention is implemented The example also provides a method of display, the method comprising:

S201. The portable electronic device determines that the content to be displayed on the display screen includes private information.

S202. The portable electronic device sends a message carrying the location information of the content to be displayed and the content to be displayed to the head mounted visual device.

The message is used to trigger the head mounted visual device to present the content to be displayed on the display screen of the portable electronic device based on at least the location information of the content to be displayed.

S203. The portable electronic device triggers the display screen to enter a non-lock screen state.

S204. The head-mounted visual device receives a message that is sent by the portable electronic device and carries location information of the content to be displayed and the content to be displayed.

S205. The head-mounted visual device acquires spatial information of the portable electronic device.

Wherein, the spatial information of the portable electronic device is used to indicate the spatial position of the portable electronic device relative to the head mounted visual device.

S206. The head-mounted visual device presents the to-be-displayed content on a display screen of the head-mounted visual device according to the location information and the spatial information of the content to be displayed.

In this embodiment, the detailed descriptions of S201 to S206 are similar to the descriptions of S101 to S106 in the embodiment shown in FIG. 2 . For details, refer to the related description of S101 to S106 in the embodiment shown in FIG. 2 . I will not repeat them here.

Different from the embodiment shown in FIG. 2, in the embodiment, if the portable electronic device determines that the content to be displayed contains private information, the portable electronic device can directly send the content to be displayed to the headset. The device displays the content to be displayed on the display screen by the head mounted visual device, and the portable electronic device triggers the display screen of the portable electronic device to enter the non-lock screen state (ie, S203, and the embodiment shown in FIG. 2 above) The method of S103 is different. In this way, all the content to be displayed on the display screen of the portable electronic device can be displayed by the head-mounted visual device, and the private information of the user can be completely ensured that the user's private information is not leaked.

In this embodiment, the private information, the content to be displayed (similar to the private information in the embodiment shown in FIG. 2 above), and the location information of the content to be displayed (and the private information in the embodiment shown in FIG. 2 above) Similar location information) and portable electronic devices For descriptions of the spatial information and the like, reference may be made to the related description in the embodiment shown in FIG. 2 above, and details are not described herein again.

Although the present embodiment is different from the embodiment shown in FIG. 2 above, in this embodiment, the content that is superimposed and displayed by the portable electronic device to the head mounted visual device is all the content to be displayed of the portable electronic device, but is portable. The format of the content to be displayed superimposed and displayed by the electronic device to the head-mounted visual device may be the same as the format of the private information superimposed and displayed by the portable electronic device to the head-mounted visual device in the embodiment shown in FIG. 2. For details, refer to the related description of the private information in the embodiment shown in FIG. 2, and details are not described herein again.

The display method provided by the embodiment of the present invention, when the portable electronic device determines that the content to be displayed on the display screen includes private information, the portable electronic device may send the content to be displayed and the location information of the content to be displayed to the headset. Depending on the device, the head-mounted visual device presents the content to be displayed on the display of the content to be displayed on the display screen of the portable electronic device, and the portable electronic device enters a non-lock screen state, thereby avoiding the portable electronic device. The device displays the content to be displayed on its display screen, thereby preventing surrounding people from seeing the private information contained in the content to be displayed, thereby protecting the user's private information from being leaked.

Optionally, in S201, the method for the portable electronic device to determine that the content to be displayed on the display screen includes private information may be one of the following:

(a) The portable electronic device determines that it is in a private mode.

(b) The portable electronic device determines that the content to be displayed includes a preset application or a preset application interface.

(c) The portable electronic device determines that the content to be displayed contains specific content.

Specifically, the descriptions of the above (a), (b), and (c) can be referred to the related descriptions of (1), (2), and (3) in the description of S101 in the embodiment shown in FIG. 2 above. I will not repeat them here.

In this embodiment, a schematic diagram of the head-mounted visual device presenting the content to be displayed on the corresponding position on the display screen of the portable electronic device can be referred to FIG. 3 and the related description of FIG. 3, and details are not described herein again.

Optionally, in conjunction with FIG. 9, as shown in FIG. 10, after S206, the method for displaying according to the embodiment of the present invention may further include:

S207. The portable electronic device detects an operation acting on the private information.

S208. The portable electronic device responds to the operation when the line of sight of the user wearing the head mounted visual device falls on the display screen of the portable electronic device.

S209. The portable electronic device does not respond to the operation when the line of sight focus of the user wearing the head mounted visual device does not fall on the display screen of the portable electronic device.

When S208 and S209 are actually executed, they can only be executed one by one, for example, S208 is executed or S209 is executed. In order to clearly show that S208 and S209 can only be executed one by one, S208 and S209 are represented by dashed boxes in FIG.

For a description of the user's line of sight focus, refer to the related description of the user's line of sight focus in the embodiment shown in FIG. 4, and details are not described herein again.

For the description of the foregoing S207 to S209, refer to the related description of S107 to S109 in the embodiment shown in FIG. 4 above, and details are not described herein again.

In this embodiment, even if the portable electronic device does not display the content to be displayed (including private information), it can normally respond to the user's operation of the private information, thereby not affecting the normal use of the portable electronic device by the user.

Further, in conjunction with FIG. 10, after S208, after the portable electronic device responds to the user's operation on the private information, if the response interface in response to the operation includes private information, the embodiment of the present invention provides The displayed methods also include:

S210. The portable electronic device sends a message carrying the location information of the response interface and the response interface to the head mounted visual device.

S211. The portable electronic device keeps the display screen in a non-lock screen state.

S212. The head mounted visual device receives a message sent by the portable electronic device that carries the response interface and the location information of the response interface.

S213. The head-mounted visual device according to the location information of the response interface and the portable device The spatial information of the child device presents the response interface on the display of the head mounted visual device.

The portable electronic device and the head mounted visual device are described above when the portable electronic device responds to the user's action on the private information as described in S110 to S213, and the response interface in response to the operation includes private information. The data interaction and processing flow between the portable electronic device and the head mounted visual device when the portable electronic device determines that the content to be displayed contains private information as described above in the embodiments S201 to S206 in the embodiment shown in FIG. 9 The data interaction and the processing flow are similar. For details, refer to the related description of S201 to S206 in the embodiment shown in FIG. 9 , and details are not described herein again.

In the embodiment of the present invention, after the portable electronic device responds to the user's operation on the private information, if the response interface in response to the operation still contains private information, the portable electronic device may continue to send the response interface to the head-mounted display. The device is presented by the head-mounted visual device, and the display screen of the portable electronic device is still in a non-lock screen state, that is, the portable electronic device still does not display the response interface, thereby more comprehensively and completely protecting the user's private information. Not leaked.

Specifically, the method for mutual authentication between the portable electronic device and the head mounted visual device can be referred to the methods shown in the above embodiments (W1), (W2), (W3), and (W4), and details are not described herein again. .

Exemplarily, as shown in FIG. 12, S201 to S204 in the above-described embodiment shown in FIG. 9 may be replaced by the following S21 to S25:

S21. The head-mounted visual device monitors the content displayed on the display screen of the portable electronic device.

S22. The head-mounted visual device acquires the display content and the location letter of the display content. interest.

S23. The head mounted visual device transmits the location information of the display content to the portable electronic device.

S24. The portable electronic device receives location information of the display content sent by the head mounted visual device.

S25. The portable electronic device triggers the display screen to enter a non-lock screen state according to the position information of the display content.

For the description of S21 to S25, refer to the related description of S201 to S204 in the embodiment shown in FIG. 9 above, and details are not described herein again.

In the above several methods of display provided by the embodiments of the present invention, since the portable electronic device can transmit the user's private information (or content containing the user's private information) to the headset that has established a wireless connection with the portable electronic device. The visual device is displayed, and the portable electronic device does not display the private information. Therefore, the above-mentioned several display methods provided by the embodiments of the present invention can ensure that the private information of the user is not leaked.

As shown in FIG. 13, an embodiment of the present invention provides a portable electronic device that includes a display screen 10 that maintains a wireless connection with a head mounted video device. The portable electronic device is for performing the steps performed by the portable electronic device of the above method. The portable electronic device can include a module corresponding to the corresponding step. For example, the portable electronic device can include:

The processing unit 11 is configured to determine that the content to be displayed on the display screen 10 includes private information, and the sending unit 12 is configured to send, to the head mounted visual device, the private person that is determined by the processing unit 11 Information and information of location information of the private information, the message being used to trigger the head mounted visual device to present the private information on the display screen 10 based at least on location information of the private information The processing unit 11 is further configured to display the content to be displayed on the display screen 10 in a manner that does not display the private information.

Optionally, the processing unit 11 is configured to determine that the content to be displayed on the display screen 10 includes private information, including: the processing unit 11 is configured to determine the portable The electronic device is in a private mode; or determining that the content to be displayed includes a preset application or a preset application interface; or determining that the content to be displayed includes specific content.

Optionally, the processing unit is further configured to display the to-be-displayed content on the display screen in a manner that does not display the private information, including: the processing unit 11 is further configured to be on the display screen 10 Displaying the content to be displayed in a manner of hiding the private information; or displaying the content to be displayed in a manner that the preset content covers the private information on the display screen 10.

Optionally, in conjunction with FIG. 13, as shown in FIG. 14, the portable electronic device further includes a detecting unit 13,

The detecting unit 13 is configured to detect, after the processing unit 11 displays the content to be displayed on the display screen in a manner that does not display the private information, detecting the action determined by the processing unit 11 The operation unit 11 is further configured to respond to the operation detected by the detecting unit 13 when the line of sight focus of the user wearing the head mounted visual device falls on the display screen 10 Or the operation detected by the detecting unit 13 is not responded when the line of sight focus of the user wearing the head mounted visual device does not fall on the display screen 10.

Further, the sending unit 12 is further configured to: when the processing unit 11 responds to the operation of the private information by the user, if the private information is included in the response interface after the operation, the processing unit 11 The wearable visual device transmits a message carrying the response interface of the response unit and the response interface of the response interface, the message being used to trigger the headset to be based on at least the response The location information of the interface is displayed on the display interface on the display screen; the processing unit 11 is further configured to not display the response interface after the response.

Optionally, the private information includes a screen display image, where the screen display image is a screen display image of an area where the private information is located on the display screen; or the private information includes: the private information Content, the style of the private information, and the font, font size, and color of the private information.

As a possible implementation, the processing unit 11 may be replaced by a processor; the sending unit 12 may be replaced by a transmitter; the detecting unit 13 may The embodiment of the present invention is not specifically limited.

An embodiment of the present invention provides a portable electronic device, when the portable electronic device determines that the content to be displayed on the display screen includes private information, the portable electronic device can transmit the private information and the location information of the private information to the headset. a visual device that presents the private information by the head-mounted visual device at the location of the private information on the display screen of the portable electronic device, and the portable electronic device displays the content to be displayed in a manner that does not display private information. This can prevent the portable electronic device from displaying the private information directly on its display screen, thereby preventing the surrounding people from seeing the private information, thereby protecting the user's private information from being leaked.

As shown in FIG. 15, an embodiment of the present invention provides a head mounted visual device that includes a display screen 20 that maintains a wireless connection with a portable electronic device. The head mounted visual device is for performing the steps performed by the head mounted visual device of the above method. The head mounted visual device may comprise a module corresponding to the corresponding step. For example, the head mounted visual device may include:

a receiving unit 21, configured to receive a message that is sent by the portable electronic device and that carries location information of the private information and the private information; the processing unit 22 is configured to acquire spatial information of the portable electronic device, and according to the private The location information of the information and the spatial information, the private information received by the receiving unit 21 is presented on the location of the private information on the display screen 20; the spatial information is used to indicate the portable electronic The spatial position of the device relative to the head mounted visual device.

Further, the receiving unit 21 is further configured to: after the portable electronic device responds to the detected action on the private information, receive the portable electronic device and carry the response interface and the a message responsive to the location information of the interface; the processing unit 22 is further configured to display on the display screen 20 according to the location information of the response interface received by the receiving unit 21 and the spatial information of the portable electronic device The response interface.

As a possible implementation manner, the receiving unit 21 may be replaced by a receiver (for example, a module that can communicate with other devices on the head mounted visual device); The processing unit 22 may be replaced by a processor or the like, which is not specifically limited in the embodiment of the present invention.

The embodiment of the present invention provides a head mounted visual device. When the head mounted visual device receives the private information sent by the portable electronic device and the location information of the private information, the head mounted visual device can acquire the portable electronic device. The spatial information of the device, and according to the location information of the private information and the spatial information, the private information is presented on the display of the private information on the display screen of the head-mounted visual device, so that the user can only pass the headset The visual device sees the private information, and avoids the portable electronic device directly displaying the private information on its display screen, thereby preventing the surrounding people from seeing the private information, thereby protecting the user's private information from being leaked.

As shown in FIG. 16, an embodiment of the present invention provides a portable electronic device that includes a display screen 30 that maintains a wireless connection with a head mounted visual device. The portable electronic device is for performing the steps performed by the portable electronic device of the above method. The portable electronic device can include a module corresponding to the corresponding step. For example, the portable electronic device can include:

The processing unit 31 is configured to determine that the content to be displayed on the display screen 30 includes private information, and the sending unit 32 is configured to send, to the head mounted visual device, the content to be displayed and the to-be-displayed a message of location information of the content, the message being used to trigger the head mounted visual device to present the content to be displayed on the display screen 30 based on at least location information of the content to be displayed; The processing unit 31 is further configured to trigger the display screen 30 to enter a non-lock screen state.

Optionally, the processing unit 31 is configured to determine that the content to be displayed on the display screen 30 includes private information, including: the processing unit 31 is configured to determine that the portable electronic device is in a private mode; or The preset content or the preset application interface is included in the content to be displayed; or the specific content is included in the content to be displayed.

Optionally, in conjunction with FIG. 16, as shown in FIG. 17, the portable electronic device further includes a detecting unit 33,

The detecting unit 33 is configured to trigger the display screen 30 at the processing unit 31 After entering the screen-out state of the non-lock screen, an operation of the private information determined by the processing unit 31 is detected; the processing unit 31 is further configured to be used by a user wearing the head-mounted visual device Responsive to the operation detected by the detecting unit 33 when the line of sight focus falls on the display screen 30; or when the line of sight focus of the user wearing the head mounted video device does not fall on the display screen 30, The operation detected by the detecting unit 33 is not responded to.

Further, the sending unit 32 is further configured to: when the processing unit 31 responds to the operation of the private information by the user, if the private information is included in the response interface after the operation, the processing unit 31 The wearable video device transmits a message carrying the response interface of the response unit and the location information of the response interface, the message being used to trigger the head mounted visual device to be based at least on the response interface The location information is presented on the display interface 30 at the location of the response interface; the processing unit 31 is further configured to keep the display screen 30 in an off-screen state of the non-lock screen.

As a possible implementation, the processing unit 31 may be replaced by a processor; the sending unit 32 may be replaced by a transmitter (for example, a module that can communicate with other devices on the portable electronic device); the detecting unit 33 It can be replaced with a detector or the like, which is not specifically limited in the embodiment of the present invention.

The embodiment of the present invention provides a portable electronic device, when the portable electronic device determines that the content to be displayed on the display screen includes private information, the portable electronic device may send the content to be displayed and the location information of the content to be displayed to the head. The wearable visual device displays the content to be displayed on the display of the content to be displayed on the display screen of the portable electronic device by the head-mounted visual device, and the portable electronic device enters the non-lock screen state, so that The portable electronic device is prevented from displaying the content to be displayed on its display screen, thereby preventing surrounding people from seeing the private information contained in the content to be displayed, thereby protecting the user's private information from being leaked.

As shown in FIG. 18, an embodiment of the present invention provides a head mounted visual device, the head mounted visual device including a display screen 40, the head mounted visual device and a portable electronic device. Keep a wireless connection. The head mounted visual device is for performing the steps performed by the head mounted visual device of the above method. The head mounted visual device may comprise a module corresponding to the corresponding step. For example, the head mounted visual device may include:

a receiving unit 41, configured to receive a message that is sent by the portable electronic device and that carries the location information of the content to be displayed and the content to be displayed; the processing unit 42 is configured to acquire spatial information of the portable electronic device, and according to the The location information of the content to be displayed and the spatial information, the content to be displayed received by the receiving unit 41 is presented on the display screen 40; the spatial information is used to indicate that the portable electronic device is relative to the The spatial location of the head-mounted visual device.

Further, the receiving unit 41 is further configured to: after the portable electronic device responds to the detected action on the private information, receive the portable electronic device and carry the response interface and the a message responsive to the location information of the interface; the processing unit 42 is further configured to display on the display screen 40 according to the location information of the response interface received by the receiving unit 41 and the spatial information of the portable electronic device The response interface.

As a possible implementation manner, the receiving unit 41 may be replaced by a receiver (for example, a module that can communicate with other devices on the head mounted visual device); the processing unit 42 may be replaced by a processor or the like. This embodiment of the present invention does not specifically limit this.

The embodiment of the present invention provides a head mounted visual device. When the head mounted visual device receives the content to be displayed and the location information of the content to be displayed sent by the portable electronic device, the head mounted visual device may be Obtaining spatial information of the portable electronic device, and displaying the to-be-displayed content on the display of the content to be displayed on the display screen of the head-mounted visual device according to the location information of the content to be displayed and the spatial information, such that The user can only see the content to be displayed through the head-mounted visual device, and avoids the portable electronic device displaying the content to be displayed on the display screen thereof, thereby preventing surrounding people from seeing the private information in the content to be displayed. In turn, the user's private information can be protected from being leaked.

As shown in FIG. 19, an embodiment of the present invention provides a portable electronic device. Portable electronic devices include:

One or more processors 50, a memory 51, a bus system 52, and an interface circuit 53, to which the one or more processors 50, the memory 51, and the interface circuit 53 are connected.

Computer instructions are stored in the memory 51, and when the one or more processors 50 execute the computer instructions, the portable electronic device performs the display as described above in FIG. 2, FIG. 4, FIG. 6, or FIG. Methods. For a specific display method, refer to the related description in the foregoing embodiment shown in FIG. 2, FIG. 4, FIG. 6, or FIG. 7, and details are not described herein again.

The embodiment further provides a storage medium, which may include the memory 51.

The one or more processors 50 may be a central processing unit (English: central processing unit, abbreviated: CPU). The one or more processors 50 can also be other general-purpose processors, digital signal processing (DSP), application specific integrated circuit (ASIC), and field programmable. A gate-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The one or more processors 50 may be dedicated processors, which may include at least one of an NFC processing chip, a baseband processing chip, a radio frequency processing chip, and the like. Further, the dedicated processor may also include a chip having other specialized processing functions of the portable electronic device.

The memory 51 may include a volatile memory (English: volatile memory), such as random-access memory (abbreviation: RAM); the memory 51 may also include a non-volatile memory (English: Non-volatile memory, such as read-only memory (English: read-only memory, abbreviation: ROM), flash memory (English: flash memory), hard disk (English: hard disk drive, abbreviation: HDD) or solid state drive (English) :solid-state drive, abbreviation: SSD); The memory 51 may also include a combination of the above types of memories.

The bus system 52 can include a data bus, a power bus, a control bus, and a signal status bus. For the sake of clarity in the present embodiment, various buses are illustrated as bus system 52 in FIG.

The interface circuit 53 may specifically be a transceiver on a portable electronic device. The transceiver can be a wireless transceiver. For example, the wireless transceiver can be an antenna of a portable electronic device or the like. The one or more processors 50 perform data transmission and reception with the other devices, such as a head mounted visual device, through the interface circuit 53.

In a specific implementation process, each step in the method flow shown in FIG. 2, FIG. 4, FIG. 6 or FIG. 7 can be implemented by the processor 50 in hardware form executing the computer-executed instruction in the form of software stored in the memory 51. . To avoid repetition, we will not repeat them here.

As shown in FIG. 20, an embodiment of the present invention provides a head mounted visual device, where the head mounted visual device includes:

One or more processors 60, a memory 61, a bus system 62, and an interface circuit 63 are connected by the bus system 62, the one or more processors 60, the memory 61, and the interface circuit 63.

Computer instructions are stored in the memory 61, and when the one or more processors 60 execute the computer instructions, the head mounted visual device performs the above-mentioned FIG. 2, FIG. 4, FIG. 6, or FIG. The method of display described. The specific display method can be seen The related description in the embodiment shown in FIG. 2, FIG. 4, FIG. 6, or FIG. 7 is not described herein again.

The embodiment further provides a storage medium, which may include the memory 61.

The one or more processors 60 can be a CPU. The one or more processors 60 may also be other general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The one or more processors 60 may be dedicated processors, which may include NFC processing chips or the like. Further, the dedicated processor may also include a chip having other specialized processing functions of the head mounted video device.

The memory 61 may include a volatile memory such as a RAM; the memory 61 may also include a non-volatile memory such as a ROM, a flash memory, an HDD or an SSD; the memory 61 may also include a memory of the above kind combination.

The bus system 62 can include a data bus, a power bus, a control bus, and a signal status bus. For the sake of clarity in the present embodiment, various buses are illustrated as bus system 62 in FIG.

The interface circuit 63 may specifically be a transceiver on a head mounted visual device. The transceiver can be a wireless transceiver. For example, the wireless transceiver can be an antenna of a head mounted visual device or the like. The one or more processors 60 perform data transmission and reception with the other devices, such as portable electronic devices, through the interface circuit 63.

In a specific implementation process, each step in the method flow shown in FIG. 2, FIG. 4, FIG. 6, or FIG. 7 can be implemented by the processor 60 in hardware form executing the computer-executed instruction in the form of software stored in the memory 61. . To avoid repetition, we will not repeat them here.

The embodiment of the present invention provides a head mounted visual device. When the head mounted visual device receives the private information sent by the portable electronic device and the location information of the private information, the head mounted visual device can acquire the portable electronic device. Device space information and according to the The location information of the private information and the spatial information, the private information is presented on the display of the private information on the display screen of the head-mounted visual device, so that the user can only see the private information through the head-mounted visual device The portable electronic device is prevented from directly displaying the private information on its display screen, thereby preventing the surrounding person from seeing the private information, thereby protecting the user's private information from being leaked.

As shown in FIG. 21, an embodiment of the present invention provides a portable electronic device, where the portable electronic device includes:

One or more processors 70, a memory 71, a bus system 72, and an interface circuit 73 are connected by the bus system 72, the one or more processors 70, the memory 71, and the interface circuit 73.

Computer instructions are stored in the memory 71, and when the one or more processors 70 execute the computer instructions, the portable electronic device performs the method of displaying as described in any of the above-described FIGS. 9-12. For a specific display method, refer to the related description in the foregoing embodiment shown in any one of FIG. 9 to FIG. 12, and details are not described herein again.

The embodiment further provides a storage medium, which may include the memory 71.

The one or more processors 70 can be a CPU. The one or more processors 70 may also be other general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The one or more processors 70 may be dedicated processors, which may include at least one of an NFC processing chip, a baseband processing chip, a radio frequency processing chip, and the like. Further, the dedicated processor may also include a chip having other specialized processing functions of the portable electronic device.

The memory 71 may include a volatile memory such as a RAM; the memory 71 may also include a non-volatile memory such as a ROM, a flash memory, an HDD or an SSD; the memory 71 may also include a memory of the kind described above combination.

The bus system 72 can include a data bus, a power bus, a control bus, and a signal status bus. For the sake of clarity in the present embodiment, various buses are illustrated as bus system 72 in FIG.

The interface circuit 73 may specifically be a transceiver on a portable electronic device. The transceiver can be a wireless transceiver. For example, the wireless transceiver can be an antenna of a portable electronic device or the like. The one or more processors 70 transmit and receive data to and from other devices, such as head mounted visual devices, through the interface circuit 73.

In a specific implementation process, each step in the method flow shown in any one of the above-mentioned FIG. 9 to FIG. 12 can be implemented by the processor 70 in hardware form executing the computer-executed instructions in the form of software stored in the memory 71. To avoid repetition, we will not repeat them here.

As shown in FIG. 22, an embodiment of the present invention provides a head mounted visual device, where the head mounted visual device includes:

One or more processors 80, a memory 81, a bus system 82, and an interface circuit 83 are coupled by the bus system 82, the one or more processors 80, the memory 81, and the interface circuit 83.

Computer instructions are stored in the memory 81, and when the one or more processors 80 execute the computer instructions, the head mounted visual device performs the display as described in any one of FIGS. 9 to 12 Methods. For a specific display method, refer to the related description in the foregoing embodiment shown in any one of FIG. 9 to FIG. 12, and details are not described herein again.

The embodiment further provides a storage medium, which may include the storage 81.

The one or more processors 80 can be a CPU. The one or more processors 80 may also be other general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

The one or more processors 80 may be dedicated processors, which may include NFC processing chips or the like. Further, the dedicated processor may also include a chip having other specialized processing functions of the head mounted video device.

The memory 81 may include a volatile memory such as a RAM; the memory 81 may also include a non-volatile memory such as a ROM, a flash memory, an HDD or an SSD; the memory 81 may also include a memory of the above kind combination.

The bus system 82 can include a data bus, a power bus, a control bus, and a signal status bus. For the sake of clarity in the present embodiment, various buses are illustrated as bus system 82 in FIG.

The interface circuit 83 may specifically be a transceiver on a head mounted visual device. The transceiver can be a wireless transceiver. For example, the wireless transceiver can be an antenna of a head mounted visual device or the like. The one or more processors 80 perform data transmission and reception with the other devices, such as portable electronic devices, through the interface circuit 83.

In a specific implementation process, each step in the method flow shown in any one of the above-mentioned FIG. 9 to FIG. 12 can be implemented by the processor 80 in hardware form executing the computer-executed instructions in the form of software stored in the memory 81. To avoid repetition, we will not repeat them here.

The embodiment of the present invention provides a head mounted visual device. When the head mounted visual device receives the content to be displayed and the location information of the content to be displayed sent by the portable electronic device, the head mounted visual device may be Obtaining spatial information of the portable electronic device, and displaying the to-be-displayed content on the display of the content to be displayed on the display screen of the head-mounted visual device according to the location information of the content to be displayed and the spatial information, such that The user can only see the content to be displayed through the head-mounted visual device, and avoids the portable electronic device displaying the content to be displayed on the display screen thereof, thereby preventing the surrounding people from seeing the waiting to be displayed. Displaying private information in the content, which in turn protects the user's private information from disclosure.

Embodiments of the present invention also provide a display system including a portable electronic device and a head mounted visual device. Illustratively, a schematic structural diagram of a possible display system is shown in FIG.

Wherein, the portable electronic device may be a portable electronic device as shown in FIG. 13 or FIG. 14; the head mounted visual device may be a head mounted visual device as shown in FIG. Alternatively, the portable electronic device may be a portable electronic device as shown in FIG. 16 or FIG. 17; the head mounted visual device may be a head mounted visual device as shown in FIG. Alternatively, the portable electronic device may be a portable electronic device as shown in FIG. 19; the head mounted visual device may be a head mounted visual device as shown in FIG. Alternatively, the portable electronic device may be a portable electronic device as shown in FIG. 21; the head mounted visual device may be a head mounted visual device as shown in FIG. For a description of the portable electronic device and the head mounted visual device and the structure thereof, reference may be made to the related description in the embodiments shown in the above various figures, and details are not described herein again.

According to the display system provided by the embodiment of the present invention, when the portable electronic device determines that the content to be displayed includes private information, the portable electronic device may send the private information (or the content to be displayed) to the head-mounted visual device for presentation. The portable electronic device does not display the private information (or triggers its display screen to enter the non-lock screen state), so that the portable electronic device can directly prevent the private information from being displayed, thereby preventing the surrounding people from seeing the private information, thereby protecting The user's private information is not leaked.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above functional modules is illustrated. In practical applications, the above functions can be allocated according to needs. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the system, the device and the unit described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, The apparatus and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

A method of display for a portable electronic device including a display screen, the portable electronic device maintaining a wireless connection with the head mounted visual device, wherein the method comprises:

Determining that the content to be displayed on the display screen contains private information;

Transmitting, to the head mounted visual device, a message carrying location information of the private information and the private information, the message being used to trigger the head mounted visual device to be based at least on location information of the private information Presenting the private information on a location of the private information on the display screen;

The content to be displayed is displayed on the display screen in such a manner that the private information is not displayed.
The method according to claim 1, wherein the determining that the content to be displayed on the display screen comprises private information comprises:

Determining that the portable electronic device is in a private mode; or

Determining that the content to be displayed includes a preset application or a preset application interface; or

Determining that the content to be displayed contains specific content.
The method according to claim 1 or 2, wherein the displaying the content to be displayed in a manner of not displaying the private information on the display screen comprises:

Displaying the content to be displayed in a manner of hiding the private information on the display screen; or

The content to be displayed is displayed on the display screen in such a manner that the preset content covers the private information.
The method according to any one of claims 1 to 3, wherein after the displaying the content to be displayed in a manner that does not display the private information on the display screen, the method further comprises:

Detecting an operation acting on the private information;

Responding to the operation when the line of sight of the user wearing the head mounted visual device falls on the display screen;

The line of sight focus of the user wearing the head mounted visual device does not fall on the display When the screen is displayed, the operation is not responded to.
A method according to any one of claims 1 to 4, characterized in that

The private information includes: content of the private information, a style of the private information, and a font, a font size, and a color of the private information.
A method of display for a head mounted visual device including a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, wherein the method comprises:

Receiving, by the portable electronic device, a message carrying location information of private information and the private information;

Acquiring spatial information of the portable electronic device, the spatial information being used to indicate a spatial location of the portable electronic device relative to the head mounted visual device;

The private information is presented at the location of the private information on the display screen based on the location information of the private information and the spatial information.
A method of display for a portable electronic device including a display screen, the portable electronic device maintaining a wireless connection with the head mounted visual device, wherein the method comprises:

Determining that the content to be displayed on the display screen contains private information;

Transmitting, to the head mounted visual device, a message carrying location information of the content to be displayed and the content to be displayed, the message being used to trigger the head mounted visual device to be based at least on the to-be-displayed Location information of the content presents the content to be displayed on the display screen;

Triggering the display screen to enter a non-lock screen state.
The method according to claim 7, wherein the determining that the content to be displayed on the display screen includes private information comprises:

Determining that the portable electronic device is in a private mode; or

Determining that the content to be displayed includes a preset application or a preset application interface; or

Determining that the content to be displayed contains specific content.
The method according to claim 7 or 8, wherein after the triggering the display screen to enter a non-lock screen state, the method further comprises:

Detecting an operation acting on the private information;

Responding to the operation when the line of sight of the user wearing the head mounted visual device falls on the display screen;

The operation is not responded when the line of sight focus of the user wearing the head mounted visual device does not fall on the display screen.
A method of display for a head mounted visual device including a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, wherein the method comprises:

Receiving, by the portable electronic device, a message carrying location information of the to-be-displayed content and the content to be displayed;

Acquiring spatial information of the portable electronic device, the spatial information being used to indicate a spatial location of the portable electronic device relative to the head mounted visual device;

And displaying the to-be-displayed content on the display screen according to the location information of the content to be displayed and the spatial information.
A portable electronic device, characterized in that the portable electronic device comprises:

One or more processors, memories, bus systems, and interface circuits, the one or more processors, the memory, and the interface circuits being coupled by the bus system;

Computer instructions are stored in the memory, and when the one or more processors execute the computer instructions, the portable electronic device performs any one of claims 1 to 5 or any one of 7 to 9 method.
A computer readable storage medium, wherein the computer readable storage medium stores computer instructions that, when executed by a processor in a portable electronic device, perform the method of claim 1 The method of any one of 5 or any one of 7 to 9.
A head mounted visual device, characterized in that the head mounted visual device comprises:

One or more processors, memories, bus systems, and interface circuits, the one or more processors, the memory, and the interface circuits being coupled by the bus system;

Computer instructions are stored in the memory, and the head mounted visual device performs the method of claim 6 or 10 when the one or more processors execute the computer instructions.
A computer readable storage medium, wherein the computer readable storage medium stores computer instructions that are visible when a processor in a head mounted visual device executes the computer instructions The device performs the method of claim 6 or 10.
A display system, characterized in that the system comprises:

A portable electronic device according to claim 11 and a head mounted visual device according to claim 13.
A portable electronic device comprising a display screen, the portable electronic device maintaining a wireless connection with the head mounted visual device, comprising:

a processing unit, configured to determine that the content to be displayed on the display screen includes private information;

a sending unit, configured to send, to the head mounted visual device, a message carrying the private information determined by the processing unit and the location information of the private information, where the message is used to trigger the headset Viewing the private information on the location of the private information on the display screen based on at least location information of the private information;

The processing unit is further configured to display the to-be-displayed content on the display screen in a manner that does not display the private information.
A portable electronic device according to claim 16 wherein:

The processing unit is configured to determine that the content to be displayed on the display screen includes private information, including: the processing unit is configured to determine that the portable electronic device is in a private mode; or determine that the content to be displayed includes a pre- Setting an application or a preset application interface; or determining that the content to be displayed contains specific content.
A portable electronic device according to claim 16 or 17, wherein

The processing unit is further configured to display the to-be-displayed content on the display screen in a manner that does not display the private information, including: the processing unit is further configured to be in the display screen Displaying the content to be displayed in a manner of hiding the private information; or displaying the content to be displayed in a manner that the preset content covers the private information on the display screen.
The portable electronic device according to any one of claims 16 to 18, wherein the portable electronic device further comprises a detecting unit,

The detecting unit is configured to detect, after the processing unit displays the content to be displayed on the display screen in a manner that does not display the private information, detecting the private information determined by the processing unit operating;

The processing unit is further configured to respond to the operation detected by the detecting unit when a line of sight focus of a user wearing the head mounted visual device falls on the display screen; or wear the wearing The user's line of sight focus of the visual device does not respond to the operation detected by the detecting unit when it does not fall on the display screen.
A portable electronic device according to any one of claims 16 to 19, wherein

The private information includes: content of the private information, a style of the private information, and a font, a font size, and a color of the private information.
A head mounted visual device, the head mounted visual device comprising a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, comprising:

a receiving unit, configured to receive a message that is sent by the portable electronic device and carries location information of the private information and the private information;

a processing unit, configured to acquire spatial information of the portable electronic device, the spatial information is used to indicate a spatial location of the portable electronic device relative to the head mounted visual device; according to the location information and the space And presenting, by the receiving unit, the private information on a location of the private information on the display screen.
A portable electronic device comprising a display screen, the portable electronic device maintaining a wireless connection with the head mounted visual device, comprising:

a processing unit, configured to determine that the content to be displayed on the display screen includes private information;

a sending unit, configured to send, to the head mounted visual device, a message carrying the location information of the content to be displayed and the content to be displayed, where the message is used to trigger the headset to be at least based on The location information of the content to be displayed presents the content to be displayed on the display screen;

The processing unit is further configured to trigger the display screen to enter a non-lock screen state.
A portable electronic device according to claim 22, wherein

The processing unit is configured to determine that the content to be displayed on the display screen includes private information, including: the processing unit is configured to determine that the portable electronic device is in a private mode; or determine that the content to be displayed includes a pre- Setting an application or a preset application interface; or determining that the content to be displayed contains specific content.
A portable electronic device according to claim 22 or 23, wherein said portable electronic device further comprises a detecting unit,

The detecting unit is configured to detect an operation of the private information determined by the processing unit after the processing unit triggers the display screen to enter a screen-off state of the non-lock screen;

The processing unit is further configured to respond to the operation detected by the detecting unit when a line of sight focus of a user wearing the head mounted visual device falls on the display screen; When the line of sight of the user of the visual device does not fall on the display screen, the operation detected by the detecting unit is not responded.
A head mounted visual device, the head mounted visual device comprising a display screen, the head mounted visual device maintaining a wireless connection with the portable electronic device, comprising:

a receiving unit, configured to receive a message that is sent by the portable electronic device and carries location information of the content to be displayed and location information of the to-be-displayed content;

a processing unit, configured to acquire spatial information of the portable electronic device, the spatial information is used to indicate a spatial location of the portable electronic device relative to the head mounted visual device; according to the location information and the space And displaying the to-be-displayed content received by the receiving unit on the display screen.