WO2018045699A1

WO2018045699A1 - Display processing method and apparatus

Info

Publication number: WO2018045699A1
Application number: PCT/CN2017/070886
Authority: WO
Inventors: 孙薇; 赵冬晓
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-09-12
Filing date: 2017-01-11
Publication date: 2018-03-15
Also published as: CN107817894A

Abstract

A display processing method and apparatus. The method comprises: when a terminal is adapted to a virtual reality (VR) device, the terminal determines whether to-be-displayed content on a display screen thereof can be identified by the VR device or not (S10); if the to-be-displayed content cannot be identified by the VR device, the terminal reconstructs a layout structure of the to-be-displayed content to be a layout structure that can be identified by the VR device (S20); the terminal displays the to-be-displayed content on the display screen according to the reconstructed layout structure (S30). According to the technical solution, a VR device can identify any type of display content on a display screen of a terminal, so that a user would not miss the content on the terminal such as an incoming call or a short message when using the VR device any more.

Description

Display processing method and device

Technical field

This document relates to, but is not limited to, the field of virtual reality technology, and relates to a display processing method and apparatus.

Background technique

Common VR (Virtual Reality) devices, such as VR glasses, often need to be used in conjunction with a variety of terminals, and the application needs to be installed on the terminal to match the VR device used. Interact.

Since the VR device like VR glasses can only recognize the content on the display layout interface of the left and right split screens and the same shape (such as an elliptical shape) as the lenses of the VR glasses, therefore, the display content on the terminal display screen is When the layout structure satisfies the VR device identification condition, the user can view the display content on the terminal through the VR device, and when the layout structure does not satisfy the VR device identification condition, the user cannot view the display content on the terminal through the VR device. For example, the 3D video played on the terminal can be recognized by the VR glasses. At this time, the user can watch the video through the VR glasses, and the content such as the incoming call or the short message on the terminal cannot be recognized by the VR glasses, so the terminal is When displaying content such as incoming calls or text messages, users can't see these contents using VR glasses, and they may miss these calls or text messages, which will cause some trouble to the user.

Therefore, how to view any type of display content on the display of the terminal through the VR device when the terminal is used with the VR device is a technical problem that needs to be solved.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the invention provides a display processing method and device, which can solve the technical problem that the VR device cannot view the specific type of display content on the terminal display screen when the terminal cooperates with the VR device.

An embodiment of the present invention provides a display processing method, where the display processing method includes:

When the terminal is adapted to the virtual reality VR device, the terminal determines whether the content to be displayed on the display screen can be recognized by the VR device;

When the content to be displayed is not recognized by the VR device, the terminal reconstructs a layout structure of the content to be displayed into a layout structure that the VR device can recognize;

The terminal displays the content to be displayed on the display screen according to the reconstructed layout structure.

Optionally, the display processing method further includes:

While the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the terminal detects a touch operation on the display screen, updating the content to be displayed according to the touch operation .

Optionally, the display processing method further includes: when the preset VR interactive switch is turned on, the terminal determines that it is currently adapted to the VR device;

The terminal detects and determines whether it is currently adapted to the VR device by setting a sensor and/or a camera thereon, and opens the VR interactive switch when it is determined that it is currently adapted to the VR device.

Optionally, when the terminal is adapted to the VR virtual reality device, the terminal determining whether the content to be displayed on the display screen can be recognized by the VR device includes:

When the terminal is adapted to the VR device, the terminal acquires a layout structure of the content to be displayed on the display screen thereof;

Determining that the content to be displayed can be recognized by the VR device when the display structure of the content to be displayed is divided into two display areas of the same size and symmetrically defined shapes; Wherein, the content in the display areas of the two specified shapes completely overlap after being translated.

Optionally, when the content to be displayed is not recognized by the VR device, the terminal reconfiguring the layout structure of the content to be displayed into a layout structure that the VR device can recognize includes:

When the content to be displayed cannot be recognized by the VR device, the terminal sorts the display items included in the layout structure according to the acquired layout structure and the preset rearrangement rule, and then rearranges in the specified order. ;

Displaying the rearranged display items in the display area of the two specified shapes in the same layout Domain to get the layout structure that the VR device can recognize.

Optionally, the content to be displayed includes one or more of the following types:

Calls, text messages, web pages, videos, pictures, app pages.

The embodiment of the invention further provides a display processing device, the display processing device comprising:

a determining module, configured to determine, when the terminal is adapted to the virtual reality VR device, whether the content to be displayed on the display screen of the terminal can be recognized by the VR device;

a reconfiguration module, configured to reconfigure a layout structure of the content to be displayed into a layout structure that the VR device can recognize when the content to be displayed cannot be recognized by the VR device;

And a display module, configured to display the to-be-displayed content on the display screen according to the reconstructed layout structure.

Optionally, the display processing device further includes:

The response module is configured to update the to-be-displayed content according to the touch operation when the touch operation on the display screen is detected during the display of the to-be-displayed content on the display screen according to the reconstructed layout structure.

Optionally, the display processing device further includes:

a detecting module, configured to detect and determine whether the terminal is currently adapted to the VR device by using a sensor and/or a camera disposed on the terminal, and open when determining that the terminal is currently adapted to the VR device The VR interactive switch;

The determining module is configured to determine that the terminal is currently adapted to the VR device when the preset VR interactive switch is turned on.

Optionally, the determining module includes:

An acquiring unit, configured to acquire a layout structure of the to-be-displayed content on the display screen of the terminal when the terminal is adapted to the VR device;

a determining unit, configured to determine, when the layout structure of the content to be displayed is a display area that divides the display area of the display screen into two left and right identical sizes and symmetric shapes, determining that the content to be displayed can be VR device identification; wherein, the display areas of the two specified shapes are The content is completely overlapping after panning.

Optionally, the reconstruction module includes:

a rearrangement unit configured to: when the content to be displayed is not recognized by the VR device, classify the display items included in the layout structure according to the acquired layout structure and preset reordering rules, and then specify Rearrangement

And a configuration unit, configured to separately arrange the rearranged display items in the display areas of the two specified shapes in the same layout to obtain a layout structure that the VR device can recognize.

Calls, text messages, web pages, videos, pictures, app pages.

The embodiment of the invention further provides a computer readable storage medium, wherein the computer readable storage medium stores computer executable instructions, and the display processing method is implemented when the computer executable instructions are executed.

The display processing method and device provided by the embodiment of the present invention, when the terminal is adapted to the VR device, determine in real time whether the content to be displayed on the display screen of the terminal can be recognized by the VR device, and the content to be displayed cannot be displayed. When the VR device is recognized by the VR device, the layout structure of the content to be displayed is reconstructed into a layout structure that can be recognized by the VR device, so that the terminal displays the display on the display screen according to the reconstructed layout structure. Tell the content to be displayed. The foregoing technical solution may enable a user to view the content to be displayed through the VR device, so that the VR device can identify any type of display content on the display screen of the terminal, and the user is using the VR device. You will not miss the call or SMS on the terminal.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

DRAWINGS

1 is a schematic flowchart of a display processing method according to Embodiment 1 of the present invention;

2 is a schematic diagram of a refinement process of step S10 in FIG. 1;

3 is a schematic diagram showing the refinement process of step S20 in FIG. 1;

4 is a schematic structural diagram of a layout before and after reconstruction in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a layout of a double row arrangement after list reconfiguration according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic flowchart of a display processing method according to Embodiment 2 of the present invention;

FIG. 7 is a schematic diagram of functional blocks of a display processing apparatus according to Embodiment 4 of the present invention; FIG.

FIG. 8 is a schematic diagram of another functional module of a display processing apparatus according to Embodiment 4 of the present invention; FIG.

FIG. 9 is a schematic diagram of still another functional block of a display processing apparatus according to Embodiment 4 of the present invention.

detailed description

The embodiments of the present invention are described in detail below with reference to the accompanying drawings.

Embodiment 1

An embodiment of the present invention provides a display processing method. As shown in FIG. 1 , a schematic flowchart of a display processing method according to an embodiment of the present invention is shown. The display processing method includes:

Step S10: When the terminal is adapted to the virtual reality VR device, the terminal determines whether the content to be displayed on the display screen can be recognized by the VR device;

The display processing method may be implemented on a terminal, and the VR device may be a device such as a VR glasses, or a device capable of playing a source of the VR device to support viewing, such as a mobile phone, a tablet computer, or the like. The content to be displayed includes but is not limited to the following types: an incoming call, a short message, a webpage, a video, a picture, an application page, and other types of display content displayed on the terminal display interface, which are not enumerated here.

Optionally, when the preset VR interactive switch is turned on, the terminal determines that it is currently adapted to the VR device. The VR interaction switch is configured on the terminal, and is disabled by default. When the terminal needs to cooperate with the VR device, after the VR interaction switch is turned on, the terminal can be adapted to the VR. In the device. The user can manually open the VR interactive switch at a specified location on the terminal, or the terminal can automatically open the VR interactive switch under certain conditions. As long as the VR interactive switch is in an open state, the terminal considers it to be in the same state as the VR device Interactive scenes and provide features that match the scene. The user can manually turn off the VR interactive switch when the VR device is not used, after which the terminal resumes normal operation and provides a regular function.

Optionally, referring to FIG. 2, the foregoing step S10 includes:

Step S11: When the terminal is adapted to the VR device, the terminal acquires a layout structure of the content to be displayed on the display screen thereof;

Step S12, when the layout structure of the content to be displayed is divided into two display areas of the same size and symmetrically defined shapes, the content to be displayed can be determined by the VR. Device identification; where the content in the display area of two specified shapes is completely overlapped after translation.

After determining that the terminal is currently adapted to the VR device, the terminal obtains a layout structure (ie, a layout setting) of the content to be displayed on the display screen from the cached display data in real time, where the layout structure includes a to-be-displayed One or more display items, such as text, pictures, videos, buttons, lists, icons, etc., and the display position of each display item on the display area of the display.

Since the VR device can only better recognize the left and right two identically-sized and symmetric contents of the display area having the same shape as the lens shape in the VR device on the display area, the content to be displayed is The layout structure is such that the display area of the display screen is equally divided into two display areas of the same size and symmetrical specified shape, and the contents of the display areas of the two specified shapes can be completely overlapped after being translated (see FIG. 4). In the reconstructed layout structure shown in (b), it may be determined that the content to be displayed can be recognized by the VR device, otherwise, the VR device cannot be recognized. Wherein, the specified shape refers to a shape identical to the shape of the lens in the VR device, and a common shape is an ellipse or a circle.

If the content to be displayed can be recognized by the VR device, the terminal directly displays the content to be displayed on the display screen according to the original layout structure. At this time, the user passes the VR device. The content to be displayed can be viewed. When the content to be displayed cannot be recognized by the VR device, the user cannot view the content to be displayed through the VR device.

Step S20: When the content to be displayed is not recognized by the VR device, the terminal reconstructs a layout structure of the content to be displayed into a layout structure that the VR device can recognize;

Optionally, referring to FIG. 3, the foregoing step S20 includes:

Step S21: When the content to be displayed is not recognized by the VR device, the terminal classifies all display items included in the layout structure according to the acquired layout structure and preset reordering rules. Specify the order of rearrangement;

Step S22: The rearranged display items are respectively arranged in the display area of the two specified shapes in the same layout to obtain a layout structure that the VR device can recognize.

When the content to be displayed is not recognized by the VR device, the terminal needs to reconstruct an existing layout structure of the content to be displayed, so that the reconstructed layout structure can satisfy the VR device. Identification requirements.

In this embodiment, the terminal classifies the display items included in the layout structure according to the preset rearrangement rule according to the acquired layout structure, for example, dividing the text, the picture, the video, and the like into a display class. Divide buttons, lists, icons, etc. into actionable classes, etc.; then rearrange them according to the specified collation, for example, in the same ellipse display area, display the display items of the display class from top to bottom in the original layout structure. Arranged in order from left to right and then placed on the left side of the elliptical display area, and each display item of the operable class is arranged in order from top to bottom and left to right in the original layout structure. On the right side of the elliptical display area, and as far as possible, all the display items are evenly covered by the elliptical display area, as shown in FIG. 4; finally, the layout setting of the display item in the elliptical display area is copied to Another elliptical display area provides a layout structure that can be recognized by the VR device.

It should be noted that, when reconfiguring the layout structure, all the display class display items may be rearranged, or only the necessary display class display items and the operable class display items guiding the user to perform the next operation may be emphasized. Rows, while other non-essential display items are no longer set in the refactored layout structure, that is, non-essential display items are no longer displayed. When the display item is a list, the children in the list can be arranged in a double row, as shown in FIG.

Step S30: The terminal displays the content to be displayed on the display screen according to the reconstructed layout structure.

In this embodiment, after the layout structure of the content to be displayed is obtained, when the content to be displayed needs to be displayed, the terminal displays the to-be-displayed on the display screen according to the reconstructed layout structure. Display content, since the content displayed according to the reconstructed layout structure can be used by the VR device Identifying, so that the user can view the content to be displayed through the VR device.

The display processing method of the embodiment of the present invention determines whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to the VR device, and when the content to be displayed cannot be When the VR device is identified, the layout structure of the content to be displayed is reconstructed into a layout structure that can be recognized by the VR device, so that the terminal displays the to-be-displayed on the display screen according to the reconstructed layout structure. Display content. The above technical solution enables the user to view the content to be displayed through the VR device, so that the VR device can recognize any type of display content on the display screen of the terminal, when the user uses the VR device. There will be no more missed calls or text messages on the terminal.

Embodiment 2

Based on the display processing method of the first embodiment, in the second embodiment, referring to FIG. 6, the display processing method further includes:

Step S40: During the terminal displaying the content to be displayed on the display screen according to the reconstructed layout structure, when the terminal detects a touch operation on the display screen, update according to the touch operation. To be displayed.

During the terminal displaying the content to be displayed on the display screen according to the reconstructed layout structure, the user can view each display item displayed on the display screen by the VR device, if the display items are Containing an operable display item, such as a button, when the user clicks the button on the display screen, the terminal can detect the touch operation on the display screen, after which the terminal according to the touch The operation updates the display on the display.

In this embodiment, when reconstructing the original layout structure, each display item in the reconstructed layout structure needs to be assigned a new label number, and the label numbers are unique to each display item. It is identified, and the label number of the display item in the reconstructed layout structure needs to be mapped one by one with the label number of the same display item in the original layout structure.

During the display of the content to be displayed on the display screen according to the reconstructed layout structure, when the user clicks on any display item of the operable type on the display screen of the terminal, the terminal can Obtaining the tag number of the display item in the reconstructed layout structure, and obtaining by mapping The tag number of the display item in the original layout structure, which in turn triggers a response event corresponding to the tag number obtained by the mapping, so that the terminal refreshes the current display content or jumps the page.

The display processing method of the embodiment of the present invention enables the VR device to recognize the display content of the terminal that is not originally recognized, and can perform the user on the terminal without the user taking the terminal from the VR device. The touch operation makes a correct response, so that the user can greatly facilitate the operation of the user by using the terminal without missing any display content provided by the terminal.

Embodiment 3

The display processing method according to the second embodiment, the display processing method further includes:

It can be understood that when the terminal determines that it is not placed in the VR device, the VR interactive switch is turned off. In this embodiment, the sensor disposed on the terminal may be one or more of a proximity sensor, a gravity sensor, and a pressure sensor, and the camera disposed on the terminal may be a front camera.

Taking the proximity sensor, the gravity sensor, and the front camera as examples on the terminal, when the gravity sensor detects that the terminal is vertically and vertically placed with respect to the horizontal plane, the terminal opens the proximity sensor, and when the proximity sensor detects After the distance between the terminal and the VR device is 0 and continues for a specified time, the front camera is turned on. If the image collected by the front camera is all black, the terminal is considered to have been placed in the VR device. .

Taking the pressure sensor and the gravity sensor on the terminal as an example, when the pressure sensor detects that there is uniform pressure around the frame of the terminal, and the gravity sensor detects that the terminal is vertically and vertically placed with respect to the horizontal plane, then The terminal is considered to have been placed in the VR device.

The display processing method proposed by the embodiment of the present invention can be automatically detected and determined by the terminal by setting a sensor and/or a camera thereon to determine whether it is currently adapted to the VR device to determine its current state. When being adapted to the VR device, the VR interactive switch is opened without the user manually opening the VR interactive switch when needed, which simplifies the user operation and is more automated and intelligent.

Embodiment 4

The embodiment of the present invention further provides a display processing device. As shown in FIG. 7, a functional block diagram of a display processing device according to an embodiment of the present invention is shown. The display processing device includes:

The determining module 100 is configured to determine, when the terminal is adapted to the VR virtual reality device, whether the content to be displayed on the display screen of the terminal can be recognized by the VR device;

The determining module 200 is configured to determine that the terminal is currently adapted to the VR device when the preset VR interactive switch is turned on.

The display processing device is disposed on the terminal, and the VR device may be a device such as a VR glasses, or a device capable of playing a source of the VR device to support viewing, such as a mobile phone, a tablet computer, or the like. The content to be displayed includes but is not limited to the following types: an incoming call, a short message, a webpage, a video, a picture, an application page, and other types of display content displayed on the terminal display interface, which are not enumerated here.

The VR interaction switch is configured on the terminal, and is disabled by default. When the terminal needs to cooperate with the VR device, after the VR interaction switch is turned on, the terminal can be adapted to the VR. In the device. The user can manually open the VR interactive switch at a specified location on the terminal, or the terminal can automatically open the VR interactive switch under certain conditions. As long as the VR interactive switch is in an open state, the terminal considers that it is in a scenario of interacting with the VR device and provides a function matching the scenario. The user can manually turn off the VR interactive switch when the VR device is not used, after which the terminal resumes normal operation and provides a regular function.

Optionally, the determining module 100 includes:

a determining unit, configured to determine, when the layout structure of the content to be displayed is a display area that divides the display area of the display screen into two left and right identical sizes and symmetric shapes, determining that the content to be displayed can be VR device identification; wherein, within two display areas of a specified shape Fully overlap after the translation.

After determining that the terminal is currently adapted to the VR device, the determining unit 200 of the determining module 100 obtains the layout structure of the content to be displayed on the display screen from the cached display data in real time ( That is, the layout setting), wherein the layout structure includes one or more display items to be displayed, such as text, pictures, videos, buttons, lists, icons, and the like, and a display position of each display item on the display area of the display screen. .

Since the VR device can only better recognize the left and right two identically-sized and symmetric contents of the display area having the same shape as the lens shape in the VR device on the display area, the content to be displayed is The layout structure is such that the display area of the display screen is equally divided into two display areas of the same size and symmetrical specified shape, and the contents of the display areas of the two specified shapes can be completely overlapped after being translated (see FIG. 4). (b) The layout structure shown), the determining unit may determine that the content to be displayed can be recognized by the VR device, otherwise it cannot be recognized by the VR device. Wherein, the specified shape refers to a shape identical to the shape of the lens in the VR device, and a common shape is an ellipse or a circle.

The reconstruction module 300 is configured to reconfigure a layout structure of the to-be-displayed content into a layout structure that the VR device can recognize when the content to be displayed cannot be recognized by the VR device;

Optionally, the reconstruction module 300 includes:

The configuration unit is configured to respectively arrange the rearranged display items in the display areas of the two specified shapes in the same layout to obtain a layout structure that the VR device can recognize.

When the content to be displayed is not recognized by the VR device, the terminal needs to reconstruct an existing layout structure of the content to be displayed, so that the reconstructed layout structure can satisfy the The identification requirements of the VR device.

In this embodiment, the reconstruction module 300 of the terminal classifies, according to the acquired layout structure, the display items included in the layout structure according to a preset rearrangement rule by the rearrangement unit, for example, Text, images, videos, etc. are divided into display classes, which divide buttons, lists, icons, etc. into actionable classes; and then rearrange them according to the specified sorting rules, for example, in the same oval display area, the class will be displayed. The display items are arranged in the order from top to bottom and left to right in the original layout structure, and are arranged on the left side of the elliptical display area, and the display items of the operable class are arranged from top to bottom in the original layout structure. The left-to-right order is arranged in the order of the right side of the elliptical display area, and as far as possible, all the display items are evenly covered by the elliptical display area, as shown in FIG. 4; finally, by the configuration unit The layout setting of the display item in the elliptical display area is copied to another elliptical display area, thereby obtaining a layout structure that can be recognized by the VR device.

It should be noted that, when reconfiguring the layout structure, the rearrangement unit may rearrange all display class display items, or may only display necessary display class items, and may operate the user to perform the next operation. Class display items are rearranged, and other non-essential display items are no longer set in the refactored layout structure, that is, non-essential display items are no longer displayed. When the display item is a list, the rearrangement unit can arrange the children in the list in a double row, as shown in FIG. 5.

The display module 400 is configured to display the content to be displayed on the display screen according to the reconstructed layout structure.

After the layout structure of the content to be displayed is obtained, when the content to be displayed needs to be displayed, the display module 400 of the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure. The content displayed in the reconstructed layout structure can be recognized by the VR device, so that the user can view the content to be displayed through the VR device.

The display processing device of the embodiment of the present invention determines whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to the VR device, and when the content to be displayed cannot be When the VR device is identified, the layout structure of the content to be displayed is reconstructed into a layout structure that can be recognized by the VR device, so that the terminal displays the to-be-displayed on the display screen according to the reconstructed layout structure. Display content. The above technical solution enables the user to view the content to be displayed through the VR device, so that the VR device can recognize any type of display content on the display screen of the terminal, when the user uses the VR device. Will not miss again The content of an incoming call or a short message on the terminal.

Optionally, based on the above display processing device, referring to FIG. 8, the display processing device further includes:

The response module 500 is configured to update the to-be-displayed content according to the touch operation when the touch operation on the display screen is detected during the display of the to-be-displayed content on the display screen according to the reconstructed layout structure .

During the display module 400 of the terminal displaying the content to be displayed on the display screen according to the reconstructed layout structure, the user can view the display items displayed on the display screen by the VR device, if these The display item includes an operable display item, such as a button, when the user clicks the button on the display screen, the response module 500 of the terminal can detect the touch operation on the display screen, and then, The response module 500 of the terminal updates the display content on the display screen according to the touch operation.

Specifically, when reconstructing the original layout structure, it is necessary to respectively assign new label numbers to the display items in the reconstructed layout structure, and the label numbers are uniquely identified for each display item, and need to be The label number of the display item in the reconstructed layout structure is mapped one by one with the label number of the same display item in the original layout structure.

After the display module 400 of the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the user clicks on any display item of the operable class on the display screen of the terminal, The response module 500 of the terminal can obtain the label number of the display item in the reconstructed layout structure, and obtain the label number of the display item in the original layout structure by mapping, thereby triggering the response corresponding to the label number obtained by the mapping. The event causes the display module 400 of the terminal to refresh the current display content or jump the page.

The display processing device of the embodiment of the present invention can enable the VR device to recognize the display content of the terminal that is not originally recognized, and can perform the user on the terminal without the user taking the terminal from the VR device. The touch operation makes a correct response, and the user is greatly facilitated to operate using the terminal without causing the user to miss any display content provided by the terminal.

Optionally, based on the above display processing device, referring to FIG. 9, the display processing device further includes:

The detecting module 600 is configured to detect and determine whether the terminal is currently adapted to the VR device by using a sensor and/or a camera disposed on the terminal, and when determining that the terminal is currently adapted to the VR device, Opening the VR interactive switch;

It can be understood that when the detecting module 600 of the terminal determines that the terminal is not placed in the VR device, the VR interactive switch is turned off. In this embodiment, the sensor disposed on the terminal may be one or more of a proximity sensor, a gravity sensor, and a pressure sensor, and the camera disposed on the terminal may be a front camera.

Taking the proximity sensor, the gravity sensor, and the front camera as examples, when the gravity sensor detects that the terminal is vertically and vertically placed with respect to the horizontal plane, the detecting module 600 of the terminal opens the proximity sensor, and when The proximity sensor detects that the distance between the terminal and the VR device is 0 and continues for a specified time, and then turns on the front camera. If the image collected by the front camera is all black, the detecting module 600 determines the terminal. Has been placed in the VR device.

Taking the pressure sensor and the gravity sensor on the terminal as an example, when the pressure sensor detects that there is uniform pressure around the frame of the terminal, and the gravity sensor detects that the terminal is vertically and vertically placed with respect to the horizontal plane, then The detection module 600 determines that the terminal has been placed in the VR device.

The display processing device of the embodiment of the present invention can automatically detect and determine whether it is currently adapted to the VR device by the terminal by setting a sensor and/or a camera thereon, so as to determine that it is currently adapted to the VR device. The VR interactive switch is opened without the user manually opening the VR interactive switch when needed, which simplifies user operations and is more automated and intelligent.

The embodiment of the invention further provides a computer readable storage medium, wherein the computer readable storage medium stores computer executable instructions, and the computer executable instructions are implemented to implement a display processing method.

One of ordinary skill in the art will appreciate that all or part of the steps in the above methods may be performed by a program to instruct related hardware, such as a processor, which may be stored in computer readable storage. In media, such as read-only memory, disk or optical disk. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by a processor. / instruction to achieve its corresponding function. This application is not limited to any specific combination of hardware and software. A person skilled in the art should understand that the technical solutions of the present application can be modified or equivalent, without departing from the spirit and scope of the technical solutions of the present application, and should be included in the scope of the claims of the present application.

Industrial applicability

The above technical solution can enable the user to not miss the content of the incoming call or the short message on the terminal when using the VR device.

Claims

A display processing method, the display processing method comprising:

When the terminal is adapted to the virtual reality VR device, the terminal determines whether the content to be displayed on the display screen can be recognized by the VR device;

When the content to be displayed is not recognized by the VR device, the terminal reconstructs a layout structure of the content to be displayed into a layout structure that the VR device can recognize;

The terminal displays the content to be displayed on the display screen according to the reconstructed layout structure.
The display processing method according to claim 1, wherein the display processing method further comprises:

While the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the terminal detects a touch operation on the display screen, updating the content to be displayed according to the touch operation .
The display processing method according to claim 1 or 2, wherein the display processing method further comprises:

When the preset VR interactive switch is turned on, the terminal determines that it is currently adapted to the VR device; the terminal detects and determines whether it is currently adapted to the VR device by setting a sensor and/or a camera thereon And when it is determined that it is currently adapted in the VR device, the VR interactive switch is turned on.
The display processing method according to claim 1, wherein when the terminal is adapted to the VR virtual reality device, the terminal determines whether the content to be displayed on the display screen can be recognized by the VR device, including:

When the terminal is adapted to the VR device, the terminal acquires a layout structure of the content to be displayed on the display screen thereof;

Determining that the content to be displayed can be recognized by the VR device when the display structure of the content to be displayed is divided into two display areas of the same size and symmetrically defined shapes; Wherein, the content in the display areas of the two specified shapes completely overlap after being translated.
The display processing method according to claim 4, wherein: when the content to be displayed cannot be recognized by the VR device, the terminal reconstructs a layout structure of the content to be displayed into a The layout structure that the VR device can recognize includes:

When the content to be displayed cannot be recognized by the VR device, the terminal sorts the display items included in the layout structure according to the acquired layout structure and the preset rearrangement rule, and then rearranges in the specified order. ;

The rearranged display items are respectively arranged in the display area of the two specified shapes in the same layout to obtain a layout structure that the VR device can recognize.
The display processing method according to claim 1, wherein the content to be displayed comprises one or more of the following types:

Calls, text messages, web pages, videos, pictures, app pages.
A display processing device, the display processing device comprising:

a determining module, configured to determine, when the terminal is adapted to the virtual reality VR device, whether the content to be displayed on the display screen of the terminal can be recognized by the VR device;

a reconfiguration module, configured to reconfigure a layout structure of the content to be displayed into a layout structure that the VR device can recognize when the content to be displayed cannot be recognized by the VR device;

And a display module, configured to display the to-be-displayed content on the display screen according to the reconstructed layout structure.
The display processing device according to claim 7, wherein the display processing device further comprises:

The response module is configured to update the to-be-displayed content according to the touch operation when the touch operation on the display screen is detected during the display of the to-be-displayed content on the display screen according to the reconstructed layout structure.
The display processing device according to claim 7 or 8, wherein the display processing device further comprises:

a detecting module, configured to detect and determine whether the terminal is currently adapted to the VR device by using a sensor and/or a camera disposed on the terminal, and open when determining that the terminal is currently adapted to the VR device VR interactive switch;

The determining module is configured to determine that the terminal is currently adapted to the VR device when the preset VR interactive switch is turned on.
The display processing device according to claim 7, wherein said determining module comprises:

An acquiring unit, configured to acquire a layout structure of the to-be-displayed content on the display screen of the terminal when the terminal is adapted to the VR device;

a determining unit, configured to determine, when the layout structure of the content to be displayed is a display area that divides the display area of the display screen into two left and right identical sizes and symmetric shapes, determining that the content to be displayed can be The VR device is identified; wherein the content in the display areas of the two specified shapes completely overlap after being translated.
The display processing device of claim 10, wherein: said reconstruction module comprises:

a rearrangement unit configured to: when the content to be displayed is not recognized by the VR device, classify the display items included in the layout structure according to the acquired layout structure and preset reordering rules, and then specify Rearrangement

The configuration unit is configured to respectively arrange the rearranged display items in the display areas of the two specified shapes in the same layout to obtain a layout structure that the VR device can recognize.
The display processing device according to claim 7, wherein said content to be displayed comprises one or more of the following types:

Calls, text messages, web pages, videos, pictures, app pages.