CN113032077A - Multitask three-dimensional effect display method and device of head-mounted device and electronic device - Google Patents

Multitask three-dimensional effect display method and device of head-mounted device and electronic device Download PDF

Info

Publication number
CN113032077A
CN113032077A CN202110336007.0A CN202110336007A CN113032077A CN 113032077 A CN113032077 A CN 113032077A CN 202110336007 A CN202110336007 A CN 202110336007A CN 113032077 A CN113032077 A CN 113032077A
Authority
CN
China
Prior art keywords
target
target application
display
application
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110336007.0A
Other languages
Chinese (zh)
Inventor
王和平
张军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202110336007.0A priority Critical patent/CN113032077A/en
Publication of CN113032077A publication Critical patent/CN113032077A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a multitask three-dimensional effect display method and device of head-mounted equipment and electronic equipment, relates to the technical field of intelligent display of the head-mounted equipment, and improves the operation experience of a user using the head-mounted equipment, and the main technical scheme of the invention is as follows: receiving a trigger instruction for opening a first target application; acquiring target display information corresponding to a first target application and a second target application according to a trigger instruction, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened; performing three-dimensional rendering display processing on target display information corresponding to the first target application and the second target application; and displaying the content information after the three-dimensional rendering display processing on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer. The method is mainly applied to three-dimensional rendering display of the target display information corresponding to the opened multiple applications.

Description

Multitask three-dimensional effect display method and device of head-mounted device and electronic device
Technical Field
The invention relates to the technical field of intelligent display of head-mounted equipment, in particular to a multitask three-dimensional effect display method and device of the head-mounted equipment and electronic equipment.
Background
With the development and application of virtual reality, augmented reality and mixed reality technologies, various head-mounted devices based on the technologies gradually appear in public vision, and virtual reality pictures, augmented reality pictures and mixed reality pictures can be displayed through a display screen of the head-mounted device, so that rich three-dimensional immersive experience is provided for a user.
At present, the smart application service provided by the head-mounted device is implemented based on an android system, under which for an installed native application or other third-party application, it is still presented with a two-dimensional planar display effect, such as an application icon displayed similarly to a desktop of a mobile phone and a method for presenting an open application, for a plurality of application icons existing on a display desktop of the head-mounted device, the application icons are presented in a two-dimensional display manner in a display screen, and as a user continuously opens a plurality of applications for a desired experience, the corresponding plurality of applications are in an opened state, but finally present to the user in the display screen is display content corresponding to a last opened application, for a user operation experience, that is, display content of other one or more opened applications is covered by display content of the last opened application, and thus is not visible to the user within the display screen.
However, although the existing two-dimensional display manner is adopted to show one or more application icons of the head-mounted device, the user can know which smart applications can operate the experience, especially in the case that a plurality of applications are in the opened state, since only the last opened application display content is shown in the display screen, the user needs to spend time and operation cost to continuously trigger switching or closing some opened applications to inquire about the required specified application, and in addition, the display screen is switched between two-dimensional and three-dimensional, so that the immersive experience of the user using the head-mounted device is greatly reduced.
Disclosure of Invention
In view of this, the present invention provides a method and an apparatus for displaying a multitask three-dimensional effect of a head-mounted device, and mainly aims to embed and display target display information corresponding to a plurality of opened target applications in the same display interface layer in the head-mounted device by using a three-dimensional rendering display manner, so that a user can conveniently and efficiently find an appointed opened target application, and meanwhile, the user is ensured to be always in a three-dimensional immersive environment, thereby greatly improving the operation experience of the user in using the head-mounted device.
In order to achieve the above purpose, the present invention mainly provides the following technical solutions:
the application provides a multitask three-dimensional effect display method of a head-mounted device in a first aspect, and the method comprises the following steps:
receiving a trigger instruction for opening a first target application;
acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened;
performing three-dimensional rendering display processing on target display information corresponding to the first target application and the second target application;
displaying the content information after the three-dimensional rendering display processing on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
In some modified embodiments of the first aspect of the present application, the performing three-dimensional rendering and display processing on the target display information corresponding to the first target application and the second target application includes:
creating corresponding display windows for the target display information corresponding to the first target application and the second target application;
rendering and filling the target display information into the corresponding display window to generate a corresponding window page;
and embedding the three-dimensional rendering of the window page corresponding to the first target application and the window page corresponding to the second target application into a display interface contained in the same layer.
In some modified embodiments of the first aspect of the present application, the embedding the three-dimensional rendering of the window page corresponding to the first target application and the window page corresponding to the second target application into a display interface included in a same layer includes:
marking a window page corresponding to the first target application as a main window page;
marking the window page corresponding to the second target application as an auxiliary window page;
and embedding the three-dimensional rendering of the auxiliary window page in the main window page.
In some modified embodiments of the first aspect of the present application, the embedding the three-dimensional rendering of the secondary window page within the primary window page includes:
if the three-dimensional rendering in the main window page is embedded into at least two auxiliary window pages, overlapping and displaying the at least two auxiliary window pages in the main window page;
in at least two auxiliary window pages displayed in an overlapped mode, the size of the auxiliary window page overlapped in the front is determined to be larger than the window size of the auxiliary window page overlapped in the rear;
if an operation instruction of clicking a target auxiliary window page by touch is received, judging whether the target auxiliary window page is an auxiliary window page superposed at the head position;
if not, adjusting the target auxiliary window page to the first position of window superposition, and amplifying the auxiliary window page with the size larger than that of the original auxiliary window page superposed at the first position.
In some modified embodiments of the first aspect of the present application, after obtaining target display information corresponding to the first target application and the second target application, the method further includes:
marking the completion time points of the loading of the target display information by the first target application and the second target application;
and adding a timestamp to the target display information according to the completion time point.
In some modified embodiments of the first aspect of the present application, the displaying the content information after the three-dimensional rendering and display processing on the display screen of the head-mounted device includes:
according to the timestamp added to the target display information, determining a timestamp matched with a window page corresponding to the target display information;
according to the timestamp matched with the window page, sequencing the window page corresponding to the first target application and the window page corresponding to the second target application according to the descending of the timestamp to obtain a corresponding sequencing queue, wherein the display time of the timestamp matched with the sequencing first window page in the sequencing queue is longer than that of the timestamp matched with the sequencing last window page;
and according to the sorting queue, displaying the window pages sorted in front on the window pages sorted in back in an overlapping manner.
In some modified embodiments of the first aspect of the present application, the acquiring, according to the trigger instruction, target display information corresponding to the first target application and the second target application includes:
loading native page display information corresponding to the first target application and the second target application;
executing screenshot operation on the native page display information to generate screenshot pages corresponding to the first target application and the second target application;
and determining screenshot pages corresponding to the first target application and the second target application as target display information corresponding to the first target application and the second target application.
In some modified embodiments of the first aspect of the present application, after the acquiring, according to the trigger instruction, target display information corresponding to the first target application and the second target application, the method further includes:
acquiring a first function touch button contained in a native page corresponding to the first target application and the second target application;
acquiring a second function touch button contained in a screenshot page corresponding to the first target application and the second target application;
establishing an association relation between the first function touch button and the second function touch button according to the same function touch button identification;
if an operation instruction of clicking a target second function touch button contained in a touch target screenshot page is received, according to the incidence relation, clicking a corresponding target first function touch button in a target native page corresponding to the target screenshot page through touch, and acquiring display information corresponding to the target first function touch button;
and generating a window page by utilizing the display information, and replacing the target screenshot page and displaying the target screenshot page in a display interface.
A second aspect of the present application provides a multitask three-dimensional effect display device of a head mounted device, the device including:
the receiving unit is used for receiving a trigger instruction for opening the first target application;
the acquiring unit is used for acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction received by the receiving unit, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened;
the processing unit is used for performing three-dimensional rendering and display processing on the target display information corresponding to the first target application and the second target application acquired by the acquisition unit;
and the display unit is used for displaying the content information subjected to the three-dimensional rendering and display processing by the processing unit on a display screen of the head-mounted device, so that the target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
A storage medium including a stored program according to a third aspect of the present application, wherein the program controls a device on which the storage medium is located to perform the multitask three-dimensional effect display method of the head-mounted device as described above when the program runs.
A fourth aspect of the present application provides an electronic device comprising at least one processor, and at least one memory, a bus, connected to the processor;
the processor and the memory complete mutual communication through the bus;
the processor is configured to invoke program instructions in the memory to perform the method of multi-tasking three-dimensional effect display for a head-mounted device as described above.
By the technical scheme, the technical scheme provided by the invention at least has the following advantages:
the invention provides a multitask three-dimensional effect display method and a multitask three-dimensional effect display device for head-mounted equipment. Compared with the prior art, the method and the device solve the problem of poor immersive experience of the user using the head-mounted device due to the fact that the application icons are displayed in a two-dimensional display mode and the application opening method is displayed, display information corresponding to a plurality of opened applications is displayed simultaneously in a three-dimensional rendering display mode, so that the user can conveniently and efficiently find the appointed opened target application, meanwhile, the user is ensured to be always in a three-dimensional immersive environment, and the operation experience of the user using the head-mounted device is greatly improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart of a multitask three-dimensional effect display method for a head-mounted device according to an embodiment of the present invention;
FIG. 2 is a schematic view of an exemplary process flow for displaying information of a target corresponding to an opened application according to an embodiment of the present invention
Fig. 3 is a flowchart of another multitask three-dimensional effect display method for a head-mounted device according to an embodiment of the present invention;
fig. 4 is a block diagram illustrating a multitask three-dimensional effect display device of a head-mounted device according to an embodiment of the present invention;
fig. 5 is a block diagram of a multitasking three-dimensional effect display device of another head-mounted device according to an embodiment of the present invention;
fig. 6 is an electronic device for displaying a multitasking three-dimensional effect of a head-mounted device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
The embodiment of the invention provides a multitask three-dimensional effect display method of head-mounted equipment, as shown in fig. 1, the method is to embed and display target display information corresponding to a plurality of opened target applications in the same layer of display interface in the head-mounted equipment by using a three-dimensional rendering display mode, and the following specific steps are provided for the embodiment of the invention:
101. and receiving a trigger instruction for opening the first target application.
In the embodiment of the present invention, the first target application is a desktop application (launcher app for short), which is different from an existing mobile phone/tablet desktop start application, but is a desktop application that is manufactured by using a 3d design tool such as unity or opengl and can be used for showing a 3d effect, so that according to the desktop application showing the 3d effect, display information of a plurality of applications that have been opened is rendered and shown in the same desktop interface in three dimensions at the same time.
102. And acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened.
In the embodiment of the present invention, the second target application refers to a native application (such as a "calendar" application, a "setting" application, and the like) installed on the head mounted device itself or a third-party application (such as a "weather" application, a map application, and the like) downloaded from an application market, it should be noted that, in the embodiment of the present invention, the "first" and the "second" are only used to distinguish different applications, there is no precedence order for describing object objects, and the target display information refers to content information of an application that is displayed when the application is opened.
The head-mounted device provides not only desktop applications but also other smart application services, icons of which can be displayed within the desktop interface, and as the user continuously opens 1 or more applications for which experience is desired, accordingly, the head-mounted device may have 1 or more applications already opened. For the embodiment of the invention, according to the received trigger instruction for opening the desktop application, a mechanism for acquiring the display information corresponding to the application is triggered, that is, the target display information corresponding to the desktop application and the target display information corresponding to 1 or more currently opened intelligent applications are acquired.
103. And performing three-dimensional rendering display processing on the target display information corresponding to the first target application and the second target application.
In the embodiment of the present invention, as shown in fig. 2, a schematic processing flow diagram of displaying information of a target corresponding to an opened application is described in detail:
the left picture, the middle picture and the right picture are included in fig. 2, and the left picture in fig. 2 shows that the opened applications are "desktop application", APP1 and APP 2; the middle picture shows target display content 0 corresponding to the desktop application, target display content 1 corresponding to APP1, and target display content 2 corresponding to APP2, which are received by the framework layer of the head-mounted device system, and as shown in fig. 2, target display content 1 and target display content 2 are returned to the desktop application; the right picture displays the target display content 1 and the target display content 2 in a three-dimensional rendering mode in the desktop application, so that the target display content 1 and the target display content 2 are embedded and displayed in the same layer of display interface.
It should be noted that, for clarity, the embodiment of the present invention is only illustrated with reference to fig. 2 to explain the step, but no specific limitation is made to the display effect of the step after the three-dimensional rendering processing is performed on the number of open applications and the plurality of target display contents.
104. And displaying the content information after the three-dimensional rendering display processing on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
In the embodiment of the present invention, after the three-dimensional rendering and display processing in step 103, the output display effect is: target display information corresponding to the desktop application and other applications is ensured to be embedded and displayed in the same layer of display interface, and therefore target display content corresponding to other applications is displayed in the target display content of the desktop application at the same time.
The embodiment of the invention provides a multitask three-dimensional effect display method for a head-mounted device. Compared with the prior art, the method and the device solve the problem that the immersive experience of the user using the head-mounted device is poor due to the fact that the application icons are displayed in a two-dimensional display mode and the application opening method is displayed, the embodiment of the invention realizes the simultaneous display of the display information corresponding to the plurality of opened applications by using a three-dimensional rendering display mode, so that the user can conveniently and efficiently find the appointed opened target application, meanwhile, the user is ensured to be always in a three-dimensional immersive environment, and the operation experience of the user using the head-mounted device is greatly improved.
In order to describe the above embodiments in more detail, another multitask three-dimensional effect display method for a head-mounted device is further provided in the embodiments of the present invention, as shown in fig. 3, the following specific steps are provided for the embodiments of the present invention:
201. and receiving a trigger instruction for opening the first target application.
In the embodiment of the present invention, the statement of this step is referred to as step 101, and is not described herein again.
202. And acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened.
In the embodiment of the present invention, when the first target application or the second target application is triggered to open, the opened application loads content information of the application, and further presents corresponding page information (i.e. native page display information), where the page information includes dynamic data information, where the dynamic data information refers to 1 or more functional touch buttons, for example: the setting application is opened, the presented page information comprises a wireless network function touch button, a voice control function touch button, a wallpaper setting function touch button and the like, and the next-level page jump can be executed according to the function touch buttons and corresponding function setting is carried out. Therefore, for the dynamic data information contained in the page information presented after each application is opened, the information quantity and the information diversity of the dynamic data information contained in the page information presented corresponding to each application are uncertain according to the difference between the function touch button actually contained in the application and the provided intelligent function service.
For the embodiment of the present invention, exemplarily, in order to simplify the target display information displayed by each opened application, after the native page display information corresponding to the first target application or the second target application is loaded, a screenshot operation may be performed on the native page display information to generate screenshot pages corresponding to the first target application and the second target application, and the screenshot pages corresponding to the first target application and the second target application are determined as the target display information corresponding to the first target application and the second target application, so that the screenshot pages are used to replace the native pages as the corresponding target display information The display effect of the interface is displayed, and the processing efficiency is greatly improved.
203. And creating corresponding display windows for the target display information corresponding to the first target application and the second target application.
In this embodiment of the present invention, as further described in detail with reference to fig. 2 illustrated above, after target display information corresponding to a first target application and a second target application is obtained, a plurality of target display information are sent to a framework layer of a head-mounted device system, and the framework layer returns the target display information corresponding to the second target application to the first target application, where the first target application creates corresponding display windows for the target display information corresponding to the first target application and the target display information corresponding to the returned second target application, so that one target display information corresponds to one display window.
204. And rendering and filling the target display information into the corresponding display window to generate a corresponding window page.
In the embodiment of the present invention, the target display information corresponding to the first target application and the second target application is rendered and filled into the corresponding display windows, for example, in step 202, the screenshot page is taken as the target display information, and then the screenshot page is correspondingly filled into the display windows, and according to the filled display windows, the window pages are correspondingly generated.
205. And embedding the three-dimensional rendering of the window page corresponding to the first target application and the window page corresponding to the second target application into a display interface contained in the same layer.
In the embodiment of the invention, the following is set forth in detail for this step:
firstly, marking a window page corresponding to a first target application as a main window page, and marking a window page corresponding to a second target application as an auxiliary window page, and according to the marking operation, obtaining the relation that auxiliary is subordinate to main in a plurality of window pages, thereby realizing the embedding of the three-dimensional rendering of the auxiliary window page into the main window page according to the relation.
Secondly, the specific implementation method for embedding the three-dimensional rendering of the auxiliary window page in the main window page includes, but is not limited to, the following exemplary statements:
example 1, if the three-dimensional rendering in the main window page is embedded into at least two auxiliary window pages, the at least two auxiliary window pages are displayed in the main window page in an overlapping manner. In at least two auxiliary window pages displayed in an overlapping mode, the size of the auxiliary window page which is overlapped in the front is determined to be larger than the window size of the auxiliary window page which is overlapped in the rear, accordingly, in all the overlapped auxiliary window pages, the characteristic display of the auxiliary window page which is overlapped in the front is realized by using the maximum window page size, and therefore the characteristic display is used for enabling a user to conveniently view the auxiliary window page which is overlapped in the front.
Example 2, if at least two auxiliary window pages are embedded in the three-dimensional rendering in the main window page, the at least two auxiliary window pages are displayed in the main window page in an overlapping manner, but an overlapping rule needs to be explained as follows:
as an example 2.1, for the at least two auxiliary window pages, grouping may be performed first, and then the auxiliary window pages in each group are overlapped, and further, in the auxiliary window pages in each group, it is determined that the size of the auxiliary window page overlapped in front is larger than the window size of the auxiliary window page overlapped in back.
For example 2.2, for the at least two auxiliary window pages, the auxiliary window page corresponding to the target display information of the application that is opened last may be processed separately from other auxiliary window pages according to the time sequence in which the application is opened, that is, the other auxiliary window pages are overlapped, and the auxiliary window page corresponding to the target display information of the application that is opened last is separately displayed, and it is ensured that the size of the window is maximized compared with the implementation.
Example 2.3, further optimizing the above example 2.1 and 2.2, may further set the transparency of the overlapping portion of the window pages, and set the threshold interval of the allowable overlapping size between the window pages, so as to obtain a more optimized overlapping scheme, avoid the window pages from being excessively overlapped, and also ensure that the user can view more contents of the overlapped window pages.
For example 3, for the at least two auxiliary window pages, if the number is small, by comparing the size of the auxiliary window pages with the size of the main window page, an attempt is made to embed the non-overlapped arrangement of the auxiliary window pages into the main window page, specifically, the arrangement embedding manner may be from edge comparison to center embedding of the main window page.
In the embodiment of the present invention, in combination with the above-implemented specific implementation method for embedding the three-dimensional rendering of the auxiliary window page into the main window page, further provided are: the specific implementation method for dynamically adjusting the three-dimensional rendering embedding mode of the original window page according to the actual touch window page of the user comprises the following steps:
firstly, if an operation instruction of clicking a target auxiliary window page by touch is received, judging whether the target auxiliary window page is an auxiliary window page superposed at the head position;
secondly, if it is determined that the target auxiliary window page is not the auxiliary window page superimposed at the head, dynamically adjusting the target auxiliary window page to the window superimposition head, where the specific implementation operations may include, but are not limited to, the following examples:
for example, "dynamically adjusting the target secondary window page to the top of the window overlay" may be: one way is that the first auxiliary window page is directly replaced by the target auxiliary window page, and the replacement operation comprises the direct exchange of the target auxiliary window page and the target auxiliary window page on the size display; in another mode, the target auxiliary window page is extracted from a plurality of auxiliary window pages, and is adjusted to be superposed in front of the original head window page, and the target auxiliary window page is adjusted to be larger than the original head auxiliary window page in size.
206. And displaying the content information after the three-dimensional rendering display processing on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
In the embodiment of the present invention, the step is to display the processing result after the three-dimensional rendering processing, so that the display effect seen by the user is that the target display information corresponding to the first target application and the second target application is embedded and displayed in the display interface of the same layer, that is, at least two auxiliary window pages are embedded and displayed in the main window page.
Further, in the embodiment of the present invention, as to at least two auxiliary window pages embedded and displayed in the main window page, which auxiliary window page should be displayed at the forefront or highlighted by the feature, a further optimized display scheme is further provided in the embodiment of the present invention, and the following specific statements are provided:
firstly, after the target display information corresponding to the first target application and the second target application is obtained, the completion time point of loading the target display information by the first target application and the second target application can be marked, and the timestamp is added to the target display information according to the completion time point.
And secondly, determining a timestamp matched with a window page corresponding to the target display information according to the timestamp added to the target display information. And sequencing the window page corresponding to the first target application and the window page corresponding to the second target application according to the timestamp matched with the window pages from large to small of the timestamp to obtain corresponding sequencing queues.
It should be noted that the display time of the timestamp matched with the page of the sequencing first window in the sequencing queue is longer than that of the timestamp matched with the page of the sequencing last window;
and finally, according to the sorting queue, displaying the window pages sorted in front on the window pages sorted in back in an overlapping manner.
In this embodiment of the present invention, in step 202, by way of example, the obtained target display information corresponding to the first target application and the second target application may be screenshot pages corresponding to native pages loaded by the applications, and then the target display information displayed on the display screen is the screenshot page, so that more other rich data information of the second target application is obtained for the target display information in the three-dimensional rendering display effect displayed in the user touch operation display screen, which may be:
first, in the embodiment of the present invention, when an application is opened, page information is loaded, where the page information includes dynamic data information and is used as a native page, and a screenshot operation is performed on the native page, and then a corresponding screenshot page is obtained, so that the native page and the screenshot page are the same as each other with respect to currently presented visible content information, and therefore, regarding the currently presented visible content information, the two pages include identification information of a function touch button and are also completely the same. Accordingly, a first function touch button contained in the native page corresponding to the first target application and the second target application is obtained. And acquiring a second function touch button contained in a screenshot page corresponding to the first target application and the second target application.
It should be noted that "first" and "second" are only convenient for distinguishing and describing the dependency relationship between the application and the functional touch button, and there is no sequential reference description.
And secondly, establishing an incidence relation between a first function touch button contained in the native page and a second function touch button contained in the screenshot page according to the same function touch button identification.
Then, if an operation instruction for clicking a target second function touch button contained in the touch target screenshot page is received, according to the association relationship, a target first function touch button corresponding to the target first function touch button in a target native page corresponding to the target screenshot page is clicked through touch, and display information corresponding to the target first function touch button is obtained, namely display information corresponding to a next-level page is jumped to in the native page. And replacing the target screenshot page clicked by touch before by using the display information, rendering and filling the target screenshot page into the original display window to generate a new window page, and replacing the target screenshot page and displaying the target screenshot page in the display interface so as to display the target screenshot page on the original window page.
For example, even if the size of the native page and the size of the screenshot page corresponding to the target application are different, the specific implementation method for obtaining more content information corresponding to the target application according to the user touch and click on the target display information can be implemented, for example:
for a target application, the native page and the screenshot page are in a corresponding relationship, and then an association relationship existing between the native page including the first functional touch identifier and the screenshot page including the second functional touch identifier can be established according to the position coverage area of the same functional touch identifier on different pages.
Specifically, for a same functional touch identifier, the corresponding position coverage area in the native page is marked as a first position area, and the corresponding position coverage area in the screenshot page is marked as a second position area, so that a mapping relation among the functional touch identifier, the first position area and the second position area is established, even if the native page and the screenshot page are different in size and even have a large difference, which functional touch identifier is touched and clicked can be identified according to the second position area in the screenshot page corresponding to the user touch and click operation, and further according to the established mapping relation, which first position area is corresponding to the functional touch identifier can be found in the native page, so that the native page can be skipped to a next-level page by touching and clicking the first position area, and finally obtaining the display information of the next level of the target application.
Further, as an implementation of the method shown in fig. 1 and fig. 3, an embodiment of the present invention provides a multitask three-dimensional effect display device of a head-mounted device. The embodiment of the apparatus corresponds to the embodiment of the method, and for convenience of reading, details in the embodiment of the apparatus are not repeated one by one, but it should be clear that the apparatus in the embodiment can correspondingly implement all the contents in the embodiment of the method. The device is applied to the opened target display information corresponding to a plurality of applications for three-dimensional rendering display, and specifically as shown in fig. 4, the device includes:
a receiving unit 31, configured to receive a trigger instruction for opening a first target application;
an obtaining unit 32, configured to obtain, according to the trigger instruction received by the receiving unit 31, target display information corresponding to the first target application and a second target application, where the second target application includes at least one application and is an application that has been run before the first target application is opened;
a processing unit 33, configured to perform three-dimensional rendering and display processing on the target display information corresponding to the first target application and the second target application acquired by the acquisition unit 32;
the display unit 34 is configured to display the content information after the three-dimensional rendering and display processing by the processing unit 33 on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
Further, as shown in fig. 5, the processing unit 33 includes:
a creating module 331, configured to create corresponding display windows for the target display information corresponding to the first target application and the second target application;
a generating module 332, configured to render and fill the target display information into the corresponding display window created by the creating module 331, and generate a corresponding window page;
a rendering module 333, configured to embed, in a display interface included in the same layer, the three-dimensional rendering of the window page corresponding to the first target application and the window page corresponding to the second target application, which are generated by the generating module 332.
Further, as shown in fig. 5, the rendering module 333 includes:
the marking sub-module 3331 is configured to mark the window page corresponding to the first target application as a main window page;
the marking sub-module 3331 is further configured to mark the window page corresponding to the second target application as an auxiliary window page;
and the rendering submodule 3332 is configured to three-dimensionally render the secondary window page marked by the marking submodule 3331 and embed the secondary window page marked by the marking submodule 3331 into the primary window page marked by the marking submodule 3331.
Further, as shown in fig. 5, the rendering sub-module 3332 includes:
the overlap sub-module 33321 is configured to, if at least two auxiliary window pages are embedded in the main window page in the three-dimensional rendering mode, overlap and display the at least two auxiliary window pages in the main window page;
the determining sub-module 33322 is configured to determine, in at least two auxiliary window pages displayed in an overlapping manner, that the size of an auxiliary window page overlapped in front is larger than the window size of an auxiliary window page overlapped in back;
the determining sub-module 33323 is configured to, if an operation instruction for touch clicking a target auxiliary window page is received, determine whether the target auxiliary window page is an auxiliary window page that is superimposed on a top position;
the execution sub-module 33324 is configured to, if the determining sub-module 33323 determines that the target auxiliary window page is not the auxiliary window page superimposed at the head, adjust the target auxiliary window page to the window superimposition head, and amplify the target auxiliary window page with a size larger than the original auxiliary window page superimposed at the head.
Further, as shown in fig. 5, the apparatus further includes:
the marking unit 35 is configured to mark a completion time point of loading the target display information by the first target application and the second target application after the target display information corresponding to the first target application and the second target application is acquired;
an adding unit 36, configured to add a timestamp to the target display information according to the completion time point marked by the marking unit 35.
Further, as shown in fig. 5, the display unit 34 includes:
the determining submodule 341 is configured to determine, according to the timestamp added to the target display information, a timestamp matched with a window page corresponding to the target display information;
the sorting submodule 342 is configured to sort, according to the timestamp matched with the window page, the window page corresponding to the first target application and the window page corresponding to the second target application from large to small of the timestamp, so as to obtain a corresponding sorting queue, where a display time of the timestamp matched with a first-order window page in the sorting queue is greater than a display time of the timestamp matched with a last-order window page in the sorting queue;
and the displaying sub-module 343 is configured to display the window pages sorted in the front in an overlapping manner on the window pages sorted in the back according to the sorting queue.
Further, as shown in fig. 5, the acquiring unit 32 includes:
the loading sub-module 321 is configured to load native page display information corresponding to the first target application and the second target application;
a generating submodule 322, configured to perform screenshot operation on the native page display information, and generate screenshot pages corresponding to the first target application and the second target application;
the determining submodule 323 is configured to determine screenshot pages corresponding to the first target application and the second target application as target display information corresponding to the first target application and the second target application.
Further, as shown in fig. 5, the apparatus further includes:
the obtaining unit 32 is further configured to obtain a first function touch button included in a native page corresponding to the first target application and the second target application;
the obtaining unit 32 is further configured to obtain a second function touch button included in a screenshot page corresponding to the first target application and the second target application;
the establishing unit 37 is configured to establish an association relationship between the first function touch button and the second function touch button according to the same function touch button identifier;
the obtaining unit 32 is further configured to, if an operation instruction for clicking a target second function touch button included in a target screenshot page is received, click, according to the association relationship, a target first function touch button corresponding to a target native page corresponding to the target screenshot page through touch, and obtain display information corresponding to the target first function touch button;
and a replacing unit 38, configured to generate a window page by using the display information, and replace the target screenshot page and display the target screenshot page in a display interface.
In summary, embodiments of the present invention provide a multitask three-dimensional effect display method and device for a head-mounted device, in an embodiment of the present invention, for a plurality of opened target applications, target display information corresponding to the target applications is processed in a three-dimensional rendering display manner, so that the target display information corresponding to the plurality of opened target applications is embedded and displayed in a same layer of display interface in the head-mounted device. Compared with the prior art, the method and the device solve the problem that the immersive experience of the user using the head-mounted device is poor due to the fact that the application icons are displayed in a two-dimensional display mode and the application opening method is displayed, the embodiment of the invention realizes the simultaneous display of the display information corresponding to the plurality of opened applications by using a three-dimensional rendering display mode, so that the user can conveniently and efficiently find the appointed opened target application, meanwhile, the user is ensured to be always in a three-dimensional immersive environment, and the operation experience of the user using the head-mounted device is greatly improved.
The multitask three-dimensional effect display device of the head-mounted equipment comprises a processor and a memory, wherein the receiving unit, the acquiring unit, the processing unit, the display unit and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more, and target display information corresponding to a plurality of opened target applications is embedded and displayed in the same layer of display interface in the head-mounted device in a three-dimensional rendering display mode by adjusting kernel parameters.
An embodiment of the present invention provides a storage medium having a program stored thereon, the program implementing a multitask three-dimensional effect display method of the head-mounted device when executed by a processor.
The embodiment of the invention provides a processor, which is used for running a program, wherein the program executes a multitask three-dimensional effect display method of a head-mounted device when running.
An embodiment of the present invention provides an electronic device 40, as shown in fig. 6, the device includes at least one processor 401, and at least one memory 402 and a bus 403 connected to the processor 401; the processor 401 and the memory 402 complete communication with each other through the bus 403; the processor 401 is adapted to call program instructions in the memory 402 to perform the above-described multi-tasking three-dimensional effect display method of the head-mounted device.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device:
a method of multi-tasking three-dimensional effect display of a head-mounted device, the method comprising: receiving a trigger instruction for opening a first target application; acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened; performing three-dimensional rendering display processing on target display information corresponding to the first target application and the second target application; displaying the content information after the three-dimensional rendering display processing on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a device includes one or more processors (CPUs), memory, and a bus. The device may also include input/output interfaces, network interfaces, and the like.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip. The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (10)

1. A method for multitasking three-dimensional effect display on a head-mounted device, the method comprising:
receiving a trigger instruction for opening a first target application;
acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened;
performing three-dimensional rendering display processing on target display information corresponding to the first target application and the second target application;
displaying the content information after the three-dimensional rendering display processing on a display screen of the head-mounted device, so that target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
2. The method according to claim 1, wherein the performing three-dimensional rendering and display processing on the target display information corresponding to the first target application and the second target application comprises:
creating corresponding display windows for the target display information corresponding to the first target application and the second target application;
rendering and filling the target display information into the corresponding display window to generate a corresponding window page;
and embedding the three-dimensional rendering of the window page corresponding to the first target application and the window page corresponding to the second target application into a display interface contained in the same layer.
3. The method of claim 2, wherein embedding the three-dimensional rendering of the window page corresponding to the first target application and the window page corresponding to the second target application within a display interface contained in a same layer comprises:
marking a window page corresponding to the first target application as a main window page;
marking the window page corresponding to the second target application as an auxiliary window page;
and embedding the three-dimensional rendering of the auxiliary window page in the main window page.
4. The method of claim 3, wherein embedding the secondary window page three-dimensional rendering within the primary window page comprises:
if the three-dimensional rendering in the main window page is embedded into at least two auxiliary window pages, overlapping and displaying the at least two auxiliary window pages in the main window page;
in at least two auxiliary window pages displayed in an overlapped mode, the size of the auxiliary window page overlapped in the front is determined to be larger than the window size of the auxiliary window page overlapped in the rear;
if an operation instruction of clicking a target auxiliary window page by touch is received, judging whether the target auxiliary window page is an auxiliary window page superposed at the head position;
if not, adjusting the target auxiliary window page to the first position of window superposition, and amplifying the auxiliary window page with the size larger than that of the original auxiliary window page superposed at the first position.
5. The method of claim 2, wherein after obtaining the target display information corresponding to the first target application and the second target application, the method further comprises:
marking the completion time points of the loading of the target display information by the first target application and the second target application;
and adding a timestamp to the target display information according to the completion time point.
6. The method of claim 5, wherein the presenting the content information after the three-dimensional rendering and display processing on the display screen of the head-mounted device comprises:
according to the timestamp added to the target display information, determining a timestamp matched with a window page corresponding to the target display information;
according to the timestamp matched with the window page, sequencing the window page corresponding to the first target application and the window page corresponding to the second target application according to the descending of the timestamp to obtain a corresponding sequencing queue, wherein the display time of the timestamp matched with the sequencing first window page in the sequencing queue is longer than that of the timestamp matched with the sequencing last window page;
and according to the sorting queue, displaying the window pages sorted in front on the window pages sorted in back in an overlapping manner.
7. The method according to any one of claims 1 to 6, wherein the obtaining target display information corresponding to the first target application and the second target application according to the trigger instruction includes:
loading native page display information corresponding to the first target application and the second target application;
executing screenshot operation on the native page display information to generate screenshot pages corresponding to the first target application and the second target application;
and determining screenshot pages corresponding to the first target application and the second target application as target display information corresponding to the first target application and the second target application.
8. The method according to claim 7, wherein after the obtaining of the target display information corresponding to the first target application and the second target application according to the trigger instruction, the method further comprises:
acquiring a first function touch button contained in a native page corresponding to the first target application and the second target application;
acquiring a second function touch button contained in a screenshot page corresponding to the first target application and the second target application;
establishing an association relation between the first function touch button and the second function touch button according to the same function touch button identification;
if an operation instruction of clicking a target second function touch button contained in a touch target screenshot page is received, according to the incidence relation, clicking a corresponding target first function touch button in a target native page corresponding to the target screenshot page through touch, and acquiring display information corresponding to the target first function touch button;
and generating a window page by utilizing the display information, and replacing the target screenshot page and displaying the target screenshot page in a display interface.
9. A multitasking three-dimensional effect display device of a head-mounted apparatus, characterized in that the device comprises:
the receiving unit is used for receiving a trigger instruction for opening the first target application;
the acquiring unit is used for acquiring target display information corresponding to the first target application and a second target application according to the trigger instruction received by the receiving unit, wherein the second target application comprises at least one application and is an application which is operated before the first target application is opened;
the processing unit is used for performing three-dimensional rendering and display processing on the target display information corresponding to the first target application and the second target application acquired by the acquisition unit;
and the display unit is used for displaying the content information subjected to the three-dimensional rendering and display processing by the processing unit on a display screen of the head-mounted device, so that the target display information corresponding to the first target application and the second target application is embedded and displayed in a display interface of the same layer.
10. An electronic device, comprising at least one processor, and at least one memory, bus connected to the processor;
the processor and the memory complete mutual communication through the bus;
the processor is configured to invoke program instructions in the memory to perform the method of multi-tasking three-dimensional effect display of a head-mounted device according to any of claims 1-8.
CN202110336007.0A 2021-03-29 2021-03-29 Multitask three-dimensional effect display method and device of head-mounted device and electronic device Pending CN113032077A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110336007.0A CN113032077A (en) 2021-03-29 2021-03-29 Multitask three-dimensional effect display method and device of head-mounted device and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110336007.0A CN113032077A (en) 2021-03-29 2021-03-29 Multitask three-dimensional effect display method and device of head-mounted device and electronic device

Publications (1)

Publication Number Publication Date
CN113032077A true CN113032077A (en) 2021-06-25

Family

ID=76452741

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110336007.0A Pending CN113032077A (en) 2021-03-29 2021-03-29 Multitask three-dimensional effect display method and device of head-mounted device and electronic device

Country Status (1)

Country Link
CN (1) CN113032077A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103164121A (en) * 2011-12-19 2013-06-19 腾讯科技（深圳）有限公司 Method and device for terminal software interface display
CN105630307A (en) * 2015-12-23 2016-06-01 努比亚技术有限公司 Apparatus and method for displaying a plurality of applications on mobile terminal
CN107590228A (en) * 2017-09-06 2018-01-16 维沃移动通信有限公司 A kind of page content processing method and mobile terminal
US20200371646A1 (en) * 2017-06-01 2020-11-26 Samsung Electronics Co., Ltd. Systems and methods for window control in virtual reality environment
CN112346802A (en) * 2019-04-15 2021-02-09 苹果公司 System, method, and user interface for interacting with multiple application windows

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103164121A (en) * 2011-12-19 2013-06-19 腾讯科技（深圳）有限公司 Method and device for terminal software interface display
CN105630307A (en) * 2015-12-23 2016-06-01 努比亚技术有限公司 Apparatus and method for displaying a plurality of applications on mobile terminal
US20200371646A1 (en) * 2017-06-01 2020-11-26 Samsung Electronics Co., Ltd. Systems and methods for window control in virtual reality environment
CN107590228A (en) * 2017-09-06 2018-01-16 维沃移动通信有限公司 A kind of page content processing method and mobile terminal
CN112346802A (en) * 2019-04-15 2021-02-09 苹果公司 System, method, and user interface for interacting with multiple application windows

Similar Documents

Publication Publication Date Title
US11164280B2 (en) Graphics layer processing in a multiple operating systems framework
US9146762B2 (en) Specialized virtual machine to virtualize hardware resource for guest virtual machines
US11036345B2 (en) System and method for on-screen graphical user interface encapsulation and reproduction
US9830176B2 (en) Methods, systems, and media for binary compatible graphics support in mobile operating systems
US10146562B2 (en) Unlimited icon overlays
CN110737490B (en) Method and device for displaying guide information
CN107292807B (en) Graph synthesis method, window setting method and system
CN109445891B (en) Picture configuration and display method, device and computer readable storage medium
CN105094520A (en) Display method and terminal
CN116136784A (en) Data processing method, device, storage medium and program product
US20180364873A1 (en) Inter-Context Coordination to Facilitate Synchronized Presentation of Image Content
CN114995929B (en) Popup window display method and device
CN111324398B (en) Method, device, terminal and storage medium for processing latest content
CN113032077A (en) Multitask three-dimensional effect display method and device of head-mounted device and electronic device
CN104951298A (en) Methods and systems for communications between apps and virtual machines
CN114924837A (en) Data processing method, electronic device and readable storage medium
CN115421631A (en) Interface display method and device
US20120252536A1 (en) Mobile terminal
US11093041B2 (en) Computer system gesture-based graphical user interface control
CN112836002A (en) Map application method, device, equipment and storage medium
CN111813404B (en) Application method, medium and client based on mixed graphic display
CN114712849B (en) Cross-platform application operation method and device, electronic equipment and storage medium
CN115016710B (en) Application program recommendation method
CN111104114A (en) Method, system and equipment for realizing self-state controllable carousel picture assembly
CN113900569A (en) Data check method, plug-in and platform based on MVVM (multifunction virtual machine) architecture

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210625

RJ01 Rejection of invention patent application after publication