CN115756176A - Application display method, head-mounted display device, and computer-readable medium - Google Patents

Application display method, head-mounted display device, and computer-readable medium Download PDF

Info

Publication number
CN115756176A
CN115756176A CN202310030256.6A CN202310030256A CN115756176A CN 115756176 A CN115756176 A CN 115756176A CN 202310030256 A CN202310030256 A CN 202310030256A CN 115756176 A CN115756176 A CN 115756176A
Authority
CN
China
Prior art keywords
application
display
application page
page
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310030256.6A
Other languages
Chinese (zh)
Other versions
CN115756176B (en
Inventor
徐铭汛
庞文刚
李翔
姜三富
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yutou Technology Hangzhou Co Ltd
China Unicom WO Music and Culture Co Ltd
Original Assignee
Yutou Technology Hangzhou Co Ltd
China Unicom WO Music and Culture Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yutou Technology Hangzhou Co Ltd, China Unicom WO Music and Culture Co Ltd filed Critical Yutou Technology Hangzhou Co Ltd
Priority to CN202310030256.6A priority Critical patent/CN115756176B/en
Publication of CN115756176A publication Critical patent/CN115756176A/en
Application granted granted Critical
Publication of CN115756176B publication Critical patent/CN115756176B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

Embodiments of the present disclosure disclose an application display method, a head-mounted display device, and a computer-readable medium. One embodiment of the method comprises: displaying each application page in a virtual three-dimensional space in an application menu list mode; determining application switching display configuration information of the head-mounted display equipment; determining the position of the selected application page in the virtual three-dimensional space when the selected application page is displayed in an initial opening mode as a display position to be switched; determining whether the display position to be switched is a target display position; determining whether a target application page is displayed at the target display position; and switching the target application page to the position to be switched and displayed, and switching the selected application page to the position to be switched and displayed so as to realize the position switching display of the selected application page and the target application page. According to the implementation method, the efficiency of the user for reviewing the application can be improved, and the user experience is further improved.

Description

Application display method, head-mounted display device, and computer-readable medium
Technical Field
Embodiments of the present disclosure relate to the field of computer technologies, and in particular, to an application display method, a head-mounted display device, and a computer-readable medium.
Background
When any application is opened in the virtual three-dimensional space displayed by the current XR device (e.g., head mounted display apparatus), the application is displayed in the virtual three-dimensional space. After a plurality of applications are opened simultaneously, a user usually operates a current application, and other application pages are often distributed in various places in a virtual three-dimensional space in a background operation mode. At present, when a certain application needs to be reviewed, the method generally adopted is as follows: and the user turns the sight to the position of the application and then carries out related operation.
However, when reviewing an application in the above manner, there are often technical problems as follows:
firstly, each application page is distributed in a scattered manner in a virtual three-dimensional space, a user needs to spend more time to find the application page needing to be checked again in the virtual three-dimensional space, in addition, if the quantity of the application pages distributed in the scattered manner in the virtual three-dimensional space is more, the difficulty degree of checking a certain application again by the user is aggravated, the efficiency of checking the application again by the user is lower, the user experience is poorer, in addition, the user needs to move to the position of checking the application last time so as to check the application again, and the user experience is further reduced.
Second, applications related to user privacy still can view user personal information in the applications in a background running mode, and the information security is poor.
Third, if the application is displayed by exchanging the position of the application page, the relative position between the application exchanging the position and the other application may change, and the user experience is poor for the user who memorizes the position of the other application page by memorizing the relative position.
The above information disclosed in this background section is only for enhancement of understanding of the background of the inventive concept and, therefore, it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Some embodiments of the present disclosure propose to apply a display method, a head-mounted display device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background section.
In a first aspect, some embodiments of the present disclosure provide an application display method, including: in response to the detection of the menu display operation acting on the external equipment, displaying each application page in a virtual three-dimensional space in an application menu list mode, wherein each application page is displayed in the virtual three-dimensional space in an initial opening mode before the menu display operation is detected; determining application switching display configuration information of the head-mounted display device in response to detecting a selection operation acting on any application page displayed in the application menu list through a virtual three-dimensional ray; responding to the application switching display configuration information representation application position switching display, and determining the position of the selected application page in the virtual three-dimensional space when the selected application page is displayed in an initial opening mode as a display position to be switched; determining whether the display position to be switched is a target display position; in response to the fact that the display position to be switched is not the target display position, determining whether a target application page is displayed at the target display position or not; and responding to the target display position to display a target application page, switching the target application page to the position to be switched for display, and switching the selected application page to the position to be switched for display so as to realize the position switching display of the selected application page and the target application page.
Optionally, after determining whether the display position to be switched is the target display position, the method further includes: and in response to the fact that the display position to be switched is determined to be the target display position, displaying the selected application page at the target display position.
Optionally, before the step of determining, in response to detecting a selection operation performed on any application page displayed in the application menu list by a virtual three-dimensional ray, a position in the virtual three-dimensional space when the selected application page is displayed in an initially opened manner as a display position to be switched, the method further includes: and determining each application page which is not positioned at the target display position when the application menu list is displayed in an initial opening mode as an application page to be released, so as to obtain an application page set to be released.
Optionally, the method further includes: deleting the selected application page from the application page set to be released so as to update the application page set to be released; and displaying each application page to be released in the updated application page set to be released in the virtual three-dimensional space in an initial opening mode.
Optionally, the application pages are displayed in the application menu list in an overlapping manner, and each application page displayed in the application menu list at least displays an application icon and an application name.
Optionally, after the step of displaying each application page in the virtual three-dimensional space in the form of an application menu list in response to the detection of the menu display operation acting on the external device, the method further includes: and in response to detecting a preview operation which acts on any application page displayed in the application menu list through the virtual three-dimensional ray, displaying a corresponding application preview window on one side of the application page previewed by the preview operation.
Optionally, after the step of displaying each application page in the virtual three-dimensional space in the form of an application menu list in response to detecting the menu display operation acting on the external device is performed, the method further includes: and in response to detecting the page clearing operation acted on any application page in the application menu list through the virtual three-dimensional ray, clearing the application page corresponding to the page clearing operation.
In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, the device comprising: one or more processors; the head-mounted display device comprises a display screen, a display module and a display module, wherein the display screen is used for displaying a virtual three-dimensional space and a virtual three-dimensional ray so that at least one application page is displayed in the virtual three-dimensional space; a storage device, on which one or more programs are stored, for storing application switching display configuration information of the head-mounted display device; the external device is used for controlling the virtual three-dimensional ray to execute related operations in the virtual three-dimensional space, and the related operations comprise: selecting operation, previewing operation and page clearing operation; when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the first aspect.
In a third aspect, some embodiments of the disclosure provide a computer readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method described in any implementation manner of the first aspect.
The above embodiments of the present disclosure have the following advantages: by the application display method of some embodiments of the present disclosure, efficiency of a user in reviewing applications can be improved, and user experience is further improved. Specifically, the efficiency of reviewing the application by the user is low, and the reason for the poor user experience is that: in addition, if the number of the scattered application pages in the virtual three-dimensional space is large, the difficulty degree of the user in reviewing a certain application is aggravated, the efficiency of reviewing the application by the user is low, the user experience is poor, in addition, the user needs to move to the position where the application is reviewed for the last time to review the application, and the user experience is further reduced. Based on this, the application display method of some embodiments of the present disclosure first displays each application page in the form of an application menu list in the virtual three-dimensional space in response to detecting a menu display operation that acts on the external device. Thereby, the respective application pages in the virtual three-dimensional space can be collectively displayed. Then, in response to detecting a selection operation that acts on any one of the application pages displayed in the application menu list through the virtual three-dimensional ray, determining application switching display configuration information of the head-mounted display device. Thus, the manner in which the application switches the display can be determined. And secondly, responding to the application switching display configuration information representation application position switching display, and determining the position of the selected application page in the virtual three-dimensional space when the selected application page is displayed in an initial opening mode as the display position to be switched. Thus, the display position to be switched for switching the display can be obtained. And then, determining whether the display position to be switched is the target display position. Therefore, whether the position of the application page needs to be switched or not can be determined so as to display the application needing to be switched and displayed. And then, responding to the non-target display position of the display position to be switched, and determining whether a target application page is displayed at the target display position. Thus, it can be determined whether or not the display of the position needs to be switched for the target application page when the display is switched. And finally, responding to the target application page displayed at the target display position, switching the target application page to the display position to be switched for display, and switching the selected application page to the target display position for display, so as to realize the position switching display of the selected application page and the target application page. Therefore, the target application page can be displayed at the position to be switched and the selected application page is displayed at the position to be switched, so that the position switching display of the target application page and the selected application page is realized. Because each application page is displayed in a centralized mode through the application menu list, a user can determine the application needing to be reviewed through the application menu list, the application page needing to be reviewed does not need to be searched in the application pages which are distributed in a scattered mode in the virtual three-dimensional space, and the efficiency of reviewing the application by the user is improved. In addition, because the position switching display of the target application page and the selected application page is realized, the user can view the selected application page displayed at the target display position without moving to the display position to be switched for viewing, and the experience of the user in re-viewing the application page is further optimized.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.
FIG. 1 is a flow diagram of some embodiments of an application display method according to the present disclosure;
FIG. 2 is a schematic diagram of an application menu list included in an application display method according to the present disclosure;
FIG. 3 is a schematic structural diagram of a head mounted display device suitable for use in implementing some embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and the embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be noted that, for convenience of description, only the portions related to the present invention are shown in the drawings. The embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Fig. 1 illustrates a flow 100 of some embodiments of an application display method according to the present disclosure. The application display method comprises the following steps:
step 101, in response to detecting a menu display operation acting on an external device, displaying each application page in a virtual three-dimensional space in an application menu list manner.
In some embodiments, in response to detecting a menu display operation applied to the external device, an execution subject (e.g., a head-mounted display apparatus) of the application display method may display each application page in the virtual three-dimensional space in the form of an application menu list. Before the menu display operation is detected, each application page can be displayed in the virtual three-dimensional space in an initial opening mode. The head-mounted display device may include a head-mounted display device and an external device. The head-mounted display device may be a device that is worn on a head of a human body and displays a picture. For example, the head mounted display device may be AR glasses. The head-mounted display device can display a virtual three-dimensional space. The virtual three-dimensional space may be a virtual three-dimensional space constructed by a mixed reality technology. Here, whether or not the user can see the real world after wearing the head mounted display device is not defined. In other words, the user can see the virtual three-dimensional space and the real world at the same time after wearing the head-mounted display device, or can only see the virtual three-dimensional space.
The external device may be an external device connected to the head-mounted display device to control the head-mounted display device. For example, the external device may be a smart phone. The menu display operation may be an operation in which a user acts on the external device to control the head-mounted display device to display an application page in an application menu list. For example, the menu display operation may be a double-finger sliding operation performed by the user on the external device. The application menu list may be a list in which each application page is placed in the application menu list to view each application page. The application menu list may be a menu list for displaying each application page. Here, the specific style when the menu list is displayed is not limited. The application page may be a page of the application displayed after the application is started. For example, the application page may be a browser page displayed after the browser is started.
The initial opening mode may be a mode in which an application page corresponding to the application is displayed after the application is started. As an example, a user wearing a head mounted display device starts a browser when looking down at a desktop of a table in the real world, the browser page may be displayed above and against the desktop. In practice, in response to detecting a menu display operation applied to the external device, the execution body may display each application page in the virtual three-dimensional space in the form of an application menu list. It is understood that, in response to detecting a menu display operation applied to the external device, each application page displayed in the virtual three-dimensional space in an initially open manner may be moved into the application menu list, so that each application page is displayed in the application menu list. Thereby, the respective application pages in the virtual three-dimensional space can be collectively displayed.
Optionally, the application pages may be displayed in an overlapping arrangement in the application menu list. Each application page displayed in the application menu list may be displayed with at least an application icon and an application name. As shown in fig. 2, fig. 2 is a schematic diagram illustrating an application menu list 200 included in the application display method described above. Among them, the application menu list 200 may display an application page 201, an application page 202, and an application page 203. The application page 201 may be a browser page. The application page 202 may be an application page of music software. The application page 203 may be an application page of the communication software. The application page 201 may include an application icon 2011 and an application name 2012. The application name 2012 can be "browser". The application page 202 may include an application icon 2021 and an application name 2022. The application name 2022 may be "music software". The application page 203 may include an application icon 2031 and an application name 2032. The application name 2032 may be "communication software".
Optionally, after step 101, in response to detecting a preview operation applied to any application page displayed in the application menu list through the virtual three-dimensional ray, a corresponding application preview window is displayed on one side of the application page previewed by the preview operation. The preview operation may be an operation of characterizing a preview application page. Here, the specific operation mode of the preview operation is not limited. For example, the preview operation may be that the user controls the duration of the virtual three-dimensional ray staying on the application page to exceed a preset duration threshold. For another example, the preview operation may be that the virtual three-dimensional ray stays on the application page for a time period exceeding a preset time period threshold while the user presses the external device for a long time. The application preview window may be a window for displaying the application page again when the application page is displayed in the application menu list. As an example, in response to detecting a preview operation that acts on any application page displayed in the application menu list through the virtual three-dimensional ray, a corresponding application preview window is displayed above the application page previewed by the preview operation.
Optionally, in response to detecting a page clearing operation that acts on any application page in the application menu list through the virtual three-dimensional ray, an application page corresponding to the page clearing operation is cleared. The page clearing operation may be an operation of closing the application to clear the application running in the background. Here, the specific operation mode of the page clearing operation is not limited. For example, the page clearing operation may be that the user controls the virtual three-dimensional ray to stay on the application page, and simultaneously, the user double-clicks the external device. As an example, in response to detecting a page clearing operation that acts on any application page in the application menu list through the virtual three-dimensional ray, an application page corresponding to the page clearing operation may be closed, so as to clear the background running of the application represented by the application page. Therefore, the application in the background can be closed through the application menu list, the centralized closing of the application is realized, the resources consumed by the application in the background running are reduced, in addition, the user does not need to search the application pages needing to be cleared in the virtual three-dimensional space, and the experience of the user in clearing the application is improved.
In some optional implementations of some embodiments, first, the execution main body may determine whether each application page displayed in an initially opened manner in the virtual three-dimensional space includes an application page satisfying an application privacy condition. The application privacy condition may be that the application represented by the application page is a privacy application. The privacy application may be a preset application that is running and may relate to the personal information of the user. For example, the privacy application described above may be a payment application. Then, the respective application pages may be displayed in the virtual three-dimensional space in the form of a list of application menus. And displaying the application pages meeting the application privacy conditions in a safe mode in the application menu list. The security mode may be to obscure specific content displayed on the page when the application page is displayed. For example, for an application page whose characterized software is payment software, the application page may be displayed in an obscured manner, so that when the user sees the application page, the content displayed by the application page in the non-obscured manner cannot be acquired.
The above-mentioned content is an inventive point of the embodiments of the present disclosure, and solves the technical problem two mentioned in the background art, "the application related to user privacy can still view the user personal information in the application in the background running mode, and the information security is poor". Factors that lead to poor information security are as follows: the application related to the user privacy can still check the personal information of the user in the application in a background running mode, and the information security is poor. If the above factors are solved, the information security of the user can be improved. To achieve this, the present disclosure displays the application pages satisfying the application privacy condition in the application menu list in a secure mode. Therefore, the probability of leakage of personal information of the user can be reduced, and the information security of the user is improved.
Step 102, in response to detecting a selection operation acting on any application page displayed in the application menu list through the virtual three-dimensional ray, determining application switching display configuration information of the head-mounted display device.
In some embodiments, in response to detecting a selection operation applied to any application page displayed in the application menu list through a virtual three-dimensional ray, the execution subject may determine application switching display configuration information of the head-mounted display device. The virtual three-dimensional ray may be a ray displayed in a virtual three-dimensional space. The user can control the virtual three-dimensional ray through the external equipment. For example, the user may control the position and the angle of the virtual three-dimensional ray displayed in the virtual three-dimensional space by moving the external device. The selection operation may be an operation in which the user selects any application page displayed in the application menu list by controlling the virtual three-dimensional ray through the external device. For example, the selection operation may be an operation in which the user clicks a touch screen of a smartphone. The application switching display configuration information may be information representing a mode of the application when switching display. The manner of the above application switching display configuration information representation application in switching display may include, but is not limited to: and displaying the application exchange position and displaying the whole application in a moving mode. The application swap position display may indicate swapping positions displayed by two application pages to display an application that is swapped in display. The application switched to display may be another application that needs to be displayed when an application page is displayed. The application moving display may be a moving of each application page to display the application page selected by the selection operation. In practice, in response to detecting a selection operation that acts on any application page displayed in the application menu list through a virtual three-dimensional ray, the execution main body may determine, through a storage device included in the head-mounted display device, application switching display configuration information of the head-mounted display device. Thus, the manner in which the application switches the display can be determined.
Optionally, after the step 102, first, in response to that the application switching display configuration information represents the whole application moving display, the execution main body may generate position moving vector information according to the position of the selected application page when the application page is displayed in the virtual three-dimensional space in the initial open manner and the target display position. The position movement vector information may represent a direction and a distance that the selected application page moves from the position when displayed in the initial open mode to the target display position. Here, a specific mode of generating the position movement vector information is not limited. For example, the position movement vector information may be generated by coordinate transformation. Then, according to the position movement vector information, the adjusted display position of each application page in the application menu list in the virtual three-dimensional space can be determined. The adjusted display position may be a position reached after each application page is moved from a position when displayed in an initial open mode according to the position movement vector information. For example, the adjusted display position of each application page may be generated by means of coordinate transformation. Finally, for each application page in the application menu list, the application page may be displayed in the virtual three-dimensional space according to the adjusted display position corresponding to the application page. And displaying the application page selected by the selection operation at the target display position. Therefore, all application pages can be displayed after being moved, so that the relative positions of the application pages are kept unchanged while the application page selected after being moved is displayed at the target display position.
The above-mentioned content is an inventive point of the embodiments of the present disclosure, and solves the technical problem mentioned in the background art "if the application is displayed by exchanging the position of the application page, the relative position between the application exchanging the position and the other application will change, and the user experience is poor for the user memorizing the position of the other application page by memorizing the relative position". Factors that lead to poor user experience are as follows: if the application is displayed by exchanging the position of the application page, the relative position between the application exchanging the position and other applications may change, and the user experience is poor for the user who memorizes the position of other application pages by memorizing the relative position. If the above factors are solved, the effect of optimizing the user experience can be achieved. In order to achieve the effect, the application is integrally moved and displayed, and all application pages can be displayed after being moved, so that the relative positions of the application pages are kept unchanged while the selected application page is displayed at the target display position after being moved, and the user experience is optimized.
And 103, responding to the application switching display configuration information representation application position switching display, and determining the position of the selected application page in the virtual three-dimensional space when the selected application page is displayed in an initial opening mode as the display position to be switched.
In some embodiments, in response to the application switching display configuration information characterizing the application position switching display, the execution main body may determine a position in the virtual three-dimensional space when the selected application page is displayed in an initially open manner as a display position to be switched. The selected application page may be the application page selected by the selection operation. Thus, the display position to be switched for switching the display can be obtained.
Optionally, before the step 103, the execution main body may determine, as an application page to be released, each application page that is not located at the target display position when displayed in an initial open manner in the application menu list, so as to obtain an application page set to be released. Therefore, the set of application pages to be released, which are not characterized to be located at the target display position, can be obtained.
And 104, determining whether the display position to be switched is the target display position.
In some embodiments, the executing body may determine whether the display position to be switched is a target display position. The target display position may be a preset position for displaying an application page. As an example, the target display position may be a position right in front of a user wearing the head-mounted display device, and may be a position away from the user by a preset display distance and a preset display height. It should be noted that, for the application page located at the target display position, the user may directly view the application page without shifting the line of sight. The preset display distance may be a preset distance value. The preset display height may be a preset height value. In practice, firstly, the coordinates of the target display position may be converted into the coordinates of the target display position in the virtual three-dimensional space, so as to obtain the converted coordinates of the target position. Then, whether the target position coordinate is the same as the coordinate of the to-be-switched display position in the virtual three-dimensional space can be compared. Therefore, whether the position of the application page needs to be switched or not can be determined so as to display the application needing to be switched and displayed.
Optionally, after step 104, in response to determining that the display position to be switched is the target display position, the selected application page may be displayed at the target display position. Thus, if the selected application page is originally displayed at the target display position, the position does not need to be switched.
And 105, responding to the non-target display position of the display position to be switched, and determining whether a target application page is displayed at the target display position.
In some embodiments, in response to determining that the display position to be switched is not the target display position, the execution main body may determine whether a target application page is displayed at the target display position. Thus, it can be determined whether or not the display of the position needs to be switched for the target application page when the display is switched.
And 106, responding to the target display position that the target application page is displayed, switching the target application page to the display position to be switched for display, and switching the selected application page to the target display position for display so as to realize the position switching display of the selected application page and the target application page.
In some embodiments, in response to that a target application page is displayed at the target display position, the execution main body may switch the target application page to the display position to be switched for display, and switch the selected application page to the target display position for display, so as to implement position switching display of the selected application page and the target application page. Therefore, the target application page can be displayed at the position to be switched and the selected application page is displayed at the position to be switched, so that the position switching display of the target application page and the selected application page is realized.
Optionally, first, the execution main body may delete the selected application page from the set of application pages to be released, so as to update the set of application pages to be released. Then, each application page to be released in the updated application page set to be released may be displayed in the virtual three-dimensional space in an initial open manner. In practice, for each application page to be released in the updated application page set to be released, the application page to be released may be displayed at a position in the virtual three-dimensional space where the application page to be released is displayed in an initial open mode. Therefore, each application page to be released in the application page set to be released can be reserved at the original position for displaying, and the position is kept unchanged.
Optionally, the number of application pages displayed in the application menu list may be greater than or equal to a preset list display page number threshold. The preset list display page quantity threshold may be a preset quantity threshold representing the display of the application page in the application menu list. The application pages may be displayed in an overlapping arrangement in the application menu list. Each application page displayed in the application menu list may display at least a page portion on which the virtual three-dimensional ray may perform an operation. It can be understood that, for each application page displayed in the application menu list, the application page is not completely covered or occluded when displayed, and a page portion on which the operation can be performed by the virtual three-dimensional ray is still displayed. Here, specific settings of the page portion are not limited. For example, the page portion may be an upper edge of the application page. For another example, the page portion may be a side edge of the application page. Therefore, when the number of the application pages displayed in the application menu list is greater than or equal to the preset list display page number threshold, the display of each application page is simplified, the dazzling of a user caused by excessive display of the application pages is avoided, the burden of the user for selecting the application pages is further reduced, and the user experience of the user for browsing the menu list is optimized.
Optionally, in response to detecting an in-list viewing operation that acts on any application page in the application menu list through the virtual three-dimensional ray, the application page corresponding to the in-list viewing operation is popped up, so that the application page corresponding to the in-list viewing operation displays the application icon and the application name. The in-list viewing operation may be an operation of viewing an application icon and an application name of an application when the number of application pages displayed in the application menu list is greater than or equal to a preset list display page number threshold. Here, the specific setting of the in-list view operation is not limited. For example, the specific settings of the above-described page clearing operation and the above-described preview operation may be referred to. As an example, in response to detecting an in-list viewing operation that acts on any application page in the application menu list through the virtual three-dimensional ray, the application page corresponding to the in-list viewing operation may be moved up, so that the application page corresponding to the in-list viewing operation displays an application icon and an application name. Thereby, the user experience of the user browsing the menu list may be further optimized.
The above-mentioned contents serve as an invention point of the embodiment of the present disclosure, and further solve the technical problem mentioned in the background art, that is, "each application page is distributed in a scattered manner in a virtual three-dimensional space, and a user needs to spend more time searching for an application page that needs to be reviewed again in the virtual three-dimensional space. The efficiency of the user for reviewing the application is low, and the user experience is poor due to the following factors: in addition, if the number of the scattered application pages in the virtual three-dimensional space is large, the difficulty degree of the user in reviewing a certain application is increased. If the above factors are solved, the effect of optimizing the user experience can be achieved. In order to achieve the effect, according to the application menu list display method and device, when the number of the application pages displayed in the application menu list is larger than or equal to the preset list display page number threshold, the display of each application page is simplified, the dazzling of a user caused by excessive display of the application pages is avoided, the burden of the user for selecting the application pages is further reduced, and therefore the user experience of the user for browsing the menu list is optimized. In addition, when the number of the application pages displayed in the application menu list is greater than or equal to the preset list display page number threshold, the application icons and the application names of the application pages can be checked through checking operation in the list, and the user experience of a user for browsing the menu list is further optimized.
Referring now to FIG. 3, a schematic structural diagram of a head mounted display device 300 suitable for use in implementing some embodiments of the present disclosure is shown. The head-mounted display apparatus illustrated in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 3, the head-mounted display apparatus 300 may include a processing apparatus 301 (e.g., a central processor, a graphics processor, etc.), a head-mounted display device 302, a storage apparatus 303 (e.g., a memory), and an external device 304. The head-mounted display device 302 may include a display screen, and the display screen may be configured to display a virtual three-dimensional space and a virtual three-dimensional ray, so that at least one application page is displayed in the virtual three-dimensional space. The storage device 303 may be configured to store application switching display configuration information of the head-mounted display apparatus. The storage device 303 also stores various programs and data necessary for the operation of the head mounted display device 300. The external device 304 may be used to control the virtual three-dimensional ray to perform the relevant operation in the virtual three-dimensional space. The related operations may include, but are not limited to: selection operation, preview operation and page clearing operation.
Here, the connection method between the head-mounted display device 302 and the external device 304 is not limited. For example, the head-mounted display device 302 and the external device 304 may be connected via bluetooth. As shown in fig. 3, the processing device 301, the head-mounted display apparatus 302, the storage device 303, and the external device 304 may be connected to each other via a bus 305.
While FIG. 3 illustrates a head mounted display device 300 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 3 may represent one device or may represent multiple devices, as desired.
In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. The computer program, when executed by the processing apparatus 301, performs the above-described functions defined in the methods of some embodiments of the present disclosure.
It should be noted that the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (Hyper Text Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be included in the head-mounted display apparatus; or may be separate and not incorporated into the head-mounted display device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the head mounted display apparatus to: in response to the detection of the menu display operation acting on the external equipment, displaying each application page in a virtual three-dimensional space in an application menu list mode, wherein each application page is displayed in the virtual three-dimensional space in an initial opening mode before the menu display operation is detected; determining application switching display configuration information of the head-mounted display device in response to detecting a selection operation acting on any application page displayed in the application menu list through a virtual three-dimensional ray; responding to the application switching display configuration information representation application position switching display, and determining the position of the selected application page in the virtual three-dimensional space when the selected application page is displayed in an initial opening mode as a display position to be switched; determining whether the display position to be switched is a target display position; in response to the fact that the display position to be switched is not the target display position, determining whether a target application page is displayed at the target display position or not; and responding to the target display position to display a target application page, switching the target application page to the display position to be switched for display, and switching the selected application page to the target display position for display so as to realize the position switching display of the selected application page and the target application page.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems on a chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept as defined above. For example, the above features and (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure are mutually replaced to form the technical solution.

Claims (9)

1. An application display method is applied to a head-mounted display device, the head-mounted display device comprises head-mounted display equipment and external equipment, and the method comprises the following steps:
responding to the detection of menu display operation acting on the external equipment, displaying each application page in a virtual three-dimensional space in an application menu list mode, wherein each application page is displayed in the virtual three-dimensional space in an initial opening mode before the menu display operation is detected;
in response to detecting a selection operation on any application page displayed in the application menu list through a virtual three-dimensional ray, determining application switching display configuration information of the head-mounted display device;
responding to the application switching display configuration information representation application position switching display, and determining the position of the selected application page in the virtual three-dimensional space when the selected application page is displayed in an initial opening mode as a display position to be switched;
determining whether the display position to be switched is a target display position;
in response to determining that the display position to be switched is not the target display position, determining whether a target application page is displayed at the target display position;
and responding to the target display position to display a target application page, switching the target application page to the display position to be switched for display, and switching the selected application page to the target display position for display so as to realize the position switching display of the selected application page and the target application page.
2. The method according to claim 1, wherein after said determining whether the display position to be switched is a target display position, the method further comprises:
in response to determining that the display position to be switched is the target display position, displaying the selected application page at the target display position.
3. The method according to claim 1, wherein before said determining a position in the virtual three-dimensional space when the selected application page is displayed in an initially open manner as a display position to be switched in response to detecting a selection operation on any application page displayed in the application menu list by a virtual three-dimensional ray, the method further comprises:
and determining each application page which is not positioned at the target display position when the application menu list is displayed in an initial opening mode as an application page to be released, so as to obtain an application page set to be released.
4. The method of claim 3, wherein the method further comprises:
deleting the selected application page from the application page set to be released so as to update the application page set to be released;
and displaying each application page to be released in the updated application page set to be released in the virtual three-dimensional space in an initial opening mode.
5. The method of claim 1, wherein the application pages are displayed in an overlapping arrangement in the application menu list, and each application page displayed in the application menu list displays at least an application icon and an application name.
6. The method of claim 1, wherein after the displaying each application page in the virtual three-dimensional space in the form of an application menu list in response to detecting a menu display operation acting on the external device, the method further comprises:
in response to detecting a preview operation acting on any application page displayed in the application menu list through the virtual three-dimensional ray, displaying a corresponding application preview window on one side of the application page previewed by the preview operation.
7. The method according to any one of claims 1-6, wherein after the step of displaying each application page in a virtual three-dimensional space in an application menu list manner in response to detecting a menu display operation acting on the external device, the method further comprises the steps of:
and in response to detecting the page clearing operation acted on any application page in the application menu list through the virtual three-dimensional ray, clearing the application page corresponding to the page clearing operation.
8. A head-mounted display device, comprising:
one or more processors;
a head-mounted display device comprising a display screen for displaying a virtual three-dimensional space and virtual three-dimensional rays such that at least one application page is displayed in the virtual three-dimensional space;
a storage device having one or more programs stored thereon and configured to store application switching display configuration information of the head-mounted display apparatus;
the external device is used for controlling the virtual three-dimensional ray to execute related operations in the virtual three-dimensional space, and the related operations comprise: selecting operation, previewing operation and page clearing operation;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method recited in any of claims 1-7.
9. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-7.
CN202310030256.6A 2023-01-10 2023-01-10 Application display method, head-mounted display device, and computer-readable medium Active CN115756176B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310030256.6A CN115756176B (en) 2023-01-10 2023-01-10 Application display method, head-mounted display device, and computer-readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310030256.6A CN115756176B (en) 2023-01-10 2023-01-10 Application display method, head-mounted display device, and computer-readable medium

Publications (2)

Publication Number Publication Date
CN115756176A true CN115756176A (en) 2023-03-07
CN115756176B CN115756176B (en) 2023-05-23

Family

ID=85348845

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310030256.6A Active CN115756176B (en) 2023-01-10 2023-01-10 Application display method, head-mounted display device, and computer-readable medium

Country Status (1)

Country Link
CN (1) CN115756176B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10289225A (en) * 1997-04-15 1998-10-27 Fuji Xerox Co Ltd Document editing device
US20080005702A1 (en) * 2006-05-31 2008-01-03 Abb Technology Ltd. Virtual work place
US20140280502A1 (en) * 2013-03-15 2014-09-18 John Cronin Crowd and cloud enabled virtual reality distributed location network
CN106662924A (en) * 2014-07-25 2017-05-10 微软技术许可有限责任公司 Mouse sharing between a desktop and a virtual world
US20170139548A1 (en) * 2015-11-13 2017-05-18 Mastercard International Incorporated Systems and methods for a rotating three-dimensional menu
CN109219795A (en) * 2016-07-05 2019-01-15 深圳脑穿越科技有限公司 page switching method, device, terminal and storage medium
CN113703704A (en) * 2021-08-26 2021-11-26 杭州灵伴科技有限公司 Interface display method, head-mounted display device and computer readable medium
CN114201104A (en) * 2021-12-13 2022-03-18 杭州灵伴科技有限公司 Virtual application interface updating method, head-mounted display device assembly and medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10289225A (en) * 1997-04-15 1998-10-27 Fuji Xerox Co Ltd Document editing device
US20080005702A1 (en) * 2006-05-31 2008-01-03 Abb Technology Ltd. Virtual work place
US20140280502A1 (en) * 2013-03-15 2014-09-18 John Cronin Crowd and cloud enabled virtual reality distributed location network
CN106662924A (en) * 2014-07-25 2017-05-10 微软技术许可有限责任公司 Mouse sharing between a desktop and a virtual world
US20170139548A1 (en) * 2015-11-13 2017-05-18 Mastercard International Incorporated Systems and methods for a rotating three-dimensional menu
CN109219795A (en) * 2016-07-05 2019-01-15 深圳脑穿越科技有限公司 page switching method, device, terminal and storage medium
CN113703704A (en) * 2021-08-26 2021-11-26 杭州灵伴科技有限公司 Interface display method, head-mounted display device and computer readable medium
CN114201104A (en) * 2021-12-13 2022-03-18 杭州灵伴科技有限公司 Virtual application interface updating method, head-mounted display device assembly and medium

Also Published As

Publication number Publication date
CN115756176B (en) 2023-05-23

Similar Documents

Publication Publication Date Title
US20230007065A1 (en) Video sharing method, apparatus, device and medium
CN109271603B (en) Method and equipment for displaying page
US11366564B2 (en) Electronic device and method for multi-view browsing in an augmented reality environment
JP7480344B2 (en) Information display method, device and electronic device
CN111291244B (en) House source information display method, device, terminal and storage medium
US10586285B2 (en) Securities information display method, apparatus, and system
CN113191726A (en) Task detail interface display method, device, equipment and computer readable medium
CN113891164A (en) Video list display method and device, electronic equipment and storage medium
CN112069524A (en) Information processing method, device, equipment and storage medium
CN113589926B (en) Virtual interface operation method, head-mounted display device and computer readable medium
US11068557B2 (en) Mobile application discovery using an electronic map
US20230199262A1 (en) Information display method and device, and terminal and storage medium
CN113986102A (en) Display control method, display control device, electronic equipment and storage medium
CN113609419A (en) Information display method and device, electronic equipment and computer readable medium
CN114997104A (en) Document display method and device, electronic equipment and storage medium
CN110456957B (en) Display interaction method, device, equipment and storage medium
CN115756176B (en) Application display method, head-mounted display device, and computer-readable medium
CN111767490A (en) Method, device, equipment and storage medium for displaying image
US11960817B2 (en) Web site preview based on client presentation state
CN115904069A (en) Input mode determination method, head-mounted display device, and computer-readable medium
CN113836455B (en) Special effect rendering method, device, equipment, storage medium and computer program product
CN114397961A (en) Head-mounted display device control method, head-mounted display device assembly, and medium
CN114637400A (en) Visual content updating method, head-mounted display device assembly and computer readable medium
CN113703704A (en) Interface display method, head-mounted display device and computer readable medium
CN113342220A (en) Window rendering method, head-mounted display kit, and computer-readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant