WO2022083554A1 - 用户界面的布局、交互方法及三维显示设备 - Google Patents

用户界面的布局、交互方法及三维显示设备 Download PDF

Info

Publication number
WO2022083554A1
WO2022083554A1 PCT/CN2021/124457 CN2021124457W WO2022083554A1 WO 2022083554 A1 WO2022083554 A1 WO 2022083554A1 CN 2021124457 W CN2021124457 W CN 2021124457W WO 2022083554 A1 WO2022083554 A1 WO 2022083554A1
Authority
WO
WIPO (PCT)
Prior art keywords
page
application
display
displayed
applications
Prior art date
Application number
PCT/CN2021/124457
Other languages
English (en)
French (fr)
Inventor
史东平
杨彬
姜明辉
刘帅
任子健
秦鹏鹏
路锋
张玉光
孙新伟
吴连朋
Original Assignee
聚好看科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110324732.6A external-priority patent/CN114385052B/zh
Application filed by 聚好看科技股份有限公司 filed Critical 聚好看科技股份有限公司
Publication of WO2022083554A1 publication Critical patent/WO2022083554A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Definitions

  • the present application relates to the technical field of smart device manufacturing, and in particular, to a layout of a user interface, an interaction method, and a three-dimensional display device.
  • VR Virtual Reality, Virtual Reality
  • AR Augmented Reality, Augmented Reality
  • VR devices and AR devices may also be collectively referred to as three-dimensional display devices.
  • a virtual reality application When using a three-dimensional display device for immersive experience, a virtual reality application is configured in the three-dimensional display device, and when the virtual reality application is started, a virtual user interface with multiple controls capable of realizing different functions is displayed. Because the space of the three-dimensional display device is a three-dimensional space, it is different from the traditional two-dimensional space. Therefore, the layout and interaction methods of the virtual user interface are different from those of flat display devices such as TVs and mobile phones. When laying out and interacting with the virtual user interface, if the traditional two-dimensional space layout method is simply transplanted to the three-dimensional space, it will lead to difficulty in interaction, unscientific layout, and discomfort that does not meet expectations when the user's perspective changes, affecting users. experience.
  • the present application provides a layout of a user interface, an interaction method, and a three-dimensional display device, so as to solve the problem of poor interaction experience of a virtual user interface.
  • the present application provides a three-dimensional display device, comprising: a virtual display configured to present a virtual user interface; a controller connected to the virtual display, the controller configured to: in response to triggering the virtual reality
  • the application startup instruction generated during application the content recommendation area including the home page and the navigation bar is presented in the main viewing angle area of the virtual user interface, and the application including applications with different attributes is presented in the bottom area of the main viewing angle of the virtual user interface Switch area.
  • the controller is further configured to: acquire a plurality of recommended contents for displaying different recommended contents when performing the presentation of the content recommendation area including displaying the home page and the navigation bar in the main viewing angle area of the virtual user interface.
  • Content recommendation data and a plurality of navigation function data for realizing different navigation functions; generating a display homepage including a plurality of pages based on a plurality of the content recommendation data, and displaying the display homepage in the content recommendation area; based on the plurality of the content recommendation data
  • the navigation function data generates a navigation bar including a plurality of navigation buttons, the navigation bar is displayed in the content recommendation area, the navigation bar is displayed below the displayed home page, and one navigation button corresponds to one navigation function data.
  • the controller when performing the displaying the display home page in the content recommendation area, is further configured to: obtain the number of sides of a regular polygon when the content recommendation area performs page display in an orthogonal page layout manner. , the preset depth of field distance between the human eye and the page in the main viewing angle direction, the preset page spacing between two adjacent pages, and the number of pages displayed in the display home page; based on the preset depth of field distance, preset page spacing and number of regular polygon sides, generate regular polygons for orthogonal page layout in the content recommendation area, and the regular polygons are in a transparent state; present multiple pages displayed in the display home page On the designated sides of the regular polygon, the number of the designated sides is equal to the number of pages displayed in the display home page.
  • the controller is further configured to: the display home page includes a home page, a left page, right page, left hidden page and right hidden page, the specified sides of the regular polygon include a middle specified side, a left specified side, a right specified side, a left hidden specified side and a right hidden specified side;
  • the left page is displayed on the left designated side
  • the main page is displayed on the middle designated side
  • the right page is displayed on the right designated side
  • the middle designated side is the center line of the main viewing angle
  • the corresponding specified side, the left side specified side is located on the left side of the middle specified side
  • the right side specified side is located on the right side of the middle specified side;
  • the left side hidden page is set on the left side hidden specified side
  • the left side hidden specified side is located on the left side of the left side specified side
  • the left side hidden page is used to cache the content recommendation data of the previous page of the left side page, and the left side hidden page is not Display;
  • the right side hidden page is set on the right side hidden specified
  • the controller is further configured to: when the page including the content recommendation data is presented on the specified side of the regular polygon, in response to a page selection instruction generated when the page on the specified side on the right side is triggered, Move the page on the specified side on the left to the left and hide it on the specified side, move the page on the specified side in the middle to the left on the specified side on the left, and move the page on the specified side on the right to the left To the middle designated edge, move the hidden page located on the right hidden designated edge to the left to the right designated edge and display it; in response to the page selection instruction generated when the page on the left designated edge is triggered, it will be located on the left designated edge.
  • the controller is further configured to: when switching different navigation buttons based on the navigation bar, if each navigation button does not obtain the control focus, add a representation of a normal state to each of the navigation buttons. If one of the navigation buttons obtains the control focus, then add an identification pattern representing the focus state to the navigation button; if one of the navigation buttons loses the control focus after obtaining the trigger operation, then add a symbol to the navigation button. A logo pattern for the legacy state.
  • the controller presents an application switching area including applications with different attributes in the bottom area of the main viewing angle of the virtual user interface, and is further configured to: the applications with different attributes include system recommended applications and locally installed applications. application; when the current number of applications recommended by the system is zero, an application switching area including a page-turning display area is generated, and the page-turning display area is used to display locally installed applications; when the current number of recommended applications by the system is not At zero time, an application switching area including a fixed display area, a page-turning display area, and an interval marker is generated.
  • the fixed display area is used to display system recommended applications
  • the page-turning display area is used to display locally installed applications.
  • the interval marker It is located between the fixed display area and the page-turning display area.
  • the controller is further configured to: when several applications are displayed in the page-turning display area, acquire the total number of displayable applications and the total number of currently displayed applications in the page-turning display area; The total number of currently displayed applications is greater than the total number of displayable applications, an application list is generated based on the applications corresponding to the total number of currently displayed applications, and the applications include displayable locally installed applications and system recommended applications corresponding to the excess number of configuration applications ; present applications corresponding to the total number of displayable applications in the page-turning display area according to the application list, and display page-turning buttons on both sides of the page-turning display area, and the page-turning buttons are used to trigger The applications in the application list are displayed in the page turning display area.
  • the present application provides a three-dimensional display device, comprising: a virtual display configured to present a virtual user interface; a controller connected to the virtual display, the controller configured to: in response to triggering the virtual reality
  • the application startup instruction generated during application generates a virtual user interface including a display home page, a navigation bar and an application switching area; when performing page switching based on the displayed home page, the page generated in response to triggering any page in the displayed home page Selecting an instruction to switch the page to display at a position corresponding to the center line of the main viewing angle; when switching the navigation buttons based on the navigation bar, in response to the navigation selection instruction generated when any navigation button in the navigation bar is triggered, it is:
  • the navigation button adds an identification pattern corresponding to the operation; when performing application switching based on the application switching area, the application is activated in response to an application switching instruction generated when any application in the application switching area is triggered.
  • the controller executes the page selection instruction generated in response to triggering any page in the display homepage, and switches the page to display at a position corresponding to the center line of the main viewing angle
  • the controller is further configured to:
  • the display home page is displayed in an orthogonal page layout manner, each page in the display home page is displayed on a specified side of a regular polygon that realizes the orthogonal page layout manner, and the specified side includes a page used for displaying the page The middle specified side, the left specified side and the right side specified side, and the left side hidden specified side and the right side specified side used to hide the page, the middle specified side is the specified side corresponding to the center line of the main viewing angle;
  • the response The page selection instruction generated when the page on the specified right side is triggered, moves the page located on the specified side on the right to the left to the specified side in the middle, and moves the page located on the specified side on the left to the left
  • the side hides the specified side and hides it, moves the page located on the middle specified side to the left to the
  • the controller when executing the navigation selection instruction generated in response to triggering any navigation button in the navigation bar, adds an identification pattern corresponding to the operation for the navigation button, and is further configured as: : When switching between different navigation buttons based on the navigation bar, if each navigation button does not obtain the control focus, add a logo pattern corresponding to the operation to each of the navigation buttons and representing a normal state; in response to A navigation selection instruction representing the control focus is generated when any navigation button in the navigation bar is triggered, and an identification pattern representing the focus state corresponding to the operation is added to the navigation button; in response to triggering the navigation bar
  • any navigation button is generated, it represents the navigation selection instruction that the control focus is lost after the trigger operation is obtained, and an identification pattern corresponding to the operation and representing the legacy state is added to the navigation button.
  • the present application provides a method for laying out a virtual user interface, the method comprising: in response to an application startup instruction generated when a virtual reality application is triggered, presenting in a main perspective area of the virtual user interface includes displaying a homepage and A content recommendation area of the navigation bar, and an application switching area including applications with different attributes is presented in the bottom area of the main viewing angle of the virtual user interface.
  • the present application provides a three-dimensional display device, comprising: a virtual display configured to present a virtual user interface including an application switching area; a controller connected to the virtual display, the controller configured to: In response to the application startup instruction generated when the virtual reality application is triggered, obtain the first application and the second application to be displayed, and the system configuration information used to characterize whether the local end is configured with the recommended display function; if the system configuration information represents If the local end is not configured with the recommended display function, load a first template interface including a page-turning display position in the application switching area, display the icon of the first application in the page-turning display position, and, when receiving a move instruction , the icon displayed in the page-turning display position moves in the direction indicated by the moving instruction; if the system configuration information indicates that the local end is configured with the recommended display function, the loading in the application switching area includes the fixed display position and The second template interface of the page-turning display position, displaying the icon of the second application in the fixed display position, displaying the icon of
  • the controller when determining whether the local end is configured with a recommended display function according to the system configuration information, is further configured to: obtain the current display quantity and system configuration of the second application in the system configuration information. The configured number of fixed display positions of Then, the configuration quantity of the fixed display position is set to zero, and it is determined that the system configuration information indicates that the local end is not configured with the recommended display function; if the configuration quantity of the fixed display position is not zero, and the No. If the current display quantity of the second application is not zero, it is determined that the system configuration information indicates that the local end is configured with the recommended display function.
  • the controller is further configured to: when a second template interface including a fixed display position and a page-turning display position is loaded in the application switching area, display between the fixed display position and the page-turning display position.
  • a spacer marker for distinguishing the first application from the second application is further configured to: when a second template interface including a fixed display position and a page-turning display position is loaded in the application switching area, display between the fixed display position and the page-turning display position.
  • the controller is further configured to: obtain the current display of the second application in the system configuration information when the first template interface including the page-turning display position is loaded in the application switching area number; if the current display number of the second application is not zero, display the icon of the first application and the icon of the second application in the page-turning display position.
  • the controller is further configured to: display the icon of the second application at the fixed display position, and display the icon of the first application at the page-turning display position.
  • the application switching area loads the second template interface including the fixed display position and the page-turning display position
  • the popularity value of the second application and the historical usage time of the first application are obtained;
  • the icon of the corresponding second application is displayed on each fixed display position in turn; according to the chronological order of the historical use time of each first application, the corresponding first application is displayed in turn.
  • An app's icon is displayed on each page-turning placement.
  • the controller when the controller is performing the displaying of the icon of the first application and the icon of the second application in the page-turning display area, the controller is further configured to: loading in the application switching area includes fixing The second template interface of the display position and the page-turning display position, and, when there is an icon of the second application that needs to be displayed in the page-turning display position, obtain the popularity value of the second application and the historical usage time of the first application ; According to the order of magnitude of the heat value of each of the second applications, the icons of the corresponding second applications are displayed on the page-turning display position at the front of the column in turn, and, according to the historical use of each of the first applications In the chronological order of time from late to early, the corresponding icons of the first application are displayed on the page-turning display position at the rear of the column, and the icons of the first application are displayed to the right of the icons of the second application.
  • the controller executes the displaying of the icon of the first application and the icon of the second application in the page-turning display area
  • the controller is further configured to: loading in the application switching area includes flipping the page.
  • the first template interface of the page display position and, when there is an icon of the second application that needs to be displayed in the page display position, obtain the popularity value of the second application and the historical usage time of the first application; according to each The order of magnitude of the popularity value of the second application, sequentially displaying the corresponding icon of the second application on the page-turning display position at the front of the column, and, according to the historical usage time of each first application from late to late.
  • the corresponding icons of the first application are sequentially displayed on the page-turning display position at the rear of the column, and the icon of the first application is displayed on the right side of the icon of the second application.
  • the present application provides a method for displaying application icons in a virtual user interface, the method comprising: acquiring a first application and a second application to be displayed in response to an application startup instruction generated when a virtual reality application is triggered, And, the system configuration information used to indicate whether the local end is configured with the recommended display function; if the system configuration information indicates that the local end is not configured with the recommended display function, load the first page including the page-turning display position in the application switching area.
  • a template interface displaying the icon of the first application in the page-turning display position, and, when receiving a movement instruction, the icon displayed in the page-turning display position moves in the direction indicated by the movement instruction; if the The system configuration information indicates that the local end is configured with the recommended display function, then load a second template interface including a fixed display position and a page-turning display position in the application switching area, and display the icon of the second application in the fixed display position, The icon of the first application is displayed in the page-turning display position, and when a move instruction is received, the icon in the fixed display position does not move, and the icon in the page-turning display position moves toward the moving instruction move in the direction indicated.
  • the controller is further configured to: in response to triggering a selection operation of a popular search data in the popular search display area, send a content details request carrying a content ID to the server, where the content details request is used for Instruct the server to query the content detail information corresponding to the content ID, where the content ID is used to represent the popular search data; receive the content detail information corresponding to the content ID returned by the server, in the virtual A content detail interface is generated in the user interface, and the content detail information is displayed in the content detail interface.
  • the controller is further configured to: in response to triggering a selection operation of a piece of historical search data in the historical record display area, send a content search request to a server, where the content search request is used to instruct the server Query the content search result corresponding to the selected historical search data; receive the content search result corresponding to the selected historical search data returned by the server, generate a search result interface in the virtual user interface, and display the search result interface The content search result.
  • the controller when performing the initial search, obtains a content search result corresponding to the target text input in the input box, and is further configured to: when performing the initial search, receive the For the operation of the input box, a search keyboard is displayed in the initial search interface, and the search keyboard is located below the input box; the target text input based on the search keyboard is received, and a content search request is sent to the server, and the content search The request is used to instruct the server to query the content search result corresponding to the target text, and the target text is displayed in the input box; and receive the content search result corresponding to the target text returned by the server.
  • the controller is further configured to: when the target text is input based on the search keyboard, send an association word acquisition request to the server, where the association word acquisition request is used to instruct the server to query and the target text.
  • Corresponding associative words receiving the associative words corresponding to the target text returned by the server, generating an associative word list, and the associative word list is displayed on the upper layer of the initial search interface in the form of a floating layer.
  • the controller when performing the continuous search, obtains a new content search result corresponding to the continuous text input in the input box, and is further configured to: when performing the continuous search, receive a display-based search result.
  • the new text entered in the input box with the target text sends a content search request to the server, where the content search request is used to instruct the server to query the new content search result corresponding to the continuous text, and the continuous text includes the target text and the new text , the continuous text is displayed in the input box; and a new content search result corresponding to the continuous text returned by the server is received.
  • the controller is further configured to: when the continuous text is displayed in the input box, send an association word acquisition request to the server, and the association word acquisition request is used to instruct the server to query and the continuous text.
  • Corresponding associative words receiving associative words corresponding to the continuous text returned by the server, generating an associative word list, and the associative word list is displayed on the upper layer of the search result interface in the form of a floating layer.
  • the controller is further configured to: when performing an initial search or a continuous search, receive an operation on a voice input box in the initial search interface, and display a voice input interface in the virtual user interface; receive a user input voice text, display the voice text in the voice input interface; send a content search request to the server, where the content search request is used to instruct the server to query the content search result corresponding to the voice text; receive the The content search result corresponding to the voice text returned by the server is displayed in the search result interface.
  • the present application provides a three-dimensional display device, comprising: a virtual display configured to present a virtual user interface displaying a Tab bar; a controller connected to the virtual display, the controller configured to: Obtain at least one tab to be displayed; if the width of the tab of the tab is less than or equal to the width of the tab to be displayed, the tab is displayed in the fully displayed state in the tab; if the tab is The width of the tab is greater than the width to be displayed in the Tab column, then the Tab label is displayed in the Tab column in an incomplete display state; when the incompletely displayed Tab label obtains the control focus, the first direction is displayed. Move each tab in the tab bar to display the incompletely displayed tab in the tab bar in a fully displayed state, and the first direction refers to the tab from the not fully displayed tab to the phase. The orientation of the fully displayed tab of the neighbor.
  • the controller executes the step of moving the tab located on the right side of the tab bar to the right to hide or display it in an incompletely displayed state
  • the controller is further configured to: The right coordinate position and tab width of the fully displayed Tab label, calculate the width of the undisplayed part of the not fully displayed Tab During the distance, from the right side of the Tab column, the tab width of each Tab label displayed in the Tab column is accumulated successively, and the accumulated width corresponding to several Tab labels is obtained; if the accumulated width is less than or equal to the width of the undisplayed part, then Hide at least one Tab label corresponding to the cumulative width; if the cumulative width is greater than the width of the undisplayed part, then display the last cumulative Tab label corresponding to the cumulative width in the incomplete display state in the tab column. On the right side, the displayed width of the last accumulated Tab label is the difference between the corresponding tab width and the width of the undisplayed portion.
  • the controller is further configured to: in response to triggering the right side of the Tab bar, when performing the displaying the incompletely displayed Tab label at the end position of the Tab bar in a fully displayed state.
  • the page-turning instruction generated by the page-turning button displays the incompletely displayed Tab labels at the left end position of the Tab column in a fully displayed state, and obtains the undisplayed subsequent Tab labels;
  • the following tabs that are not shown are displayed on the right side of the fully displayed tabs in order from left to right.
  • the present application provides a method for dynamically displaying a tab, the method comprising: obtaining at least one tab to be displayed; if the width of the tab of the tab is less than or equal to the width of the tab to be displayed, then The Tab label is displayed in the Tab column in a fully displayed state; if the width of the Tab label is greater than the width to be displayed in the Tab column, the Tab label is displayed in the incomplete display state in the Tab column.
  • Tab bar when the under-displayed Tab label obtains the control focus, move each Tab label in the Tab bar to the first direction, so as to display the under-displayed Tab label in the fully displayed state in the tab bar.
  • the first direction refers to a direction from an unfully displayed Tab to an adjacent fully displayed Tab.
  • the present application provides a three-dimensional display device, comprising: a virtual display configured to present a virtual user interface displaying different applications; a camera configured to collect image information; A controller connected to the camera, the controller is configured to: receive an operation on any application in the virtual user interface, and present an account login interface including a scan code login control in the virtual user interface; the operation of the scan code login control, turning on the camera, and presenting a scan code login interface including an image display area in the account login interface, and the image display area is used to display the image information collected by the camera; obtaining The camera collects the account login information obtained by logging in the two-dimensional code, and logs in to the account corresponding to the application based on the account login information.
  • the QR code generated by the account information of the application.
  • the controller when the controller executes the acquiring the account login information obtained by the camera to collect the login two-dimensional code, the controller logs in to the corresponding application based on the account login information.
  • the account is further configured to: obtain account login information obtained by the camera collecting the login two-dimensional code provided by the intelligent terminal, and device source field information used to characterize the source of the local device; based on the account login information and device source field information, generate an account login request, and send it to the server, where the account login request is used to instruct the server to perform account verification based on the account login information and device source field information; receive a response from the server to the account login The account verification result returned after the request is based on the account verification result to realize the login of the account corresponding to the application.
  • the controller implements the account verification result based on the account verification result after receiving the account verification result returned by the server in response to the account login request.
  • the login of the account corresponding to the application is further configured to: receive the account verification result returned after the server responds to the account login request, parse the account verification result, and obtain account verification parameters; When the verification parameter indicates that the login is successful, the login process of the account corresponding to the application is performed; when the account verification parameter indicates that the login fails, the login process of the account corresponding to the application is not performed.
  • the controller when the controller executes the login process of the account corresponding to the application when the account verification parameter indicates that the login is successful, the controller is further configured as: When the account verification parameter indicates that the login is successful, obtain user information in the account verification result; generate an application homepage of the application based on the user information, and display the application homepage in the virtual user interface .
  • the controller does not perform the login process of the account corresponding to the application when the account verification parameter indicates that the login fails, and is further configured to: the account verification parameter indicates the login failure.
  • the login failure information is obtained, the login failure information in the account verification result is obtained; a login failure prompt is generated based on the login failure information, and the login failure prompt is displayed in the code scanning login interface.
  • the present application provides a server, including: a memory configured to store registered account information of an account corresponding to an application; a controller connected to the memory, the controller configured to: display in a three-dimensional
  • the device performs the account login of the application, it receives the account login request sent by the 3D display device.
  • the account login request carries the account login information and the device source field information, and the account login information refers to the scanning by the 3D display device.
  • the QR code for logging in refers to the QR code generated by the smart terminal based on the configured account information of the application logged in with the account.
  • the controller when the controller performs the account verification based on the account login information and the device source field information to obtain an account verification result, the controller is further configured to: acquire the registered account information corresponding to the application, and compare Whether the registered account information and the account login information are consistent; if the registered account information and the account login information are inconsistent compared with each other, then generate login failure information and account verification parameters for characterizing the login failure, and the account verification
  • the verification result includes login failure information and account verification parameters used to characterize the login failure; if the registered account information and the account login information are compared and consistent, then based on the device source field information, determine whether the account allows the Application login in the three-dimensional display device; when the account allows the application in the three-dimensional display device to log in, user information for account login and account verification parameters for indicating successful login are generated, and the account verification The result includes user information and account verification parameters used to characterize successful login.
  • the controller is further configured to: based on the device source field information, determine whether the account allows the application in the three-dimensional display device to log in, based on the device source field information.
  • the source of the target device of the three-dimensional display device that sends the account login request ; obtain the user status of other devices that are the same as the source of the target device, and determine whether the application in the corresponding other device has logged in the account based on the user status; if The application in the other device is logged in with the account, then the account logged in by the application in the other device is logged out, and an identification that allows the application in the three-dimensional display device to log in to the account is generated; if the other device is not logged in with the account the account number, then generate an identifier that allows the application in the three-dimensional display device to log in to the account number.
  • the present application provides an account login method, which is applied to a three-dimensional display device.
  • the method includes: receiving an operation on any application in a virtual user interface, and presenting in the virtual user interface includes scanning a code to log in The account login interface of the control; receiving an operation on the scan code login control, turning on the camera, and presenting a scan code login interface including an image display area in the account login interface, and the image display area is used for displaying The image information collected by the camera; the account login information obtained by the camera collected and logged in the QR code is obtained, and the account corresponding to the application is logged in based on the account login information.
  • the user interface for controlling the virtual application of the display device is displayed on the display and AR/VR glasses.
  • the user interface includes a global UI
  • the global UI may include a recommended content area, a business classification extension area, an application shortcut operation entry area, and a suspended object area.
  • the suspended matter area is configured above the left and right oblique sides of the fixed area, and may be configured as a replaceable image or a jump link.
  • the global UI further includes a status bar for displaying time, network connection status, power status, and more shortcut operation entries.
  • the display device further includes a handle, and the handle operates the user interface of the AR/VR terminal, including a return button, a home button, a volume up and down button, and a touch area.
  • the display device further includes a mobile phone-side VR assistant.
  • a mobile phone-side VR assistant When the mobile phone-side VR assistant and the display device are not connected via Bluetooth and cannot set WIFI, a prompt message will be displayed on the user interface.
  • the display device further includes a voice assistant, and the voice assistant may be implemented as an avatar entry.
  • the user interface will display a pop-up prompt.
  • FIG. 1A shows a schematic diagram of an operation scenario between a display device and a control device in some embodiments
  • FIG. 1B shows a block diagram of the hardware configuration of the display device 200 in some embodiments
  • FIG. 1C shows a block diagram of the hardware configuration of the control device 100 in some embodiments
  • FIG. 1D shows a schematic diagram of the functional configuration of the display device 200 in some embodiments
  • FIG. 1E shows a schematic diagram of software configuration in the display device 200 in some embodiments
  • FIG. 1F shows a schematic configuration diagram of an application in the display device 200 in some embodiments
  • FIG. 2A shows a global schematic diagram of a virtual user interface of a three-dimensional display device according to some embodiments
  • 3A shows a schematic diagram of a content recommendation area in a virtual user interface according to some embodiments
  • 3B shows a schematic diagram of an orthogonal page layout according to some embodiments
  • FIG. 3D shows a schematic diagram of displaying a homepage in an orthogonal layout manner according to some embodiments
  • FIG. 3E shows another schematic diagram of displaying a home page in an orthogonal layout manner according to some embodiments
  • 3F shows a display effect diagram showing that a page in the home page moves to the right during interaction according to some embodiments
  • 3G shows a display effect diagram showing that the page in the home page moves to the left during interaction according to some embodiments
  • 3H shows a display effect diagram of the navigation bar during interaction according to some embodiments
  • 3I shows a display effect diagram of the application switching area during interaction according to some embodiments
  • 3J shows a display effect diagram of the page-turning display area when page-turning interaction is performed according to some embodiments
  • FIG. 3K shows a display effect diagram of the application switching area when page-turning interaction is performed according to some embodiments
  • 3L shows a flowchart of a method of interacting with a virtual user interface according to some embodiments
  • FIG. 4A shows a flowchart of a method for presenting application icons in a virtual user interface according to some embodiments
  • 4B shows a display effect diagram of a page-turning display area when the local end is not configured with a recommended display function according to some embodiments
  • 4C shows a display effect diagram of an application switching area when the local end is configured with a recommended display function according to some embodiments
  • FIG. 4D shows a display effect diagram of the page-turning display area when page-turning interaction is performed according to some embodiments
  • FIG. 4E shows a display effect diagram of the application switching area when page-turning interaction is performed according to some embodiments
  • 4F shows another display effect diagram of the page-turning display area when page-turning interaction is performed according to some embodiments
  • FIG. 4G shows another display effect diagram of the application switching area when page-turning interaction is performed according to some embodiments.
  • 4H shows a display effect diagram of displaying application information in an application switching area according to some embodiments
  • 4I shows a display effect diagram of the application switching area during interaction according to some embodiments
  • Figure 5A shows a flowchart of a content search method according to some embodiments
  • Figure 5B shows a timing diagram of a content search method according to some embodiments
  • Figure 5C shows a data flow diagram of a content search method according to some embodiments
  • Figure 5D shows a schematic diagram of a virtual user interface home page in accordance with some embodiments
  • 5E shows a schematic diagram of a search initial page according to some embodiments.
  • 5F shows a schematic diagram of searching based on a search initial page, according to some embodiments.
  • 5G shows a schematic diagram of a content details interface according to some embodiments.
  • Figure 5H shows a schematic diagram of a search results interface according to some embodiments
  • 5I shows a schematic diagram of inputting target text based on a search keyboard according to some embodiments
  • 5J shows a schematic diagram of a search result interface generated based on target text according to some embodiments
  • 5K shows a schematic diagram of a list of associative words according to some embodiments.
  • 5L shows a schematic diagram of the effect of performing a sliding page-turning operation based on a search result interface according to some embodiments
  • Figure 5M shows a schematic diagram of a voice input interface according to some embodiments
  • FIG. 5N shows a schematic diagram of a voice input interface in a sound collection step according to some embodiments
  • Figure 50 shows a schematic diagram of a voice input interface in a recognition step according to some embodiments
  • 5P shows a schematic diagram of a voice input interface for displaying abnormal operation prompt information according to some embodiments
  • FIG. 6A shows a schematic presentation of a Tab column composed of big data information according to some embodiments
  • 6B shows a flowchart of a method for dynamically displaying a Tab column according to some embodiments
  • FIG. 6C shows a schematic diagram of the area of the Tab column according to some embodiments.
  • FIG. 6D shows a schematic diagram of a Tab tab displayed in a fully displayed state according to some embodiments
  • FIG. 6E shows a schematic diagram of displaying a Tab tab in an incomplete display state according to some embodiments
  • FIG. 6F shows a schematic diagram of a Tab column displaying several tabs according to some embodiments
  • FIG. 6G shows a schematic diagram of calculating the width of the undisplayed portion according to some embodiments
  • FIG. 6H shows another schematic diagram of calculating the width of the undisplayed portion according to some embodiments.
  • 6I shows a schematic diagram of the effect of a tab bar that is not fully displayed in the Tab column according to some embodiments
  • 6J shows a schematic diagram of the effect of triggering an incompletely displayed Tab label existing in the Tab column according to some embodiments
  • 6K shows a schematic diagram of the effect of page-to-left based on the Tab column according to some embodiments
  • FIG. 6L shows a schematic diagram of the effect of turning a page to the right based on the Tab column according to some embodiments
  • 6N shows a schematic diagram of presenting a search history interface in a virtual user interface according to some embodiments
  • 60 shows a schematic diagram of the effect of displaying the Tab bar in the search history interface according to some embodiments.
  • 6P shows a schematic diagram of the effect of adding a legacy status identification pattern on a Tab label according to some embodiments
  • FIG. 7A shows a schematic diagram of a scenario in which a user wears an operating handle of a three-dimensional display device according to some embodiments
  • FIG. 7B shows a flowchart of an account login method according to some embodiments.
  • FIG. 7C shows an interaction diagram of an account login method according to some embodiments.
  • FIG. 7D shows a schematic display diagram of an account login interface according to some embodiments.
  • FIG. 7F shows a schematic diagram of a scene where a camera captures a login QR code provided by a smart terminal according to some embodiments
  • 7G shows a frame diagram of a smart terminal when logging into an account according to some embodiments.
  • FIG. 7H shows another flowchart of an account login method according to some embodiments.
  • remote control refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance.
  • infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included.
  • RF radio frequency
  • a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
  • gesture used in this application refers to a user's behavior that is used by a user to express an expected thought, action, purpose/or result through an action such as a change of hand shape or hand movement.
  • FIG. 1A shows a schematic diagram of an operation scenario between a display device and a control device in some embodiments.
  • the user may operate the display apparatus 200 through the mobile terminal 300 , the AR/VR glasses 500 and the control apparatus 100 .
  • control apparatus 100 can control the display device 200 by a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., in a wireless or other wired manner.
  • a remote control including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc.
  • mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .
  • the display device 200 is controlled using an application running on the smart device.
  • the app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 300 may install a software application with the display device 200, and realize connection communication through a network communication protocol, so as to realize the purpose of one-to-one control operation and data communication.
  • the display device 200 also performs data communication with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the display device 200 may be a liquid crystal display, an OLED display, or a projection display device.
  • the specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
  • the display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and the like.
  • IPTV Internet Protocol TV
  • FIG. 1B A block diagram of a hardware configuration of the display apparatus 200 according to an exemplary embodiment is shown in FIG. 1B .
  • the display device 200 includes a controller 210, a tuner-demodulator 220, a communication interface 230, a detector 240, an input ⁇ output interface 250, a video processor 261, an audio processor 262, a display 280, an audio Output 270, memory 290, power supply, infrared receiver.
  • the display 280 is used for receiving the image signal input from the video processor 261, and performing components for displaying video content and images and a menu manipulation interface.
  • the display 280 includes a display screen component for presenting a picture, and a driving component for driving image display.
  • Display video content which can come from broadcast television content or various broadcast signals that can be received through wired or wireless communication protocols. Alternatively, various image contents sent from the network server side can be displayed and received from the network communication protocol.
  • the display 280 simultaneously displays a user-manipulated UI interface generated in the display device 200 and used to control the display device 200 .
  • a driving component for driving the display is also included.
  • the display 280 is a projection display, it may also include a projection device and a projection screen.
  • the communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communication interface 230 may be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 and other network communication protocol chips or a near field communication protocol chip, and an infrared receiver (not shown in the figure).
  • the display device 200 may establish control signal and data signal transmission and reception with an external control device or a content providing device through the communication interface 230 .
  • an infrared receiver an interface device that can be used to receive infrared control signals of the control device 100 (eg, an infrared remote control, etc.).
  • the detector 240 is used by the display device 200 to collect external environment or external interaction signals.
  • the detector 240 includes a light receiver 242, a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.
  • an image collector 241 such as a camera, a camera, etc., which can be used to collect external environment scenes, as well as to collect user attributes or interactive gestures with users, can adaptively change display parameters, and can also recognize user gestures to achieve and The function of interaction between users.
  • the detector 240 may also be a temperature sensor, for example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the display device 200 can be adjusted to display a relatively cool color temperature of the image, or when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color of the image.
  • the detector 240 including a sound collector, etc., such as a microphone, can be used to receive the user's voice, including the voice signal of the user's control instructions for controlling the display device 200, or to collect ambient sounds for use in Identifying the environmental scene type, the display device 200 can adaptively adapt to the environmental noise.
  • the input/output interface 250 is used for data transmission between the control display device 200 of the controller 210 and other external devices. Such as receiving video signals and audio signals from external devices, or data such as command instructions.
  • the input/output interface 250 may include, but is not limited to, the following: a high-definition multimedia interface HDMI interface 251, an analog or data high-definition component input interface 253, a composite video input interface 252, a USB input interface 254, an RGB port (not shown in the figure) out) and any one or more interfaces.
  • the input/output interface 250 may also form a composite input/output interface with the above-mentioned multiple interfaces.
  • tuner 220 may also be in an external device, such as an external set-top box or the like.
  • the set-top box outputs the television audio and video signals after modulation and demodulation, and is input into the display device 200 through the input/output interface 250 .
  • the video processor 261 is configured to process the received external video signal according to the standard codec protocol of the input signal to obtain a signal that can be directly displayed or played on the display device 200 .
  • the audio processor 262 is configured to receive an external audio signal, and process the input signal according to a standard codec protocol to obtain a sound signal that can be played in the speaker.
  • the video processor 261 may include one or more chips.
  • the audio processor 262 may also include one or more chips.
  • the video processor 261 and the audio processor 262 may be separate chips, or may be integrated with the controller 210 in one or more chips.
  • the audio output 272 under the control of the controller 210, receives the sound signal output by the audio processor 262, such as the speaker 272, and besides the speaker 272 carried by the display device 200 itself, it can be output to the external sound of the generating device of the external device
  • the power input from the external power supply provides power supply support for the display device 200 .
  • the power supply may include a built-in power supply circuit installed inside the display device 200 , or may be an external power supply installed in the display device 200 , and a power interface that provides an external power supply in the display device 200 .
  • the user input interface is used for receiving user input signals, and then sending the received user input signals to the controller 210 .
  • the user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.
  • the user inputs a user command through the remote controller 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 210 .
  • the user may input user commands on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the controller 210 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory 290 .
  • the controller 210 includes a RAM 213 and a ROM 214, a graphics processor 216, a CPU processor 212, and a communication interface 218, such as a first interface 218-1, a second interface 218-2 to an nth interface 218-n , and the communication bus.
  • the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected through a bus.
  • the ROM 213 is used to store various system startup instructions. For example, when the power-on signal is received, the display device 200 starts to power on, and the CPU processor 212 executes the system startup command in the ROM to copy the operating system stored in the memory 290 to the RAM 213 to start the operating system. After the startup of the operating system is completed, the CPU processor 212 copies various application programs in the memory 290 to the RAM 213, and then starts to run and start various application programs.
  • the graphics processor 216 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and so on. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, generating various objects obtained based on the arithmetic unit, and displaying the result of rendering on the display 280 .
  • CPU processor 212 for executing operating system and application program instructions stored in memory 290 . And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.
  • CPU processor 212 may include multiple processors.
  • the plurality of processors may include a main processor and multiple or one sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode.
  • the controller 210 may control the overall operation of the display apparatus 100 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.
  • the object can be any one of the optional objects, such as a hyperlink or an icon.
  • Operations related to the selected object such as displaying operations linked to hyperlinked pages, documents, images, etc., or executing operations corresponding to the icon.
  • the user command for selecting the UI object may be an input command through various input devices (eg, a mouse, a keyboard, a touchpad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.
  • the memory 290 includes storing various software modules for driving the display device 200 .
  • various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is used for the signal communication between various hardwares in the postpartum care display device 200 and the bottom software module that sends processing and control signals to the upper layer module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage.
  • the speech recognition module includes a speech analysis module and a speech instruction database module.
  • the display control module is a module used to control the display 280 to display image content, and can be used to play information such as multimedia image content and UI interface.
  • Communication module a module for control and data communication with external devices.
  • the browser module is a module for performing data communication between browsing servers. Service modules are used to provide various services and modules including various applications.
  • the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focal objects.
  • FIG. 1C A configuration block diagram of the control device 100 according to an exemplary embodiment is shown in FIG. 1C.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .
  • the control device 100 is configured to control the display device 200 , and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.
  • control device 100 may be a smart device.
  • control device 100 may install various applications for controlling the display device 200 according to user requirements.
  • the mobile terminal 300 or other intelligent electronic device can perform a similar function of controlling the device 100 after installing the application for operating the display device 200 .
  • the user can install the application, various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other intelligent electronic devices, so as to realize the function of controlling the physical keys of the device 100 .
  • the controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 218, and a communication bus.
  • the controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation among the internal components and the external and internal data processing functions.
  • the communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110 .
  • the received user input signal is sent to the display device 200 .
  • the communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131 , a Bluetooth module 132 , and an NFC module 133 .
  • the user input/output interface 140 wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a key 144.
  • the output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it can be an infrared interface or a radio frequency interface.
  • the control device 100 includes at least one of a communication interface 130 and an output interface.
  • the communication interface 130 is configured in the control device 100, such as: WiFi, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WiFi protocol, or Bluetooth protocol, or NFC protocol encoding.
  • the memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller 110 .
  • the memory 190 can store various control signal instructions input by the user.
  • the power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110 .
  • FIG. 1D shows a schematic diagram of a functional configuration of the display device 200 according to an exemplary embodiment.
  • the memory 290 is used to store the operating system, application programs, content, and user data, etc., under the control of the controller 210 , to perform system operations that drive the display device 200 and respond to various operations of the user.
  • Memory 290 may include volatile and/or nonvolatile memory.
  • the memory 290 is specifically used to store the running programs that drive the controller 210 in the display device 200, and to store various application programs built in the display device 200, various application programs downloaded by the user from the external device, and various graphic user programs related to the application. interface, as well as various objects related to the graphical user interface, user data information, and various internal data supporting the application.
  • the memory 290 is used to store system software such as OS kernel, middleware, and applications, as well as input video data and audio data, and other user data.
  • the memory 290 is specifically used to store drivers and related data such as the audio and video processors 261 and 262 , the display 280 , the communication interface 230 , the tuner and demodulator 220 , and the input/output interface of the detector 240 .
  • memory 290 may store software and/or programs representing an operating system (OS) including, for example, a kernel, middleware, application programming interfaces (APIs) and/or applications.
  • OS operating system
  • APIs application programming interfaces
  • the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, a light receiving module module 2909, power control module 2910, operating system 2911, and other applications 2912, browser modules, and the like.
  • the controller 210 executes various software programs in the memory 290, such as: broadcast TV signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Other applications such as identification function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.
  • FIG. 1E shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.
  • the operating system 2911 including execution operating software for handling various basic system services and for performing hardware-related tasks, acts as an intermediary for data processing accomplished between applications and hardware components.
  • a portion of the operating system kernel may contain a set of software to manage hardware resources of the display device and provide services for other programs or software codes.
  • a portion of the operating system kernel may contain one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device.
  • Drivers may contain code to operate video, audio and/or other multimedia components. Examples include display, camera, Flash, WiFi, and audio drivers.
  • the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of the displayed content thereof.
  • the communication module 2911-2 is used to connect with other peripherals via related communication interfaces and communication networks.
  • the user interface module 2911-3 is used to provide an object for displaying a user interface so that each application program can access it, which can realize user operability.
  • Control application 2911-4 for controllable process management, including runtime applications and the like.
  • the event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912. In some embodiments, it is implemented in the operating system 2911 and in the application program 2912 on the one hand, and is used to monitor various user input events , will refer to the handlers that implement one or more sets of predefined operations in response to the recognition results of various events or sub-events according to various events.
  • the event monitoring module 2914-1 is used to monitor user input interface input events or sub-events.
  • the event identification module 2914-2 is used to input the definitions of various events to various user input interfaces, identify various events or sub-events, and transmit them to the processing program for executing its corresponding one or more groups .
  • the event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of the external control device (eg, the control device 100 , etc.).
  • the external control device eg, the control device 100 , etc.
  • one or more sub-events in the remote control include various forms, including but not limited to one or a combination of key press up/down/left/right/, confirm key, key press and so on.
  • non-physical button operations such as move, hold, release and other operations.
  • the interface layout manager 2913 directly or indirectly receives and monitors each user input event or sub-event from the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container
  • the size or position, level, etc. of the interface perform various operations related to the interface layout.
  • the application layer 2912 contains various applications that may also be executed on the display device 200 .
  • Applications may include, but are not limited to, one or more applications, such as: live TV applications, video-on-demand applications, media center applications, application centers, game applications, and the like.
  • the embodiments of the present application can be applied to various types of display devices (including but not limited to: smart TVs, AR/AR/VR terminals, and other devices).
  • the technical solutions will be described below with regard to the display device for realizing virtual reality and the operation UI of various related virtual reality applications.
  • the display device that implements virtual reality in various embodiments of the present application may also be referred to as a virtual reality device or a three-dimensional display device, which may include a VR device or an AR device or other devices or device combinations capable of implementing a display function.
  • a virtual reality application is configured in the 3D display device, and a virtual user interface is presented in the virtual space when the virtual reality application is started.
  • a virtual user interface is presented in front of your eyes.
  • the virtual user interface displays functional controls that can realize different business requirements. Each business requirement corresponds to a function, such as homepage recommendation, navigation, etc.; , live broadcast, 4K video, program application, game, travel, etc.
  • the three-dimensional display device provides an immersive experience of three-dimensional scenes, so that the space of the three-dimensional display device is a three-dimensional space, which is different from the traditional two-dimensional space. Therefore, for the layout and interaction method of the virtual user interface, different from flat display devices such as TVs and mobile phones, 3D display devices have the ability to control the three-dimensional layout. Flexible layout in 360-degree space, and different interfaces can be seen as the person's head turns.
  • the unscientific layout causes the user's perspective to change and cause discomfort that does not meet expectations.
  • User experience which can provide different layouts according to human visual characteristics, thereby improving user experience.
  • This layout method aims to make full use of the three-dimensional space characteristics and human visual characteristics for layout and interaction, so that all layouts can be operated within the comfortable experience range.
  • the overall layout of the virtual user interface can be divided into regions around the main perspective of the human eye.
  • the main viewing angle refers to the range that the user's human eyes can see when the user's head is not turned, and the main viewing angle of the three-dimensional display device can be understood as the range of images that the device can display.
  • Figure 2A shows a global schematic diagram of a virtual user interface of a three-dimensional display device according to some embodiments.
  • the regions of the global interface divided according to the main perspective of the human eye include: the main perspective region, the top region of the main perspective, the bottom region of the main perspective, the left region and the right region of the main perspective.
  • the main viewing area shows the most frequently used functions, that is, the media assets, applications, and games that users can use.
  • the left and right areas of the main viewing angle are secondary convenient operation areas, which are used to expand the functions of the main viewing angle area. Different from the defect of limited viewing angle of the human eye in two-dimensional space, it is difficult to clearly watch the content within the large viewing angle range in the horizontal direction. However, it is different for the stereoscopic space.
  • the left and right areas of the main viewing angle are respectively set on both sides of the main viewing angle area, and the content on the left and right sides can be easily seen through the orthogonal layout.
  • the top area of the main viewing angle is the display area for common prompt information, including time, network, power and other information
  • the bottom area of the main viewing angle is the application shortcut entry, which can realize application switching and startup.
  • the virtual user interface also supports the animation display of 3D models for operation information display and entrance.
  • the virtual user interface is presented in the virtual space.
  • the virtual user interface is divided into various areas as shown in FIG. 2A , and corresponding content is displayed in each area.
  • the most comfortable and easy-to-operate area is within a 60-degree field of view directly in front of the human eye, so the content that the user cares about the most is displayed. Therefore, the most frequently used functions can be displayed in the main viewing area of the virtual user interface for easy viewing by users. That is, the content recommendation area is displayed in the main viewing angle area, and the content recommendation area is the area shown in (1) in FIG. 2A .
  • the top area of the content recommendation area displays prompt information, including time, network, battery and other information
  • the middle area of the content recommendation area displays the home page
  • the bottom of the content recommendation area displays the navigation bar.
  • the display home page is used to display pages including functional controls provided by the virtual reality application to provide different business requirements.
  • Several navigation buttons are displayed in the navigation bar, and the set number of the navigation buttons can be 7 or other values.
  • the navigation bar is the area shown in (2) in Figure 2A.
  • Displaying the prompt information, home page and navigation bar within 60 degrees in front of the human eye can better divide the content hierarchy of the content recommendation area, thus forming the hierarchical relationship of navigation and page collection, supporting users to browse more conveniently and find content of interest.
  • an application switching area including applications with different attributes is presented in the bottom area of the main viewing angle of the virtual user interface, and the application switching area is used as an application shortcut entry to quickly start the application to display the applications recommended by the system on the home page, with high popularity, Applications frequently used by users, etc., increase the exposure of the corresponding applications, and recommend the above-mentioned applications to users for use or installation.
  • the application switching area can display applications recommended by the system for users, as well as locally installed applications, that is, applications with different attributes include system recommended applications and locally installed applications.
  • the system-recommended applications include system-recommended installation applications and system-recommended applications, and locally installed applications include system-preset applications and third-party applications installed by users.
  • the application switching area is shown as (3) in Figure 2A.
  • the application switching area is located on the home page of the virtual user interface to display recommended applications for users.
  • the application switching area is divided, and applications with the same attribute are displayed in the same area, which is convenient for Users choose to interact with purpose, avoiding confusion, and the interaction experience is better.
  • a 3D model animation can also be displayed in the virtual user interface, and the 3D model animation can also be displayed in the virtual user interface. That is, the message recommendation entry, and the UI state can refer to the content shown in part (4) in FIG. 2A .
  • the message recommendation entry is a configurable three-dimensional animation. Compared with the two-dimensional picture form, the three-dimensional animation can flexibly configure text, pictures, animation, sound, etc., and configure it according to the needs of operation activities, and the application actively requests.
  • An embodiment of the present application provides a three-dimensional display device, including: a virtual display configured to present a virtual user interface; a controller connected to the virtual display, and when executing a method for laying out a virtual user interface, the controller is configured to execute the following Steps: in response to the application startup instruction generated when the virtual reality application is triggered, present a content recommendation area including a home page and a navigation bar in the main viewing angle area of the virtual user interface, and present a content recommendation area including different attributes in the main viewing angle bottom area of the virtual user interface The app switch area for the app.
  • the overall layout of the virtual user interface can be divided into regions around the main perspective of the human eye.
  • the main viewing angle refers to the range that the user's human eyes can see when the user's head is not turned, and the main viewing angle of the three-dimensional display device can be understood as the range of images that the device can display.
  • an application switching area including applications with different attributes is presented in the bottom area of the main viewing angle of the virtual user interface.
  • the application switching area can display applications recommended by the system for the user, and can also display locally installed applications, that is, applications with different attributes include System recommended apps and locally installed apps. Locally installed applications include system preset applications and user-installed third-party applications.
  • the number of applications displayed in the application switching area is limited. It does not display all the applications with different attributes above, but only displays applications that have been recently used by users, frequently used in history, currently popular or have high commercial value. The purpose is to give the above applications more Exposure to direct the user to launch the above application.
  • the application when displaying an application recommended by the system in the application switching area, the application may be an application recommended by the system according to the user's preference that has not been installed, or an application recommended by the system that has been installed by the user. If the recommended application is an application that has not been installed, when the application is triggered, you can directly jump to the application download page to download and install it; if the recommended application is an installed application, you can directly start the application when the application is triggered. the app.
  • the controller when the content recommendation area is displayed in the virtual user interface, the controller is further configured to: obtain a content recommendation area for implementing the presentation of the content recommendation area including displaying the home page and the navigation bar in the main viewing angle area of the virtual user interface.
  • Multiple content recommendation data displayed by different recommended contents and multiple navigation function data used to realize different navigation functions ; generate a display homepage including multiple pages based on multiple content recommendation data, and display the display homepage in the content recommendation area;
  • Each navigation function data generates a navigation bar including a plurality of navigation buttons, displays the navigation bar in the content recommendation area, and displays the navigation bar below the displayed home page, and one navigation button corresponds to one navigation function data.
  • the recommended content of the virtual reality application and the navigation bar for operating the virtual reality application can be displayed in the content recommendation area corresponding to the main perspective area of the virtual user interface.
  • the recommended content of the virtual reality application is displayed in the form of a page. Therefore, when displaying the virtual user interface, the three-dimensional display device obtains a plurality of content recommendation data from the server for realizing the display of different recommended contents.
  • FIG. 3A shows a schematic diagram of a content recommendation area in a virtual user interface according to some embodiments.
  • the content recommendation area is used to configure TAB columns of different categories, and the different categories of TAB columns include featured topics, popular games, homepage recommendation, popular drama series, panoramic recommendation and other columns.
  • the media resources can include 2D film and television, education courses, travel, 3D, 360-degree panorama, live broadcast, 4K film and television, program applications, games, travel and other media content.
  • business, and this column can choose different template styles, and can support the simultaneous recommendation and arrangement of media assets and themes. Therefore, the acquired content recommendation data corresponds to the above-mentioned different columns and the configuration information in the columns, and the like, and one configuration information corresponds to one content recommendation data.
  • a page can be generated according to multiple content recommendation data, and a home page can be generated and displayed according to multiple pages.
  • the display homepage is the application homepage of the virtual reality application, and the display homepage is displayed in the middle area of the content recommendation area, so that the user can view it from the main perspective in the virtual space.
  • the home page is displayed as shown in (1) in Figure 3A.
  • the configuration content of the displayed home page supports manual drag and drop, and may also support the configuration method of screening the media asset package big data recommendation.
  • the display home page further includes a left move control, a right move control for moving the option target, for selecting a different TAB.
  • the content of the selected TAB is displayed in the central area of the user interface; the content of the unselected TAB is displayed in the left and right areas of the selected TAB, and is faded.
  • manipulation when manipulating the virtual reality application, manipulation may be achieved through different navigation buttons.
  • a navigation function data implements a navigation function, and a navigation function is triggered by a navigation button.
  • a navigation bar including a plurality of navigation buttons can be generated according to the acquired plurality of navigation function data, and the navigation bar is displayed at the bottom of the content recommendation area, that is, the navigation bar is displayed below the displayed home page.
  • the navigation bar is shown as part (2) in Figure 3A.
  • the navigation bar of the main viewing angle is a long strip layout, and the maximum number of displayed controls is 7, which is displayed in a centered layout. This position is also within 60 degrees in front of the human eye, which allows users to easily click the corresponding navigation bar button. .
  • the navigation bar supports the configuration of extended categories for different categories. If there is a new business type, you can configure an independent TAB to display the corresponding page content.
  • the extended categories in the navigation bar can also be sorted and adjusted and offline business operations can be performed.
  • the navigation bar may include content: Movies, Education, Travel, Apps, My.
  • the navigation bar is configured to display a large business category TAB, and supports configuration of more categories, and its icons support configuration.
  • the main viewing area of the virtual user interface displays content such as media assets, applications, and games that are most frequently used by users
  • the displayed content is in units of pages, and a page is composed of one or more templates. displayed together.
  • three pages are generally displayed at the same time, namely the main page in the middle, and the display pages are displayed on the left and right sides at the same time.
  • a tiling method is usually adopted, and the main page is set in the middle, where the human eye is facing, the left page is located on the left side of the main page, and the right page is located on the right side of the main page.
  • the concept of a camera exists in a three-dimensional display device. The position of the camera can be understood as the position of the human eye, and what the eye sees is what the camera can shoot.
  • This tiling method has a simple layout, but if you want to see the content on both sides, you need to turn your head to view it. However, since the range of visual angle that the human eye can clearly see in the horizontal direction is certain, and the two sides have exceeded the range of the clear visual angle of the human eye in the horizontal direction, it is very difficult to view the contents of the pages on both sides by turning the head.
  • the embodiment of the present application provides an orthogonal page layout method, which utilizes orthogonal characteristics and human eye viewing angle characteristics to plan the main viewing angle area
  • the size and distance of the interface area, the angle and size and distance of the left and right expansion areas, etc. the display homepage adopts the orthogonal page layout method to adjust the layout to ensure that all layouts are operated within the comfortable experience range, which is convenient for users to view each page.
  • the controller when an orthogonal page layout is adopted, is further configured to perform the following steps when performing displaying the home page in the content recommendation area: displaying pages in an orthogonal page layout in the content recommendation area
  • displaying pages in an orthogonal page layout in the content recommendation area When , obtain the number of regular polygon sides, the preset depth of field distance between the human eye and the page in the main viewing angle direction, the preset page spacing between two adjacent pages, and the number of pages displayed in the display home page; based on Preset the depth of field distance, preset page spacing and the number of regular polygon sides, generate regular polygons for orthogonal page layout in the content recommendation area, and the regular polygons are in a transparent state; multiple pages displayed in the display home page are presented in the On the specified sides of the regular polygon, the number of specified sides is equal to the number of pages displayed in the display main page.
  • Orthogonal page layout means that each page is laid out according to the feature that the position from the human eye is exactly the same, which is equivalent to arranging each page on the side of a regular polygon.
  • the number of regular polygon sides is used to determine the regular polygons for page display.
  • the number of regular polygon sides is related to the number of pages that need to be displayed in the display home page. If the number of pages that need to be displayed in the display home page is large, regular polygons with more sides can be selected, such as regular octagon, regular decagon, regular dodecagon, etc.; if the page that needs to be displayed on the home page is displayed If the number is small, you can choose regular polygons with fewer sides, such as regular quadrilaterals, regular hexagons, etc.
  • Figure 3B shows a schematic diagram of an orthogonal page layout according to some embodiments.
  • the selected regular polygon is a regular hexagon.
  • the circle in FIG. 3B is the inscribed circle (dotted line part) of the regular hexagon, and the center 0 is the position of the device camera, that is, the position of the human eye; the three rectangles on the top of the regular hexagon are three pages.
  • the preset depth-of-field distance between the human eye and the page in the main viewing angle direction is the Z-axis distance in space, that is, the distance between the human eye and the facing page, which can usually be set to 9 meters or other values. There is no specific limitation here.
  • the preset depth of field distance can be regarded as the radius of the inscribed circle where the regular polygon is located, such as r in FIG. 3B .
  • the preset page spacing between two adjacent pages may be equal to the distance between the midpoints of the two pages, and is used to define the size of the area of the regular polygon. If the preset page spacing is larger, the area of the regular polygon is larger; if the preset page spacing is smaller, the area of the regular polygon is smaller.
  • the number of pages displayed in the display homepage is used to represent the number of pages that can be displayed simultaneously in the content recommendation area. For example, as shown in FIG. If there are 3 pages, the number of pages displayed on the display home page is 3.
  • an orthogonal page layout can be generated according to the preset depth of field distance, the preset page spacing and the number of regular polygon sides. of regular polygons.
  • the regular polygons can be set to a transparent state and presented in the content recommendation area, so that the final visual effect is that the three pages are in an orthogonal page layout, and the regular polygons are invisible.
  • the edges located in front of the user will be used to display the page, that is, the edges located above the center of the circle are selected for displaying the page. Since the center of the circle is the position of the human eye, it can be shown that the human is located in the center of the regular polygon, and the corresponding page is displayed using several edges in front of the human eyes.
  • the number of sides of the displayable page selected specifically is determined according to the number of pages displayed in the display home page, and then the designated sides of the regular polygon for displaying pages can be determined according to the number of pages displayed in the display home page. Finally, the plurality of pages displayed in the display main page are rendered on the designated sides of the regular polygon, and the number of designated sides is equal to the number of pages displayed in the display main page.
  • three pages are usually displayed at the same time, namely the middle main page, the left page and the right page, and at least one poster can be presented in each page.
  • at least one poster can be presented in each page.
  • Posters refer to the propaganda pictures corresponding to the media assets, and the poster position refers to the position on the homepage for displaying the posters.
  • Template Define the display style of one or several posters. Only one poster can be displayed in a template, or multiple posters can be displayed. Templates can design their interface presentation forms according to user experience, visual effects, etc. Different templates have different presentation forms. Technically, a type is defined for each template, that is, Template Type, which is used to identify different templates, and convert its presentation form into a template data structure according to the template design. The template has two large rectangles at the upper end and three small rectangles at the lower end as shown in part (1) in FIG. 3A . Each rectangular position is a poster, such as thematic posters, application posters, VIP posters, commodity posters, etc.
  • the interaction process when interacting based on the pages in the displayed home page, whether it is a tiled layout or an orthogonal layout, the interaction process is usually performed by switching the page to be viewed to the middle.
  • FIG. 3C shows a display effect diagram when the page is interacted in a traditional manner according to some embodiments.
  • content recommendation data is usually presented in the middle main page and the right page, while the left page is in a blank state.
  • click on the right page see part (b) in Figure 3C, the middle home page moves to the left to the left page, the right page moves to the middle to the left, and at the same time continues to request the server for the content recommendation data of the next page And cache, if there is new data, it will be displayed on the right page.
  • the user continues to click on the right page to turn the page to the left, and continuously obtains the data of each subsequent page starting from the data of the first page, and displays the data of the sixth page in the
  • the middle main page the data from the first page to the sixth page has been obtained at this time
  • the user starts to click on the left page to turn the page from one direction to the other.
  • you continue to click and return to the state of part (a) in Figure 3C that is, the first page is displayed on the middle main page, and when the left page is blank, according to the characteristics of circular display, the left page should display the first page.
  • the embodiment of the present application provides an operation mode that can not be affected by the data download state, the server side generates a real-time cache of the corresponding data according to the user request, and supports fast data retrieval; Allows users to start reading data from any page without reading data sequentially.
  • the device side in order to implement data caching, the device side no longer generates only 3 pages, but generates 5 pages, of which three pages are used to display content recommendation data (which can be seen by users), and the other two Used to cache the interface but not display it (the user can't see it, it can only be seen after moving the page).
  • the displayed home page includes a main page, a left page, a right page, a left hidden page, and a right hidden page.
  • the main page is located in the middle to display the first page of data;
  • the right page is located to the right of the main page to display the second page of data;
  • the right hidden page is located to the right of the right page for caching
  • the third page of data is not displayed.
  • the left page is located on the left side of the main page, the left hidden page is located on the left side of the left page, the left page and the left hidden page do not display data, and the left hidden page is hidden and not displayed. Visually, the only pages the user can see are the main page, the left page, and the right page.
  • the number of specified sides of the regular polygon used to carry each page in the display homepage for display is also 5, and the specified sides of the regular polygon include the middle specified side and the left specified side. , Right Side Specified, Left Hide Specified Side, and Right Side Hide Specified Side.
  • the pages displayed on the middle specified side, the left specified side and the right specified side can be seen by the user; the left side hidden specified side and the right side hidden specified side are only used to cache the page, and the corresponding page will not be seen by the user.
  • the controller in order to realize an operation mode of any left and right loop, and to present a plurality of pages displayed in the display home page on the designated sides of the regular polygon, is further configured to: display the left page on the left designated side On the side, the main page is displayed on the specified side in the middle, the right page is displayed on the specified side on the right, the specified side in the middle is the specified side corresponding to the center line of the main viewing angle, and the specified side on the left is located on the left side of the specified side in the middle.
  • the specified side on the right is to the right of the specified side in the middle; the left hidden page is set on the left hidden specified side, the left hidden specified side is located on the left side of the left specified side, and the left hidden page is used to cache the left page
  • the content recommendation data of the previous page, the hidden page on the left is not displayed; set the hidden page on the right on the specified side of the hidden right side, the specified side of the hidden right side is located on the right side of the specified side on the right side, and the hidden page on the right side uses The content recommendation data of the next page after the page on the right is cached, and the hidden page on the right is not displayed.
  • the specified side in the middle is the specified side corresponding to the center line of the main viewing angle, which corresponds to the main page, which is convenient for users to view; the specified side on the left is located on the left side of the specified side in the middle, and corresponds to the left page; the specified side on the right is located on the specified side in the middle.
  • the right side corresponds to the right page; the right side hidden specified side is located to the right of the right side specified side, corresponding to the right side hidden page; the left side hidden side is located on the left side of the left side specified side, corresponding to the left side hidden page .
  • the left page is displayed on the left specified side
  • the main page is displayed on the middle specified side
  • the right page is displayed on the right specified side.
  • FIG. 3D shows a schematic diagram of displaying a home page in an orthogonal layout manner according to some embodiments.
  • the selected specified sides are serial numbers 1, 2, 3, 4, and 5, which correspond to the middle specified side 3413, the left specified side 3412, the right specified side 3414, and the left side respectively.
  • the specified edge 3411 is hidden and the specified edge 3415 is hidden on the right. 5 pages are simultaneously generated in the display home page, namely the main page 3403, the left page 3402, the right page 3404, the left hidden page 3401 and the right hidden page 3405.
  • the left hidden page is displayed on the specified edge
  • the left page is displayed on the left specified edge
  • the main page is displayed on the middle specified edge
  • the right page is displayed on the right specified edge
  • the right hidden page is displayed on the specified right edge. page. Since in a regular hexagon, the specified sides located directly in front of the human eye (the inscribed circle center 0) are the middle specified side, the left specified side and the right specified side, and the left hidden specified side and the right hidden specified side are both behind the human eye. However, since the pages displayed on the left-side hidden designated side and the right-side hidden designated side are hidden pages and are not displayed, it does not hinder the user's viewing.
  • FIG. 3E shows another schematic diagram of displaying the home page in an orthogonal layout manner according to some embodiments.
  • the selected specified sides are serial numbers 1, 2, 3, 4, and 5, corresponding to the middle specified side 3513, the left side specified side 3512, the right side specified side 3514, the left side specified Side hides the designated edge 3511 and right hides the designated edge 3515.
  • 5 pages are simultaneously generated in the display home page, namely the main page 3503, the left page 3502, the right page 3504, the left hidden page 3501 and the right hidden page 3505.
  • the left hidden page is displayed on the specified edge
  • the left page is displayed on the left specified edge
  • the main page is displayed on the middle specified edge
  • the right page is displayed on the right specified edge
  • the right hidden page is displayed on the specified right edge. page.
  • the above-mentioned five specified sides are all located directly in front of the human eye (the center of the inscribed circle is 0), and the pages displayed on each of the specified sides can be easily viewed by the user.
  • the middle specified side, the left side specified side and the right side specified side are located in front of people's eyes. Since the left side hidden specified side and the right side hidden specified side are displayed on the The page is not displayed, so even if the left hidden specified edge and the right hidden specified edge are located behind the human eye in space, the page located on the hidden specified edge will move to the position in front of the human eye when interacting , so this doesn't affect user viewing.
  • the adjacent hidden pages on the left and the hidden pages on the right to the currently operating page can be used.
  • the data of the page is read ahead and cached. That is, the left hidden page is used to cache the content recommendation data of the previous page of the left page, and the left hidden page is not displayed.
  • the hidden page on the right is used to cache the content recommendation data of the next page of the page on the right, and the hidden page on the right is not displayed.
  • the user when interacting with a page, can select a page through a handle matched with a three-dimensional display device, or select a page by using a gaze component installed on the three-dimensional display device.
  • the gaze component is the front of the eyes, which can be equivalent to where the eye sees.
  • the page needs to be moved to the front of the main viewing angle, that is, the corresponding page is moved to the middle designated edge, replacing the original displayed main page. content.
  • the user triggers any media asset or application on the page, and then the process of starting the media asset or application can be realized.
  • the controller when the user interacts with the displayed homepage obtained based on the foregoing page layout manner, the controller is further configured to:
  • Each specified edge in the regular polygon is displayed with pages, and content recommendation data is presented on each page. If the user selects and views based on each page in the displayed homepage, he can click the page on the specified side on the right to generate a process of browsing to the left to display each page in the homepage; and when clicking on the page on the specified side on the left, a page on the specified side is generated. Right-navigation displays the procedures for the various pages in the home page.
  • a virtual user interface is generated in the virtual space, and a home page is presented and displayed in the content recommendation area in the main viewing angle area of the virtual user interface.
  • the three-dimensional display device requests the server to display the content recommendation data corresponding to the first 3 pages in the home page at one time, and generates the main page (the first page of data), the right page (the second page of data) and the right hidden page ( Data on the third page), displayed in sequence on the specified side in the middle, the specified side on the right, and the specified side hidden on the right.
  • the left page does not display the content.
  • the last page of data is displayed on the left hidden page.
  • FIG. 3F shows a display effect diagram showing that a page in the home page moves to the right when interacting according to some embodiments.
  • the display home page includes 10 pages.
  • the first page is the main page, which is displayed on the middle designated side 3613;
  • the second page is the right page, which displays On the right designated edge 3614;
  • the third page is the right hidden page, displayed on the right hidden designated edge 3615.
  • the left page is a blank page, displayed on the left specified edge 3612.
  • the tenth page is required to replace the current home page. face, displayed on the middle specified edge. Therefore, at the initial moment, the tenth page can be used as a left hidden page and presented on the left hidden specified side 3611, but not displayed.
  • the tenth page on the specified side hidden on the left moves to the right on the specified side on the left, that is, the tenth page
  • the page is the left page; the left side is hidden and the specified side is replaced to render the ninth page (without display processing), that is, the ninth page is the left side hidden page.
  • the pages on the middle specified edge, the right specified edge, and the right hidden specified edge do not move.
  • the 5 pages in the currently displayed homepage move as a whole to the right by one position, that is, the hidden page that hides the specified side on the left side.
  • the ninth page move to the right to the specified side on the left and display it.
  • the eighth page is cached on the left side of the hidden specified side, that is, the eighth page is the left side hidden page; it will be located on the left side of the specified side.
  • the user can directly trigger the operation on the media assets or applications displayed on the page on the middle specified side.
  • the user wants to trigger media assets or applications in other pages, he can click the page on the specified edge on the left to generate a page selection instruction, so that the entire display home page moves one position to the right, and the page on the left replaces the adjacent edge to the right Move the page located on the specified side on the right to the specified side to hide on the right and hide it, move the page located on the specified side in the middle to the specified side on the right, and move the page located on the specified side on the left to the specified side.
  • the three-dimensional display device requests the server to display the content recommendation data corresponding to the first 3 pages in the homepage at one time, and display the content recommendation data on the middle specified side, the right side specified side and the right hidden specified side in turn.
  • the middle page is moved to the left page
  • the right page is moved to the middle
  • the right cache page is displayed
  • the left hidden page is moved to the far right, and the left page becomes the left hidden page.
  • FIG. 3G shows a display effect diagram showing that a page in the home page moves to the left during interaction according to some embodiments.
  • the display home page includes 10 pages.
  • the first page is the main page, which is displayed on the middle designated side 3713;
  • the second page is the right page, which displays On the right designated edge 3714;
  • the third page is the right hidden page, displayed on the right hidden designated edge 3715;
  • the left page is a blank page, displayed on the left designated edge 3712;
  • the left hidden page can be The last page, located on the left side of the hidden specified edge 3711, is not displayed.
  • the last page originally located on the specified side of the hidden left side can be moved to the left to generate a cycle, and moved to the far right, that is, on the specified side of the hidden right side Waiting for cached pages in the queue.
  • the page queue waiting to be cached on the right side of the hidden specified side is the subsequent page of the currently displayed page, and the subsequent pages are arranged in order. That is, referring to part (b) in FIG. 3G , when the first page is the left page (designated edge on the left), the left hidden page (designated edge hidden on the left) does not cache the page.
  • the fourth to ninth pages exist in the page queue. If it moves to the left once, that is, when the fourth page is cached on the designated side of the right cache, the fifth to tenth pages exist in the page queue, and other circular processes are analogous.
  • the page queue includes the previous pages of the currently displayed page, and the previous pages are arranged in reverse order. For example, when the tenth page (the last page) is cached on the designated edge of the left cache, and the third page is cached on the designated edge of the right cache, the ninth to fourth pages exist in the page queue. If it is moved to the right once, when the ninth page is cached on the specified side of the left cache, the eighth to third pages exist in the page queue, and other circular processes are analogous.
  • the last page originally located on the left side of the hidden designation does not move, and still stays in the left hidden designation on the side.
  • the first page is displayed on the specified side on the left
  • the last page (the tenth page) is displayed on the specified side hidden on the left
  • the pages displayed on the adjacent two specified sides make all the pages of the home page connected end to end. , which can realize circular interaction. If the user clicks on the left page to move to the right, the first page returns to the middle specified edge, and the last page (the tenth page) is displayed on the left specified edge.
  • the user can directly trigger the operation on the media assets or applications displayed on the page on the middle specified side. If the user wants to trigger media assets or applications in other pages, he can click the page on the specified edge on the right to generate a page selection instruction, so that the entire display home page moves one position to the left, and the page on the right replaces the adjacent edge to the left. Move the page located on the specified side on the left to the left and hide it on the specified side, move the page located on the specified side in the middle to the specified side on the left, and move the page located on the specified side on the right to the specified side.
  • Animation effects are added to the moving process from visible to invisible for smooth operation and avoid affecting the user's look and feel. Animation effects include ease in, ease out, etc.
  • the 3D display device when performing cyclic interaction, can read multiple pages of data at a time, and can cache the data of adjacent pages, so that there is no need to perform a network interaction when moving, and the operation fluency is improved.
  • the page index parameter can be carried in the page selection instruction and sent to the server to obtain the corresponding page index parameter.
  • page data For example, when any three pages are currently displayed, if the user wants to view the data of the last page as soon as possible by clicking on the left page, a page index parameter carrying the tenth page is generated, and the server sends the data of the tenth page without pressing the The data is read sequentially, and the page displaying the home page can be interacted with any left and right loop that is not affected by the data download status, improving user experience.
  • the number of pages included in the display home page is less than or equal to 5, during initialization, it is equivalent to caching all the data of the 5 pages. Therefore, when interacting, just keep the corresponding page and cycle left and right.
  • a display home page and a navigation bar are displayed in the content recommendation area, and the navigation bar can also be interacted with when cyclic interaction is performed based on the displayed home page.
  • the navigation bar is the part shown in (2) in Figure 3A.
  • the interaction of the navigation bar corresponds to the corresponding page set, and the default is five navigation buttons of "Recommendation", “Video”, “Education”, “Application” and “My” .
  • the navigation bar information is generated through the server configuration, and the application obtains the navigation bar information by requesting the navigation function data from the server, and displays it according to the obtained data.
  • the controller when interacting based on the navigation bar, is further configured to: when switching different navigation buttons based on the navigation bar, if no control focus is obtained for each navigation button, then for each navigation button Add a logo pattern representing the normal state; if one of the navigation buttons gets the control focus, add a logo pattern representing the focused state to the navigation button; if one of the navigation buttons loses the control focus after the trigger operation, add a symbol for the navigation button A logo pattern for the legacy state.
  • the corresponding page is displayed in the displayed home page. For example, when the "Recommend” button is clicked, the recommended page is displayed on the display home page; when the "Video” button is clicked, the media asset page is displayed on the display home page. And the page switched by clicking the navigation button is displayed on the designated edge in the middle, which is convenient for the user to directly select.
  • a page is displayed by default in the display home page, and at this time, a corresponding navigation button in the navigation bar is selected by default.
  • the default selected navigation button is equivalent to the user clicking the navigation button. Therefore, the navigation button is in the legacy state, and a logo pattern representing the legacy state is added to the navigation button. If the user moves the control focus to a navigation button, an identification icon of the focused state is added to the navigation button, and the identification pattern of the focused state can be in the form of highlight. If the other navigation buttons do not have the control focus, a logo pattern representing the normal state is added to each navigation button, and the logo pattern in the normal state may be in a transparent form.
  • a logo pattern representing the legacy state is added to the navigation button that performs the trigger operation.
  • the logo pattern of the legacy state can be a color logo or a A transparent rectangle for the border.
  • FIG. 3H shows a display effect diagram of the navigation bar during interaction according to some embodiments.
  • the control focus When the user operates the control focus to move to a certain navigation button, it will be highlighted (the logo pattern of the focused state), indicating that the focus is currently acquired; when the focus is not clicked away, it will return to the normal state (the logo pattern of the normal state).
  • the “recommended” button when the user moves the control focus to the “recommended” button, the “recommended” button is highlighted, and the rest of the buttons are in a normal state.
  • adding or deleting navigation bars is supported, a new navigation bar is generated through server configuration and sent to the application, and the application generates the corresponding navigation bar in real time according to the configuration information.
  • the collision operation refers to whether the coordinates of the line intersect with the coordinates of the navigation button in the navigation bar. If they intersect, it means that the ray collides with the navigation button, and it is determined that the navigation button has the control focus.
  • a trigger operation can be performed to switch the navigation.
  • an application switching area including applications with different attributes may be presented in the bottom area of the main viewing angle of the virtual user interface.
  • the application switching area can display applications recommended by the system for users, as well as locally installed applications, that is, applications with different attributes include system recommended applications and locally installed applications.
  • Locally installed applications include system preset applications and user-installed third-party applications.
  • the number of applications displayed in the application switching area is limited. It does not display all the applications with different attributes above, but only displays applications that have been recently used by users, frequently used in history, currently popular or have high commercial value.
  • the purpose is to give the above applications more Exposure to direct the user to launch the above application.
  • the controller when the application switching area is displayed, presents an application switching area including applications with different attributes in the bottom area of the main viewing angle of the virtual user interface, and is further configured to: the current number of recommended applications in the system is zero When the current number of applications recommended by the system is not zero, an application switching area including a page turning display area is generated, and the page turning display area is used to display locally installed applications; when the current number of applications recommended by the system is not zero, an application switching area including a fixed display area, a page turning display area and interval marks is generated The application switching area, the fixed display area is used to display system recommended applications, the page-turning display area is used to display locally installed applications, and the interval mark is located between the fixed display area and the page-turning display area.
  • the application switching area is an application shortcut entry, which is used to quickly open other applications.
  • the layout of the shortcut entrance takes into account the operational needs, and adopts a two-stage layout, that is, the left half is the application configured and delivered by the system side, and the right half is other applications installed on the machine. To distinguish and facilitate user understanding, the middle is designed with space marks.
  • the application recommended by the system may be automatically generated by the server according to the user operating the virtual reality application, or may be manually configured by the user, a specific generation strategy is configured through the server operation interface. If the server does not automatically generate the recommended application or the user does not manually configure the recommended application, the system recommended application may not be generated. Therefore, when generating the application switching area, the two-segment layout may not be used, but only the one-segment layout may be used.
  • the virtual reality application obtains the configuration information of the application switching area from the server to obtain the current number of applications recommended by the system.
  • FIG. 3I shows a display effect diagram of an application switching area during interaction according to some embodiments. If the current number of system-recommended applications is zero, it means that there is no system-recommended application, and only locally installed applications need to be displayed. Therefore, an application switching area including a page-turning display area is generated, and the page-turning display area is used to display locally installed applications. Referring to part (a) of FIG. 3I, the page-turning display area 3901 displays seven locally installed applications B1-B7.
  • an application switching area including a fixed display area, a page-turning display area and an interval marker is generated, the system recommended application is displayed in the fixed display area, the locally installed application is displayed in the page-turning display area, and the interval marker is located in the fixed display area and the page-turning display area.
  • a space mark 3913 is used to distinguish system recommended applications and locally installed applications. Referring to part (b) of FIG. 3I, the fixed display area 3912 displays three system recommended applications X1-X3, and the page-turning display area 3911 displays four locally installed applications B1-B4.
  • the number of applications that can be displayed in the application switching area is limited, so that the displayed number of system-recommended applications and the displayed number of locally installed applications are both limited.
  • the controller is further configured to: when the current number of applications recommended by the system is not zero, obtain the preset number of configurable applications in the fixed display area; if the current number of applications recommended by the system is not zero If the number is less than or equal to the preset number of configurable applications, the system-recommended applications are displayed in the fixed display area, and the locally installed applications are displayed in the page-turning display area; if the current number of system-recommended applications is greater than the preset number of configurable applications, calculate The excess number of configuration applications is displayed, and the system recommended applications corresponding to the preset number of configurable applications are displayed in the fixed display area, and the system recommended applications corresponding to the excess number of locally installed applications and configuration applications are displayed in the page-turning display area.
  • the application switching area includes a fixed display area and a page-turning display area.
  • the preset number of configurable applications in the fixed display area is the maximum number of applications that can be displayed in the fixed display area.
  • the current number of system-recommended apps is less than or equal to the preset number of configurable apps, it means that the fixed display area can fully display all system-recommended apps, then the system-recommended apps will be displayed in the fixed display area, and the locally installed apps will be displayed in the page-turning display area.
  • the current number of system-recommended applications is greater than the preset number of configurable applications, it means that the fixed display area cannot fully display all system-recommended applications. In this case, only system recommendations corresponding to the preset number of configurable applications are displayed in the fixed display area. application, then display the interval mark, and then display the excess system recommended applications in the page-turning display area.
  • the preset number of configurable applications is subtracted from the current number of applications recommended by the system to obtain the excess number of configurable applications.
  • the system recommended applications corresponding to the preset number of configurable applications are displayed in the fixed display area, and the system recommended applications corresponding to the locally installed applications and the excess number of configuration applications are displayed in the page turning display area.
  • the preset number of configurable applications in the fixed display area is 3, and the current number of applications recommended by the system is 5, the excess number of configured applications is calculated as 2.
  • the first three system recommended applications X1-X3 are displayed in the fixed display area 3912, and the last two system recommended applications X4-X5 are displayed in the page turning display area 3911.
  • the page-turning display area needs to display both system-recommended applications and locally installed applications, in order to avoid display confusion, the excess system-recommended applications can be placed at the front of the page-turning display area, and the locally installed applications can be placed at the top of the system-recommended applications. rear end.
  • the number of applications currently required to be displayed in the page-turning display area exceeds the total number of displayable applications in the page-turning display area, a page-turning operation needs to be performed on the page-turning display area.
  • the total number of displayable applications in the page-turning display area is the maximum number of applications that can be displayed simultaneously in the page-turning display area.
  • the controller when performing a page turning operation, is further configured to: when several applications are displayed in the page turning display area, obtain the total number of displayable applications and the total number of currently displayed applications in the page turning display area; If the total number of applications is greater than the total number of displayable applications, an application list is generated based on the applications corresponding to the total number of currently displayed applications, including locally installed applications that can be displayed and system recommended applications corresponding to the excess number of configured applications; according to the application list Applications corresponding to the total number of displayable applications are presented in the page-turning display area, and page-turning buttons are displayed on both sides of the page-turning display area, and the page-turning buttons are used to trigger applications in the application list to be displayed in the page-turning display area.
  • the total number of displayable applications and the total number of currently displayed applications in the page turning display area are obtained. If the total number of currently displayed applications is greater than the total number of displayable applications, it means that the page-turning display area is insufficient to display all displayable applications, and a page-turning operation is required.
  • an application list is generated according to the applications corresponding to the total number of currently displayed applications, and the applications include locally installed applications that can be displayed and system recommended applications corresponding to the excess number of configured applications.
  • the system-recommended application is listed in the front end, and the locally installed application is listed in the back end. While locally installed applications include system preset applications and third-party applications, the system preset applications are placed in the front, and the third-party applications are placed in the back. Therefore, the order of each application in the application list is a system recommended application, a system preset application, and a third-party application.
  • the locally-uninstalled applications recommended by the system are placed in the front end, so as to instruct the user to download and install; for locally-installed applications, the most recently used, frequently used Sequentially sorts apps, with infrequently used apps on the backend.
  • the applications corresponding to the total number of displayable applications are presented in the page-turning display area according to the order in the application list.
  • Page turning buttons are displayed on both sides, and the page turning buttons are used to trigger applications in the application list to be displayed in the page turning display area.
  • FIG. 3J shows a display effect diagram of the page-turning display area when page-turning interaction is performed according to some embodiments.
  • the application switching area only includes the page turning display area. If the total number of displayable applications in the page-turning display area is 7 and the total number of currently displayed applications is 10, an application list is generated according to the 10 applications, and the first 7 applications B1-B7 in the application list are displayed on the page-turning page. display area.
  • page turning buttons 3931 are displayed on the left and right sides of the page turning display area, respectively.
  • page-turning button when the page-turning button is triggered, all applications in the page-turning display area are moved to the left, the application B1 at the first position is hidden, and the bit column is selected from the application list
  • the current top application B8 is displayed in the last digit of the page turning display area.
  • the locally installed applications presented in the page-turning display area are B2-B8.
  • the page-to-left button is triggered again, as shown in part (c) of FIG. 3J , the first application B2 is hidden, and the first application B9 is selected from the application list to be displayed on the page turning The last digit of the display area.
  • the locally installed applications presented in the page-turning display area are B3-B9.
  • the applications that need to be displayed currently can be completely displayed in the page-turning display area, and the page-turning button does not need to be displayed at this time.
  • FIG. 3K shows a display effect diagram of the application switching area when page-turning interaction is performed according to some embodiments.
  • the application switching area includes a fixed display area 3912 and a page-turning display area 3911 . If the preset number of configurable applications in the fixed display area is 3, and the current number of applications recommended by the system is 5, it is calculated that the excess number of configurable applications is 2. At this time, the first three system recommended applications (system recommended applications X1, X2, X3) are displayed in the fixed display area, and the last two system recommended applications (system recommended applications X4, X5) are displayed in the page turning display area.
  • the total number of displayable applications in the page-turning display area is 4 and the number of locally installed applications to be displayed is 5, the total number of currently displayed applications is calculated to be 7, of which the total number of currently displayed applications includes two excess applications.
  • System recommended applications system recommended applications X4, X5
  • five locally installed applications B1-B5
  • an application list is generated based on the two excess system recommended applications (system recommended applications X4, X5) and five locally installed applications, and the first 4 applications in the application list are displayed in the page-turning display area, that is, the system recommended applications X4, system Recommended application X5, locally installed application B1, and locally installed application B2 are displayed in the page-turning display area.
  • page turning buttons are displayed on the left and right sides of the page turning display area.
  • the page-turning button when the page-turning button is triggered, all applications in the page-turning display area are moved to the left, and the system-recommended application X4 located at the first position in the page-turning display area is hidden, and the In the application list, the locally installed application B3 that is currently ranked first is displayed in the last position of the page-turning display area.
  • the applications displayed in the page turning display area are the system recommended application X5, the locally installed application B1, the locally installed application B2, and the locally installed application B3.
  • the system-recommended application X5 located at the first position in the page-turning display area is hidden, and the current first-ranking application is selected from the application list.
  • the locally installed application B4 is displayed in the last digit of the page-turning display area.
  • the applications displayed in the page turning display area are respectively a locally installed application B1, a locally installed application B2, a locally installed application B3, and a locally installed application B4.
  • the system recommended application and the locally installed application may be updated and displayed in the application switching area.
  • a page-turning button for page-to-left may only be displayed on the left side of the application switching area to indicate that there are more applications.
  • the application in the fixed display area to the left of the interval mark does not move, and the application in the page-turning display area to the right of the interval mark moves to the left as a whole, and moves to the last position. Display the next application.
  • This design is to highlight the entry of operational configuration and guide users to use it.
  • the left arrow will continue to be displayed, otherwise it will be hidden; at the same time, the page-turning button to turn the page to the right will be displayed, indicating that the user can turn the page back.
  • the application icon is enlarged and highlighted, indicating that the user has obtained the focus, and the corresponding name of the application is displayed at the same time.
  • the configuration information can be extended to display other information such as application introduction. At this time, clicking the button will jump to the corresponding application. If the application is not installed, it will jump to the download page for the user to download and install.
  • a 3D model animation can also be displayed in the virtual user interface, and the 3D model animation can also be displayed in the virtual user interface. It is the message recommendation entry, and the UI status can refer to the content shown in part (4) in FIG. 1 .
  • the message recommendation entry is a configurable three-dimensional animation. Compared with the two-dimensional picture form, the three-dimensional animation can flexibly configure text, pictures, animation, sound, etc., and configure it according to the needs of operation activities, and the application actively requests.
  • the controller when the virtual user interface is generated, is further configured to: in response to the application startup instruction generated when the virtual reality application is triggered, present a message recommendation entry in the top area of the main viewing angle of the virtual user interface, and the message recommendation entry is used to implement Message recommendation, the message recommendation entry is an area presented in the form of three-dimensional animation.
  • the message recommendation entrance may be a suspended object area, which is arranged in a suspended form above the left oblique side or above the right oblique side of the top area of the main viewing angle.
  • the message recommendation portal may be configured as a replaceable avatar, or configured as a jump link.
  • the suspended object jumps to a certain message, application, or displays a specified function page after receiving the confirmation operation.
  • the suspended objects may not be configured with jump links, and are simply used for image display.
  • the message recommendation entry can be configured in the form of animation
  • the corresponding animation curve can be designed with corresponding animation tracks according to different operation contents
  • the application displays according to the delivered track.
  • the message recommendation portal when the message recommendation portal gets the focus, its corresponding animation can be updated, such as pausing the movement in space, and triggering a new animation to indicate or display the content that needs to be recommended to the user; optional when clicking Trigger different animations or sounds, etc.
  • the message recommendation portal may also have a naughty function, that is, it can intelligently avoid user selection, and introduce operational activities to the user with interesting animations or sounds.
  • the three-dimensional display device starts the virtual reality application when the layout of the virtual user interface is performed, and presents the content recommendation area including the home page and the navigation bar in the main viewing angle area of the virtual user interface, and, in the virtual user interface, the content recommendation area is displayed.
  • the bottom area of the main viewing angle of the user interface presents an application switching area including applications of different properties.
  • the display homepage adopts an orthogonal layout, which can ensure that all page layouts are operated within a comfortable experience range, which is convenient for users to view each page.
  • the navigation bar is arranged in the main viewing angle area, so that users can switch the navigation buttons; the application switching area is displayed in the bottom area of the main viewing angle, so that users can quickly switch applications.
  • the above layout in the three-dimensional space can make the user experience the best when interacting.
  • the user can conveniently interact with the content in the virtual user interface.
  • Figure 3L shows a flow diagram of a method of interacting with a virtual user interface according to some embodiments.
  • An embodiment of the present application provides a three-dimensional display device, including: a virtual display configured to present a virtual user interface; a controller connected to the virtual display, when the method for interacting with the virtual user interface shown in FIG. 3L is executed, the controller is Configured as:
  • a virtual user interface can be generated in the virtual space.
  • the content of the virtual user interface can refer to the content shown in FIG. 1 , including displaying the home page, the navigation bar, the application switching area and the message recommendation portal.
  • the user when switching pages based on the displayed home page, the user can switch the page to be viewed to a position corresponding to the center line of the main viewing angle, so that the user can view the content of the page directly.
  • the controller when the controller executes a page selection instruction generated in response to triggering the display of any page in the home page, the controller switches the page to display at a position corresponding to the center line of the main viewing angle, and is further configured to: display the home page in an orthogonal page layout manner
  • each page in the display homepage is displayed on the specified side of the regular polygon that realizes the orthogonal page layout, and the specified side includes the middle specified side, the left side specified side and the right side specified side for displaying the page.
  • the middle specified side is the specified side corresponding to the center line of the main viewing angle; generated in response to triggering the page on the specified side on the right side
  • the page selection instruction of moves the page located on the specified side on the right to the left on the specified side in the middle, and, moves the page located on the specified side on the left to the left on the specified side of the hidden side and hides it, and moves the page located on the specified side on the left to the specified side on the left and hides it, and moves the page located on the specified side on the left to the specified side on the left to the specified side.
  • the page on the side is moved to the left on the specified side on the left, and the hidden page located on the hidden specified side on the right is moved to the left on the specified side on the right and displayed; the page is generated in response to triggering the page on the specified side on the left.
  • Select the command to move the page located on the specified side on the left to the specified side in the middle, and move the page located on the specified side on the right to the specified side on the right to hide and hide, and move the page located on the specified side in the middle to the right Move the page to the right to the specified edge on the right, and move the hidden page located on the left hidden specified edge to the right to the specified left edge and display it.
  • an identification pattern may be added to each navigation button that performs an operation, and the user is prompted that the navigation button has obtained the focus.
  • the controller when executing the navigation selection instruction generated in response to triggering any navigation button in the navigation bar, the controller adds an identification pattern corresponding to the operation to the navigation button, and is further configured to: switch between different navigation buttons based on the navigation bar.
  • the navigation buttons are selected, if each navigation button does not obtain the control focus, then each of the navigation buttons is added with an identification pattern representing the normal state corresponding to the operation; in response to triggering any navigation in the navigation bar
  • the navigation selection instruction that is generated when the button is used to characterize the control focus is added, and the identification pattern corresponding to the operation that characterizes the focused state is added to the navigation button; the character obtained when any navigation button in the navigation bar is triggered is obtained.
  • the navigation selection instruction of the control focus is lost, and an identification pattern corresponding to the operation representing the legacy state is added to the navigation button.
  • the user when performing application switching based on the application switching area, the user can click any application displayed in the application switching area to generate an application switching instruction, and the 3D display device can directly start the application to realize fast application switching.
  • the page when performing the interaction of the virtual user interface, when the page is switched based on the displayed homepage, in response to the page selection instruction generated when any page in the homepage is triggered to be displayed, the page is displayed. Switch to the position display corresponding to the center line of the main viewing angle.
  • a logo pattern corresponding to the operation is added to the navigation button.
  • the application is started in response to an application switching instruction generated when any application in the application switching area is triggered. It can be seen that the device can achieve the best interactive experience.
  • a method for laying out a virtual user interface provided by an embodiment of the present application is executed by the controller of the three-dimensional display device provided in the foregoing embodiment, and the method includes:
  • the content recommendation area including the home page and the navigation bar is presented in the main viewing angle area of the virtual user interface, and the content recommendation area including displaying the home page and the navigation bar is presented in the main viewing angle bottom area of the virtual user interface.
  • Figure 3L shows a flow diagram of a method of interacting with a virtual user interface according to some embodiments.
  • an interaction method for a virtual user interface provided by an embodiment of the present application is executed by the controller of the three-dimensional display device provided in the foregoing embodiment, and the method includes:
  • a virtual user interface including a display home page, a navigation bar and an application switching area is generated; when page switching is performed based on the displayed home page, in response to triggering any one of the displayed home pages
  • the page selection instruction generated when the page is generated, and the page is switched to display at the position corresponding to the center line of the main viewing angle; when the navigation button is switched based on the navigation bar, in response to triggering any navigation button in the navigation bar.
  • a navigation selection instruction adding an identification pattern corresponding to the operation to the navigation button; when performing application switching based on the application switching area, in response to an application switching instruction generated when any application in the application switching area is triggered, Launch the application.
  • the layout of a virtual user interface, an interaction method and a three-dimensional display device provided by the embodiments of the present application, when the virtual user interface layout is performed, the virtual reality application is started, and the main viewing angle area of the virtual user interface presents the following steps: Display the content recommendation area of the home page and the navigation bar, and present an application switching area including applications with different attributes in the bottom area of the main viewing angle of the virtual user interface.
  • the display homepage adopts an orthogonal layout, which can ensure that all page layouts are operated within a comfortable experience range, which is convenient for users to view each page.
  • any page in the home page is triggered to be displayed and switched to display at the position corresponding to the center line of the main viewing angle.
  • the method and the three-dimensional display device utilize the three-dimensional space characteristics and visual characteristics to generate a virtual user interface in an orthogonal layout manner in the three-dimensional space, and the content in the virtual user interface is within the user's main viewing angle range. It is convenient for users to interact with each other within a comfortable experience range and improve the interactive experience.
  • an application switching area including applications with different attributes is presented in the bottom area of the main viewing angle of the virtual user interface, and the application switching area is used as an application shortcut entry to quickly start the application to display the applications recommended by the system on the home page, with high popularity, Applications frequently used by users, etc., increase the exposure of the corresponding applications, and recommend the above-mentioned applications to users for use or installation.
  • the application switching area can display applications recommended by the system for users, as well as locally installed applications, that is, applications with different attributes include system recommended applications and locally installed applications.
  • the system-recommended applications include system-recommended installation applications and system-recommended applications, and locally installed applications include system-preset applications and third-party applications installed by users.
  • the application switching area is shown as (3) in Figure 1.
  • the application switching area is located on the home page of the virtual user interface to display recommended applications for users.
  • the applications with different attributes include system recommended applications and locally installed applications, so that when the virtual reality user interface is displayed, applications with different attributes cannot be distinguished, and the user experience is not good.
  • an embodiment of the present application provides a three-dimensional display device.
  • the application switching area is divided, and the same
  • the application of attributes is displayed in the same area, which is convenient for users to choose interaction with purpose, avoid confusion, and provide a better interaction experience.
  • FIG. 4A shows a flowchart of a method for presenting application icons in a virtual user interface according to some embodiments.
  • a three-dimensional display device provided by an embodiment of the present application includes: a virtual display configured to present a virtual user interface including an application switching area; a controller connected to the virtual display, which is used in executing the virtual user interface shown in FIG. 4A .
  • the controller is configured to perform the following steps:
  • S401 Acquire a first application and a second application to be displayed, and system configuration information for indicating whether the local end is configured with a recommended display function in response to an application startup instruction generated when the virtual reality application is triggered.
  • 3D display devices The interaction of 3D display devices is different from traditional TVs, mobile phones, etc., generally interact through head touch points or handle, no longer operate in sequence like a remote control, but like a mouse, you can freely select the display displayed in the virtual user interface. Any UI control to operate.
  • the user wears the three-dimensional display device and triggers the virtual reality application configured in the three-dimensional display device to generate a virtual user interface in the virtual three-dimensional space.
  • the virtual user interface refer to the content shown in FIG. 1 , and when an application needs to be displayed, it can be displayed in the application switching area shown in (3) in FIG. 1 .
  • the three-dimensional display device obtains the first application and the second application to be displayed from the server, and the system configuration information for indicating whether the local end is configured with the recommended display function.
  • the server is the system side, and various types of data required by the three-dimensional display device are stored in the server.
  • the second application is a system recommendation application
  • the first application is a locally installed application.
  • System-recommended applications refer to applications recommended or installed by the system to 3D display devices, including system-recommended applications and system-recommended applications; locally installed applications refer to applications that have been configured in 3D display devices, including system-preset applications and system-recommended applications.
  • User-installed third-party applications User-installed third-party applications.
  • the number of applications displayed in the application switching area is limited. Instead of displaying all the applications with different attributes mentioned above, only applications that are recently used by users, frequently used in history, currently popular, or high in commercial value are displayed. It is to give the above-mentioned applications more exposure to guide users to start the above-mentioned applications.
  • the application when displaying an application recommended by the system in the application switching area, the application may be an application recommended by the system according to the user's preference that has not been installed, or an application recommended by the system that has been installed by the user. If the recommended application is an application that has not been installed, when the application is triggered, you can directly jump to the application download page to download and install it; if the recommended application is an installed application, you can directly start the application when the application is triggered. the app.
  • a fixed display area and a page-turning display area may be generated in the application switching area.
  • the application switching area loads the second template interface.
  • the fixed display area in the second template interface is configured with several fixed display positions, and each fixed display position is used to display the system recommended applications;
  • the page-turning display area in the second template interface is configured with several page-turning display positions, and each Display slots are used to showcase locally installed applications.
  • the fixed display area and the page-turning display area are not always displayed at the same time.
  • the fixed display area is cancelled and only the page-turning display area is displayed.
  • the application switching area loads the first template interface, and there is only a page-turning display position in the first template interface.
  • whether the system side recommends the application for the user and whether the device side displays the function can be selectively configured by the developer according to the device parameters. Therefore, when the application is displayed in the virtual user interface, it can be determined whether the three-dimensional display device has the recommended display function according to the system configuration information.
  • the recommendation display function is used to indicate whether the system side recommends the application for the device side, and whether the 3D display device needs to display the application recommended by the system side. If the local end has the recommended display function, load the second template interface in the application switching area to display the fixed display area and the page-turning display area at the same time, that is, display the fixed display position and the page-turning display position at the same time; if the local end does not have the recommended display function, the first template interface is loaded in the application switching area, and only the page-turning display area is displayed, that is, only the page-turning display position is displayed.
  • the controller when determining whether the local end is configured with a recommended display function according to the system configuration information, is further configured to: obtain the current display quantity of the second application in the system configuration information and the configuration of the system-configured fixed display position Quantity; if the configured quantity of fixed display positions is zero, it is determined that the system configuration information indicates that the recommended display function is not configured on the local end; if the current display quantity of the second application is zero, the configured quantity of fixed display positions is set to zero, And, it is determined that the system configuration information indicates that the local end is not configured with the recommended display function; if the configuration number of fixed display positions is not zero, and the current display number of the second application is not zero, then it is determined that the system configuration information indicates the configuration of the local end There is a recommended display function.
  • the judging conditions include two, namely the configuration number of fixed display positions used to display system recommended applications and the current display number of the second application (system recommended application) pushed by the system , the current display quantity of the second application refers to the number of applications recommended by the system that need to be displayed on the three-dimensional display device.
  • the configuration quantity and the current display quantity are both stored in the system configuration information. Therefore, the current display quantity of the second application and the configuration quantity of the system-configured fixed display position can be obtained according to the system configuration information.
  • the fixed display position is a position in the fixed display area where the system-recommended application display can be performed.
  • the application switching area presents the first template interface. At this time, no matter whether the system side recommends the displayable application to the device side, it cannot be displayed in the fixed display area. Therefore, it can be determined according to the system configuration information that the local end is not configured with the recommended display function.
  • the current display number of the second application is zero, it means that the system side does not recommend the displayable second application to the device side, and it also means that the device side will not display fixed display positions. For example, if the application is not recommended on the system side, if the fixed display position is still displayed on the device side, there will be no content to be displayed on each fixed display position, resulting in an empty display content in the fixed display area. The blank fixed display area still occupies space in the application switching area, which reduces the number of applications that can be displayed in the page-turning display area, which affects the interface layout and user experience. Therefore, when the current number of impressions of the second application is zero, even if the device side is configured with a fixed display position, it will not be displayed again. At this time, it can be determined according to the system configuration information that the local end is not configured with the recommended display function.
  • the configured number of fixed display positions in the fixed display area is zero, it means that the device is not configured with fixed display positions. If the current display number of the second application is zero, it means that the system has not recommended any application that can be displayed, that is, there is no need to display content in the fixed display position. Therefore, the device does not need to configure the fixed display position.
  • the fixed display position can be The number of configurations is set to zero. Based on this, it can be determined according to the system configuration information that the local end is not configured with the recommended display function.
  • the judgment is based on three cases, namely (1) the number of fixed display positions in the fixed display area is zero, and (2) the current display of the second application The number is zero, (3) the configuration number of the fixed display positions in the fixed display area is zero, and the current display number of the second application is zero.
  • the configured quantity of fixed display positions is not zero, and the current display quantity of the second application is not zero, it means that a fixed display area (fixed display position) is configured on the device side, and, the system side is directed to The device side recommends apps that can be displayed.
  • the second application needs to be displayed in the fixed display area, that is, it is determined according to the system configuration information that the local end is configured with the recommended display function.
  • the determination basis includes a situation where the configured number of fixed display positions and the current display number of the second application are not zero.
  • the system configuration information indicates that the local end is not configured with the recommended display function, load a first template interface including a page-turning display position in the application switching area, display the icon of the first application in the page-turning display position, and, after receiving the When moving the instruction, the icon displayed in the page-turning display position moves to the direction indicated by the moving instruction.
  • the local end When it is determined according to the system configuration information that the local end is not configured with the recommended display function, it means that the number of fixed display positions configured in the fixed display area is zero, and/or the current display number of the second application is zero, and the device side does not need to be in the fixed display area.
  • the display area displays the icon of the second application, and only needs to display the icon of the first application in the page-turning display position. Therefore, the first template interface including the page-turning display position is loaded in the application switching area to display the icon of the first application in the page-turning display position, and the application switching area is displayed in the bottom area of the main viewing angle of the virtual user interface.
  • FIG. 4B shows a display effect diagram of the page turning display area 4201 when the local end is not configured with the recommendation display function according to some embodiments.
  • the configured number of fixed display positions is zero, and/or the current display number of the second application is zero, it means that no fixed display position is configured on the device side, and there is no second application recommended by the system, and only the display
  • the first application such as a locally installed application. Therefore, the first template interface including only the page-turning display area is displayed in the application switching area, and several page-turning display positions are presented in the page-turning display area, and the page-turning display positions are used to display locally installed applications.
  • the application switching area includes a page-turning display area, and seven page-turning display positions are presented in the page-turning display area, and seven locally installed applications B1-B7 are displayed respectively.
  • the application icon on the page-turning display position can be triggered to move through the page-turning operation, so as to view the application icons in the subsequent sequence or the previous sequence.
  • the user triggers the page turning buttons on both sides of the application switching area through the handle to generate movement instructions. If the right page turning button is triggered to turn the page to the left, the corresponding direction of the movement instruction is to move to the left, and then the application icon on each page turning display position is controlled to move one position to the left as a whole, and the page on the far right is turned. A new app icon is re-displayed on the page display position, and the application icon originally displayed on the page-turning display position on the far left is hidden.
  • the left page-turning button is triggered to turn the page to the right
  • the direction corresponding to the movement instruction is to move to the right
  • the application icon on each page-turning display position is controlled to move one position to the right as a whole, and is moved to the far left.
  • a new application icon is redisplayed on the page-turning display position on the side, while the original application icon displayed on the page-turning display position on the far right is hidden.
  • system configuration information indicates that the local end is not configured with the recommended display function
  • no matter whether the system end recommends the displayable application to the device end it cannot be displayed in the fixed display position. Therefore, without judging whether the current display quantity of the second application is zero, it can be determined according to the system configuration information that the local end is not configured with the recommended display function.
  • the system still recommends apps that can be displayed to the device. .
  • the application switching area still needs to display the second application.
  • the controller is further configured to: in the case of loading the first template interface including the page-turning display position in the application switching area, obtain the current display quantity of the second application in the system configuration information; if If the current display quantity of the second application is not zero, the icon of the first application and the icon of the second application are displayed in the page-turning display position.
  • the device side When the configured number of fixed display positions is zero, the device side is not configured with fixed display positions, but there are applications recommended by the system. Displays the icons of system-recommended apps and locally installed apps.
  • the controller when the controller displays the icon of the first application and the icon of the second application in the page-turning display area, the controller is further configured to: obtain the configuration number and designation of the page-turning display positions in the system configuration information The total number of applications of the application, the specified application includes the first application and the second application that needs to be displayed in the page-turning display position; if the configured number of page-turning display positions is greater than or equal to the total number of applications of the specified application, each page-turning display will be displayed by each page.
  • the page-turning display area needs to display system-recommended applications and locally installed applications at the same time, due to the limited length of the page-turning display area, the number of page-turning display positions configured in the page-turning display area is limited, so that the number of applications that can be displayed is limited. Therefore, it is necessary to judge Whether the page-turning display area needs to be displayed in the form of page-turning.
  • the page-turning display area includes page-turning display positions for displaying application icons, and obtains the configuration number of page-turning display positions and the total number of applications of the specified application.
  • the second application shown system recommended application. If the configured number of page-turning display positions is greater than or equal to the total number of applications of the specified application, it means that the page-turning display area can display all system-recommended and locally-installed applications that need to be displayed at the same time, and the system-recommended and locally-installed applications will be displayed In each page-turning display position of the page-turning display area, at this time, there is no need to display the page-turning button.
  • the display order of the application icons in each page-turning display area in the page-turning display area is sorted according to the order of system recommended applications and locally installed applications, that is, the system recommended applications are displayed first, and then the locally installed applications are displayed. In this case, the order is from left to right.
  • the icon of the second application is loaded from the page-turning display position at the front of the left side of the column, and the next page-turning display position is loaded with the icon of the next second application. After all the icons of the second application are displayed, the next A page-turning display position loads the icon of the first application, and so on, until content is displayed on each page-turning display position in the page-turning display area.
  • the sorting order is to display the applications recommended for installation by the system first, and then the applications recommended for use by the system; for locally installed applications with the same attributes, the sorting order can be the most recently installed applications. order, the order of recent use by users, the order of frequent use in history, the order of high current popularity, or the order of high commercial value.
  • the page-turning display area cannot display all the system-recommended applications and locally installed applications that need to be displayed at the same time. In the page mode, the system recommended applications and locally installed applications are displayed in the page-turning display area.
  • an application list is generated based on the order of system-recommended applications and locally installed applications, and the specified applications corresponding to the total number of applications are selected in the application list to display in the page-turning display area, while the rest of the applications in the application list are temporarily unavailable. to show.
  • page turning buttons are displayed on both sides of the application switching area, and the page turning buttons are used to trigger the specified application in the application list to be displayed in the page turning display area.
  • the generation order of the application list may adopt the application display order of the page-turning display area described above.
  • the generated application list includes four system-recommended applications X1-X4 and six locally installed applications B1-B6.
  • select the first 7 applications in the application list namely, four system-recommended applications X1-X4 and three locally installed applications B1-B3, respectively, and display them in seven page-turning display positions in the page-turning display area.
  • a right page turning button is displayed on the right side of the application switching area to prompt the user to turn the page to the left to view other applications in the application list.
  • the left page turn button is displayed on the left side of the application switching area to realize the page turn to the right.
  • an interval mark 4203 may be displayed in the application switching area, as shown in FIG. 4B ( As shown in parts b) and (c), the interval marker is located between the system recommended application and the locally installed application.
  • the space mark moves along with each application icon in the page turning display position.
  • the system configuration information indicates that the local end is configured with the recommended display function
  • load a second template interface including a fixed display position and a page-turning display position in the application switching area, display the icon of the second application in the fixed display position, and display the icon of the second application in the page-turning position.
  • the display position displays the icon of the first application, and when the move instruction is received, the icon in the fixed display position does not move, and the icon in the page-turning display position moves in the direction indicated by the move instruction.
  • the local end is configured with the recommended display function, indicating that the device end is configured with a fixed display area, the fixed display area is configured with several fixed display positions, and the system end generates an application recommended to the device end, the device end needs to be in the application
  • the switching area displays the first application and the second application at the same time. Therefore, a second template interface including a fixed display position and a page-turning display position is loaded in the application switching area, so as to display the icon of the second application in the fixed display position and the icon of the first application in the page-turning display position. For example, system-recommended applications are displayed in the fixed display area, and locally installed applications are displayed in the page-turning display area.
  • the application switching area when the system configuration information indicates that the local end is configured with the recommended display function, the application switching area needs to display the system recommended application and the locally installed application at the same time.
  • the loading of the application switching area includes a fixed display position and a page-turning display position
  • an interval mark can be displayed in the application switching area, and the interval mark is located between the fixed display position and the page-turning display position. Separating system-recommended apps and locally installed apps with spacer markers makes it easier for users to quickly and accurately select apps of interest.
  • the fixed display positions and the interval marks in the fixed display area do not move along with the respective page turning display positions in the page turning display area.
  • the previous or subsequent application icons can be viewed by turning pages.
  • the left page-turning button is triggered, a move instruction to turn the page to the right is generated, and the page-turning display position in the second template interface responds to the moving instruction, while the fixed display position does not respond to the moving instruction. Therefore, the application icon in the fixed display position does not move with the moving instruction, but the icon in the page-turning display position moves in the direction indicated by the moving instruction, that is, the application icon on the page-turning display position moves one position to the right.
  • the number of fixed display positions and page-turning display positions configured in the application switching area is limited, so that the displayed number of system-recommended applications and the displayed number of locally installed applications are both limited.
  • the controller when the controller displays the icon of the second application in the fixed display position and the icon of the first application in the page-turning display position, the controller is further configured to: load the first application including the fixed display position and the page-turning display position in the application switching area.
  • the second template interface obtain the configuration quantity of the fixed display position in the system configuration information and the current display quantity of the second application; if the current display quantity of the second application is less than or equal to the configuration quantity of the fixed display position, display it in the fixed display position
  • the icon of the second application, the icon of the first application is displayed in the page-turning display position; if the current display quantity of the second application is greater than the configured quantity of the fixed display position, the excess quantity of the recommended application is calculated, and the display in the fixed display position and the fixed display position are calculated.
  • the icon of the first application and the icon of the second application corresponding to the excess number of recommended applications are displayed in the page-turning display position.
  • the second template interface loaded in the application switching area includes a fixed display area and a page-turning display area.
  • the fixed display area can completely display all system-recommended applications, and system recommendations are displayed in sequence in each fixed display area of the fixed display area application, locally installed applications are displayed in turn in each page-turning display position in the page-turning display area.
  • FIG. 4C shows a display effect diagram of the application switching area when the local end is configured with a recommendation display function according to some embodiments.
  • the configured number of fixed display positions is not zero, and the current display number of the second application is not zero, see part (a) in FIG. 4C , for example, if the system recommends that the current display number of the application is 3, If the number of fixed display positions in the fixed display area 4202 is 3, three system recommended applications X1-X3 can be completely displayed in the fixed display area.
  • the page-turning display area 4201 is configured with four page-turning display positions to display corresponding locally installed applications. For example, the page-turning display area displays four locally installed applications B1-B4.
  • the current display number of the second application is greater than the configured number of fixed display positions, it means that the fixed display area cannot completely display all system-recommended applications, and in this case, it is only displayed on each fixed display position in the fixed display area
  • the number of system-recommended applications corresponding to the number of fixed display slots will be displayed, and then the interval mark will be displayed, and then the excess system-recommended applications will be displayed in the page-turning display area, and the excess system-recommended applications will be displayed on the page-turning display slot.
  • the current display number of the system-recommended applications is subtracted from the configured number of fixed display positions to obtain the excess number of recommended applications, so that the system-recommended applications corresponding to the configured number of fixed display positions are displayed in the fixed display area, and the page-turning display area is displayed. Displays the system recommended apps corresponding to the locally installed apps and the excess recommended apps.
  • the excess number of recommended applications is calculated to be 2 indivual.
  • the excess system-recommended applications can be placed in the front-end page-turning display position of the page-turning display area, and the locally installed applications can be placed in The system recommends the backend of the application.
  • the display order when the icons corresponding to the second application are displayed in each fixed display position, the display order may be displayed according to the order of the popularity of the second application; when the icons corresponding to the first application are displayed in each page-turning display position , the display order can be displayed according to the historical usage time of the first application. This presentation method is applied in the scenario where the second template interface is loaded in the application switching area.
  • the controller when the application icon is displayed, is further configured to: display the icon of the second application in the fixed display position, and display the icon of the first application in the page-turning display position, and be further configured to: in the application switching
  • the second template interface including the fixed display position and the page-turning display position is loaded in the area, the popularity value of the second application and the historical usage time of the first application are obtained; according to the order of the popularity value of each second application, the corresponding The icon of the second application is displayed on each fixed display position; according to the chronological order of the historical usage time of each first application, the icon of the corresponding first application is displayed in each page turn display in turn. position.
  • the second application and the first application may be displayed in the second template interface at the same time.
  • the icon of the second application When displaying the icon of the second application in the fixed display position, it can be displayed according to the popularity value of each second application, that is, the popularity value of each second application is sorted from high to low, and the first fixed display on the left
  • the icon of the second application with the highest popularity value is displayed in the position; the second fixed position at the far side displays the icon of the second application with the second highest popularity value, and so on.
  • the icons of the second application are also displayed on the front-end page-turning display position in the order of the size of the heat value.
  • the icons of the second application are also displayed on the front-end page-turning display position in the order of the size of the heat value.
  • the icon of the second application continues to display the icon of the first application.
  • the icon display of the first application is displayed according to the historical usage time, and the most recently used icon of the first application is displayed in the free leftmost page-turning display position, that is, it is displayed on the right side of the icon of the second application; Some used icons of the first application are displayed on the next free page-turning display position, that is, on the right side of the icon of the first application displayed previously, and other second application icons and so on.
  • the number of applications currently required to be displayed in the page-turning display area exceeds the configured number of page-turning display positions in the page-turning display area, a page-turning operation needs to be performed on the page-turning display area.
  • the configured number of page-turning display positions in the page-turning display area is the maximum number of applications that can be displayed simultaneously in the page-turning display area.
  • the controller when the controller displays the system recommended application and the locally installed application in the page-turning display area, the controller is further configured to: obtain the configured number of page-turning display positions and the total application number of the specified application in the system configuration information, and the specified application includes the first An application and a second application that needs to be displayed in the page-turning display area; if the configured number of page-turning display positions is greater than or equal to the total number of applications of the specified application, each page-turning display position loads the icon of the second application in turn and the icon of the first application; if the configuration number of the page-turning display positions is less than the total number of applications of the specified application, the order of the second application and the first application generates an application list; the specified application corresponding to the total number of applications in the application list is It is displayed in the page-turning display position, and a page-turning button is displayed on both sides of the application switching area, and the page-turning button is used to trigger the specified application in the application list to be displayed in the page-turning display
  • the configured number of page-turning display positions in the page-turning display area and the total number of applications of the specified application are obtained. If the total number of applications of the specified application is greater than the configured number of page-turning display positions, it means that the page-turning display area is not enough to display all displayable applications, and a page-turning operation is required.
  • the designated applications include locally installed applications and system recommended applications that need to be displayed in the page-turning display area.
  • the system-recommended applications that need to be displayed in the page-turning display area refer to the recommended applications among all system recommended applications except those displayed in the fixed display area.
  • the system recommends the application corresponding to the excess number of applications.
  • the implementation process of displaying each attribute application in the page-turning display area may refer to the steps shown in the foregoing embodiments, which will not be repeated here.
  • the applications corresponding to the total number of displayable applications are presented in the page-turning display area according to the order in the application list, and in the application switching area
  • the page turning buttons are displayed on both sides, and the page turning buttons are used to trigger the application in the application list to be displayed in the page turning display area of the page turning display area.
  • the scene where the icon of the second application is displayed on the page-turning display position includes two situations. One is when the first template interface is loaded in the application switching area. At this time, the configuration quantity of the fixed display position is zero. However, there is a second application recommended by the system. Therefore, the second application recommended by the system and the first application need to be displayed on the page-turning display position at the same time. The other is when the second template interface is loaded in the application switching area. At this time, the configuration quantity of the fixed display position is not zero, and the number of second applications recommended by the system exceeds the configuration quantity of the fixed display position. The second application displayed by the display position is displayed on the page-turning display position simultaneously with the first application.
  • the controller when the second template interface is loaded in the application switching area, when the controller displays the icon of the first application and the icon of the second application in the page-turning display area, the controller is further configured to: loading the application switching area includes: The second template interface of the fixed display position and the page-turning display position, and when there is an icon of the second application that needs to be displayed in the page-turning display position, the popularity value of the second application and the historical usage time of the first application are obtained; In the order of the popularity of each second application, the icon of the corresponding second application is displayed on the page-turning display position at the front of the column in turn, and, according to the historical usage time of each first application from late to early In chronological order, the corresponding icons of the first application are displayed in sequence on the page-turning display position at the rear end of the column, and the icons of the first application are displayed to the right of the icons of the second application.
  • the second application and the first application may be displayed in the second template interface at the same time. If the configured quantity of the fixed display position is less than the current display quantity of the second application, the corresponding number of icons of the second application will be displayed in the fixed display position, the icons of the first application will be displayed on the page-turning display position, and the rest not displayed in the fixed display position. Bit of the second app's icon.
  • the icon of the second application When displaying the icon of the second application in the fixed display position, it can be displayed according to the popularity value of each second application, that is, the popularity value of each second application is sorted from high to low, and the first fixed display on the left
  • the icon of the second application with the highest popularity value is displayed in the position; the second fixed position at the far side displays the icon of the second application with the second highest popularity value, and so on.
  • the icons of the second application are also displayed on the front-end page-turning display position in the order of the size of the heat value.
  • the icons of the second application are also displayed on the front-end page-turning display position in the order of the size of the heat value.
  • the icon of the second application continues to display the icon of the first application.
  • the icon display of the first application is displayed according to the historical usage time, and the most recently used icon of the first application is displayed in the free leftmost page-turning display position, that is, it is displayed on the right side of the icon of the second application; Some used icons of the first application are displayed on the next free page-turning display position, that is, on the right side of the icon of the first application displayed previously, and other second application icons and so on.
  • the controller when the first template interface is loaded in the application switching area, when the controller displays the icon of the first application and the icon of the second application in the page-turning display area, the controller is further configured to: loading the application switching area includes: The first template interface of the page-turning display position, and, when there is an icon of the second application that needs to be displayed in the page-turning display position, obtain the popularity value of the second application and the historical usage time of the first application; according to each second application In the order of the popularity of each first application, the icons of the corresponding second applications are displayed on the page-turning display position at the front of the column. The corresponding icon of the first application is displayed on the page-turning display position at the back end of the column, and the icon of the first application is displayed on the right side of the icon of the second application.
  • the icons of the second application and the first application are simultaneously displayed in the second template interface by using a page-turning display position.
  • a page-turning display position For an implementation manner of displaying the icon of the first application and the icon of the second application on the page-turning display position, reference may be made to the content of the foregoing embodiments, which will not be repeated here.
  • the display order of the first application, the display order of the second application, and the order of generating the application list may also adopt other sorting methods, which are not specifically limited here.
  • the page turning buttons on both sides of the application switching area can be triggered.
  • the page turning action can trigger the application to move a position, and can also trigger the overall movement position of the application on a page.
  • the controller is further configured to: when viewing a specified application in the application list that is not displayed in the page turning display position, receive a right The operation of the page-turning button moves the icon of the specified application next to the last display application in the application list to the left to display it in the last page-turning display position.
  • the last display application refers to the display at the end of the page-turning display area.
  • An application with a page-turning display position receiving the operation of the page-turning button on the left, and moving the icon of the previous designated application that is located in the first display application in the application list to the right and displaying it in the first page-turning display position, the first display application refers to The application displayed in the first page-turning placement of the page-turning display area.
  • the user can trigger the page-turning button to view the applications in the application list that have not been displayed in the page-turning display position.
  • the page-turning operation on the application icon in the page-turning display position When performing the page-turning operation on the application icon in the page-turning display position, it can be applied in the scene where only the page-turning display area is displayed in the application switching area, that is, the scene where the first template interface is loaded, and it can also be applied in the application switching area to display the fixed display at the same time. In the scene of the display area and the page-turning display area, that is, the scene of loading the second template interface.
  • FIG. 4D shows a display effect diagram of the page-turning display area when page-turning interaction is performed according to some embodiments.
  • the application switching area loads the first template interface only including the page-turning display area, and the page-turning display area is configured with several page-turning display positions. If the configured number of page-turning display positions is 7, and the total number of currently displayed applications is 10, an application list is generated according to the 10 applications, and the first 7 applications B1-B7 in the application list are displayed in the page-turning display area.
  • the page turning buttons are displayed on the left and right sides of the application switching area.
  • the right page turning button is displayed on the right side.
  • the left page turning button is displayed on the left side.
  • the right page-turn button is triggered to generate a page-to-left instruction.
  • the entire application displayed in the current page-turning display position is controlled to one position to the left.
  • the first application icon on the first page-turning display position of the page-turning display area is hidden, and the last There is a vacancy on the slot display slot.
  • an icon of an application to be displayed from the applications that are not displayed in the application list select an icon of an application to be displayed from the applications that are not displayed in the application list.
  • the application to be displayed is the next designated application located at the last display application originally displayed in the last page-turning display position.
  • the icon of the app is moved one position to the left and displayed in the last page-turning position.
  • the application B2 at the first position is hidden, and the next designated application B9 is selected from the application list and displayed in the page turning display area the last one.
  • the locally installed applications presented in the page-turning display area are B3-B9.
  • the left page turning button 4205 is triggered to generate a right page turning instruction.
  • all applications B3-B9 that control the page-turning display position are moved one position to the right.
  • the non-positioned application B9 on the last page-turning display position of the page-turning display area is hidden, and the first position is hidden. There are vacancies on the display slot.
  • an application to be displayed is selected from the applications that have not been displayed in the application list, and the application to be displayed is the previous designated application B2 of the first display application B3 that was originally displayed in the first page-turning display position, and the previous designated application B2 is moved one position to the right to be displayed in the first page-turning placement.
  • the locally installed applications presented in the page-turning display area are B2-B8, which are restored to the state shown in part (b) of FIG. 4D .
  • the process of performing the page-turning operation may refer to the process shown in FIG. 4D . It is not repeated here. In this scenario, if there is an interval mark in the page-turning display area, the interval mark will move along with it when the page is turned.
  • FIG. 4E shows a display effect diagram of the application switching area when page-turning interaction is performed according to some embodiments.
  • the application switching area loads the second template interface including the fixed display area and the page-turning display area.
  • the display area is configured with several fixed display positions, and the page-turning display area is configured with several page-turning display positions. If the number of fixed placements configured is 3, and the current number of recommended applications by the system is 5, the excess number of recommended applications is calculated to be 2.
  • the icons of the first three system recommended applications (system recommended applications X1, X2, X3) are displayed on the three fixed display positions in the fixed display area, and the last two system recommended applications (system recommended applications X4, X5) The icon of is displayed on the first two page-turning display positions in the page-turning display area.
  • the total number of applications currently displayed is calculated as 7
  • the total number of currently displayed applications includes: Two excess system recommended applications (system recommended applications X4, X5) and five locally installed applications (B1-B5).
  • an application list is generated according to the two excess system recommended applications (system recommended applications X4, X5) and five locally installed applications, and the first four applications in the application list are displayed on the four page-turning display positions in the page-turning display area. , that is, the system recommended application X4, the system recommended application X5, the locally installed application B1, and the locally installed application B2 are displayed in the page-turning display position.
  • page turning buttons are displayed on the left and right sides of the application switching area.
  • the three application icons in the fixed display area do not move, and all applications currently displayed in the page-turning display area move to the left and are located in the page-turning display area.
  • the first system-recommended application X4 is hidden, and the next designated application B3 that was originally displayed in the last page-turning display position selected from the application list is displayed in the last position of the page-turning display area, that is, the end. Bit flip display bit.
  • the applications displayed in the page turning display area are the system recommended application X5, the locally installed application B1, the locally installed application B2, and the locally installed application B3.
  • the left page turning button is triggered to generate a right page turning instruction.
  • all applications B1-B4 in the page-turning display area are controlled to move one position to the right.
  • the unpositioned application B4 on the last page-turning display position of the page-turning display area is hidden, and the first position is hidden. There are vacancies on the display slot.
  • the application to be displayed is the previous designated application X5 (the system recommended application) located in the first display application B1 that was originally displayed in the first page-turning display position.
  • the previous designated application X5 is moved one position to the right and displayed in the first page-turning display position.
  • the applications presented in the page-turning display area are system recommended application X5, locally installed application B1, locally installed application B2, and locally installed application B3, which are restored to the state shown in part (b) of FIG. 4E .
  • the remaining page-turning states can be cycled according to the foregoing method.
  • the controller is further configured to: when viewing a specified application in the application list that is not displayed in the page turning display position, receive For the operation of the page-turning button on the right, the application icon in the application list that is located in the page-turning display position of the page corresponding to the page where the application is currently displayed is displayed in the page-turning display position; receiving the operation of the page turning button on the left , to display the application icon corresponding to the previous page of the page where the application is currently displayed in the page-turning display position in the page-turning display position in the page-turning display position in the page-turning display position.
  • the user can trigger the page-turning button to view the application in the application list that has not been displayed in the page-turning display area.
  • the page-turning operation is performed on the application icon displayed in the page-turning display area, that is, the scene of loading the first template interface, it can be applied to the scene where only the page-turning display area is displayed in the application switching area, and it can also be applied to the application switching area that displays the fixed page at the same time. In the scene of the display area and the page-turning display area, that is, the scene of loading the second template interface.
  • FIG. 4F shows another display effect diagram of the page-turning display area when page-turning interaction is performed according to some embodiments.
  • the application switching area loads the first template interface including only the page-turning display area, and the page-turning display area is configured with several page-turning display positions. If the configured number of page-turning display positions is 7, and the total number of currently displayed locally installed applications is 12, an application list is generated according to the 12 applications, and the 12 locally installed applications are paginated according to the configured number of page-turning display positions.
  • the division is to divide the first 7 locally installed applications B1-B7 into the first page, and the last 5 locally installed applications B8-B12 into the second page. During initial display, the first seven applications B1-B7 corresponding to the first page in the application list are displayed in each page-turning display position.
  • the page turning buttons are displayed on the left and right sides of the application switching area.
  • the right page turning button is displayed on the right side.
  • the left page turning button is displayed on the left side.
  • the right page-turn button is triggered to generate a page-to-left instruction.
  • all applications displayed in the current page-turning display position are controlled to turn one page to the left as a whole.
  • the application icons on each page-turning display position in the page-turning display area are all hidden. Select the application on the next page from the applications that are not displayed in the application list, and move each application icon on the next page to the left to display it in each page-turning display position.
  • the second page is the last page of the application list, and the number of applications in the second page is less than the number of page-turning display slots, the remaining two display slots are free. And, the right page turning button is hidden, and at this time, the page that has been turned can be viewed by triggering the left page turning button.
  • the left page turning button is triggered to generate a right page turning instruction.
  • all applications displayed in the current page-turning display area are controlled to turn one page to the right as a whole.
  • all application icons on each page-turning display position in the page-turning display area are hidden, From the applications that are not displayed in the application list, select the application icons on the previous page, move each application icon on the previous page to the right, and display them in each page-turning display position.
  • the second page application B8-B12 is currently displayed in the page turning display area, and the user triggers the left page turning button, then the second page currently displayed corresponds to 5 All the applications B8-B12 are moved to the right and hidden, while the 7 applications B1-B7 corresponding to the first page are obtained from the application list and displayed in the page-turning display position, returning to the state shown in part (a) of FIG. 4F .
  • FIG. 4G shows another display effect diagram of the application switching area when page-turning interaction is performed according to some embodiments.
  • the application switching area loads the second template including the fixed display area and the page-turning display area.
  • the fixed display area is configured with several fixed display positions
  • the page-turning display area is configured with several page-turning display positions. If the number of fixed placements configured is 3, and the current number of recommended applications by the system is 5, the excess number of recommended applications is calculated to be 2.
  • the first three system recommended applications (system recommended applications X1, X2, X3) are displayed on the three fixed display positions in the fixed display area, and the last two system recommended applications (system recommended applications X4, X5) are displayed on the On the first two page-turning display positions of the page-turning display area.
  • the total number of currently displayed applications is calculated as 12, and the total number of currently displayed applications includes: Two excess system recommended applications (system recommended applications X4, X5) and ten locally installed applications (B1-B10).
  • an application list is generated according to the two excess system recommended applications (system recommended applications X4, X5) and 10 locally installed applications, and the first 4 application icons in the application list are displayed in the four page-turning display positions of the page-turning display area.
  • the system recommended application X4, the system recommended application X5, the locally installed application B1, and the locally installed application B2 are displayed on the four page-turning display positions in the page-turning display area.
  • the page turning buttons are displayed on the left and right sides of the application switching area.
  • the right page turning button is displayed on the right side.
  • the left page turning button is displayed on the left side.
  • the right page-turn button is triggered to generate a page-to-left instruction.
  • each application icon displayed in the fixed display area does not move, and all applications displayed in the current page-turning display area are controlled to turn one page to the left as a whole.
  • each page-turning display position in the page-turning display area All the application icons on the page are hidden, and at the same time, select the application on the next page from the applications that are not displayed in the application list, and move the application icon on the next page to the left to display it in each page-turning display position in the page-turning display area. superior.
  • the page-turning display area currently displays the third-page applications B7-B10. If the user wants to look back at the page that has been turned over, and the user triggers the page-turning button on the left, all the 4 applications B7-B10 corresponding to the third page currently displayed are moved to the right and hidden, and the second page is obtained from the application list at the same time.
  • the four applications B3-B6 corresponding to the page are displayed in the page-turning display area, and the state is restored to the state shown in part (b) of FIG. 4G .
  • the right page turning button is triggered again, and the application on the fourth page is displayed in the page turning display area. If the third page is the last page of the application list, and the number of applications in the third page is equal to the number of page-turning displays, hide the right page-turning button. Turn over the page.
  • the system recommended application and the locally installed application may be updated and displayed in the application switching area.
  • a right page turning button for turning left pages may be displayed only on the right side of the application switching area to indicate that there are more Multiple applications.
  • the application in the fixed display area to the left of the interval mark does not move, and the application icon in the page-turning display area to the right of the interval mark moves to the left as a whole, and is in the last position. Displays the next application icon.
  • the right arrow After turning the page to the left, according to the status, if there are more, the right arrow will continue to be displayed, otherwise it will be hidden; at the same time, the left page turning button for turning the page to the right is displayed, indicating that the user can turn the page back.
  • a page-turning display scenario if the remaining data in the application list is less than or equal to one page, the data of the page is completely displayed, the right-side page-turning button is hidden, and only the left-side page-turning button is displayed.
  • the user clicks the page-turning button on the left the data of the previous page is displayed, and the page-turning button on the right is displayed to indicate that the user can view the application in the page that has been turned over, as shown in Figure 4G (b ) section.
  • the application icon is enlarged and highlighted, indicating that the user has obtained the focus, and the corresponding name of the application is displayed at the same time.
  • the configuration information can be extended to display other information such as application introduction. At this time, clicking this button will jump to the corresponding application. If the application is not installed, it will jump to the download page for the user to download and install.
  • the controller is further configured to: acquire application information of the application when any application displayed in the application switching area obtains the control focus; display the application information on the location where the application is located below the placement.
  • the application information includes an application name, introduction information, etc., and is used to briefly introduce the application. Especially for an application recommended by the system but not installed on the local end, the application information is convenient for the user to understand the details of the application to determine whether to trigger the installation process or the use process.
  • the app information below the app icon that is, below the placement of the app. If the application is a system recommended application, the corresponding application information is displayed below the recommended display position; if the application is a locally installed application, the corresponding application information is displayed below the page-turning display position.
  • FIG. 4H shows a display effect diagram of displaying application information in an application switching area according to some embodiments.
  • the application B2 is a "video application A” application, the application name "video application A” and "Introduction Content”.
  • three states of normal, focus and legacy are defined, and corresponding logo patterns are added to the corresponding display positions respectively, to indicate to the user that the app on that placement is in focus.
  • a logo pattern representing the focused state is added to the display position where the app is located, and the logo pattern of the focused state is added. Can be highlighted. If the display position where other applications are located does not gain the control focus, a logo pattern representing the normal state is added to each navigation button, and the logo pattern in the normal state may be in a transparent form. If the application that obtained the control focus is triggered, and the control focus moves to the display position where other applications are located, a logo pattern representing the legacy state is added to the display position where the application that performs the trigger operation is located, and the logo pattern of the legacy state can be a color. Logo or transparent rectangle with border.
  • FIG. 4I shows a display effect diagram of an application switching area during interaction according to some embodiments.
  • the user controls the focus to move to the display position of an application, it will be highlighted (the logo pattern of the focused state), indicating that the current application has obtained the focus; if the focus is not clicked away, it will return to the normal state (the logo pattern of the normal state).
  • the normal state the logo pattern of the normal state.
  • a logo pattern representing the legacy state is added to the display position where the "video application A” application is located, that is, A transparent rectangle with a border and suppresses the display of application information.
  • a logo pattern representing the focus state is added to the display position of the "K song” application that currently has the control focus, that is, highlighted, and the application information is displayed.
  • the collision operation refers to whether the coordinates of the line intersect with the coordinates of the display position where the application is located in the application switching area. If they intersect, it means that the ray collides with the display position where the application is located, and it is determined that the display position where the application is located has the control focus.
  • a trigger operation can be performed to start the application.
  • the applications displayed in the application switching area are usually displayed in the form of application icons.
  • the application icon is relatively monotonous, so 3D models and animations can also be delivered through the system.
  • the application icon, name and application information are displayed in the form of animation, or, only a separate model animation is displayed to improve by displaying different animations for different models and different states user experience.
  • the application switching area is divided, and applications of the same attribute are displayed in the same area, so as to distinguish and display applications of different attributes, and It can take into account the operational needs and user needs, so that users can choose to interact with purpose, avoid confusion, and have a better interactive experience.
  • the second template interface of the page-turning display location and the page-turning display location displays the icon of the second application in the fixed display location, and the icon of the first application is displayed in the page-turning display location.
  • the icon in the fixed display position does not move, and the icon in the page-turning display position moves in the direction indicated by the moving instruction.
  • the virtual reality application since the virtual reality application is configured with applications implementing different functions, too many applications are displayed in the virtual user interface, which is inconvenient for the user to quickly start the application that he is interested in. Or, under the film and television category, it can provide thousands of media assets, and users cannot quickly watch the media assets they are interested in. Therefore, when searching for content that the user is interested in based on the virtual user interface, a search function can be configured for the three-dimensional display device, and the searched content includes applications with different functions, media resources, educational courses, games, and the like.
  • the commonly used search function is to classify the content and display the content of the same category in a list. If the number is large, it can be displayed in multiple list pages, and finally find the target content through the page turning operation, such as video application A.
  • the embodiments of the present application provide a three-dimensional display device.
  • a content search method is proposed to avoid frequent page turning and increase operating costs, so that users can use search more easily.
  • the user does not need to return to the initial search interface to search again, that is, the user can continuously search based on the search results, so that the user can quickly find the content of interest to the user and improve the user's search convenience.
  • FIG. 5A shows a flowchart of a content search method according to some embodiments
  • FIG. 5B shows a sequence diagram of a content search method according to some embodiments
  • FIG. 5C shows a data flow of the content search method according to some embodiments picture.
  • a three-dimensional display device provided by an embodiment of the present application includes: a virtual display configured to present a virtual user interface displaying a search button; a controller connected to the virtual display, which is configured to perform FIG. 5A , FIG. 5B and FIG. 5C . When the content search method is shown, the controller is configured to perform the following steps:
  • S501 Receive an operation on a search button, and display an initial search interface including an input box in a virtual user interface.
  • the user wears the three-dimensional display device and triggers the virtual reality application configured in the three-dimensional display device to generate a virtual user interface in the virtual three-dimensional space.
  • Figure 5D shows a schematic diagram of a virtual user interface home page in accordance with some embodiments.
  • a search button 5401 is displayed on the top of the virtual user interface home page (content recommendation area), and the search button is a unified search entry of the home page of the three-dimensional display device.
  • the user enters the unified search by clicking the search entry icon, and the media resources of the search results can be implemented, for example, for all business applications, application media resources, film and television media resources, and education business media resources, such as education, children, VR classrooms, etc.; , businesses include but are not limited to homepage recommendations, popular games, featured topics, and popular episodes.
  • an initial search page is generated and displayed on the home page of the virtual user interface.
  • the content switched and displayed in the virtual user interface is the initial search page.
  • the cursor in the three-dimensional display device can be freely positioned at any position of the display window along with the handle. There is no need to set the focus movement logic according to the display column of the interface.
  • the initial search page generated after the user clicks the search button includes an input box 5501 , a voice input box 5502 , a search history 5503 , a popular search 5504 and an input method keyboard 5505 .
  • the user moves the cursor to the position of the search box, and when the confirm button on the remote control is pressed, the three-dimensional display device compares the position of the cursor with the position of each column object on the page, and determines the operator to perform the operation. It is a search button, so executing the search button corresponds to the confirmation instruction logic.
  • the command logic corresponding to different buttons/controls/objects can be different.
  • the input box is a search input box.
  • the cursor of the input box blinks to indicate the input state; the input box displays a prompt by default to support background configuration. When there is no configuration, it displays "Please enter the name of the content to be searched", and the search prompt disappears after the user enters text.
  • the search input box can be configured to input a maximum of 50 characters; after more than 50 characters can not continue to input, when clicking a character, the user interface prompts "up to 50 characters”; the input character length exceeds the length of the text box, the middle of the text displays " " to display the most recent and most recently entered characters.
  • the voice input box dynamically displays the voice guide, the carousel is displayed randomly, the time interval of the carousel can be adjusted, and the carousel has animation display;
  • the data of the voice guide comes from the "Voice Speaking Corpus", from which data is randomly obtained for carousel;
  • the corpus can be configured as an operation configuration statement, such as "you can search by saying xxx", “try to say xxx”, where xxx comes from the name of the popular TOP media searched by the previous business.
  • movies and TV shows only the hot search TOP data of movies and TV, and games only show the TOP data of games, and the operation can configure how much TOP data is required; when entering from the independent portal of other services, the input box only displays the voice of the hot search content of the current business introductory words.
  • Search history is the history record display area. After the user enters the search for the first time or clears the record, there is no history record, and the popular recommendation on the initial search page is moved up; when entering the details page, the history record is recorded once, and the current record is displayed, that is, click to enter from the search result. On the details page, press the return key to return to the search result interface. When the history record module appears on the screen, the latest history record will be refreshed and displayed; the history records are arranged in reverse chronological order, that is, the most recent history record is ranked first. 2 lines.
  • the history record refers to the search history, not the playback history, that is, the search terms used by the user each time they search, not the search content.
  • search history entry is generated, and at the same time, the search history interface in the history display area is refreshed, and the newly generated search history entry is displayed at the front end of the search history interface. If the number of search history entries that can be displayed in the search history interface exceeds the maximum limit, the earliest generated search history entries will be deleted.
  • the popular recommended content has a smooth upward animation effect; when the user clicks on the history record, the search results are displayed directly without the configuration of associative words; when the user enters from the independent entrance of other services, the history record of the current service is displayed;
  • the verse rules of the history record may include defining the maximum length of each cell and the maximum number of displayed words. If the length is too long, an ellipsis will be displayed, and a marquee will be displayed after focusing.
  • Hot search is the hot search display area, which can be entered from the home page search entry (search button) of the 3D display device.
  • the initial search page displays the popular search content of movies and TV; when the user enters from the independent entrance of other services, the hot search displays the current search service People search for content and click through to the corresponding page.
  • the input method keyboard can be a search keyboard, which is displayed in layers with the main screen; the search keyboard pops up only when the user clicks the input box.
  • the input method keyboard cannot use the built-in keyboard (2D keyboard) configured by the system, and the problem of abnormal display will occur. Therefore, the search keyboard in this application is a 3D keyboard.
  • the search keyboard in this application is a 3D keyboard.
  • Figure 5F shows a schematic diagram of searching based on a search initial page, according to some embodiments.
  • the user clicks on the input box, and a search keyboard pops up.
  • the search keyboard is displayed at the bottom of the input box, and when text is entered based on the search keyboard, the text is displayed in the input box.
  • two contents of popular searches and search history are displayed in the initial search interface generated by the user triggering the search button on the home page of the three-dimensional display device. Therefore, in order to realize the display of the above two contents, the device side needs to obtain corresponding data from the server to display the corresponding contents.
  • the controller When the popular search data and historical search data are displayed on the initial search interface, the controller performs the operation of receiving the search button, displays the initial search interface including the input box in the virtual user interface, and is further configured to: in response to triggering the search button Content search instruction, send a search data request to the server, the search data request is used to instruct the server to obtain popular search data and historical search data; receive popular search data and historical search data returned by the server, and generate in the virtual user interface the input box, history
  • the user triggers the search button on the homepage through the handle or helmet used in conjunction with the three-dimensional display device to generate a content search instruction, and the controller generates a search data request in response to the content search instruction and sends it to the server.
  • the server After receiving the search data request, the server returns popular search data and historical search data to the three-dimensional display device.
  • the popular search data is used to provide the display of different popular media resources
  • the historical search data is used to provide the display of the search terms used by the user when searching in different periods.
  • the search data requests include popular search data requests and historical search data requests.
  • a data request for popular searches is sent to the server, and the server returns the data for popular searches, including information such as corresponding media asset IDs, poster images, and rights and interests.
  • the three-dimensional display device displays the picture according to the link to the picture of the media asset returned by the server, and displays the corresponding title text according to the title data of the media asset.
  • a data request for historical search is sent to the server, and the server returns the data of historical search, including the search term information used by the user for historical search.
  • an initial search interface is displayed as shown in FIG. 5E , and the content is pre-made popular searches and search history.
  • Popular Search calculates the current high-frequency search resources of different users through big data, and performs initial display.
  • the search history is the search term information used in the user's historical search, and is initially displayed.
  • each popular search data can be sorted and displayed according to the popularity index, and the displayed content is information such as media asset posters and media asset names.
  • the search terms corresponding to each historical search data are displayed in reverse order.
  • the input box is used to display the target text that triggers the search process, and the target text is the search term used by the user when searching. If a search is performed with the target text, the search term corresponding to the target text is displayed at the top of the history display area, and the remaining search terms originally displayed are moved one position backward.
  • the user can directly jump to the corresponding media asset result without performing additional operations, which is convenient for the user to operate.
  • the controller when interacting based on the popular search display area, is further configured to: in response to triggering a selection operation of a popular search data in the popular search display area, send a content details request carrying a content ID to the server, and the content details request It is used to instruct the server to query the content details information corresponding to the content ID, and the content ID is used to represent popular search data; receive the content details information corresponding to the content ID returned by the server, and generate the content details interface in the virtual user interface. Display content details.
  • a content details request with a content ID is sent, and data is requested from the server to obtain the content details of the popular search data.
  • the device side After receiving the content detail information returned by the server, the device side jumps to the content detail interface, and displays the content detail information corresponding to the popular search data selected by the user.
  • 5G shows a schematic diagram of a content details interface in accordance with some embodiments.
  • the device sends the media asset ID of "A movie” to the server.
  • the content details interface is displayed in the virtual user interface.
  • the interface displayed in the virtual user interface is switched from the search initial interface to the content details interface by left sliding, and the search initial interface is hidden in the lower layer of the content details interface and is not visible.
  • the user may perform a quick search based on each search term displayed in the history display area.
  • the search for the search term can be executed immediately, and the search result is displayed in the search result area.
  • Figure 5H shows a schematic diagram of a search results interface in accordance with some embodiments.
  • the device end receives the content search result corresponding to the selected historical search data returned by the server, and generates a search result interface based on the content search result of "A cartoon", which is displayed in the virtual user interface.
  • the interface displayed in the virtual user interface is switched from the search initial interface to the search result interface by left sliding, and the search initial interface is hidden in the lower layer of the search result interface and is not visible.
  • the search result interface includes media resources related to the search term "A cartoon", and the user can click any media resource displayed in the search result interface to watch. After the user clicks any of the media assets shown in FIG. 5H , the interface jumps to the content details interface as shown in FIG. 5G , which will not be repeated here.
  • the user may also perform a new search process.
  • the user's self-search process can be an initial search process and a continuous search process.
  • the initial search process refers to the process that the user searches for a specific keyword for the first time
  • the continuous search process refers to the user continuing the next search process based on the results of the initial search after the initial search process.
  • the controller when the initial search is performed, obtains the content search result corresponding to the target text input in the input box when the initial search is performed, and is further configured to: when the initial search is performed, receive a pair of The operation of the input box, the search keyboard is displayed in the initial search interface, and the search keyboard is located below the input box; the target text input based on the search keyboard is received, and the content search request is sent to the server, and the content search request is used to instruct the server to query the corresponding target text.
  • the content search result is displayed, and the target text is displayed in the input box; the content search result corresponding to the target text returned by the server is received.
  • a search keyboard pops up in the initial search interface, and the search keyboard is located below the input box.
  • the search keyboard is a 3D virtual keyboard.
  • the search keyboard is visually displayed on the initial search interface.
  • the depth of field distance between the interfaces that is, the distance between the human eye and the facing interface, can usually be set to 9 meters, or can be other values, which are not specifically limited here.
  • 4 refers to 4 pixels, that is, the distance of 4 pixels between the search keyboard and the initial search interface, and the rotation angle of the X axis of the search keyboard is 30 degrees.
  • the search keyboard Before the search keyboard is displayed in the initial search interface, since the user does not click on the input box, there is no focus in the input box and no cursor is displayed. After the search keyboard is displayed, the input box gains focus and the cursor is displayed. When the user clicks the area in the search keyboard to input, the input content will be appended to the cursor in the input box in real time. When the user clicks the area outside the search keyboard, the search keyboard does not respond; when the user clicks the hide button on the search keyboard, the search keyboard is hidden, the input box loses focus, and the cursor in the input box is hidden.
  • a hidden button is set in the search keyboard. If the user does not need to operate the search keyboard, the hidden button can be triggered to hide the search keyboard.
  • the search keyboard can also be canceled when the search result interface is generated, that is, after the search result interface is presented in the virtual user interface, indicating that a search process is completed, the search keyboard can be hidden. In the next search process, click the input box again to pop up the search keyboard again.
  • the device After determining the target text for the search process, the device generates a content search request based on the target text and sends it to the server, and the server queries the corresponding content search result based on the target text. After receiving the content search result returned by the server, the device side can generate a search result interface and display it in the virtual user interface.
  • FIG. 5I shows a schematic diagram of inputting target text based on a search keyboard according to some embodiments
  • FIG. 5J shows a schematic diagram of a search result interface generated based on the target text according to some embodiments.
  • the device if the user operates the search keyboard, "ABCD" is input and displayed in the search keyboard.
  • the device generates a content search request to the server based on the target text "ABCD”, and generates a search result interface after receiving the content search result returned by the server.
  • Different types of media assets related to "ABCD" are displayed in the search result interface.
  • the controller is further configured to perform the following steps: when the target text is input based on the search keyboard, send an associative word acquisition request to the server, and the associative word acquisition request is used to instruct the server to query and target The associative words corresponding to the text; the associative words corresponding to the target text returned by the server are received, and the associative word list is generated, and the associative word list is displayed in the upper layer of the initial search interface in the form of a floating layer.
  • the device side will obtain the associated word associated with the content of the input box from the server in real time.
  • the device generates an association word acquisition request based on the content in the current input box, and sends it to the server to request to obtain the association word corresponding to the target text.
  • Figure 5K shows a schematic diagram of an associative word list according to some embodiments. If the user operates the search keyboard and inputs the target text "AB", the generated associative word list is shown in Figure 5K, and the associative words associated with "AB” can be "ABCDEFG”, "ABCDHIJK", etc.
  • not all target texts correspond to associative words. Therefore, when an associative word exists, a list of associative words can be displayed on the initial search interface; and if there is no associated word, the list of associative words is not displayed on the initial search interface.
  • the device when the user enters text on the initial search interface, uses the 3D input method to input text, and the main interface can display the associated words in real time; slip.
  • the user interface can swipe left to switch to the search result interface to display the search results of the associative word; if there is no associative word on the user interface, no result feedback is displayed to recommend the hot search content of the current business to the user.
  • the associative words in the associative word list will also change accordingly in real time. If there is no associative word, it will not be displayed, if there is an associative word, it will be displayed. Therefore, a list of associative words based on the text in the input box will appear in real time. Therefore, there is a logic of displaying -> hiding, and hiding -> displaying the associative word list with the user's input or deletion.
  • the device side each time the user performs input and deletion, the device side initiates a request to the server in real time, and the associative words are stored in the media repository of the server.
  • the server After the server receives the request, it performs big data calculations on the media assets in the media asset library, and returns the calculation results to the device in Json format.
  • the data In order to ensure the real-time and fast data transmission, the data only includes the content of the associative words.
  • the user can perform a quick search based on each association word displayed in the association word list, that is, click on any association word to obtain the content search result.
  • the associative word that the user wants to search appears in the associative word list, you can directly click the associative word to perform a complete search.
  • the user triggers the associated word, generates a content search request, and sends it to the server.
  • the server queries the content search result corresponding to the association word.
  • the device side After receiving the content search results returned by the server, the device side can generate a search result interface and display it in the virtual user interface. At this time, the selected associative word is displayed in the input box, replacing the text input by the user originally displayed in the input box.
  • the interface displayed in the virtual user interface is switched from the search initial interface to the search result interface, and the search initial interface is hidden in the lower layer of the search result interface and is invisible.
  • the associative word string is assigned to the Text component, and the Text component is displayed and refreshed.
  • the associative word string is assigned to the Text component, and the Text component is displayed and refreshed.
  • the search result interface displays the search result of "ABCD", as shown in FIG. 5J .
  • the layer displaying popular searches is the same layer as the layer displaying the input box and the layer displaying search results
  • the interface displaying the associative words is a layer of another level. That is to say, popular searches, search results, and input boxes are displayed on the layer where the initial search interface is located, while the list of associated words is suspended above the initial search interface.
  • the content may be displayed in the form of paging. If the user wants to view the content of other pages, he or she can slide the interface to the right or left to perform a sliding page-turning operation.
  • FIG. 5L shows a schematic diagram of the effect of performing a sliding page turning operation based on a search result interface according to some embodiments.
  • Each page in the search result interface can be laid out in an orthogonal layout.
  • the page in the user's front view area is the main page, and the user can directly click on each content search result displayed on this page.
  • the user wants to view the content of the right page the right page is triggered, and the right page is slid left to the position of the main page (the middle position), and then clicks each content search result displayed on the page.
  • the left page is triggered, and the left page is swiped to the right to the position of the main page (the middle position), and then clicks each content search result displayed on the page.
  • each interface displayed in the virtual user interface is laid out in an orthogonal layout manner, and therefore, the manner of sliding pages can be adopted, such as a search initial interface, a search result interface, and the like. Swipe left to view the next interface, swipe right to view the previous interface.
  • the search result interface may be classified according to different types of content search results, and corresponding Tab buttons may be configured for each classification, for example, "movie selection”, “movie” and “television series” in FIG. 5L .
  • Tab button By clicking the Tab button, the user switches to the media asset content corresponding to the Tab for viewing.
  • the user when performing an initial search, the user can directly jump to the corresponding media asset result in the popular search data displayed in the popular search display area on the initial interface without performing additional operations, which is convenient for the user to operate.
  • You can also perform quick searches based on each search term displayed in the history display area.
  • the search for the search term can be executed immediately, and the search result is displayed in the search result area.
  • Users can search by themselves by inputting the target text based on the input box, and can also perform a quick search based on the associative words of the target text. All of the above search methods can provide users with a quick traversal search experience, avoid frequent page turning and increase operating costs, and provide a good user experience.
  • a continuous search process is generated.
  • the continuous search process means that after the initial search process, the user continues to perform the next search process based on the results of the initial search.
  • the user can search again without returning to the initial search interface, that is, the user can continuously search based on the search results, so that the user can quickly find the content they are interested in and improve the user's search convenience.
  • the interface for performing the search is the search result interface after the previous search is completed, as shown in FIG. 5J .
  • the search result interface in addition to displaying the content search results, the input box is always displayed, so that the user can change the text content in the input box in real time for the next search process.
  • the input box displays the previously entered target text.
  • the user triggers the input box again, the input box gets the focus, and the cursor is positioned behind the target text.
  • the user inputs new text again based on the pop-up search keyboard.
  • the target text used last time and the new text input this time constitute continuous text.
  • the device side performs a new search process based on continuous text, obtains new content search results, and displays them in the search result interface.
  • the content displayed in the search result interface is replaced by the previous content search result based on the target text with the current new content search result based on the continuous text.
  • the controller when the continuous search is performed, obtains new content search results corresponding to the continuous text input in the input box when the continuous search is performed, and is further configured to: when the continuous search is performed, receive Based on the new text input in the input box displaying the target text, a content search request is sent to the server.
  • the content search request is used to instruct the server to query the new content search result corresponding to the continuous text.
  • the continuous text includes the target text and the new text, and the continuous text is displayed. In the input box; receive new content search results corresponding to the continuous text returned by the server.
  • the input box displays the target text used in the previous search, and a new search process is performed using the newly entered new text and the target text as continuous text.
  • the device side generates a content search request and sends it to the server, and receives the new content search result corresponding to the continuous text returned by the server, and the device side displays the new content search result in the search result interface.
  • the content in the input box becomes “ABCD” at this time, and the user can continue to search on the basis of this result.
  • the user operates the handle or the helmet to focus on the input box, and the search keyboard pops up. For example, if you continue to input "E”, then the content of the input box becomes “ABCDE", that is, the continuous text is "ABCDE”.
  • a new search process is performed based on the continuous text as "ABCDE”, and the acquired new content search result is displayed in the search result interface.
  • the device side may also provide an association word based on continuous text, so that the user can quickly select a search term that matches the user.
  • the controller is further configured to: when the continuous text is displayed in the input box, send a request for obtaining the associative words to the server, and the request for obtaining the associative words is used to instruct the server to query the corresponding words corresponding to the continuous text.
  • Associative words Receive associative words corresponding to the continuous text returned by the server, generate an associative word list, and the associative word list is displayed in the upper layer of the search result interface in the form of a floating layer.
  • the device In the input box there is the target text scene used by the previous search. Every time the user uses the search keyboard to input new text or delete it, that is, when the content of the input box changes compared to the previous time, the device side will obtain the associated word associated with the content of the input box from the server in real time. At this time, as the content of the input box changes, the device generates an association word acquisition request based on the continuous text in the current input box, and sends it to the server to request to obtain the association word corresponding to the continuous text.
  • a list of associative words can be generated and displayed in the upper layer of the search result interface in the form of a floating layer.
  • the user does not need to enter the desired search term completely, but can select one of the associative words that matches the desired search term in the associative term list as the search term during the text input process, so as to quickly search.
  • the currently presented interface is the search result interface. Therefore, when the associative word list is displayed, it is displayed on top of the search result interface; when there is no associative word, the associative word list is hidden, and the search result interface below the associative word list is displayed.
  • the content in the input box becomes “ABCD” at this time, and the user can continue to search on the basis of this result. For example, if you continue to input "E”, the content of the input box will become “ABCDE”. Since the content of the input box has changed, the list of associative words based on the big data algorithm has also changed. At this time, the list of associative words will appear as "ABCDE”. ABCDEFGH”, “ABCDEOPQ”, etc. The user can continue to click on the "ABCDEFGH” associative word to perform a search for the "ABCDEFGH” keyword. At this point, the search result interface is refreshed, and the search result of "ABCDEFGH" appears.
  • the content of the input box becomes "ABCDEFGH” at this time, and the user can continue to input, for example, input "X", the association word list will continue to be refreshed, for example, "ABCDEFGHXY" appears.
  • the search of "ABCDEFGHXY" is executed, and the search result area is refreshed at the same time. And refresh the content of the input box to "ABCDEFGHXY".
  • the target text displayed in the input box can be deleted to re-enter new text.
  • the next search process is performed based on the new text.
  • the search process based on the re-entered new text can also provide the function of associative words, and the relevant process can refer to the above-mentioned content, which will not be repeated here.
  • the user when performing a continuous search, the user can perform the next search process based on the previous search results. At this time, the search method can be performed again without returning to the initial search interface, that is, the user can continuously search based on the search results. Users can quickly find content they are interested in, which improves user search convenience.
  • the device determines whether in the initial search process or in the continuous search process.
  • the device provides the user with a way of entering text by means of a search keyboard, and can also be a way of voice input.
  • the user can trigger the voice input box in the initial search interface shown in FIG. 5E , and input a voice command in the pop-up voice input interface to realize content search.
  • the controller is further configured to: when performing an initial search or continuous search, receive an operation on the voice input box in the initial search interface, and display the voice input interface in the virtual user interface; and receive the user Input voice text, display the voice text in the voice input interface; send a content search request to the server, and the content search request is used to instruct the server to query the content search result corresponding to the voice text; receive the content search corresponding to the voice text returned by the server The results are displayed in the search results interface.
  • the user triggers the voice input box in the search initial interface, and the voice input interface pops up.
  • the interface displayed in the virtual user interface is slidably switched from the search initial interface to the voice input interface.
  • Fig. 5M shows a schematic diagram of a voice input interface according to some embodiments
  • Fig. 5N shows a schematic diagram of a voice input interface according to some embodiments in a sound collection step
  • Schematic of the steps. 5M, (b) and (c) the user triggers the voice input box, the voice input interface is displayed in the virtual user interface, and the voice input interface displays "listening"; the voice input interface includes a radio step; the radio page includes voice guidance, The number of the voice guidance can be configured as required.
  • the voice guide database is derived from the "Voice Speaking Corpus", and the data is randomly selected for display, and refreshed every time the voice interface is activated; when entering from the independent entrance of each service, only the voice guide of the current service is displayed.
  • a voice search control such as a voice input box
  • start the voice acquisition on the three-dimensional display device to collect the voice
  • the sound collection of the 3D display device is turned off after the user exits the voice collection/exits the voice collection interface/preset time.
  • sound collection is started and a voice input interface is displayed.
  • the three-dimensional display device exits the voice input interface after receiving the search result fed back by the server, and displays the search result interface.
  • the sound collection may be hardware-enabled or disabled sound-collecting elements, or software-enabled sound data conversion.
  • the user enters the voice input interface and the device starts recording, and after receiving the user's voice command, the voice command is converted into voice text and displayed on the voice input interface.
  • the device After the voice text is generated, the device generates a content search request and sends it to the server to obtain the content search result corresponding to the voice text from the server. After receiving the content search result corresponding to the voice text returned by the server, the device displays the content search result in the search result interface.
  • the display recognition receives the user's voice command
  • its recognition interface is as shown in FIG. 50
  • the three-dimensional display device adopts streaming recognition to display the recognized content in real time; after the recognition is completed, the search result interface is entered.
  • playback will be directly started in the following situations, including: the search result exactly matches the voice and text; there are "play xxx", “I want to watch xxx”, and "I want to watch xxx” in the corpus; At this time, the virtual user interface does not display the search result interface, and the subsequent logic of starting playback is performed according to the specific logic of each service.
  • the controller is further configured to: display the abnormal operation prompt information in the voice input interface when the voice text input by the user is not received; receive the new voice text input based on the abnormal operation prompt information, and execute the new voice text based on the new voice text.
  • Content search process if the user's voice command is not standard, or the voice recognition function is abnormal, the situation that the user's voice command cannot be received may occur.
  • the controller is further configured to: display the abnormal operation prompt information in the voice input interface when the voice text input by the user is not received; receive the new voice text input based on the abnormal operation prompt information, and execute the new voice text based on the new voice text. Content search process.
  • the voice input interface wait for 15 seconds to listen to the sound. If any voice content cannot be recognized, the feedback message that the user's voice has not been received will be displayed, that is, the abnormal operation prompt message.
  • FIG. 5P shows a schematic diagram of a voice input interface displaying abnormal operation prompt information according to some embodiments.
  • an abnormal operation prompt message such as “no voice detected”
  • the voice input interface if the voice text is still not recognized after 15 seconds of sound collection, an abnormal operation prompt message, such as “no voice detected”, is displayed in the voice input interface. And synchronously display the voice guidance to indicate that the user should enter the voice command in the correct way.
  • a content search process may be performed based on the new voice text.
  • a content search process may be performed based on the new voice text.
  • the user triggers the voice input box in the search result interface, and the voice input interface pops up.
  • the interface displayed in the virtual user interface is slidably switched from the search result interface to the voice input interface.
  • the voice input supports escaping. For example, if the user says “I want to watch movies of actor C”, the search is actually based on the escaped content "movies of actor C”, and the corresponding search results are displayed. and associative words.
  • the voice input method can replace the input method using the search keyboard, which is more convenient, can avoid frequent interaction, and has a good user experience.
  • a three-dimensional display device provided by the embodiment of the present application triggers a search button to display an initial search interface including an input box when searching for content;
  • the content search result corresponding to the target text is generated and displayed on the search result interface; during continuous search, the new content search result corresponding to the continuous text entered in the input box is obtained, and the new content search result is displayed in the search result interface.
  • Continuous text includes target text and newly entered text.
  • the three-dimensional display device proposes a content search method that avoids frequent page turning and increases operating costs to facilitate interaction, so that users can use the search function more easily.
  • the user can search again without returning to the initial search interface, that is, the user can search continuously based on the search results, so that the user can quickly find the content they are interested in, and improve the user's search convenience.
  • applications that can implement different functions are presented in the virtual user interface, usually using a tab bar to display content of different attributes, categories or functions.
  • the tab bar includes multiple tabs, one tab corresponds to one attribute, category or function, and the attributes, categories or functions of the content displayed under the same tab should be the same.
  • FIG. 6A shows a schematic representation of Tab columns composed of big data information according to some embodiments.
  • tabs C6102 are displayed in the Tab column 6101, they are "Guess you like comedy movies", “Guess you like”, “Guess you like”, “Guess you like”, “Guess you like”, “Guess you like XXXX” Movie”.
  • the data length of each tab is not the same, and the default display width of the tab bar is limited, so that the display of the fifth tab on the right side of the tab bar is incomplete.
  • the content of the fifth tab that the user can see is "Guess you like X", so that the user cannot know the actual content of the tab, which affects the user experience.
  • the interaction method is different from traditional TVs, mobile phones, etc. Generally, the interaction is performed through head touch points or handles, instead of sequential operations like a remote control, but similar to a mouse, you can freely select virtual Operates on any UI control presented in the user interface. It can be seen that the self-operated mode of the three-dimensional display device can directly select the tab label that is not fully displayed to obtain the information of the label. Therefore, if the specific information of a certain tab is obtained by using the traditional interaction method, it will bring new problems to the user's experience from the perspective of display and interaction method.
  • the traditional processing methods include using the omission method to display the Tab label, using the marquee method to display the Tab label, and using the completely hidden method to display the Tab label.
  • the ellipsis method is to define the display length of the tab label of the rule, and the excess part is represented by "".
  • the marquee method also defines the display length of the regular Tab label, and the excess part is displayed in the form of a marquee when the focus is obtained.
  • the completely hidden method is to hide and not display all the tabs that cannot fully display the tab, but there is a blank area in the tab bar, which is not beautiful. It can be seen that the above three methods have certain obstacles to the user's interaction and experience, the UI is closed and the information is viewed, which is not convenient for the user's operation and affects the user's experience.
  • the embodiment of the present application provides a three-dimensional display device, which is combined with the three-dimensional display device through a handle or
  • the feature that the head control contacts can be freely operated, combined with the uncertainty of the data of each tab, allows the tab bar to display one or more tabs instead of a fixed number of tabs.
  • the number of displayed tabs is dynamically calculated according to the content of the tab itself, and the tabs on the left and right sides of the tab bar are allowed to be incompletely displayed.
  • the initial state is shown in FIG. 6A , the tabs are displayed from the leftmost to the right. As long as the tabs are not completely filled with the tabs, the next tab will be displayed, so the next tab may be completely displayed or only a part of it may be displayed. And during interaction, when the incompletely displayed Tab gets the control focus, the content of the Tab bar can be controlled to move as a whole, so that the incompletely displayed Tab can be completely displayed for the user to view.
  • TabMenuWidth can be defined: the width of the tab bar; FilledWidth: indicating the width of the tab bar that has been filled; CurrentTabWidth: the width of the current tab to be displayed.
  • the operation of the Tab label to obtain the control focus is not the traditional situation of triggering the direction keys of the remote control to gradually move to the Tab label, but the interaction through the head touch point or handle used in conjunction with the 3D display device, for example
  • the user can directly place the control focus on the corresponding tab, and there is no need to go through other tabs when the tab obtains the control focus. Therefore, in combination with the display characteristics of the Tab column and the interactive characteristics of the three-dimensional display device, compared to the logic of not displaying if it cannot be fully displayed, the present application can view the specific information of the incompletely displayed Tab tag in time through the partial display of the Tab tag, and Acquiring the focus of the cursor provides a good user experience.
  • FIG. 6B shows a flowchart of a method for dynamically displaying a Tab column according to some embodiments.
  • a three-dimensional display device provided by an embodiment of the present application includes: a virtual display configured to present a virtual user interface displaying a Tab bar; a controller connected to the virtual display is performing the dynamic display of the Tab bar shown in FIG. 6B . method, the controller is configured to perform the following steps:
  • the user wears the three-dimensional display device and triggers the virtual reality application configured in the three-dimensional display device to generate a virtual user interface in the virtual three-dimensional space.
  • the virtual user interface refer to the content shown in FIG. 2A , and when an application needs to be displayed, it can be displayed in the application switching area shown in (3) in FIG. 2A .
  • a virtual user interface is presented in a virtual three-dimensional space.
  • tab bars adapted to different interaction scenarios are presented in the virtual user interface.
  • Interactive scenarios include but are not limited to: when triggering any one of the navigation buttons in the navigation bar as shown in Figure 2A (2), displaying the corresponding page in the virtual user interface, for example, when triggering the "education" navigation button, in the virtual user interface
  • the content recommendation area of the interface displays the content corresponding to the "Education" function, and the different categories corresponding to the above functions are displayed at the top in the form of Tab labels.
  • each actor information corresponds to a Tab tag, and a tab bar composed of multiple tab tags representing actor information is displayed at the bottom of the video media asset name.
  • searching for information based on a search box different historical search information is displayed in the pop-up search history interface.
  • Each historical search information corresponds to a tab, and several tabs are uniformly displayed in the search history interface.
  • the historical search information can be exists in the form of keywords.
  • Tab labels When displaying, at least one tab to be displayed corresponding to an interactive scene is generated, and a tab column is generated in the corresponding virtual user interface in the interactive scene, and the at least one tab is displayed in the tab column.
  • Different Tab labels correspond to different attribute names, function names, category names, keyword names, etc., so that the data length of each Tab label is different. Visually, it is reflected in the different label widths of each Tab label.
  • the label width refers to The width of the position occupied by this tab.
  • Tab labels in the Tab column When displaying Tab labels in the Tab column, several Tab labels in the same interaction scene are arranged in a predetermined order, and displayed in the Tab column in turn. Due to the layout limitation of the virtual user interface, the content that the Tab bar can display is limited, and the Tab bar can only be displayed within its preset display width, which is the maximum width of the content that the Tab bar can display. It can be seen that if the tab width of the tab label is larger, the number of tab labels that can be displayed in the tab bar is smaller; if the tab width of the tab label is smaller, the number of tab labels that can be displayed in the tab bar is larger.
  • the preset display width of the Tab column is limited, and the width of each Tab label is different, there may be a situation that a certain Tab label is not fully displayed during display. Therefore, when displaying a certain tab, it can be determined whether the tab can be displayed in the tab according to the size relationship that the width of the tab is less than or equal to the width to be displayed in the tab, and if it can be displayed , the display form of the Tab label.
  • the to-be-displayed width of the tab bar refers to the difference between the preset display width of the tab bar and the already filled width, that is, the remaining width.
  • the to-be-displayed width of the tab bar and at least one tab with different tab widths to be displayed are obtained, and the to-be-displayed width of the tab bar refers to the remaining width of the tab bar that can be displayed. If the tab width of the tab to be displayed is less than or equal to the to-be-displayed width of the tab bar, it means that the tab can be displayed completely, and the tab is displayed in the tab bar in a fully displayed state. If the width of the tab to be displayed is greater than the width of the tab to be displayed, it means that the tab cannot be fully displayed, and only a part of it can be displayed. At this time, the tab is displayed in the tab bar in an incomplete display state.
  • the displayable width of the Tab label can be determined first, and the part corresponding to the displayable width of the Tab label is displayed in the Tab column in the incomplete display state.
  • the Tab label The displayable width of is equal to the to-be-displayed width of the Tab column.
  • the displayable range of the Tab column may be represented by the width to be displayed.
  • the range corresponding to the to-be-displayed width is the free area in the Tab column where no Tab labels are displayed, and the to-be-displayed width of the Tab column refers to the remaining width of the Tab column that can display the labels.
  • FIG. 6C shows a schematic diagram of the area of the Tab column according to some embodiments.
  • the to-be-displayed width of the Tab column is equal to its preset display width, and the entire area of the Tab column is the free area 6302 (such as The position of the dotted box in the figure) can be displayed on the label; the width to be displayed in the Tab column is the width of the free area.
  • part (b) in FIG. 6C during the display process, part of the entire area of the Tab column will be filled with at least one Tab label C6304.
  • the area not filled with the Tab label is the free area 6303, and the Tab column 's to-be-displayed width is smaller than its default display width. If the next tab is to be filled, the tab width of the tab is compared with the free area to determine the display form of the tab.
  • FIG. 6D shows a schematic diagram of a Tab tab displayed in a fully displayed state according to some embodiments.
  • a two-dimensional coordinate system can be established based on the Tab column 6401, and the coordinate origin is located at the upper left corner of the Tab column, or at the upper left corner of the virtual user interface, from left to right.
  • the direction is the positive X axis, and the direction from top to bottom is the positive Y axis.
  • the left position coordinates of the free area of the Tab column are the right position coordinates of the last displayed Tab label; if If no Tab label is displayed in the Tab bar, the left position coordinates of the free area of the Tab bar are the position coordinates of the left border of the Tab bar.
  • the calculation process can be performed only with the X-axis coordinate value; if the Tab column is set vertically, the calculation process can be performed only with the Y-axis coordinate value. If the Tab column is set irregularly, the calculation process can be performed with the complete X-axis and Y-axis coordinate values.
  • the width of the next designated Tab C6403 to be displayed is H1
  • the width H1 of the designated Tab is less than or equal to the width L1 of the Tab column to be displayed , indicating that the designated Tab label can be displayed in the free area of the Tab column
  • the Tab label is displayed in the Tab column in a fully displayed state. If there is already a previously displayed Tab in the Tab column at this time, the specified Tab will be displayed behind the previous Tab.
  • the designated Tab label is displayed at the initial position on the left side of the Tab column.
  • FIG. 6E shows a schematic diagram of a Tab tab displayed in a partially displayed state according to some embodiments.
  • the tab width of the Tab label as H2
  • the label width H2 of the Tab label is greater than the to-be-displayed width L2 of the Tab column, it means that the designated Tab label cannot be displayed in the free area of the Tab column. In this case, the Tab label needs to be displayed in the Tab column in an incompletely displayed state.
  • the displayable width of the Tab tag In order to determine part of the content displayed in the Tab column by the specified Tab tag, the displayable width of the Tab tag needs to be determined. In some embodiments, the displayable width of the Tab label is equal to the to-be-displayed width of the Tab column, that is, the displayable width of the Tab label is L2.
  • part (b) in FIG. 6E the part corresponding to the displayable width L2 of the Tab label is displayed in the Tab column.
  • the display of the Tab label The form is not fully displayed.
  • the rest of the Tab label is not displayed in the Tab column.
  • the display order of each Tab in the Tab column is displayed in a left-to-right order, and there may be gaps left between the Tabs for distinction, or they may be displayed end to end without gaps.
  • the above process of judging whether the display can be performed is performed, that is, whether the display can be displayed, and the display form (completely displayed state and incompletely displayed state) when it can be displayed. Then, when displaying based on the preset display width of the Tab column, the Tab label located on the right border of the Tab column can be located in the Tab column in the fully displayed state, or in the Tab column in the incomplete display state (half display half hide).
  • the first direction is from right to left; if the incompletely displayed tab is on the left side of the tab bar, the first direction is from left to right direction.
  • the judging method may be similar to the manner in which each tab is displayed in the tab column. Specifically, according to the display order of the tabs, the tab widths of each tab are accumulated in sequence to obtain the accumulated widths corresponding to several tabs. If the accumulated width is greater than the preset display width, it is determined that the last accumulated tab is an incompletely displayed tab.
  • An incompletely displayed tab is a tab that is displayed in an incompletely displayed state, that is, a part of the content is displayed in the tab bar, and another part of the content is hidden outside the border of the tab bar. Therefore, it can be determined whether there is a tab that is not fully displayed according to the preset display width of the Tab column and the label width of each Tab label displayed in the Tab column.
  • the tab bar displays each tab in sequence from the left, that is, the first tab on the left side of the tab bar is usually the fully displayed tab. Therefore, starting from the leftmost side of the Tab column, the tab widths of each tab are accumulated, and the accumulation order is the display order of each tab.
  • FIG. 6F shows a schematic diagram of the Tab column displaying several tabs according to some embodiments. Each time the accumulation process is performed, it is determined whether the obtained accumulated width exceeds the preset display width of the Tab column. Referring to FIG. 6F, the default display width of the Tab column is L0.
  • the corresponding cumulative width D2 H1+H2, D2 ⁇ L0;
  • the fourth cumulative process before the calculation
  • the cumulative width D4 H1+H2+H3+H4 corresponding to the four Tab labels, D4 ⁇ L0;
  • the accumulated width is greater than the preset display width, indicating that the last accumulated Tab is not completely displayed in the Tab column, then it is determined that the accumulated last Tab is an incompletely displayed Tab. .
  • the user can directly select one of the interested tabs to trigger.
  • the user wants to view the specific information of the tab that is not fully displayed, it is necessary to move the display position of the tab when the tab that is not fully displayed gains the control focus.
  • the controller executes the incompletely displayed Tab. If the incompletely displayed Tab is located on the right side of the Tab bar, when the incompletely displayed Tab obtains the control focus, Move the tab located on the left side of the tab bar to the left to hide or display it in an incompletely displayed state, and move the incompletely displayed tab to the left to display it on the right side of the tab bar in a fully displayed state.
  • the first direction is Move the direction to the left; if the tab that is not fully displayed is on the left side of the tab bar, when the tab that is not fully displayed gets the control focus, move the tab located on the right side of the tab bar to the right to hide or not fully display
  • the state display, and the tab label that is not fully displayed is moved to the right to display the fully displayed state on the left position of the Tab column, and the first direction is the direction of moving to the right.
  • the tab bar is controlled All tabs currently displayed in the tab are moved to the left as a whole. At this time, the tab label that is not fully displayed is displayed on the right side of the Tab bar in the fully displayed state, and the Tab label located on the left side of the Tab bar is moved to the left to hide or display it in an incomplete display state, which needs to be hidden.
  • the number of tabs can be determined according to the width of the undisplayed part of the tabs that are not fully displayed.
  • the controller executes to move the tab located on the left side of the Tab column to the left to hide or display it in an incompletely displayed state
  • the controller is further configured to perform the following steps: based on the incompletely displayed Tab located on the right side of the Tab column.
  • the left coordinate position of the label and the width of the label calculate the width of the undisplayed part of the tab that is not fully displayed; when all the tabs displayed in the tab bar move to the left by the distance of the width of the undisplayed part, start from the left side of the tab bar in order Accumulate the tab width of each tab displayed in the Tab column, and obtain the cumulative width corresponding to several tabs; if the cumulative width is less than or equal to the width of the undisplayed part, hide at least one tab corresponding to the cumulative width; if the cumulative width If it is larger than the width of the undisplayed part, the last accumulated tab corresponding to the accumulated width will be displayed on the left side of the tab bar in an incomplete display state, and the display width of the last accumulated tab will be the width of the corresponding tab and the undisplayed part. difference in width.
  • each tab in the tab bar moves to the left as a whole.
  • the distance moved to the left as a whole is the incompletely displayed Tab.
  • the width of the rest of the label i.e. the width of the undisplayed part.
  • FIG. 6G shows a schematic diagram of calculating the width of a non-displayed portion according to some embodiments.
  • the tabs displayed in the Tab column are Tab tabs C1, C2, C3, C4, and C5, respectively.
  • Tab tab C5 is an incompletely displayed tab, and the rest are fully displayed tabs.
  • the magnitude of the leftward movement of each Tab in the Tab column is H52. Therefore, when all the tabs displayed in the tab bar are moved to the left by a distance H52 of the width of the undisplayed part, the tab widths of each tab displayed in the tab bar are accumulated sequentially from the left side of the tab bar to obtain several tabs corresponding to cumulative width.
  • the accumulation direction is left to right.
  • the accumulated width corresponding to the first n tabs is less than or equal to the width of the undisplayed part, it means that the n tabs will be moved out of the display range of the tab column from the left when the moving distance is H52. At this time, the n corresponding to the accumulated width will be Tabs are hidden.
  • the n+1th (last) accumulated Tab label corresponding to the accumulated width is displayed on the left side of the Tab column in an incomplete display state.
  • the tab located on the left side of the tab bar is moved to the left to hide or display in an incompletely displayed state.
  • the judgment can also be made according to the size relationship between the left and right position coordinates of each Tab label and the left position coordinates of the Tab column.
  • the tab bar is controlled All tabs currently displayed in the tab are moved to the right as a whole. At this time, the tabs that are not fully displayed are displayed on the left side of the tab bar in a fully displayed state, and the tabs on the left side of the tab bar are moved to the right to hide them.
  • the number of tabs that need to be hidden can be determined according to the The width of the undisplayed part of the tab label that is not fully displayed is determined.
  • the controller executes to move the tab located on the right side of the tab bar to the right to hide or display it in an incompletely displayed state
  • the controller is further configured to: based on the right side of the incompletely displayed tab located on the left side of the tab bar Coordinate position and tab width, calculate the width of the undisplayed part of the tab that is not fully displayed; when all the tabs displayed in the tab bar move to the right by the distance of the undisplayed part width, the tab bar is accumulated sequentially from the right side of the tab bar The tab width of each displayed tab, and the cumulative width corresponding to several tabs is obtained; if the cumulative width is less than or equal to the width of the undisplayed part, at least one tab corresponding to the cumulative width is hidden; if the cumulative width is greater than the undisplayed part width, the last accumulated tab corresponding to the accumulated width is displayed on the right side of the tab bar in an incomplete display state, and the display width of the last accumulated tab is the difference between the width of the corresponding
  • each tab in the tab bar moves to the right as a whole.
  • the distance moved to the right as a whole is the incompletely displayed Tab.
  • the width of the rest of the label i.e. the width of the undisplayed part.
  • FIG. 6H shows another schematic diagram of calculating the width of a non-displayed portion according to some embodiments.
  • the tabs displayed in the Tab column are Tab tabs C3, C4, C5, and C6, respectively.
  • Tab tab C3 is an incompletely displayed tab, and the rest are fully displayed tabs.
  • determine the width H32 H3-H31 of the undisplayed part of the tab label that is not fully displayed.
  • the range of the rightward movement of each Tab in the Tab column is H32. Therefore, when all the tabs displayed in the tab bar are moved to the right by a distance H32 of the width of the undisplayed part, the tab widths of each tab displayed in the tab bar are accumulated sequentially from the right side of the tab bar to obtain several tabs corresponding to cumulative width.
  • the accumulation direction is right to left.
  • the accumulated width corresponding to the first n tabs is less than or equal to the width of the undisplayed part, it means that the n tabs will be moved out of the display range of the tab column from the right side when the moving distance is H32. At this time, the n corresponding to the accumulated width will be Tabs are hidden.
  • the n+1th (last) accumulated Tab label corresponding to the accumulated width is displayed on the right side of the Tab column in an incomplete display state.
  • the tab located on the right side of the tab bar is moved to the right to hide or display in an incompletely displayed state.
  • the judgment can also be made according to the size relationship between the position coordinates of the left and right sides of each Tab label and the position coordinates of the right side of the Tab column.
  • FIG. 6I shows a schematic diagram of the effect of an incompletely displayed tab in the Tab column according to some embodiments
  • FIG. 6J shows a schematic diagram of the effect of triggering an incompletely displayed Tab in the Tab column according to some embodiments.
  • each Tab in the Tab bar is interacted based on the foregoing content.
  • the user triggers the "Education” button in the navigation bar to generate an "educationion” display interface in the virtual user interface, and there are Tab columns including a plurality of Tab labels in the interface simultaneously, and the Tab labels are respectively "all primary school students" in turn.
  • Course “Pre-class Preview", “Ancient Poetry Appreciation", “End-of-Term Review", and "I love to study the first grade"
  • the Tab label on the far right is a label that is not fully displayed.
  • the tab bar when interacting with each tab displayed in the tab bar, if the trigger is a tab that is not fully displayed, when the tab obtains the control focus, the tab bar is displayed.
  • Each tab shown in the tab moves as a whole, and the moving direction is opposite to the position of the tab in the tab column.
  • the range of movement is the width of the undisplayed part of the tab that is not fully displayed.
  • the tab on the other side is hidden or displayed in an incompletely displayed state, while the tab on this side is displayed in a fully displayed state. in the Tab column. Therefore, through this interaction process, when the user places the control focus on a tab that is not fully displayed, the user can view the specific information of the tab in time, and the user experience is good.
  • the tab that is not fully displayed can be used as the next tab.
  • the first tab displayed on a page, that is, the tab is completely displayed.
  • the controller is further configured to: obtain the number of tabs to be displayed and the current number of tabs displayed in the tab bar, where the tabs displayed in the tab bar include the fully displayed state.
  • the displayed tabs and the tabs displayed in the incomplete display state if the number of tabs is greater than the current displayed number, the page turning buttons are displayed on both sides of the tab bar, and the page turning buttons are used to trigger the page turning operation.
  • the tab bar Due to the limited display area of the tab bar, if the number of tabs to be displayed is greater than the current number of tabs displayed, the tab bar cannot display the above-mentioned tabs at the same time. In this case, the page turning buttons are displayed on both sides of the tab bar. , the page turning button is used to trigger the page turning operation.
  • a right page turning button 6203 is displayed on the right side of the Tab.
  • page turning to the left is implemented to view the tabs to be displayed in the subsequent sequence.
  • the left page turning button 6204 is displayed on the left side of the Tab.
  • page turning to the left is implemented to view the tabs to be displayed in the previous sequence.
  • the content of the next tab display page can be directly obtained and displayed in the tab bar middle. If there is an incompletely displayed tab in the tab displayed in the current tab bar, when turning the page, the incompletely displayed tab will be completely displayed at the end position of the tab bar, and the end position refers to the tab The leftmost or rightmost position of the column.
  • the controller when the page turning button is operated to perform a page turning operation on the content in the Tab column, the controller is further configured to: receive the operation on the page turning button, if there is an incompletely displayed Tab label in the Tab column, Then display the incompletely displayed tab at the end of the tab bar in a fully displayed state; if there is no incompletely displayed tab in the tab bar, according to the width of the tab bar to be displayed and the label of the undisplayed tab Width to display at least one undisplayed tab in the tab column.
  • the tab that is not fully displayed can be left when performing a page turn. Displayed in the Tab column, and displayed in a fully displayed state. In order to facilitate the user to view and ensure the display order of each tab, the tabs that are not fully displayed can be displayed at the end position of the tab bar in a fully displayed state, and the end position can be the left or right side of the tab bar. .
  • the controller when the page-to-left is performed, is further configured to perform the following step in response to the triggering of displaying the incompletely displayed Tab tab at the end position of the Tab column in a fully displayed state.
  • the page-to-left command generated by the page-turning button on the right side of the Tab bar displays the incompletely displayed Tab labels at the left end of the Tab bar in a fully displayed state, and obtains the undisplayed subsequent Tab labels;
  • the displayed subsequent tabs are displayed on the right side of the fully displayed tabs in order from left to right.
  • the incompletely displayed tab may still be displayed at the left end position of the tab bar.
  • the subsequent Tab label refers to the label located after the currently displayed Tab label according to the display order.
  • the acquisition quantity of the subsequent Tab label is determined based on the preset display width of the Tab column.
  • the specific determination method can refer to the content of the foregoing embodiment, It will not be repeated here.
  • the display order of each tab is sorted from left to right, that is, the tabs that are not fully displayed are located at the leftmost position of the tab column, and the remaining tabs are located in the incompletely displayed tabs. on the right. That is, after performing a page turn to the left, the tab labels that are not fully displayed are displayed at the left end of the tab bar, so that the left side of the tab labels that are not fully displayed is aligned with the left side of the tab bar, and the remaining subsequent tab labels are displayed in turn. Arrange display on the right.
  • FIG. 6K shows a schematic diagram of the effect of page-to-left based on the Tab column according to some embodiments.
  • 4 tabs C2, C3, C4, C5 are shown in the Tab column
  • the Tab label C5 is a tab that is not fully displayed and is located on the right side of the Tab column.
  • part (b) in FIG. 6K when the right page turning button is triggered and the page turning left is executed, the subsequent Tab labels C6 and C7 are obtained, and the labels C5, C6 and C7 are displayed in the order from left to right in the In the Tab bar, at this time, the label C5 is located at the far left of the Tab bar and is displayed completely.
  • the controller when performing a page turn to the right, is further configured to perform the following steps: in response to the triggering The page-to-right command generated by the page-turning button on the left side of the Tab bar displays the incompletely displayed Tab labels at the right end of the Tab bar in a fully displayed state, and obtains the undisplayed pre-order Tab labels; The displayed preorder tabs are displayed in order from right to left to the left of the fully displayed tabs.
  • the incompletely displayed tab may still be displayed at the right end position of the tab bar.
  • the pre-order Tab label refers to the label located before the currently displayed Tab label according to the display order, and the acquisition quantity of the pre-order Tab label is determined based on the preset display width of the Tab column.
  • the specific determination method can refer to the content of the foregoing embodiment, The difference is that the display direction is from right to left (the display direction in the foregoing embodiment is from left to right), which will not be repeated here.
  • the display order of each tab is sorted from right to left, that is, the tabs that are not fully displayed are located in the rightmost and first position of the tab column, and the remaining tabs are located in the tabs that are not fully displayed. to the left. That is, after performing a page turn to the right, the tab labels that are not fully displayed are displayed at the right end of the tab bar, so that the right side of the tab labels that are not fully displayed is aligned with the right side of the tab bar, and the remaining pre-order tab labels are displayed in turn to the right side of the tab bar. Arranged left display.
  • the incompletely displayed Tab When performing a page turn to the right, no matter whether the incompletely displayed Tab is located on the right or left side of the Tab bar, the incompletely displayed Tab will be displayed on the next tab display page of the Tab bar when the page is turned. To the far right of the tab, while displaying the previous tab, the tab that was not fully displayed can be completely displayed.
  • FIG. 6L shows a schematic diagram of the effect of turning a page to the right based on the Tab column according to some embodiments.
  • 4 tabs C10, C11, C12, C13 are displayed in the Tab column, and the Tab label C13 is an incompletely displayed tab and is located on the right side of the Tab column.
  • the pre-order Tab labels C7, C8, and C9 are obtained, and the labels C7, C8, C9, and C13 are arranged from left to right. The order is displayed in the Tab column. At this time, the label C13 is still at the far right of the Tab column and is displayed completely.
  • the page turning operation when the page turning operation is performed based on each tab displayed in the Tab column, the content acquired in the previous sequence or the subsequent sequence replaces the currently displayed content.
  • the incompletely displayed Tab tag when the page is turned, the incompletely displayed Tab tag is still fully displayed at the end of the Tab column in a fully displayed state. Therefore, when turning pages, the user can simultaneously view the specific information of the tab tags that are not fully displayed in the current page while viewing the pre-sequence or post-sequence Tab tags, and the user experience is good.
  • the virtual user interface presents Tab bars adapted to the different interaction scenarios. Then, when the corresponding Tab label is displayed in the Tab column, the display methods that can be adopted will also be different.
  • the controller when searching for a certain video media asset, in a scene where actor information is displayed, the controller is further configured to perform the following steps when displaying at least one Tab tag in the Tab column: when displaying the media asset information, generate several tab labels with different label widths based on several character information included in the media asset information, and display the character information display interface including the Tab column in the virtual user interface; based on the display order of each character information , accumulate the tab width of at least one Tab label to obtain the cumulative width; if the cumulative width is less than or equal to the preset display width of the Tab column, the Tab label corresponding to the cumulative width will be displayed in the Tab column; if the cumulative width is greater than the preset display width of the Tab column Assuming the display width, the last accumulated Tab tag corresponding to the accumulated width is used as the content of the next tab display page, and the other tab tags corresponding to the accumulated width except the last accumulated Tab tag are used as the current tab display page. The content is displayed in the Tab column.
  • the virtual user interface When searching for a certain video media asset, the virtual user interface displays media asset information, where the media asset information includes the video media asset name, character information, and the like, and the character information may be actor information. There will be multiple actors in the same video media asset, therefore, the corresponding Tab tag can be generated based on the information of each character.
  • the name of the video media asset is usually displayed at the top of the character information display interface, and a tab bar composed of multiple tabs representing actor information is displayed at the bottom of the video media asset name.
  • actor information display only the names of actors that can be fully displayed in the current background are displayed; turning the page left and right still ensures that all displayed can be fully displayed. It can be seen that in this scenario, there are only fully displayed tabs in the tab bar, and no incompletely displayed tabs.
  • the label width of each corresponding Tab label is sequentially accumulated in the order of the actor information to obtain the corresponding accumulated width.
  • the cumulative width corresponding to the n tabs is less than or equal to the preset display width of the tab bar, it means that the tab bar can fully display the n tabs, and the tab corresponding to the cumulative width is displayed in the tab bar.
  • the cumulative width corresponding to the n+1 tabs is greater than the default display width of the tab bar, it means that the tab bar cannot fully display the n+1 tabs.
  • other tabs corresponding to the accumulated width except the last accumulated Tab are displayed in the Tab column as the content of the current tab display page, that is, the first n Tabs are completely displayed in the Tab column.
  • the last accumulated Tab tag corresponding to the accumulated width is used as the content of the next tab display page, that is, the n+1th Tab tag is displayed in the next tab display page.
  • FIG. 6M shows a schematic diagram of the effect of displaying the Tab column in the character information display interface according to some embodiments.
  • FIG. 6M shows only the names of two actors are completely displayed in the current Tab column, and there is actually a third actor "Actor C".
  • the third actor information can still be completely displayed through the preset display width of the entire Tab column and the calculation of the accumulated width occupied by the actor information already displayed.
  • the above method can be used to realize that the third actor "Actor C" is displayed in the next tab display page.
  • you can also choose to turn the page, adding an arrow to the right to indicate that there are more actors, instead of only showing a part of the third actor.
  • the content provided in the foregoing embodiment may be referred to to present the remaining fully displayed actor information in the next tab display page, which will not be repeated here.
  • the search history interface that pops up during the search presents different historical search information, each historical search information corresponds to a tab, and several tabs are presented uniformly
  • historical search information can exist in the form of keywords.
  • the controller is further configured to perform the following steps when performing the display of at least one Tab label in the Tab bar: receiving an operation on the search box presented in the virtual user interface, Obtain historical search information, generate several tabs with different tab widths, and display a search history interface including a tab bar in the virtual user interface, and the tab bar includes several tab display rows; based on the time when each tab is generated In order, accumulate the tab width of at least one Tab label to obtain the cumulative width; if the cumulative width is less than or equal to the preset display width of the Tab column, the Tab label corresponding to the cumulative width will be displayed in the bottom label display row of the Tab column; if the cumulative width If it is greater than the preset display width of the Tab column, the last accumulated Tab tag corresponding to the accumulated width will be displayed in the previous tab display row of the bottom label display row, and the accumulated width corresponding to the last accumulated Tab tag other than the last accumulated Tab will be displayed. Other tabs are displayed in the bottom tab
  • the user may query the content that has been queried before.
  • the search keywords are displayed to users.
  • FIG. 6N shows a schematic diagram of presenting a search history interface in a virtual user interface according to some embodiments.
  • the user places the control focus on the search box and clicks to trigger, and the search history interface can be displayed in the search user interface.
  • historical search information generated when the user searches in a near period of time can be obtained, and the historical search information can be search keywords used by the user each time he searches for information.
  • the lengths of the search keywords are different, so that when a corresponding Tab label is generated based on each search keyword, the label width of each Tab label is different.
  • the historical search information will be displayed to the user at the same time, so that the user can quickly select a previously used search keyword to search again. Therefore, it is necessary to display all the generated tabs in a unified manner, and it is necessary to ensure that each displayed tab is in a fully displayed state.
  • the default display width of the Tab column is limited, and it is impossible to display too many Tab labels in the same row at the same time. Therefore, multiple label display rows can be displayed in the Tab column.
  • Each tab display row is arranged in sequence from top to bottom, and the display width of each tab display row is equal to the default display width of the Tab column.
  • the label display row at the bottom is used to display the earliest generated search keywords, and the label display row at the top is used to display the latest (latest) generated search keywords.
  • the tag width of at least one Tab tag is accumulated in turn to obtain the accumulated width.
  • the generation time of the Tab label is the generation time of the corresponding historical search information.
  • the cumulative width corresponding to the first n tabs is less than or equal to the default display width of the tab bar, it means that the bottom tab display row of the tab bar can completely display the n tabs, then the first n tabs corresponding to the cumulative width will be displayed. Display rows in tabs at the bottom of the tab bar.
  • the cumulative width corresponding to the n+1 tabs is greater than the default display width of the tab bar, it means that the tab display row at the bottom of the tab bar cannot fully display the n+1 tabs.
  • other tabs corresponding to the accumulated width except the last accumulated Tab are displayed in the bottom tab display row, that is, the first n tabs are completely displayed in the bottom first tab display row 6205 of the Tab column.
  • display the last accumulated Tab tag corresponding to the accumulated width in the previous tab display row of the bottom tab display row that is, display the n+1th Tab tag in the previous tab display of the bottom tab display row, that is, the second tab display Line 6206 or the third tab displays line 6207.
  • several tabs located in the same label display row are displayed in the order from left to right according to the generation time of the tabs from late to early, that is, the earliest generated tab is displayed. It is located at the far right of the label display line, and the latest generated Tab label is located at the far left of the label display line.
  • the total number of Tab tabs displayed in the Tab column is related to the number of tab display rows, the preset display width and the tab width, which are not specifically limited here.
  • the label lengths of each Tab tag are different, so that the total tab widths displayed in several tab display rows with the same preset display width are different.
  • the multi-line display method is adopted, and each line requires a complete display, and the incomplete display is automatically cut to the next display.
  • FIG. 60 shows a schematic diagram of the effect of displaying the Tab bar in the search history interface according to some embodiments.
  • the historical search information "XX”, "XXX”, and "XXXXXX” are the earliest searched contents.
  • the preset display width of the label display line it is completely displayed in one line, and it is displayed as one line, which is displayed on the bottom of the Tab bar.
  • a label is displayed in row 6205.
  • this logic by calculating the content that can be displayed and the content that has already been displayed in a row, it is judged whether the content to be displayed can still be fully displayed in this row, if it can be fully displayed, it is now in this row; otherwise, move down as a whole, A new line is displayed at the top.
  • tabs are allowed to be displayed in an incompletely displayed state, and in other scenarios, only the tabs are allowed to be displayed completely.
  • tabs that are not displayed in the Tab column can be displayed by turning pages, and in other scenarios, all tabs can be displayed in full at the same time. No matter what display method is adopted, it can facilitate user interaction and improve user experience.
  • each tab in the Tab column when a user interacts based on each tab in the Tab column, in order to better distinguish the triggering state of each tab and indicate user operation feedback, three states are defined, normal, in focus, and left, and respectively. A corresponding logo pattern is added to the corresponding tab to indicate to the user that the tab has been focused.
  • a logo pattern representing the focused state is added to the Tab.
  • the logo pattern can be highlighted. While other tabs do not have the control focus, a logo pattern representing the normal state is added to each tab, and the logo pattern in the normal state may be in a transparent form. If the control focus is moved to other tabs after the tab that has the control focus is triggered, a logo pattern representing the legacy state is added to the tab that performs the trigger operation.
  • the logo pattern of the legacy state can be a color logo or a tape Transparent rectangle with border.
  • the controller when adding an identification pattern to the Tab, is further configured to: when any one of the Tabs in the Tab column obtains the control focus, add an identification pattern 6501 representing the focus state to the Tab; if If the tab that has obtained the control focus loses the control focus after the triggering operation is not performed, then the identification pattern 6503 representing the normal state is added to the tab; Identification pattern 6502 that characterizes the legacy state.
  • the logo pattern in the focused state moves with the tab.
  • FIG. 6P shows a schematic diagram of the effect of adding a legacy status identification pattern on a Tab label according to some embodiments.
  • the tab with the control focus is "appreciation of ancient poetry”
  • the content corresponding to "appreciation of ancient poetry” is displayed in the switching virtual user interface.
  • the user leaves the control focus from the tab and falls on "I love to learn Chinese in the first grade”, then adds a logo pattern representing the legacy state to the tab "appreciation of ancient poetry", and, for The tab label "I love learning first grade Chinese” is highlighted, and the rest of the tab labels are in normal state.
  • the collision operation refers to whether the coordinates of the line intersect with the coordinates of the tab label. If they intersect, it means that the ray collides with the tab label, and it is determined that the tab label obtains the control focus.
  • a trigger operation can be performed to start the Tab label.
  • the introduction of the tab can be displayed synchronously and other information.
  • the controller when displaying the tab information, is further configured to perform the following steps: when any one of the Tab tabs in the Tab column obtains the control focus, obtain the tab information of the Tab tab. Generate a floating layer prompt box based on the label information, and display the floating layer prompt box on the side of the Tab label.
  • a floating layer prompt box is generated from the label information of the Tab label, and the floating layer prompt box is displayed on the side where the Tab label is located.
  • the label information of the tab label is displayed in the floating layer prompt box.
  • the label information includes the corresponding category, attribute or function name, and introduction information of the tab label. It is used to briefly introduce the application, so that the user does not need to trigger the tab. The specific information can be obtained to improve the user experience.
  • the three-dimensional display device provided by the embodiments of the present application can display different forms of Tab columns according to different interaction scenarios, so as to realize the dynamic display of the Tab columns. , to improve the user experience.
  • FIG. 6B shows a flowchart of a method for dynamically displaying a Tab column according to some embodiments.
  • a method for dynamically displaying a Tab column provided by an embodiment of the present application is executed by the controller in the three-dimensional display device provided by the foregoing embodiment.
  • the method includes: acquiring at least one Tab label to be displayed; if the The tab width of the Tab label is less than or equal to the to-be-displayed width of the Tab column, then the Tab label is displayed in the Tab column in a fully displayed state; if the tab width of the Tab label is greater than the to-be-displayed width of the Tab column , then the Tab label is displayed in the Tab column in an incompletely displayed state; when the incompletely displayed Tab label obtains the control focus, move each Tab label in the Tab column to the first direction, In order to display the incompletely displayed Tab in the Tab column in a fully displayed state, the first direction refers to the direction from the not fully displayed Tab to the adjacent fully displayed Tab.
  • a method for dynamically displaying a tab bar and a three-dimensional display device provided by the embodiment of the present application, when displaying several tab labels in the tab bar, according to the tab width of the tab label and the width of the tab bar to be displayed.
  • the size relationship each tab is displayed in a fully displayed state or an incompletely displayed state.
  • the incompletely displayed tabs gain the control focus, move each tab in the tab bar to the first direction to display the incompletely displayed tabs in the tab bar in a fully displayed state for the user to view.
  • the method and the three-dimensional display device provided by the embodiments of the present application combined with the free operation of the three-dimensional display device and the uncertainty of the data length of each tab label, etc., the number of tab labels displayed in the tab column is dynamically calculated according to the content of the tab label itself. , and when the incompletely displayed Tab label obtains the control focus, the incompletely displayed Tab label can be completely displayed for the user to view.
  • the three-dimensional display device is used with a handle or a touch point of the head, and the user can interact with various services provided in the virtual reality application by operating the handle or adjusting the direction of the touch point of the head.
  • the cursor in the control three-dimensional display device can be freely positioned at any position of the display window along with the handle.
  • the collision operation refers to whether the coordinates of the line intersect with the coordinates of the business or application. If they intersect, it means that the ray collides with the business or application, and it is determined that the business or application has the control focus. At this time, if the user clicks the OK key of the handle, the trigger operation can be performed.
  • FIG. 7A shows a schematic diagram of a scenario in which a user wears an operating handle of a three-dimensional display device according to some embodiments.
  • the user operates the handle 7200 by hand to interact with various services or applications provided by the virtual reality application configured in the three-dimensional display device.
  • the handle is provided with a touchpad 7201 and a button 7202, and the touchpad can be used as an application key, and click to perform a confirmation operation.
  • the button can perform single-click and double-click operations, a single-click operation performs a return action, and a double-click operation performs a main screen action.
  • some services or applications provided in virtual reality applications usually require account login before they can be used. If a user wants to start an application or service, the user needs to log in with an account first.
  • the login interface usually includes a user name input box and a password input box. If the user wants to enter a user name, click the user name input box through the handle, and the input method area will pop up synchronously. At this time, the user name input box and the input method area need to be Also displayed for user input.
  • AR devices in 3D display devices are subject to angular resolution, brightness, contrast, light transmittance, image artifacts, distortion, consistency, or non-display issues, such as: eye-friendly area, size, weight, battery, cost , durability and a series of reasons, the FOV angle of the current mainstream AR devices is generally around 40°x30°, which makes the display window of the 3D display device smaller.
  • the display window of the 3D display device is small. Under the condition that the user can clearly see the interface in the window, the display window cannot display too much content, which restricts the display area of the user's input box and the input method area, and cannot be fully displayed in the window at the same time. show. Therefore, for user operations with a large interface, for example, when a user logs in through input method input, since the input area interface and input method keyboard interface cannot be fully displayed in the window, the user needs to turn the head frequently to adjust the angle of view to see the login interface. content, the input operation can be performed. It can be seen that this operation is extremely unfriendly, which makes the account login method cumbersome and inconvenient for the user to operate, which may cause the user to abandon the login and affect the user experience.
  • the present application provides a three-dimensional display device that not only configures the traditional manual input account login method for it, but also provides a three-dimensional display device.
  • a scan code login method that does not require users to manually input.
  • the 3D display device is equipped with an extremely convenient scan code login method that does not require user input. It can be used in various types of AR/VR hardware headsets, and is also suitable for any scenario that requires account login.
  • the FOV display angle of the VR device in the three-dimensional display device is relatively large, and its display window is relatively large. It is also feasible to use the code login method in VR devices. The following describes the application of the scan code login method to an AR device as an example.
  • FIG. 7B shows a flowchart of an account login method according to some embodiments
  • FIG. 7C shows an interaction diagram of an account login method according to some embodiments.
  • an embodiment of the present application provides a three-dimensional display device, including: a virtual display configured to present a virtual user interface displaying different applications; a camera configured to capture images information; the controller connected to the virtual display and the camera respectively, when executing the account login method shown in FIG. 7B and FIG. 7C , the controller is configured to execute the following steps S701 to S703:
  • Scenarios in which the 3D display device needs to perform account login include but are not limited to account logins for various system applications and third-party applications configured in the 3D display device, as well as account logins for virtual reality applications.
  • Various system applications and third-party applications are displayed in a virtual user interface generated by the virtual reality application.
  • the user wears the three-dimensional display device and picks up the handle to operate, as shown in the scene diagram in FIG. 7A .
  • the user operates the handle to click on any application in the virtual user interface. If the application selected by the user needs to log in to the account to obtain more usage rights, but the application has not yet logged in to the account, the user needs to log in with the account.
  • FIG. 7D shows a schematic display of an account login interface according to some embodiments.
  • the account login interface 7402 pops up, and the account login interface is displayed in the virtual user interface. .
  • the three-dimensional display device provides a traditional manual input account login method, and in order to achieve fast login, the three-dimensional display device also provides a scan code login method that does not require user input.
  • the account login interface includes a manual login control and a code scanning login control, and the manual login control and the code scanning login control can be clicked and switched.
  • the manual login control is used to call up the manual login interface and display it in the account login interface.
  • the manual login interface 7403 displays the user name input box, password input box, login confirmation key, account application, skip control and other contents.
  • the scan code login control is used to call up the scan code login interface and display it in the account login interface.
  • the scan login interface includes the image display area and skip controls.
  • the user can click the manual login control or the scan code login control in the account login interface through the handle to switch the display of the manual login interface and the scan code login interface.
  • the manual login interface in the default state, when the account login interface is initially generated and displayed, the manual login interface is preferentially displayed in the account login interface by default. At this time, the account login interface also displays manual login controls and scan code login controls. If the user wants to use the scan code login method, they can click the scan code login control. At this time, the scan code login interface is switched to be displayed in the account login interface. In this scenario, if the user wants to use the manual input method again, click the manual login control. At this time, the account login interface switches back to displaying the manual login interface again.
  • S702. Receive an operation on the scan code login control, turn on the camera, and present a scan code login interface including an image display area in the account login interface, where the image display area is used to display image information collected by the camera.
  • the user can use the handle to click the scan code login control in the account login interface to log in by the scan code login method.
  • the 3D display device When using the scan code login method, in order to facilitate the scan code operation, the 3D display device needs to simultaneously turn on its configured camera, and at the same time, the switch scan code login interface is displayed in the account login interface.
  • FIG. 7E shows a schematic diagram of displaying a code scanning login interface according to some embodiments.
  • the scan code login interface 7404 is switched to display, and the scan code prompt pops up synchronously, and the scan code prompt is displayed in the display image display area 7405 of the scan code login interface, such as "Please log in the mobile phone to the two-dimensional code at the camera" etc.
  • the camera of the 3D display device is used to collect image information, such as scanning the login QR code provided by the mobile phone.
  • An image display area is displayed in the scan code login interface. After the camera is turned on, the image display area is used to display the image information collected by the camera in real time.
  • the camera in order for the user to be able to see the image information collected by the camera through the image display area when the scan code login interface is displayed, the camera needs to be turned on earlier than the scan code login interface display time, that is, when the scan code is scanned. Before the login interface is displayed, the camera has been turned on. This solution can avoid that when the camera is turned on later than the display time of the scan code login interface, the image display area does not display any content, and it is easy for users to mistakenly think that the device is faulty, such as camera failure, device display failure, etc., affecting users. experience.
  • the controller in order to ensure that the camera is turned on earlier than the display time of the scan code login interface, when the user clicks the scan code login control, the controller first generates a camera start command and sends it to the camera to activate the camera. After the camera is turned on, call up the scan code login interface for display, so that when the scan code login interface is displayed, the image display area can directly display the picture captured by the camera in real time.
  • the user clicks the scan code login control turns on the camera, and displays the scan code login interface, the user can use the camera to capture the login QR code to realize the account login of the application that he started.
  • S703 Obtain the account login information obtained by the camera and the login two-dimensional code, and log in to the account corresponding to the application based on the account login information.
  • the login two-dimensional code refers to the two-dimensional code generated by the intelligent terminal based on the configured account information for logging in to the application with the account. .
  • the camera of the 3D display device is set on the outside of the 3D display device, such as the position facing the user's forehead, so that the camera can collect the image content in front of the user's line of sight;
  • the content that can be seen realizes the effect that the content that the user sees is the image information collected by the camera.
  • FIG. 7F shows a schematic diagram of a scenario in which a camera captures a login two-dimensional code 7301 provided by a smart terminal 7300 according to some embodiments.
  • the user when scanning the code to log in, the user can move the log-in QR code to the capture range of the camera, and the camera scans the log-in QR code to obtain the account log-in information of the application that it started, and realizes the account log-in of the application. .
  • the login two-dimensional code is provided by the smart terminal, the smart terminal that provides the login two-dimensional code is configured with an application started by the three-dimensional display device, and the application configured in the smart terminal is logged in with a corresponding account, that is to say , the login QR code is generated by the smart terminal based on the configured account information for logging in to an application with an account.
  • the smart terminal may be a mobile terminal such as a mobile phone and a pad.
  • the application configured in the smart terminal is the same as the application configured in the 3D display device and needs to be activated.
  • the smart terminal is configured with the client of video application A
  • the 3D display device is also configured with the client of video application A.
  • the client of the video application A in the three-dimensional display device needs to log in to the account, it can log in by scanning the login QR code provided by the client of the video application A in the smart terminal.
  • the user needs to open the same application configured in the smart terminal. If the application in the smart terminal does not log in to the account, you need to log in to the account on the smart terminal first. In the application login account state of the smart terminal, click the login QR code control in the application to generate a login QR code, which is displayed on the display of the smart terminal.
  • the user operates the 3D display device and uses the camera to collect the login QR code provided by the smart terminal, that is, the image display area in the scan code login interface of the 3D display device is aligned with the login QR code, so that the login QR code is displayed on the In the image display area, scan the code to log in.
  • the account login operation can be performed directly without the user's second confirmation on the smart terminal side, so that the account can be quickly logged in; in other embodiments, the user may also be required to log in on the smart terminal side.
  • the second confirmation to ensure account security.
  • the scan code login method adopted by the three-dimensional display device is different from the general scan code login method, for example, different from the scan code login method of the social application B.
  • the mobile phone In the process of scanning the code to log in to the account of social application B, for example, when logging in to social application B in the web version, the mobile phone is used as the scanning terminal, and the account of social application B on the mobile phone needs to be in the logged-in state; version is not logged in.
  • the web version logs in to social application B the web version of social application B is logged in by scanning the QR code provided by the web version on the mobile terminal of the account logged in social application B.
  • the 3D display device In the account login process of the 3D display device, the 3D display device is used as the scanning terminal, and the application in the 3D display device is not logged into the account; the smart terminal is used as the scanned code terminal, and the application account in the smart terminal is in the logged-in state.
  • the 3D display device without the account login scans the login QR code provided by the smart terminal with the account logged in, so as to realize the account login of the application in the 3D display device.
  • the difference between the scan code login method of the three-dimensional display device and the general scan code login method is that in this application, the scan code end of the unregistered account scans the login QR code provided by the scanned code end of the login account to realize the scan code. code terminal account login.
  • the general scan code login method is to scan the QR code provided by the scanned code terminal without the logged-in account by the scan code terminal that has an account logged in, so as to realize the account login of the scanned code terminal.
  • the three-dimensional display device when scanning a code to log in to an account, the three-dimensional display device first needs an application login account in the smart terminal, and if not logged in, the smart terminal application will prompt the user to log in when the application generates a login QR code.
  • FIG. 7G shows a frame diagram of a smart terminal when logging into an account according to some embodiments.
  • the process of the application login account in the smart terminal is that the account SDK provides three static callback interfaces of account parameters, login status and user information, and three function invocation interfaces of login, logout and refresh token (Token).
  • Static callbacks support Add (add) and Remove (remove) operations.
  • the interaction between the account SDK and the system side (server) is realized through the unified network layer communication SDK (unified data access layer).
  • the underlying code of the SDK encapsulates DNS resolution and GSLB.
  • the uplink and downlink data signature verification method uses Appkey/Appsecret to sign, encrypt and decrypt uplink requests and downlink data.
  • the local cache management of user information is saved through the Android Shared Preferences (Android data persistence) mechanism.
  • Android Shared Preferences Android data persistence
  • the specific processing flow of the intelligent terminal based on the above framework is as follows: (1) When the App (ie, the application) is started, the callback function is first registered through the account SDK static interface, and then the account management instance is created. (2) When the account SDK is instantiated, it is determined whether to log in again or refresh the Token according to the locally cached user information. If you need to log in or fail to refresh the Token, return it through the login status callback interface registered by the App, and the App determines whether to pop up the login interface according to the status.
  • Account SDK login process each time you log in, first obtain the initial password through the query interface (this password is a global general password and maintained on the system side) and the new password strength requirements and call back the App, and the App will display the UI according to the requirements. The login result and error code need to be called back to the App. If the password needs to be changed forcibly, go to the forced change page to change the password, and the App will determine whether the new password meets the password strength requirements.
  • Account SDK Token maintenance including refresh timing and synchronization with other modules.
  • Token refresh timing (1) After each successful login: when the App starts, it is refreshed when the account instance is instantiated; it is refreshed when the network is reconnected. (2) Timed refresh: 90% of the validity period of the Token is reached, refresh the Token; when the Token is refreshed, the Refresh token will also be refreshed, and the Token within the validity period can be used. For example, refresh 10 times, as long as they are all valid, 10 can be used. (3) Refresh when abnormal: After the refresh fails, for example, the external network is blocked, the server is busy and other abnormal conditions, it will be refreshed every 1 minute. (4) The Token returned when requesting system-side data is invalid, and the Token needs to be refreshed.
  • Data synchronization mechanism synchronize to the unified data request SDK. Synchronize the callback function registered with the App.
  • the smart terminal can operate the application to generate a login two-dimensional code.
  • the smart terminal When generating the login QR code, the smart terminal obtains account information of the application, and the account information includes user name, password, UID, and the like. UID is the unique identifier of the application and its account.
  • the intelligent terminal sends a two-dimensional code generation request carrying account information to the account server.
  • the account server After the account server receives the QR code generation request, it encrypts the username and password carried in the request, and regenerates a random UID based on the UID.
  • the account server sends the encrypted user name, password, and randomly generated UID and other information to the intelligent terminal, and the application in the intelligent terminal generates the login QR code according to the data returned by the system (ie the account server) and the randomly generated UID information,
  • the data includes encrypted usernames and passwords.
  • the encrypted user name, password, and randomly generated UID are the account login information obtained by scanning the login QR code.
  • the randomly generated UID is used to guarantee the validity period of the QR code.
  • the UID is valid for 40s.
  • the system will regenerate a UID and notify the application in the smart terminal.
  • the application in the smart terminal regenerates a login QR code based on the latest data, and refreshes the login QR code.
  • the 3D display device scans the newly generated login QR code through the camera to ensure the smooth login of the application account.
  • the 3D display device scans the login QR code provided by the smart terminal through the RGB camera, obtains the encrypted user name, password, UID and other data (account login information) in the login QR code, and splices the 3D QR code at the same time. Display the local device source field of the device, send the data to the account server, and the account server will verify it, so as to realize the account login of the application in the three-dimensional display device.
  • the controller is further configured to perform the following steps when obtaining the account login information obtained by the camera to collect the login two-dimensional code, and to log in to the account corresponding to the application based on the account login information.
  • the account login information obtained by the code, and the device source field information used to represent the source of the local device; based on the account login information and the device source field information, an account login request is generated and sent to the server.
  • the account login request is used to instruct the server based on the account
  • the login information and the device source field information are used for account verification; the account verification result returned by the server in response to the account login request is received, and the application corresponding account login is realized based on the account verification result.
  • the 3D display device scans the login QR code provided by the smart terminal through the camera to obtain the account login information.
  • the account login information is generated by the smart terminal based on the account information of the application.
  • the 3D display device After obtaining the account login information in the login QR code, the 3D display device also needs to obtain the device source field information locally.
  • the device source field information is used to represent the source of the local device.
  • the device source can be understood as the end device as Devices such as 3D display devices, mobile phones or TVs.
  • the server When the 3D display device wants to log in to the application account, the server must verify that the login can be realized, so as to determine whether the application account in the smart terminal can be logged into the application of the 3D display device. Therefore, the 3D display device needs to send the account login request generated by the account login information and the device source field information to the server, and the server will perform account verification based on the account login information and the device source field information to ensure that the 3D display device can perform account login. .
  • account verification process of the server reference may be made to steps S21 to S23 and related implementation contents provided in subsequent embodiments, which will not be repeated here.
  • the server After completing the account verification, the server returns the account verification result to the 3D display device. Based on the account verification result, the application corresponding account can be logged in, that is, the application in the 3D display device logs in to the application corresponding account in the smart terminal.
  • the account verification result data is sent to the three-dimensional display device in the form of Https or Http.
  • the data transmission methods between the server and the 3D display device, between the 3D display device and the smart terminal, and between the smart terminal and the server are all transmitted in the form of Https or Http, and the information in the above information transmission uses the Json data format to transmit.
  • the specific data transmission mode may be determined according to the actual application, and is not specifically limited here. Relatively speaking, the Https transmission method is more secure than the Http transmission method.
  • the account verification result includes login success and login failure. Therefore, the three-dimensional display device can determine whether to perform the account login process based on the account verification result, that is, whether to log in to the account applied in the smart terminal.
  • the controller is further configured to perform the following steps when receiving the account verification result returned by the server in response to the account login request, and implementing the application corresponding account login based on the account verification result: after the receiving server responds to the account login request In the returned account verification result, the account verification result is parsed to obtain the account verification parameters; when the account verification parameters indicate that the login is successful, the login process of the corresponding account is executed; when the account verification parameters indicate that the login fails, no Execute the login process of the account corresponding to the application.
  • the account verification result includes account verification parameters, and the account verification parameters are used to represent whether the login succeeds or fails in the current account login process.
  • the three-dimensional display device After receiving the account verification result returned by the server, the three-dimensional display device performs json parsing to obtain account verification parameters.
  • the account verification parameters there is an identifier representing a successful login or a failed login, and based on the identifier, the corresponding interface display of successful login and login failure is performed.
  • the logon of successful login refers to the logo of allowing the application in the 3D display device to log in to the corresponding account
  • the logo of failed login refers to the logo of not allowing the application in the three-dimensional display device to log in to the corresponding account.
  • the account refers to the account of the configuration application in the smart terminal.
  • the three-dimensional display device can execute the login process of the application corresponding to the account in the smart terminal. If the identifier in the account verification parameter indicates that the current account login process is a login failure, the three-dimensional display device does not perform the login process of the application corresponding to the account in the smart terminal.
  • the controller when performing the application account login process, performs the login process of the application corresponding account when the account verification parameter indicates that the login is successful, and is further configured to perform the following steps: in the account verification parameter Indicates that when the login is successful, the user information in the account verification result is obtained; the application homepage of the application is generated based on the user information, and the application homepage is displayed in the virtual user interface.
  • the account verification parameter indicates that the login is successful, it means that the process of requesting account login by the current 3D display device can be executed, and the account applied in the smart terminal can be logged in.
  • the three-dimensional display device parses the account verification result to obtain user information.
  • User information is the data returned by the server, including avatar, nickname, rights and other information.
  • the account verification result includes user information and account verification parameters used to represent the successful login in the current account login process.
  • the three-dimensional display device executes an application startup operation based on the user information, generates an application home page, the application home page displays relevant content provided by the application and user information, and displays the application home page in the virtual user interface.
  • the interface is refreshed, the account login interface (scan code login interface) originally displayed in the virtual user interface is canceled, and the display is switched to the application home page, completing the process of application startup and account login.
  • a prompt message "login successful" may be displayed in the scan code login interface first. After the prompt information is canceled, refresh the interface, cancel the display of the scan code login interface, and display the application home page to realize application startup and account login.
  • the controller when the application account login process is not performed, does not perform the login process of the application corresponding account when the account verification parameter indicates that the login fails, and is further configured to: the account verification parameter indicates the login. When it fails, obtain the login failure information in the account verification result; generate a login failure prompt based on the login failure information, and display the login failure prompt on the QR code login interface.
  • the account verification parameter indicates that the login fails, it means that the process of requesting the account login by the current 3D display device is not executable, that is, the account corresponding to the application in the smart terminal cannot be logged in.
  • the three-dimensional display device parses the account verification result, and obtains login failure information, and the login failure information is used to represent the failure cause of the current account login failure.
  • the account verification result includes login failure information and account verification parameters used to represent the login failure in the current account login process.
  • a login failure prompt needs to be generated based on the login failure information, and the login failure prompt is displayed on the QR code login interface, and the application account login process is no longer performed.
  • a new login method is proposed, that is, the application uses the scanning code to log in way to achieve account login.
  • the account login interface including the scan code login control is presented in the virtual user interface; the scan code login control is operated, the camera is turned on, and the scan code login interface including the image display area is presented in the account login interface. ; Use the camera to scan the login QR code provided by the smart terminal, obtain the account login information obtained after scanning the login QR code, and realize the application account login based on the account login information.
  • the three-dimensional display device provided by the present application provides a scan code login method, which does not require manual input by the user.
  • the account login of the application in the three-dimensional display device can be quickly realized. The operation is convenient and convenient, and the user experience is good.
  • FIG. 7H shows another flowchart of an account login method according to some embodiments.
  • An embodiment of the present application provides a server, including: a memory configured to store registered account information of an account corresponding to an application; a controller connected to the memory, when executing the account login method shown in FIG. 7H , the controller is configured as The following steps S711 to S713 are performed:
  • the account login request carries the account login information and the device source field information.
  • the account login information refers to the information provided by the 3D display device scanning the smart terminal.
  • the information obtained after logging in to the QR code refers to the QR code generated by the smart terminal based on the configured account information for logging in to the application with an account, and the device source field information is used to characterize the source of the device.
  • an account login scenario is generated.
  • the 3D display device needs to use its configured camera to scan the login QR code provided by the smart terminal.
  • the login QR code is generated based on the account information of the application with an account configured in the smart terminal.
  • the application configured in the smart terminal is the same as The applications that need to be activated in the three-dimensional display device are the same. After scanning, the three-dimensional display device can obtain the account login information of the application in the smart terminal.
  • the 3D display device In order to realize the account login of the application, the 3D display device needs to verify the account login information obtained by it to ensure the smooth progress of the login process. The verification process is performed by the server. Therefore, the three-dimensional display device obtains its device source field information, generates an account login request based on the device source field information and account login information, and sends it to the server.
  • the server for implementing account verification may be an account server.
  • the account server parses the account login request to obtain account login information and device source field information carried in the account login request.
  • Account login information refers to the information obtained after the 3D display device scans the login QR code provided by the smart terminal.
  • the login QR code refers to the QR code generated by the smart terminal based on the configured account information for logging in to the application with an account.
  • the source field information is used to characterize the source of the device.
  • the server After receiving the account login request sent by the 3D display device, the server can verify the account login information to determine whether the account applied in the smart terminal can be logged into the application of the 3D display device, that is, to determine whether the login process is successful. , to ensure the smooth progress of the account login process and improve the user experience.
  • the server responds to the account login request sent by the 3D display device, and obtains the account login information and device source field information carried in the account login request to perform account verification, and obtain the account verification result.
  • the account verification result includes two kinds of results: login success and login failure. Therefore, the three-dimensional display device can determine whether to perform the account login process based on the account verification result, that is, determine whether to log in to the account applied in the smart terminal.
  • the controller when the controller performs account verification based on the account login information and the device source field information, and obtains the account verification result, the controller is further configured to perform the following step E: acquiring the registered account information corresponding to the application, comparing Whether the registered account information and account login information are consistent; if the registered account information and account login information are inconsistent, the login failure information and account verification parameters used to characterize the login failure are generated.
  • the account verification parameters of the login failure if the registered account information and the account login information are consistent, based on the device source field information, determine whether the account allows the application in the 3D display device to log in; when the account allows the application in the 3D display device to log in, User information for performing account login and account verification parameters for indicating successful login are generated, and the account verification result includes user information and account verification parameters for indicating successful login.
  • the server verifies the account login information carried in the account login request sent by the 3D display device and the device source field information, it first compares the user name and password based on the account login information to determine whether the 3D display device needs to log in to the account. It is the same as the account applied in the smart terminal.
  • the user When an application registers an account, the user will create a corresponding account, that is, a user name and password, and send it to the server for storage. Therefore, when the server performs account verification, the registered account information of the application can be obtained from the memory.
  • the server In order to ensure that the server can accurately obtain the registered account information corresponding to the application that needs to be started in the three-dimensional display device, it may be obtained based on the UID in the account login information.
  • Account login information includes encrypted user name, password, UID and other data, and UID is used to uniquely identify the application and its account.
  • the server parses the account login information to obtain the encrypted user name, password, and UID. If the three-dimensional display device needs to be activated and the application for account login has an account registered, the server may obtain the registered account information of the corresponding application based on the UID.
  • the account login information corresponding to the application for which the 3D display device needs to be activated and the account is logged in is consistent with the registered account information at the time of registration, it means that the account login process can be performed, that is, the 3D display
  • the application in the device can log in to the account of the application in the smart terminal. If the 3D display device needs to be activated and the account login information corresponding to the application for account login is inconsistent with the registered account information at the time of registration, it means that the account login process is abnormal and cannot be performed, that is, the application in the 3D display device cannot be logged into the smart terminal. account in the application.
  • login failure information and an account used to represent the login failure are generated.
  • the account verification result includes login failure information and account verification parameters used to represent the login failure.
  • the account verification parameter used to represent the login failure includes a login failure identifier
  • the login failure identifier refers to an identifier that does not allow the application in the three-dimensional display device to log in to the corresponding account.
  • the login failure information is used to represent the failure reason of the account login failure, such as account inconsistency, network abnormality, etc.
  • the three-dimensional display device can perform account login.
  • the same account can log in to different devices for multi-terminal login; and for the same device, the same account can only log in to one device. Therefore, in order to determine whether the same device as the 3D display device has already logged in the account (that is, the account applied in the smart terminal), it is necessary to determine whether the device has already logged in the account (that is, the smart terminal) according to the device source field information.
  • the account of the application in the terminal that is, to determine whether the account (that is, the account of the application in the smart terminal) allows the login of the application in the three-dimensional display device that sends the account login request.
  • the account When the account allows the application in the 3D display device to log in, it indicates that the application in the 3D display device that sent the account login request can log in to the account, and then the user information used for account login and the account verification parameters used to indicate successful login are generated. .
  • the account verification result includes user information and account verification parameters used to indicate successful login.
  • the user information is data returned by the server, including avatars, nicknames, rights and interests and other information.
  • the account verification parameter used to represent the successful login includes an identifier representing the successful login, and the identifier of the successful login refers to the identifier that allows the application in the three-dimensional display device to log in to the corresponding account.
  • the controller determines whether the account allows the application in the three-dimensional display device to log in based on the device source field information.
  • the controller is further configured to perform the following steps: based on the device source field information, determine the three-dimensional device that sends the account login request.
  • Display the source of the target device of the device obtain the user status of other devices with the same source as the target device, and judge whether the application in the corresponding other device has an account based on the user status; if the application in the other device is logged in; The account number is generated, and an identifier that allows the application in the three-dimensional display device to log in to the account number is generated.
  • the device source field information is used to identify the source, ie type, of different devices.
  • the account has been logged in, then obtain other devices with the same source as the target device, and obtain the user status of the other device.
  • the user status can represent the login account of the corresponding device. information.
  • other devices with the same source as its target device are also 3D display devices. If it is a mobile phone, other devices with the same source as its target device are also mobile phones.
  • the account information logged in each other device can be determined. If the account information logged in by one of the other devices is consistent with the account information corresponding to the application configured in the smart terminal, it means that the application in the other device is logged in with the account. In this case, the three-dimensional display device that sends the account login request cannot directly perform account login.
  • the 3D display device that sends the latest account login request can log in to the account based on the login principle that accounts give priority to the latest request. At this time, it is necessary to log out the account in other devices that have logged into the account, so as to realize the top number login of the three-dimensional display device that sends the account login request.
  • the 3D display device that sends the account login request can realize the current account login process. Therefore, after the top number login operation, the corresponding generation allows the application in the three-dimensional display device to log in to the account. ID of the account.
  • the 3D display device that sends the account login request can directly perform the normal account login process. Therefore, in this scenario, an identifier that allows the application in the three-dimensional display device to log in to the account can be directly generated.
  • the server performs account verification based on the account login request sent by the three-dimensional display device, and can obtain two account verification results including login success and login failure.
  • the account verification result representing successful login enables the 3D display device to continue the subsequent account login process; the account verification result representing the login failure enables the 3D display device to no longer perform the subsequent account login process.
  • the server After obtaining the account verification result based on the aforementioned method, the server sends the account verification result to the three-dimensional display device, and the three-dimensional display device executes the corresponding account login process based on the content in the account verification result.
  • the three-dimensional display device executes the corresponding account login process based on the content in the account verification result.
  • the embodiment of the present application provides a server that, when the three-dimensional display device needs to perform account login of a corresponding application, responds to the account login request sent by the three-dimensional display device, and performs the process based on the account login information and device source field information carried in the account login request.
  • the account verification is performed to obtain the account verification result; the account verification result is sent to the three-dimensional display device, so that the three-dimensional display device realizes the login of the corresponding account of the application based on the account verification result.
  • the account verification result includes two kinds of results: login success and login failure.
  • the account verification result representing the successful login enables the 3D display device to continue the subsequent account login process; the account verification result representing the login failure can make the 3D display device no longer Perform subsequent account login procedures.
  • the server provided in this application performs account verification on the account login information of the corresponding application provided by the smart terminal when the three-dimensional display device uses the scan code login method for account login, and when the verification is passed, the three-dimensional display device can be allowed to execute
  • the normal account login process ensures the normal progress of the account login process.
  • an account login method, a three-dimensional display device, and a server provided by the embodiments of the present application in order to solve the problem that the traditional account login method requires user operation and the display window is small and inconvenient, the present application adopts scanning code.
  • the login method realizes account login.
  • the account login interface including the scan code login control is presented in the virtual user interface; the scan code login control is operated, the camera is turned on, and the scan code login interface including the image display area is presented in the account login interface. ;Use the camera to scan the login QR code provided by the smart terminal, obtain the account login information obtained by scanning the login QR code, and send it to the server for account verification.
  • the application account login is realized based on the account login information. It can be seen that the method, the three-dimensional display device and the server provided by the embodiments of the present application provide a scan code login method, without the need for manual input by the user, by scanning the login two-dimensional code provided by the intelligent terminal configured with the corresponding application, the three-dimensional display device can be quickly realized The account login of the application is convenient and convenient to operate, and the user experience is good.

Abstract

在虚拟的用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,在主视角底部区域呈现包括不同属性应用的应用切换区。显示主页采用正交布局方式,可保证所有页面布局均在舒适体验范围内进行操作。交互时,触发显示主页中任一个页面将其切换至主视角中心线对应的位置显示。触发导航栏中任一个导航按钮,为其添加与操作对应的标识图案。触发应用切换区中任一个应用进行应用启动。该方法及三维显示设备,利用三维空间特点和视觉特点,采用正交布局方式生成虚拟用户界面,该虚拟用户界面中的内容均在用户的主视角范围内,提高交互体验。

Description

用户界面的布局、交互方法及三维显示设备
本申请要求在2020年10月19日提交的、申请号为202011119774.8、发明名称为“一种实现虚拟现实应用的显示设备”;2021年03月26日提交的、申请号为202110324509.1、发明名称为“一种虚拟用户界面的布局、交互方法及三维显示设备”;2021年04月02日提交的、申请号为202110361156.2、发明名称为“一种虚拟用户界面中应用图标的展示方法及三维显示设备”;2021年03月26日提交的、申请号为202110324732.6、发明名称为“一种Tab栏的动态展示方法及三维显示设备”;2021年04月02日提交的、申请号为202110360910.0、发明名称为“一种内容搜索方法及三维显示设备”;2021年06月09日提交的、申请号为202110640803.3、发明名称为“一种账号登录方法及三维显示设备、服务器”的中国专利申请的优先权,其全部内容通过引用结合在本公开中。
技术领域
本申请涉及智能设备制造技术领域,尤其涉及一种用户界面的布局、交互方法及三维显示设备。
背景技术
VR(Virtual Reality,虚拟现实)或AR(Augmented Reality,增强现实)是可以创建和体验虚拟世界的计算机仿真系统,它利用计算机生成一种模拟环境,使用户沉浸到该环境中。VR设备和AR设备也可统称为三维显示设备。
在利用三维显示设备进行沉浸体验时,三维显示设备内配置虚拟现实应用,并在启动虚拟现实应用时呈现显示有多个可实现不同功能的控件的虚拟用户界面。由于三维显示设备的空间为三维空间,不同于传统的二维空间。因此,对于虚拟用户界面的布局和交互方式,不同于电视、手机等平面显示设备。在对虚拟用户界面进行布局和交互时,若将传统的二维空间布局方式简单移植到三维空间,将会导致交互困难,布局不科学引发用户视角变化时与预期不符的不适感等,影响用户体验。
发明内容
本申请提供了用户界面的布局、交互方法及三维显示设备,以解决虚拟用户界面在交互时体验不好的问题。
第一方面,本申请提供了一种三维显示设备,包括:虚拟显示器,被配置为呈现虚拟用户界面;与所述虚拟显示器连接的控制器,所述控制器被配置为:响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。
可选的,所述控制器在执行所述在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,被进一步配置为:获取用于实现不同推荐内容展示的多个内容推荐数据以及用于实现不同导航功能的多个导航功能数据;基于多个所述内容推荐数据生成包括多个页面的显示主页,将所述显示主页显示在内容推荐区;基于多个所述导航功能数据生成包括多个导航按钮的导航栏,将所述导航栏显示在内容推荐区,所述导航栏显示在所述显示主页的下方,一个导航按钮对应一个导航功能数据。
可选的,所述控制器在执行所述将所述显示主页显示在内容推荐区,被进一步配置为:在所述内容推荐区以正交页面布局方式进行页面显示时,获取正多边形边数,在主视角方向上人眼与页面之间的预设景深距离,相邻两个页面之间的预设页面间距,以及,所述显示主页中进行显示的页面数量;基于所述预设景深距离、预设页面间距和正多边形边数,在所述内容推荐区生成用于进行正交页面布局的正多边形,所述正多边形为透明状态;将所述显示主页中进行显示的多个页面呈现在所述正多边形的指定边上,所述指定边的数量与所述显示主页中进行显示的页面数量相等。
可选的,所述控制器在执行所述将所述显示主页中进行显示的多个页面呈现在所述正多边形的指定边上,被进一步配置为:所述显示主页包括主页面、左侧页面、右侧页面、左侧隐藏页面和右侧隐藏页面,所述正多边形的指定边包括中间指定边、左侧指定边、右侧指定边、左侧隐藏指定边和右侧隐藏指定边;将所述左侧页面显示在左侧指定边上,将所述主页面显示在中间指定边上,将所述右侧页面显示在右侧指定边上,所述中间指定边为主视角中心线对应的指定边,所述左侧指定边位于所述中间指定边的左侧,所述右侧指定边位于中间指定边的右侧;将所述左侧隐藏页面设置在左侧隐藏指定边上,所述左侧隐藏指定边位于所述左侧指定边的左侧,所述左侧隐藏页面用于缓存所述左侧页面的前一页面的内容推荐数据,所述左侧隐藏页面不进行显示;将所述右侧隐藏页面设置在右侧隐藏指定边上,所述右侧 隐藏指定边位于所述右侧指定边的右侧,所述右侧隐藏页面用于缓存所述右侧页面的后一页面的内容推荐数据,所述右侧隐藏页面不进行显示。
可选的,所述控制器被进一步配置为:在所述正多边形的指定边上呈现包括内容推荐数据的页面时,响应于触发所述右侧指定边上的页面时产生的页面选择指令,将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧指定边的页面向左移动至中间指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示;响应于触发所述左侧指定边上的页面时产生的页面选择指令,将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧指定边的页面向右移动至中间指定边上,将位于左侧隐藏指定边的隐藏页面向右移动至左侧指定边上并进行显示。
可选的,所述控制器被进一步配置为:在基于所述导航栏切换不同的导航按钮时,如果每个导航按钮均未获得控制焦点,则为每个所述导航按钮均添加表征正常状态的标识图案;如果其中一个导航按钮获得控制焦点,则为所述导航按钮添加表征获焦状态的标识图案;如果其中一个导航按钮获得触发操作后又丢失控制焦点,则为所述导航按钮添加表征遗留状态的标识图案。
可选的,所述控制器在执行所述在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区,被进一步配置为:所述不同属性应用包括系统推荐应用和本地安装应用;在所述系统推荐应用的当前数量为零时,生成包括翻页显示区的应用切换区,所述翻页显示区用于显示本地安装应用;在所述系统推荐应用的当前数量不为零时,生成包括固定显示区、翻页显示区和间隔标记的应用切换区,所述固定显示区用于显示系统推荐应用,所述翻页显示区用于显示本地安装应用,所述间隔标记位于所述固定显示区和翻页显示区之间。
可选的,所述控制器被进一步配置为:在所述系统推荐应用的当前数量不为零时,获取所述固定显示区的可配置应用的预设数量;如果所述系统推荐应用的当前数量小于或等于可配置应用的预设数量,则在所述固定显示区显示系统推荐应用,在所述翻页显示区显示本地安装应用;如果所述系统推荐应用的当前数量大于可配置应用的预设数量时,计算配置应用超出数量,以及,在所述固定显示区显示与可配置应用的预设数量对应的系统推荐应用,在所述翻页显示区显示本地安装应用和配置应用超出数量对应的系统推荐应用。
可选的,所述控制器被进一步配置为:在所述翻页显示区显示数个应用时,获取所述翻页显示区的可显示应用总数量和当前显示应用的总数量;如果所述当前显示应用的总数量大于可显示应用总数量,则基于所述当前显示应用的总数量对应的应用生成应用列表,所述应用包括可显示的本地安装应用和配置应用超出数量对应的系统推荐应用;按照所述应用列表在所述翻页显示区呈现所述可显示应用总数量对应的应用,以及,在所述翻页显示区的两侧显示翻页按钮,所述翻页按钮用于触发所述应用列表中的应用显示在所述翻页显示区。
可选的,所述控制器被进一步配置为:响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角顶部区域呈现消息推荐入口,所述消息推荐入口用于实现消息推荐,所述消息推荐入口为通过三维动画形式呈现的区域。
第二方面,本申请提供了一种三维显示设备,包括:虚拟显示器,被配置为呈现虚拟用户界面;与所述虚拟显示器连接的控制器,所述控制器被配置为:响应于触发虚拟现实应用时产生的应用启动指令,生成包括显示主页、导航栏和应用切换区的虚拟用户界面;在基于所述显示主页进行页面切换时,响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示;在基于所述导航栏进行导航按钮切换时,响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案;在基于所述应用切换区进行应用切换时,响应于触发所述应用切换区中任一个应用时产生的应用切换指令,启动所述应用。
可选的,所述控制器在执行所述响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示,被进一步配置为:在所述显示主页以正交页面布局方式进行页面显示时,所述显示主页中的每个页面显示在实现正交页面布局方式的正多边形的指定边上,所述指定边包括用于显示页面的中间指定边、左侧指定边和右侧指定边,以及,用于隐藏页面的左侧隐藏指定边和右侧隐藏指定边,所述中间指定边为主视角中心线对应的指定边;响应于触发所述右侧指定边上的页面时产生的页面选择指令,将位于右侧指定边的页面向左移动至中间指定边上,以及,将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示;响应于触发所述左侧指定边上的页面时产生的页面选择指令,将位于左侧指定边的页面向右移动至中间指定边上,以及,将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧隐藏指定边的隐藏页面向右移动至左侧指定边上并进行显示。
可选的,所述控制器在执行所述响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案,被进一步配置为:在基于所述导航栏切换不同的导航按钮时,如果每个导航按钮均未获得控制焦点,则为每个所述导航按钮均添加与所述操作对应的表征正常状态的标识图案;响应于触发所述导航栏中任一个导航按钮时产生的表征获得控制焦点的导航选择指令,为所述导航按钮添加与所述操作对应的表征获焦状态的标识图案;响应于触发所述导航栏中任一个导航按钮时产生的表征获得触发操作后又丢失控制焦点的导航选择指令,为所述导航按钮添加与所述操作对应的表征遗留状态的标识图案。
第三方面,本申请提供了一种虚拟用户界面的布局方法,所述方法包括:响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。
第四方面,本申请提供了一种虚拟用户界面的交互方法,所述方法包括:响应于触发虚拟现实应用时产生的应用启动指令,生成包括显示主页、导航栏和应用切换区的虚拟用户界面;在基于所述显示主页进行页面切换时,响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示;在基于所述导航栏进行导航按钮切换时,响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案;在基于所述应用切换区进行应用切换时,响应于触发所述应用切换区中任一个应用时产生的应用切换指令,启动所述应用。
第五方面,本申请提供了一种三维显示设备,包括:虚拟显示器,被配置为呈现包括应用切换区的虚拟用户界面;与所述虚拟显示器连接的控制器,所述控制器被配置为:响应于触发虚拟现实应用时产生的应用启动指令,获取需要展示的第一应用和第二应用,以及,用于表征本端是否配置有推荐展示功能的系统配置信息;如果所述系统配置信息表征本端未配置有推荐展示功能,则在所述应用切换区加载包括翻页展示位的第一模板界面,在所述翻页展示位展示第一应用的图标,以及,在接收到移动指令时,所述翻页展示位中展示的图标向所述移动指令所指示的方向移动;如果所述系统配置信息表征本端配置有推荐展示功能,则在所述应用切换区加载包括固定展示位和翻页展示位的第二模板界面,在所述固定展示位展示所述第二应用的图标,在所述翻页展示位展示所述第一应用的图标,以及,在接收到移动指令时,所述固定展示位中的图标不动,所述翻页展示位中的图标向所述移动指令所指示的方向移动。
可选的,所述控制器在根据所述系统配置信息判断本端是否配置有推荐展示功能,被进一步配置为:获取所述系统配置信息中的所述第二应用的当前展示数量和系统配置的固定展示位的配置数量;如果所述固定展示位的配置数量为零,则确定所述系统配置信息表征本端未配置有推荐展示功能;如果所述第二应用的当前展示数量为零,则将所述固定展示位的配置数量设置为零,以及,确定所述系统配置信息表征本端未配置有推荐展示功能;如果所述固定展示位的配置数量不为零,以及,所述第二应用的当前展示数量不为零,则确定所述系统配置信息表征本端配置有推荐展示功能。
可选的,所述控制器被进一步配置为:在所述应用切换区加载包括固定展示位和翻页展示位的第二模板界面时,在所述固定展示位和翻页展示位之间展示间隔标记,所述间隔标记用于区分第一应用和第二应用。
可选的,所述控制器被进一步配置为:在所述应用切换区加载包括翻页展示位的第一模板界面的情况下,获取所述系统配置信息中的所述第二应用的当前展示数量;如果所述第二应用的当前展示数量不为零,则在所述翻页展示位展示所述第一应用的图标和所述第二应用的图标。
可选的,所述控制器在执行所述在所述固定展示位展示所述第二应用的图标,在所述翻页展示位展示所述第一应用的图标,被进一步配置为:在所述应用切换区加载包括固定展示位和翻页展示位的第二模板界面时,获取所述系统配置信息中的固定展示位的配置数量和第二应用的当前展示数量;如果所述第二应用的当前展示数量小于或等于所述固定展示位的配置数量,则在所述固定展示位上展示第二应用的图标,在所述翻页展示位上展示第一应用的图标;如果所述第二应用的当前展示数量大于所述固定展示位的配置数量,则计算推荐应用超出数量,以及,在所述固定展示位展示与所述固定展示位的配置数量对应的第二应用,在所述翻页展示位展示第一应用的图标和推荐应用超出数量对应的第二应用的图标。
可选的,所述控制器在执行所述在所述固定展示位展示所述第二应用的图标,在所述翻页展示位展示所述第一应用的图标,被进一步配置为:在所述应用切换区加载包括固定展示位和翻页展示位的第二模板界面时,获取所述第二应用的热度值和所述第一应用的历史使用时间;根据每个所述第二应用的热度值的大小顺序,依次将对应的第二应用的图标展示在每个固定展示位上;根据每个所述第一应用的历史使用时间的由晚至早的时间顺序,依次将对应的第一应用的图标展示在每个翻页展示位上。
可选的,所述控制器在执行所述在所述翻页展示区展示所述第一应用的图标和所述第二应用的图标,被进一步配置为:获取所述系统配置信息中的翻页展示位的配置数量和指定应用的总应用数量,所述指 定应用包括所述第一应用和需要在翻页展示位展示的第二应用;如果所述翻页展示位的配置数量大于或等于指定应用的总应用数量,则由每个翻页展示位依次加载所述第二应用的图标和第一应用的图标;如果所述翻页展示位的配置数量小于指定应用的总应用数量,则基于所述第二应用和第一应用的顺序生成应用列表;将所述应用列表中的与所述总应用数量对应的指定应用展示在翻页展示位,以及,在所述应用切换区的两侧显示翻页按钮,所述翻页按钮用于触发所述应用列表中的指定应用展示在所述翻页展示位。
可选的,所述控制器在执行所述在所述翻页展示区展示所述第一应用的图标和所述第二应用的图标,被进一步配置为:在所述应用切换区加载包括固定展示位和翻页展示位的第二模板界面,以及,存在需要在翻页展示位展示的第二应用的图标时,获取所述第二应用的热度值和所述第一应用的历史使用时间;根据每个所述第二应用的热度值的大小顺序,依次将对应的第二应用的图标展示在位列前端的翻页展示位上,以及,根据每个所述第一应用的历史使用时间的由晚至早的时间顺序,依次将对应的第一应用的图标展示在位列后端的翻页展示位上,所述第一应用的图标展示在第二应用的图标的右侧。
可选的,所述控制器在执行所述在所述翻页展示区展示所述第一应用的图标和所述第二应用的图标,被进一步配置为:在所述应用切换区加载包括翻页展示位的第一模板界面,以及,存在需要在翻页展示位展示的第二应用的图标时,获取所述第二应用的热度值和所述第一应用的历史使用时间;根据每个所述第二应用的热度值的大小顺序,依次将对应的第二应用的图标展示在位列前端的翻页展示位上,以及,根据每个所述第一应用的历史使用时间的由晚至早的时间顺序,依次将对应的第一应用的图标展示在位列后端的翻页展示位上,所述第一应用的图标展示在第二应用的图标的右侧。
第六方面,本申请提供了一种虚拟用户界面中应用图标的展示方法,所述方法包括:响应于触发虚拟现实应用时产生的应用启动指令,获取需要展示的第一应用和第二应用,以及,用于表征本端是否配置有推荐展示功能的系统配置信息;如果所述系统配置信息表征本端未配置有推荐展示功能,则在所述应用切换区加载包括翻页展示位的第一模板界面,在所述翻页展示位展示第一应用的图标,以及,在接收到移动指令时,所述翻页展示位中展示的图标向所述移动指令所指示的方向移动;如果所述系统配置信息表征本端配置有推荐展示功能,则在所述应用切换区加载包括固定展示位和翻页展示位的第二模板界面,在所述固定展示位展示所述第二应用的图标,在所述翻页展示位展示所述第一应用的图标,以及,在接收到移动指令时,所述固定展示位中的图标不动,所述翻页展示位中的图标向所述移动指令所指示的方向移动。
第七方面,本申请提供了一种三维显示设备,包括:虚拟显示器,被配置为呈现展示有搜索按钮的虚拟用户界面;与所述虚拟显示器连接的控制器,所述控制器被配置为:接收对所述搜索按钮的操作,在所述虚拟用户界面中展示包括输入框的搜索初始界面;在进行初始搜索时,获取与所述输入框中输入的目标文本对应的内容搜索结果,基于所述内容搜索结果生成搜索结果界面,将所述搜索结果界面展示在所述虚拟用户界面中;在进行连续搜索时,获取与所述输入框中输入的连续文本对应的新内容搜索结果,将所述新内容搜索结果展示在搜索结果界面中,所述连续文本包括目标文本和新输入的文本。
可选的,所述控制器在执行所述接收对所述搜索按钮的操作,在所述虚拟用户界面中展示包括输入框的搜索初始界面,被进一步配置为:响应于触发所述搜索按钮的内容搜索指令,发送搜索数据请求至服务器,所述搜索数据请求用于指示所述服务器获取热门搜索数据和历史搜索数据;接收所述服务器返回的热门搜索数据和历史搜索数据,在所述虚拟用户界面中生成包括输入框、历史记录展示区和热门搜索展示区的搜索初始界面,所述热门搜索展示区用于展示所述热门搜索数据,所述历史记录展示区用于展示历史搜索数据,所述输入框用于输入触发搜索过程的目标文本。
可选的,所述控制器被进一步配置为:响应于触发所述热门搜索展示区中的一个热门搜索数据的选中操作,发送携带内容ID的内容详情请求至服务器,所述内容详情请求用于指示所述服务器查询与所述内容ID对应的内容详情信息,所述内容ID用于表征所述热门搜索数据;接收所述服务器返回的与所述内容ID对应的内容详情信息,在所述虚拟用户界面中生成内容详情界面,所述内容详情界面中展示所述内容详情信息。
可选的,所述控制器被进一步配置为:响应于触发所述历史记录展示区中的一个历史搜索数据的选中操作,发送内容搜索请求至服务器,所述内容搜索请求用于指示所述服务器查询与选中的历史搜索数据对应的内容搜索结果;接收所述服务器返回的与选中的历史搜索数据对应的内容搜索结果,在所述虚拟用户界面中生成搜索结果界面,所述搜索结果界面中展示所述内容搜索结果。
可选的,所述控制器在执行所述在进行初始搜索时,获取与所述输入框中输入的目标文本对应的内容搜索结果,被进一步配置为:在进行初始搜索时,接收对所述输入框的操作,在所述搜索初始界面中展示搜索键盘,所述搜索键盘位于所述输入框的下方;接收基于所述搜索键盘输入的目标文本,发送内容搜索请求至服务器,所述内容搜索请求用于指示所述服务器查询与目标文本对应的内容搜索结果,所 述目标文本显示在所述输入框中;接收所述服务器返回的与目标文本对应的内容搜索结果。
可选的,所述控制器被进一步配置为:在基于所述搜索键盘输入目标文本时,发送联想词获取请求至服务器,所述联想词获取请求用于指示所述服务器查询与所述目标文本对应的联想词;接收所述服务器返回的与所述目标文本对应的联想词,生成联想词列表,所述联想词列表以浮层的形式展示在所述搜索初始界面的上层。
可选的,所述控制器被进一步配置为:在基于联想词进行搜索时,响应于触发所述联想词列表中的一个联想词的选中操作,发送内容搜索请求至服务器,所述内容搜索请求用于指示所述服务器查询与选中的联想词对应的内容搜索结果;接收所述服务器返回的与选中的联想词对应的内容搜索结果,所述选中的联想词展示在所述输入框中。
可选的,所述控制器在执行所述在进行连续搜索时,获取与所述输入框中输入的连续文本对应的新内容搜索结果,被进一步配置为:在进行连续搜索时,接收基于展示有目标文本的输入框输入的新文本,发送内容搜索请求至服务器,所述内容搜索请求用于指示所述服务器查询与连续文本对应的新内容搜索结果,所述连续文本包括目标文本和新文本,所述连续文本显示在所述输入框中;接收所述服务器返回的与连续文本对应的新内容搜索结果。
可选的,所述控制器被进一步配置为:在所述输入框中展示连续文本时,发送联想词获取请求至服务器,所述联想词获取请求用于指示所述服务器查询与所述连续文本对应的联想词;接收所述服务器返回的与所述连续文本对应的联想词,生成联想词列表,所述联想词列表以浮层的形式展示在所述搜索结果界面的上层。
可选的,所述控制器被进一步配置为:在进行初始搜索或者连续搜索时,接收对所述搜索初始界面中语音输入框的操作,在所述虚拟用户界面中展示语音输入界面;接收用户输入的语音文本,将所述语音文本展示在所述语音输入界面中;发送内容搜索请求至服务器,所述内容搜索请求用于指示所述服务器查询与语音文本对应的内容搜索结果;接收所述服务器返回的与语音文本对应的内容搜索结果,展示在搜索结果界面中。
可选的,所述控制器被进一步配置为:在未接收到用户输入的语音文本时,在所述语音输入界面中展示异常操作提示信息;接收用户基于所述异常操作提示信息后输入的新语音文本,基于所述新语音文本执行内容搜索过程。
第八方面,本申请提供了一种内容搜索方法,所述方法包括:接收对搜索按钮的操作,在虚拟用户界面中展示包括输入框的搜索初始界面;在进行初始搜索时,获取与所述输入框中输入的目标文本对应的内容搜索结果,基于所述内容搜索结果生成搜索结果界面,将所述搜索结果界面展示在所述虚拟用户界面中;在进行连续搜索时,获取与所述输入框中输入的连续文本对应的新内容搜索结果,将所述新内容搜索结果展示在搜索结果界面中,所述连续文本包括目标文本和新输入的文本。
第九方面,本申请提供了一种三维显示设备,包括:虚拟显示器,被配置为呈现展示有Tab栏的虚拟用户界面;与所述虚拟显示器连接的控制器,所述控制器被配置为:获取待展示的至少一个Tab标签;如果所述Tab标签的标签宽度小于或等于Tab栏的待展示宽度,则将所述Tab标签以完全显示状态展示在所述Tab栏中;如果所述Tab标签的标签宽度大于所述Tab栏的待展示宽度,则将所述Tab标签以未完全显示状态展示在所述Tab栏中;在所述未完全显示的Tab标签获得控制焦点时,向第一方向移动所述Tab栏中的每个Tab标签,以将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏中,所述第一方向是指从未完全显示的Tab标签至相邻的完全显示的Tab标签的方向。
可选的,所述控制器在执行所述在所述未完全显示的Tab标签获得控制焦点时,向第一方向移动所述Tab栏中的每个Tab标签,被进一步配置为:如果所述未完全显示的Tab标签位于所述Tab栏的右侧,则在所述未完全显示的Tab标签获得控制焦点时,将位于所述Tab栏左侧的Tab标签向左移动隐藏或以未完全显示状态展示,以及,将所述未完全显示的Tab标签向左移动以完全显示状态展示在所述Tab栏的右侧位置,所述第一方向为向左移动方向;如果所述未完全显示的Tab标签位于所述Tab栏的左侧,则在所述未完全显示的Tab标签获得控制焦点时,将位于所述Tab栏右侧的Tab标签向右移动隐藏或以未完全显示状态展示,以及,将所述未完全显示的Tab标签向右移动以完全显示状态展示在所述Tab栏的左侧位置,所述第一方向为向右移动方向。
可选的,所述控制器在执行所述将位于所述Tab栏左侧的Tab标签向左移动隐藏或以未完全显示状态展示,被进一步配置为:基于位于Tab栏右侧的所述未完全显示的Tab标签的左侧坐标位置和标签宽度,计算所述未完全显示的Tab标签的未显示部分宽度;在所述Tab栏中展示的所有Tab标签向左移动所述未显示部分宽度的距离时,从所述Tab栏左侧开始依次累积Tab栏中展示的每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度;如果所述累积宽度小于或等于未显示部分宽度,则将所述累积宽度对应的至少一个Tab标签隐藏;如果所述累积宽度大于未显示部分宽度,则将所述累积宽度对应的 最后一个累积的Tab标签以未完全显示状态展示在所述Tab栏的左侧位置,所述最后一个累积的Tab标签的展示宽度为对应的标签宽度与所述未显示部分宽度的差值。
可选的,所述控制器在执行所述将位于所述Tab栏右侧的Tab标签向右移动隐藏或以未完全显示状态展示,被进一步配置为:基于位于Tab栏左侧的所述未完全显示的Tab标签的右侧坐标位置和标签宽度,计算所述未完全显示的Tab标签的未显示部分宽度;在所述Tab栏中展示的所有Tab标签向右移动所述未显示部分宽度的距离时,从所述Tab栏右侧开始依次累积Tab栏中展示的每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度;如果所述累积宽度小于或等于未显示部分宽度,则将所述累积宽度对应的至少一个Tab标签隐藏;如果所述累积宽度大于未显示部分宽度,则将所述累积宽度对应的最后一个累积的Tab标签以未完全显示状态展示在所述Tab栏的右侧位置,所述最后一个累积的Tab标签的展示宽度为对应的标签宽度与所述未显示部分宽度的差值。
可选的,所述控制器被进一步配置为:获取待展示的所述Tab标签的标签数量和所述Tab栏中展示的Tab标签的当前展示数量,所述Tab栏中展示的Tab标签包括以完全显示状态展示的Tab标签和以未完全显示状态展示的Tab标签;如果所述标签数量大于所述当前展示数量,则在所述Tab栏的两侧展示翻页按钮,所述翻页按钮用于触发翻页操作。
可选的,所述控制器被进一步配置为:接收对所述翻页按钮的操作,如果所述Tab栏中存在未完全显示的Tab标签,则将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏的端部位置;如果所述Tab栏中不存在未完全显示的Tab标签,则按照所述Tab栏的待展示宽度和未展示的Tab标签的标签宽度,将至少一个未展示的Tab标签展示在所述Tab栏中。
可选的,所述控制器在执行所述将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏的端部位置,被进一步配置为:响应于触发所述Tab栏右侧翻页按钮产生的向左翻页指令,将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏的左侧端部位置,以及,获取未展示的后序Tab标签;将所述未展示的后序Tab标签按从左至右的顺序依次展示在完全显示的Tab标签的右侧。
可选的,所述控制器在执行所述将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏的端部位置,被进一步配置为:响应于触发所述Tab栏左侧翻页按钮产生的向右翻页指令,将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏的右侧端部位置,以及,获取未展示的前序Tab标签;将所述未展示的前序Tab标签按从右至左的顺序依次展示在完全显示的Tab标签的左侧。
可选的,所述控制器被进一步配置为:在所述Tab栏中的任一个Tab标签获得控制焦点时,获取所述Tab标签的标签信息;基于所述标签信息生成浮层提示框,将所述浮层提示框展示在所述Tab标签所在位置的一侧。
第十方面,本申请提供了一种Tab栏的动态展示方法,所述方法包括:获取待展示的至少一个Tab标签;如果所述Tab标签的标签宽度小于或等于Tab栏的待展示宽度,则将所述Tab标签以完全显示状态展示在所述Tab栏中;如果所述Tab标签的标签宽度大于所述Tab栏的待展示宽度,则将所述Tab标签以未完全显示状态展示在所述Tab栏中;在所述未完全显示的Tab标签获得控制焦点时,向第一方向移动所述Tab栏中的每个Tab标签,以将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏中,所述第一方向是指从未完全显示的Tab标签至相邻的完全显示的Tab标签的方向。
第十一方面,本申请提供了一种三维显示设备,包括:虚拟显示器,被配置为呈现显示有不同应用的虚拟用户界面;摄像头,被配置为采集图像信息;分别与所述虚拟显示器和所述摄像头连接的控制器,所述控制器被配置为:接收对所述虚拟用户界面中任一应用的操作,在所述虚拟用户界面中呈现包括扫码登录控件的账号登录界面;接收对所述扫码登录控件的操作,开启所述摄像头,以及,在所述账号登录界面中呈现包括图像显示区的扫码登录界面,所述图像显示区用于显示所述摄像头采集的图像信息;获取所述摄像头采集登录二维码得到的账号登录信息,基于所述账号登录信息登录所述应用对应的账号,所述登录二维码是指由智能终端基于配置的登录有所述账号的所述应用的账号信息生成的二维码。
可选的、根据权利要求1所述的三维显示设备,所述控制器在执行所述获取所述摄像头采集登录二维码得到的账号登录信息,基于所述账号登录信息登录所述应用对应的账号,被进一步配置为:获取所述摄像头采集所述智能终端提供的登录二维码得到的账号登录信息,以及,用于表征本端设备来源的设备来源字段信息;基于所述账号登录信息和设备来源字段信息,生成账号登录请求,发送至服务器,所述账号登录请求用于指示所述服务器基于所述账号登录信息和设备来源字段信息进行账号校验;接收所述服务器响应所述账号登录请求后返回的账号校验结果,基于所述账号校验结果实现所述应用对应账号的登录。
可选的、根据权利要求2所述的三维显示设备,所述控制器在执行所述接收所述服务器响应所述账号登录请求后返回的账号校验结果,基于所述账号校验结果实现所述应用对应账号的登录,被进一步配置为:接收所述服务器响应所述账号登录请求后返回的账号校验结果,对所述账号校验结果进行解析, 得到账号校验参数;在所述账号校验参数表征登录成功时,执行所述应用对应账号的登录过程;在所述账号校验参数表征登录失败时,不执行所述应用对应账号的登录过程。
可选的、根据权利要求3所述的三维显示设备,所述控制器在执行所述在所述账号校验参数表征登录成功时,执行所述应用对应账号的登录过程,被进一步配置为:在所述账号校验参数表征登录成功时,获取所述账号校验结果中的用户信息;基于所述用户信息生成所述应用的应用主页,将所述应用主页显示在所述虚拟用户界面中。
可选的,所述控制器在执行所述在所述账号校验参数表征登录失败时,不执行所述应用对应账号的登录过程,被进一步配置为:在所述账号校验参数表征登录失败时,获取所述账号校验结果中的登录失败信息;基于所述登录失败信息生成登录失败提示,将所述登录失败提示显示在所述扫码登录界面中。
第十二方面,本申请提供了一种服务器,包括:存储器,被配置为存储有应用对应账号的注册账号信息;与所述存储器连接的控制器,所述控制器被配置为:在三维显示设备进行应用的账号登录时,接收所述三维显示设备发送的账号登录请求,所述账号登录请求中携带账号登录信息和设备来源字段信息,所述账号登录信息是指由所述三维显示设备扫描智能终端提供的登录二维码后获得的信息,所述登录二维码是指由智能终端基于配置的登录有所述账号的所述应用的账号信息生成的二维码,所述设备来源字段信息用于表征设备来源;响应于所述账号登录请求,基于所述账号登录信息和设备来源字段信息进行账号校验,得到账号校验结果;将所述账号校验结果发送至所述三维显示设备,以使所述三维显示设备基于所述账号校验结果实现所述应用对应账号的登录。
可选的,所述控制器在执行所述基于所述账号登录信息和设备来源字段信息进行账号校验,得到账号校验结果,被进一步配置为:获取所述应用对应的注册账号信息,对比所述注册账号信息和所述账号登录信息是否一致;如果所述注册账号信息和所述账号登录信息对比不一致,则生成登录失败信息和用于表征登录失败的账号校验参数,所述账号校验结果包括登录失败信息和用于表征登录失败的账号校验参数;如果所述注册账号信息和所述账号登录信息对比一致,则基于所述设备来源字段信息,确定所述账号是否允许所述三维显示设备中的应用登录;在所述账号允许所述三维显示设备中的应用登录时,生成用于进行账号登录的用户信息和用于表征登录成功的账号校验参数,所述账号校验结果包括用户信息和用于表征登录成功的账号校验参数。
可选的,所述控制器在执行所述基于所述设备来源字段信息,确定所述账号是否允许所述三维显示设备中的应用登录,被进一步配置为:基于所述设备来源字段信息,确定发送所述账号登录请求的三维显示设备的目标设备来源;获取与所述目标设备来源相同的其他设备的用户状态,基于所述用户状态判断对应其他设备中的应用是否登录有所述账号;如果所述其他设备中的应用登录有所述账号,则将所述其他设备中的应用登录的账号退出,以及,生成允许三维显示设备中的应用登录所述账号的标识;如果其他设备未登录有所述账号,则生成允许三维显示设备中的应用登录所述账号的标识。
第十三方面,本申请提供了一种账号登录方法,应用于三维显示设备,所述方法包括:接收对虚拟用户界面中任一应用的操作,在所述虚拟用户界面中呈现包括扫码登录控件的账号登录界面;接收对所述扫码登录控件的操作,开启所述摄像头,以及,在所述账号登录界面中呈现包括图像显示区的扫码登录界面,所述图像显示区用于显示所述摄像头采集的图像信息;获取所述摄像头采集登录二维码得到的账号登录信息,基于所述账号登录信息登录所述应用对应的账号,所述登录二维码是指由智能终端基于配置的登录有所述账号的所述应用的账号信息生成的二维码。控制所述显示设备虚拟应用的用户界面显示于所述显示器、AR\VR眼镜。
可选的,所述用户界面包括全局UI,所述全局UI可包括推荐内容区域、业务分类扩展区域、应用快捷操作入口区域以及悬浮物区域。
可选的,所述应用快捷操作入口区域还包括个性化入口,设置于应用快捷操作入口区域的左右边缘侧位置。
可选的,所述悬浮物区域配置在固定区域左右斜侧上方,可配置为可替换形象、或跳转链接。
可选的,所述全局UI还包括状态栏,用于显示时间、网络连接状态、电量状态、及更多快捷操作入口。
可选的,所述显示设备还包括手柄,所述手柄对AR/VR终端的用户界面进行操作,包括返回按钮、主页按钮、音量加减按钮、触摸区域。
可选的,所述显示设备还包括手机端VR助手,所述手机端VR助手与显示设备蓝牙未连接无法设置WIFI时,用户界面将显示提示信息。
可选的,所述显示设备还包括语音助手,所述语音助手可实施为虚拟形象入囗。
可选的,所述显示设备的电量不足20%、10%、5%时,用户界面将显示弹窗提示。
附图说明
图1A中示出了一些实施例中显示设备与控制装置之间操作场景的示意图;
图1B中示出了一些实施例中显示设备200的硬件配置框图;
图1C中示出了一些实施例中控制设备100的硬件配置框图;
图1D中示出了一些实施例中显示设备200的功能配置示意图;
图1E中示出了一些实施例中显示设备200中软件配置示意图;
图1F中示出了一些实施例中显示设备200中应用程序的配置示意图;
图2A示出了根据一些实施例的三维显示设备的虚拟用户界面的全局示意图;
图3A示出了根据一些实施例的虚拟用户界面中内容推荐区的示意图;
图3B示出了根据一些实施例的正交页面布局方式的示意图;
图3C示出了根据一些实施例的基于传统方式对页面进行交互时的展示效果图;
图3D示出了根据一些实施例的显示主页采用正交布局方式的一种示意图;
图3E示出了根据一些实施例的显示主页采用正交布局方式的另一种示意图;
图3F示出了根据一些实施例的交互时显示主页中的页面向右移动的展示效果图;
图3G示出了根据一些实施例的交互时显示主页中的页面向左移动的展示效果图;
图3H示出了根据一些实施例的导航栏在交互时的展示效果图;
图3I示出了根据一些实施例的应用切换区在交互时的展示效果图;
图3J示出了根据一些实施例的翻页显示区在进行翻页交互时的展示效果图;
图3K示出了根据一些实施例的应用切换区在进行翻页交互时的展示效果图;
图3L示出了根据一些实施例的虚拟用户界面的交互方法的流程图;
图4A示出了根据一些实施例的虚拟用户界面中应用图标的展示方法的流程图;
图4B示出了根据一些实施例的本端未配置有推荐展示功能时翻页显示区的展示效果图;
图4C示出了根据一些实施例的本端配置有推荐展示功能时应用切换区的展示效果图;
图4D示出了根据一些实施例的翻页显示区在进行翻页交互时的一种展示效果图;
图4E示出了根据一些实施例的应用切换区在进行翻页交互时的一种展示效果图;
图4F示出了根据一些实施例的翻页显示区在进行翻页交互时的另一种展示效果图;
图4G示出了根据一些实施例的应用切换区在进行翻页交互时的另一种展示效果图;
图4H示出了根据一些实施例的应用切换区展示应用信息的展示效果图;
图4I示出了根据一些实施例的应用切换区在交互时的展示效果图;
图5A示出了根据一些实施例的内容搜索方法的流程图;
图5B示出了根据一些实施例的内容搜索方法的时序图;
图5C示出了根据一些实施例的内容搜索方法的数据流图;
图5D示出了根据一些实施例的虚拟用户界面主页的示意图;
图5E示出了根据一些实施例的搜索初始页面的示意图;
图5F示出了根据一些实施例的基于搜索初始页面进行搜索的示意图;
图5G示出了根据一些实施例的内容详情界面的示意图;
图5H示出了根据一些实施例的搜索结果界面的示意图;
图5I示出了根据一些实施例的基于搜索键盘输入目标文本的示意图;
图5J示出了根据一些实施例的基于目标文本生成的搜索结果界面的示意图;
图5K示出了根据一些实施例的联想词列表的示意图;
图5L示出了根据一些实施例的基于搜索结果界面执行滑动翻页操作的效果示意图;
图5M示出了根据一些实施例的语音输入界面的示意图;
图5N示出了根据一些实施例的语音输入界面在收音步骤的示意图;
图5O示出了根据一些实施例的语音输入界面在识别步骤的示意图;
图5P示出了根据一些实施例的展示异常操作提示信息的语音输入界面的示意图;
图6A示出了根据一些实施例的大数据信息组成的Tab栏的展示示意图;
图6B示出了根据一些实施例的Tab栏的动态展示方法的流程图;
图6C示出了根据一些实施例的Tab栏的区域示意图;
图6D示出了根据一些实施例的Tab标签以完全显示状态进行展示的示意图;
图6E示出了根据一些实施例的Tab标签以未完全显示状态进行展示的示意图;
图6F示出了根据一些实施例的Tab栏展示数个Tab标签的示意图;
图6G示出了根据一些实施例的计算未显示部分宽度的一种示意图;
图6H示出了根据一些实施例的计算未显示部分宽度的另一种示意图;
图6I示出了根据一些实施例的Tab栏中存在未完全显示的Tab标签的效果示意图;
图6J示出了根据一些实施例的触发Tab栏中存在的未完全显示的Tab标签的效果示意图;
图6K示出了根据一些实施例的基于Tab栏进行向左翻页的效果示意图;
图6L示出了根据一些实施例的基于Tab栏进行向右翻页的效果示意图;
图6M示出了根据一些实施例的在人物信息展示界面中展示Tab栏的效果示意图;
图6N示出了根据一些实施例的虚拟用户界面中呈现搜索历史界面的示意图;
图6O示出了根据一些实施例的在搜索历史界面中展示Tab栏的效果示意图;
图6P示出了根据一些实施例的在Tab标签上添加遗留状态标识图案的效果示意图;
图7A示出了根据一些实施例的用户佩戴三维显示设备操作手柄的场景示意图;
图7B示出了根据一些实施例的账号登录方法的一种流程图;
图7C示出了根据一些实施例的账号登录方法的交互图;
图7D示出了根据一些实施例的账号登录界面的显示示意图;
图7E示出了根据一些实施例的扫码登录界面的显示示意图;
图7F示出了根据一些实施例的摄像头采集智能终端提供的登录二维码的场景示意图;
图7G示出了根据一些实施例的登录账号时智能终端的框架图;
图7H示出了根据一些实施例的账号登录方法的另一种流程图。
具体实施方式
使本申请示例性实施例的目的、技术方案和优点更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施例中的技术方案进行清楚、完整地描述,显然,所描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。
基于本申请中示出的示例性实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。此外,虽然本申请中公开内容按照示范性一个或几个实例来介绍,但应理解,可以就这些公开内容的各个方面也可以单独构成一个完整技术方案。
应当理解,本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,例如能够根据本申请实施例图示或描述中给出那些以外的顺序实施。
本申请中使用的术语“遥控器”,是指电子设备(如本申请中公开的显示设备)的一个组件,通常可在较短的距离范围内无线控制电子设备。一般使用红外线和/或射频(RF)信号和/或蓝牙与电子设备连接,也可以包括WiFi、无线USB、蓝牙、动作传感器等功能模块。例如:手持式触摸遥控器,是以触摸屏中用户界面取代一般遥控装置中的大部分物理内置硬键。
本申请中使用的术语“手势”,是指用户通过一种手型的变化或手部运动等动作,用于表达预期想法、动作、目的/或结果的用户行为。
图1A中示出了一些实施例中显示设备与控制装置之间操作场景的示意图。如图1A中示出,用户可通过移动终端300、AR/VR眼镜500和控制装置100操作显示设备200。
其中,控制装置100可以遥控器,包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,以无线或其他有线方式来控制显示设备200。在一些实施例中,也可以使用移动终端、平板电脑、计算机、笔记本电脑、和其他智能设备以控制显示设备200。例如,使用在智能设备上运行的应用程序控制显示设备200。该应用程序通过配置可以在与智能设备关联的屏幕上,在直观的用户界面(UI)中为用户提供各种控制。
示例的,移动终端300可与显示设备200安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作的和数据通信的目的。
如图1A中还示出,显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。显示设备200,可以液晶显示器、OLED显示器、投影显示设备。具体显示设备类型,尺寸大小和分辨率等不作限定,本领技术人员可以理解的是,显示设备200可以根据需要做性能和配置上一些改变。
显示设备200除了提供广播接收电视功能之外,还可以附加提供计算机支持功能的智能网络电视功能。示例的包括,网络电视、智能电视、互联网协议电视(IPTV)等。
图1B中示出了根据示例性实施例中显示设备200的硬件配置框图。如图1B中示出,显示设备200中包括控制器210、调谐解调器220、通信接口230、检测器240、输入\输出接口250、视频处理器261,音频处理器262,显示器280,音频输出270、存储器290,供电电源、红外接收器。
显示器280,用于接收源自视频处理器261输入的图像信号,进行显示视频内容和图像以及菜单操控界面的组件。显示器280包括用于呈现画面的显示屏组件,以及驱动图像显示的驱动组件。显示视频内容,可以来自广播电视内容,也可以是说,可通过有线或无线通信协议接收的各种广播信号。或者,可显示来自网络通信协议接收来自网络服务器端发送的各种图像内容。
显示器280,同时显示显示设备200中产生且用于控制显示设备200的用户操控UI界面。
以及,根据显示器280类型不同,还包括用于驱动显示的驱动组件。或者,倘若显示器280为一种投影显示器,还可以包括一种投影装置和投影屏幕。
通信接口230是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如:通信接口230可以是Wifi芯片231,蓝牙通信协议芯片232,有线以太网通信协议芯片233等其他网络通信协议芯片或近场通信协议芯片,以及红外接收器(图中未示出)。
显示设备200可以通过通信接口230与外部控制设备或内容提供设备之间建立控制信号和数据信号发送和接收。以及,红外接收器,可用于接收控制装置100(如:红外遥控器等)红外控制信号的接口器。
检测器240,是显示设备200用于采集外部环境或与外部交互的信号。检测器240包括光接收器242,用于采集环境光线强度的传感器,可以通过采集环境光可以自适应性显示参数变化等。
以及包括图像采集器241,如相机、摄像头等,可以用于采集外部环境场景,以及用于采集用户的属性或与用户交互手势,可以自适应变化显示参数,也可以识别用户手势,以实现与用户之间互动的功能。
在其他一些示例性实施例中,检测器240,还可温度传感器等,如通过感测环境温度,显示设备200可自适应调整图像的显示色温。如当温度偏高的环境时,可调整显示设备200显示图像色温偏冷色调,或当温度偏低的环境时,可以调整显示设备200显示图像偏暖色调。
在其他一些示例性实施例中,检测器240,包括声音采集器等,如麦克风,可以用于接收用户的声音,包括用户控制显示设备200的控制指令的语音信号,或采集环境声音,用于识别环境场景类型,显示设备200可以自适应适应环境噪声。
输入/输出接口250,在控制器210的控制显示设备200与外部其他设备间数据传输。如接收外部设备的视频信号和音频信号、或命令指令等数据。
其中,输入/输出接口250可以包括,但不限于如下:可以高清多媒体接口HDMI接口251、模拟或数据高清分量输入接口253、复合视频输入接口252、USB输入接口254、RGB端口(图中未示出)等任一个或多个接口。
在其他一些示例性实施例中,输入/输出接口250也可以上述多个接口形成复合性的输入/输出接口。
在一些示例性实施例中,调谐解调器220也可在外置设备中,如外置机顶盒等。这样,机顶盒通过调制解调后输出电视音视频信号,经过输入/输出接口250输入显示设备200中。
视频处理器261,用于将接收外部视频信号,根据输入信号的标准编解码协议进行处理,可得到直接可显示设备200上显示或播放的信号。
音频处理器262,用于接收外部的音频信号,根据输入信号的标准编解码协议进行处理,得到可以在扬声器中播放的声音信号。
在其他一些示例性实施例中,视频处理器261可以包括一颗或多颗芯片组成。音频处理器262,也可以包括一颗或多颗芯片组成。
以及,在其他一些示例性实施例中,视频处理器261和音频处理器262,可以单独的芯片,也可以于控制器210一起集成在一颗或多颗芯片中。
音频输出272,在控制器210的控制下接收音频处理器262输出的声音信号,如:扬声器272,以及除了显示设备200自身携带的扬声器272之外,可以输出至外接设备的发生装置的外接音响输出端子274,如:外接音响接口或耳机接口等。
供电电源,在控制器210控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电电源可以包括安装显示设备200内部的内置电源电路,也可以是安装在显示设备200外部电源,在显示设备200中提供外接电源的电源接口。
用户输入接口,用于接收用户的输入信号,然后,将接收用户输入信号发送给控制器210。用户输入信号可以是通过红外接收器接收的遥控器信号,可以通过网络通信模块接收各种用户控制信号。
示例的,用户通过遥控器100或移动终端300输入用户命令,用户输入接口则根据用户的输入,显示设备200则通过控制器210响应用户的输入。
在一些实施例中,用户可在显示器280上显示的图形用户界面(GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入 用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。
控制器210,通过存储在存储器290上中各种软件控制程序,来控制显示设备200的工作和响应用户的操作。
如图1B所示,控制器210包括RAM213和ROM214以及图形处理器216、CPU处理器212、通信接口218,如:第一接口218-1、第二接口218-2到第n接口218-n,以及通信总线。其中,RAM213和ROM214以及图形处理器216、CPU处理器212、通信接口218通过总线相连接。
ROM213,用于存储各种系统启动的指令。如在收到开机信号时,显示设备200电源开始启动,CPU处理器212运行ROM中系统启动指令,将存储在存储器290的操作系统拷贝至RAM213中,以使开始运行启动操作系统。当操作系统启动完成后,CPU处理器212再将存储器290中各种应用程序拷贝至RAM213中,然后,开始运行启动各种应用程序。
图形处理器216,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等。包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象。以及包括渲染器,产生基于运算器得到的各种对象,进行渲染的结果显示在显示器280上。
CPU处理器212,用于执行存储在存储器290中操作系统和应用程序指令。以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最终显示和播放各种音视频内容。
在一些示例性实施例中,CPU处理器212,可以包括多个处理器。多个处理器可包括一个主处理器以及多个或一个子处理器。主处理器,用于在预加电模式中执行显示设备200一些操作,和/或在正常模式下显示画面的操作。多个或一个子处理器,用于在待机模式等状态下一种操作。
控制器210可以控制显示设备100的整体操作。例如:响应于接收到用于选择在显示器280上显示UI对象的用户命令,控制器210便可以执行与由用户命令选择的对象有关的操作。
其中,所述对象可以是可选对象中的任何一个,例如超链接或图标。与所选择的对象有关操作,例如:显示连接到超链接页面、文档、图像等操作,或者执行与所述图标相对应程序的操作。用于选择UI对象用户命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。
存储器290,包括存储用于驱动显示设备200的各种软件模块。如:存储器290中存储的各种软件模块,包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等。
其中,基础模块用于产后护理显示设备200中各个硬件之间信号通信、并向上层模块发送处理和控制信号的底层软件模块。检测模块用于从各种传感器或用户输入接口中收集各种信息,并进行数模转换以及分析管理的管理模块。
例如:语音识别模块中包括语音解析模块和语音指令数据库模块。显示控制模块用于控制显示器280进行显示图像内容的模块,可以用于播放多媒体图像内容和UI界面等信息。通信模块,用于与外部设备之间进行控制和数据通信的模块。浏览器模块,用于执行浏览服务器之间数据通信的模块。服务模块,用于提供各种服务以及各类应用程序在内的模块。
同时,存储器290还用存储接收外部数据和用户数据、各种用户界面中各个项目的图像以及焦点对象的视觉效果图等。
图1C中示出了根据示例性实施例中控制设备100的配置框图。如图1C所示,控制设备100包括控制器110、通信接口130、用户输入/输出接口140、存储器190、供电电源180。
控制设备100被配置为控制显示设备200,以及可接收用户的输入操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起用用户与显示设备200之间交互中介作用。如:用户通过操作控制设备100上频道加减键,显示设备200响应频道加减的操作。
在一些实施例中,控制设备100可是一种智能设备。如:控制设备100可根据用户需求安装控制显示设备200的各种应用。
在一些实施例中,如图1A所示,移动终端300或其他智能电子设备,可在安装操控显示设备200的应用之后,可以起到控制设备100类似功能。如:用户可以通过安装应用,在移动终端300或其他智能电子设备上可提供的图形用户界面的各种功能键或虚拟按钮,以实现控制设备100实体按键的功能。
控制器110包括处理器112和RAM113和ROM114、通信接口218以及通信总线。控制器110用于控制控制设备100的运行和操作,以及内部各部件之间通信协作以及外部和内部的数据处理功能。
通信接口130在控制器110的控制下,实现与显示设备200之间控制信号和数据信号的通信。如:将接收到的用户输入信号发送至显示设备200上。通信接口130可包括WiFi芯片131、蓝牙模块132、NFC模块133等其他近场通信模块中至少之一种。
用户输入/输出接口140,其中,输入接口包括麦克风141、触摸板142、传感器143、按键144等其他输入接口中至少一者。输出接口包括将接收的用户指令发送至显示设备200的接口。在一些实施例 中,可以红外接口,也可以是射频接口。在一些实施例中,控制设备100包括通信接口130和输出接口中至少一者。控制设备100中配置通信接口130,如:WiFi、蓝牙、NFC等模块,可将用户输入指令通过WiFi协议、或蓝牙协议、或NFC协议编码,发送至显示设备200.
存储器190,用于在控制器110的控制下存储驱动和控制控制设备200的各种运行程序、数据和应用。存储器190,可以存储用户输入的各类控制信号指令。
供电电源180,用于在控制器110的控制下为控制设备100各元件提供运行电力支持。可以电池及相关控制电路。
图1D中示出了根据示例性实施例中显示设备200功能配置示意图。如图1D所示,存储器290用于存储操作系统、应用程序、内容和用户数据等,在控制器210控制下执行驱动显示设备200的系统运行以及响应用户的各种操作。存储器290可以包括易失性和/或非易失性存储器。
存储器290,具体用于存储驱动显示设备200中控制器210的运行程序,以及存储显示设备200内置各种应用程序,以及用户从外部设备下载的各种应用程序、以及与应用相关各种图形用户界面,以及与图形用户界面相关的各种对象,用户数据信息,以及各种支持应用的内部数据。存储器290用于存储OS内核、中间件和应用等系统软件,以及存储输入的视频数据和音频数据、及其他用户数据。
存储器290,具体用于存储音视频处理器261和262、显示器280、通信接口230、调谐解调器220、检测器240输入/输出接口等驱动程序和相关数据。
在一些实施例中,存储器290可以存储软件和/或程序,用于表示操作系统(OS)的软件程序包括,例如:内核、中间件、应用编程接口(API)和/或应用程序。示例的,存储器290,包括广播接收模块2901、频道控制模块2902、音量控制模块2903、图像控制模块2904、显示控制模块2905、音频控制模块2906、外部指令识别模块2907、通信控制模块2908、光接收模块2909、电力控制模块2910、操作系统2911、以及其他应用程序2912、浏览器模块等等。控制器210通过运行存储器290中各种软件程序,来执行诸如:广播电视信号接收解调功能、电视频道选择控制功能、音量选择控制功能、图像控制功能、显示控制功能、音频控制功能、外部指令识别功能、通信控制功能、光信号接收功能、电力控制功能、支持各种功能的软件操控平台、以及浏览器功能等其他应用。
图1E中示出了根据示例性实施例中显示设备200中软件系统的配置框图。
如图1E中所示,操作系统2911,包括用于处理各种基础系统服务和用于实施硬件相关任务的执行操作软件,充当应用程序和硬件组件之间完成的数据处理的媒介。一些实施例中,部分操作系统内核可以包含一系列软件,用以管理显示设备硬件资源,并为其他程序或软件代码提供服务。
其他一些实施例中,部分操作系统内核可包含一个或多个设备驱动器,设备驱动器可以是操作系统中的一组软件代码,帮助操作或控制显示设备关联的设备或硬件。驱动器可以包含操作视频、音频和/或其他多媒体组件的代码。示例的,包括显示屏、摄像头、Flash、WiFi和音频驱动器。
其中,可访问性模块2911-1,用于修改或访问应用程序,以实现应用程序的可访问性和对其显示内容的可操作性。
通信模块2911-2,用于经由相关通信接口和通信网络与其他外设的连接。
用户界面模块2911-3,用于提供显示用户界面的对象,以供各应用程序可访问,可实现用户可操作性。
控制应用程序2911-4,用于可控制进程管理,包括运行时间应用程序等。
事件传输系统2914,可在操作系统2911内或应用程序2912中实现,以一些实施例中,一方面在在操作系统2911内实现,同时在应用程序2912中实现,用于监听各种用户输入事件,将根据各种事件指代响应各类事件或子事件的识别结果,而实施一组或多组预定义的操作的处理程序。
其中,事件监听模块2914-1,用于监听用户输入接口输入事件或子事件。
事件识别模块2914-2,用于对各种用户输入接口输入各类事件的定义,识别出各种事件或子事件,且将其传输给处理用以执行其相应一组或多组的处理程序。
其中,事件或子事件,是指显示设备200中一个或多个传感器检测的输入,以及外界控制设备(如控制设备100等)的输入。如:语音输入各种子事件,手势识别的手势输入,以及控制设备的遥控按键指令输入的子事件等。示例的,遥控器中一个或多个子事件包括多种形式,包括但不限于按键按上/下/左右/、确定键、按键按住等中一个或组合。以及非实体按键的操作,如移动、按住、释放等操作。
界面布局管理器2913,直接或间接接收来自于事件传输系统2914监听到各用户输入事件或子事件,用于更新用户界面的布局,包括但不限于界面中各控件或子控件的位置,以及容器的大小或位置、层级等与界面布局相关各种执行操作。
如图1F中所示,应用程序层2912包含也可在显示设备200执行的各种应用程序。应用程序可包含但不限于一个或多个应用程序,如:直播电视应用程序、视频点播应用程序、媒体中心应用程序、应用 程序中心、游戏应用等。
本申请实施例可以应用于各种类型的显示设备(包括但不限于:智能电视、AR/AR/VR终端等设备)。下文将就实现虚拟现实的显示设备及相关各种虚拟现实应用的操作UI对技术方案进行阐述。本申请各个实施例中的中实现虚拟现实的显示设备又可以被称为虚拟现实设备或三维显示设备,其可以包括VR设备或AR设备或其他能够实现显示功能的设备或设备组合。
在利用三维显示设备进行沉浸体验时,三维显示设备内配置虚拟现实应用,并在启动虚拟现实应用时在虚拟空间中呈现虚拟用户界面,即在用户佩戴三维显示设备进行沉浸体验时,在用户的眼前呈现虚拟用户界面。虚拟用户界面中展示可实现不同业务需求的功能控件,每个业务需求对应一种功能,业务需求例如首页推荐、导航等;首页推荐页面中的2D影视、教育课程、旅游、3D、360度全景、直播、4K影视、程序应用、游戏、旅游等。
三维显示设备提供三维场景的沉浸式体验,使得三维显示设备的空间为三维空间,不同于传统的二维空间。因此,对于虚拟用户界面的布局和交互方式,不同于电视、手机等平面显示设备,三维显示设备具有控件立体布局的能力,不再局限于眼前的一张平面,而是可以在上下左右前后的360度空间内灵活布局,并随着人的头部转动看到不同的界面。
在对虚拟用户界面进行布局和交互时,为了避免将传统的二维空间布局方式简单移植到三维空间,导致的交互困难,布局不科学引发用户视角变化时与预期不符的不适感等问题,影响用户体验,可根据人的视觉特点提供不同的布局,从而提升用户体验。该布局方式旨在充分利用三维空间特点和人的视觉特点进行布局和交互,使得所有布局均在舒适体验范围内进行操作。
由于虚拟用户界面显示在三维虚拟空间内,为根据人眼的视觉特点可在三维空间内承载不同的内容,可将虚拟用户界面的全局界面整体布局围绕人眼主视角进行区域划分。其中,主视角是指用户人眼在未转动头部时可以看到的范围,三维显示设备的主视角可以理解为设备能够展示的图像范围。
根据空间布局的优势,可以在一个界面中展示更多的信息,因此,根据空间位置和人体工学特点划分功能区域,不同的功能区显示不同的内容,从而实现一次可以科学地显示更多内容。
图2A示出了根据一些实施例的三维显示设备的虚拟用户界面的全局示意图。如图2A所示,全局界面按照人眼主视角进行划分的区域包括:主视角区域、主视角顶部区域、主视角底部区域、主视角左侧区域和右侧区域。
主视角区域展示的是最为频繁使用的功能,即用户可使用的媒资、应用和游戏等。主视角左、右侧区域是次级方便操作的区域,用于主视角区域功能扩展。不同于二维空间内人眼视角有限的缺陷,难以在水平方向观看清楚超大视角范围内的内容。但是对于立体空间则不同,在主视角区域的两侧分别设置主视角左侧区域和右侧区域,可通过正交布局可以很方便地看到左右两侧的内容。
主视角顶部区域为常用提示信息展示区包括时间、网络、电量等信息,主视角底部区域为应用快捷入口,可实现应用切换启动。同时,在空间范围内,虚拟用户界面还支持三维模型动画展示,用于运营信息展示和入口。
在用户佩戴三维显示设备,并启动三维显示设备内配置的虚拟现实应用后,在虚拟空间中呈现虚拟用户界面。虚拟用户界面被划分为图2A所示的各个区域,并在各个区域内分别展示对应的内容。
在一些实施例中,在图2A所示的布局方式下,人眼正前方60度范围的视场角内是最为舒适也是最易操作的区域,所以显示的为用户最关心的内容。因此,可在虚拟用户界面的主视角区域展示最频繁使用的功能,便于用户查看。即将内容推荐区展示在主视角区域,内容推荐区如图2A中(1)所示区域。
内容推荐区的顶部区域展示提示信息,包括时间、网络、电量等信息,内容推荐区的中间区域展示显示主页,内容推荐区的底部展示导航栏。显示主页用于展示包括虚拟现实应用提供不同业务需求的功能控件的页面,导航栏中显示数个导航按钮,导航按钮的设置数量可为7个或其他数值。导航栏如图2A中(2)所示区域。
将提示信息、显示主页和导航栏均显示在人眼正前方60度范围内,可以更好地划分内容推荐区的内容层次关系,从而形成导航、页面集合的层级关系,支持用户更方便的浏览和查找感兴趣的内容。
在一些实施例中,在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区,将应用切换区作为应用快捷入口,以快速启动应用在主页展示系统推荐的应用、热度较高、用户频繁使用的应用等,提高相应应用的更多曝光度,将上述应用推荐给用户进行使用或安装。应用切换区可展示系统为用户推荐的应用,还可展示本地安装应用,即不同属性的应用包括系统推荐应用和本地安装应用。系统推荐应用包括系统推荐安装应用和系统推荐使用应用,本地安装应用包括系统预置应用和用户安装的第三方应用。应用切换区如图2A中(3)所示区域。
应用切换区位于虚拟用户界面的主页,以展示为用户推荐的应用。为了使应用切换区在展示应用时能够区分不同属性,以及,能够兼顾运营需求和用户需求,在展示虚拟用户界面时,将应用切换区进行 划分,将同一属性的应用展示在同一区域内,便于用户有目的地选择交互,避免出现混乱,交互体验更好。
在一些实施例中,为便于用户在操作虚拟现实应用时,为用户提供特别推荐,例如,当前存在的活动、热映电影等信息,还可在虚拟用户界面中展示三维模型动画,三维模型动画即为消息推荐入口,UI状态可参见图2A中的(4)部分所示内容。
消息推荐入口为可配置的三维动画,相比于二维图片形式,该三维动画可以灵活配置文字、图片、动画、声音等,根据运营活动需要配置,应用主动请求。
第一部分
本申请实施例提供一种三维显示设备,包括:虚拟显示器,被配置为呈现虚拟用户界面;与虚拟显示器连接的控制器,在执行虚拟用户界面的布局方法时,控制器被配置为执行下述步骤:响应于触发虚拟现实应用时产生的应用启动指令,在虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。
由于虚拟用户界面显示在三维空间内,为根据人眼的视觉特点可在三维空间内承载不同的内容,可将虚拟用户界面的全局界面整体布局围绕人眼主视角进行区域划分。其中,主视角是指用户人眼在未转动头部时可以看到的范围,三维显示设备的主视角可以理解为设备能够展示的图像范围。
在一些实施例中,在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区,应用切换区可展示系统为用户推荐的应用,还可展示本地安装应用,即不同属性的应用包括系统推荐应用和本地安装应用。本地安装应用包括系统预置应用和用户安装的第三方应用。应用切换区展示的应用数量有限,并非将上述不同属性的应用全部展示,而是仅展示用户最近使用、历史频繁使用、当前热度较高或商业价值较高的应用,目的是给予上述应用更多曝光,以指引用户启动上述应用。
例如,在应用切换区展示系统推荐应用时,该应用可为系统根据用户喜好推荐的还未进行安装的应用,还可为系统推荐的用户已经安装的应用。如果推荐的是还未安装的应用,则在触发该应用时,可直接跳转到应用下载页面,进行下载安装;如果推荐的是已进行安装的应用,则在触发该应用时,可直接启动该应用。
在一些实施例中,在虚拟用户界面中显示内容推荐区时,控制器在执行在虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,被进一步配置为:获取用于实现不同推荐内容展示的多个内容推荐数据以及用于实现不同导航功能的多个导航功能数据;基于多个内容推荐数据生成包括多个页面的显示主页,将显示主页显示在内容推荐区;基于多个导航功能数据生成包括多个导航按钮的导航栏,将导航栏显示在内容推荐区,导航栏显示在显示主页的下方,一个导航按钮对应一个导航功能数据。
为便于用户在主视角范围内查看到其感兴趣的内容,可将虚拟现实应用的推荐内容和操控虚拟现实应用的导航栏显示在位于虚拟用户界面的主视角区域对应的内容推荐区。
虚拟现实应用的推荐内容以页面的形式进行展示,为此,在展示虚拟用户界面时,三维显示设备向服务器获取用于实现不同推荐内容展示的多个内容推荐数据。
图3A示出了根据一些实施例的虚拟用户界面中内容推荐区的示意图。如图3A所示,内容推荐区用于配置不同分类TAB栏目,不同的分类TAB栏目包括精选专题、热门游戏、首页推荐、热播剧集、全景推荐等栏目。
在不同的栏目中可以选择配置媒资、专题等信息;该媒资可包括2D影视、教育课程、旅游、3D、360度全景、直播、4K影视、程序应用、游戏、旅游等具有媒资内容的业务,并且该栏目可以选择不同的模板样式、可支持媒资和专题同时推荐编排。因此,获取的内容推荐数据对应上述不同的栏目以及栏目中的配置信息等,一个配置信息对应一个内容推荐数据。
由于同一个页面中可以同时显示多个媒资或专题等配置信息,即可根据多个内容推荐数据生成一个页面,并根据多个页面生成显示主页。显示主页为虚拟现实应用的应用主页,将显示主页显示在内容推荐区的中间区域,便于用户在虚拟空间中的主视角范围内查看。显示主页如图3A中(1)所示部分。
在一些实施例中,显示主页的配置内容支持手动拖拽、也可以支持筛选媒资包大数据推荐的配置方式。
在一些实施例中,显示主页还包括用于移动选项目标的左向移动控件、右向移动控件,用于选择不同的TAB。被选中的TAB其内容显示于用户界面的中心区域;未被选中的TAB内容显示于已选中TAB的左右两侧区域,并进行淡化显示。
在一些实施例中,在操控虚拟现实应用时,可通过不同的导航按钮实现操控。为此,在展示虚拟用户界面时,获取用于实现不同导航功能的多个导航功能数据。一个导航功能数据实现一个导航功能,一个导航功能由一个导航按钮进行触发。
因此,可根据获取的多个导航功能数据生成包括多个导航按钮的导航栏,将导航栏显示在内容推荐 区的底部,即导航栏显示在显示主页的下方。导航栏如图3A中(2)所示部分。
主视角的导航栏为长条状布局,控制最大显示数量为7个,以居中布局方式展示,此位置也是人眼正前方60度范围内,这样可以让用户方便的点击到对应的导航栏按钮。
导航栏支持配置不同分类的扩展分类。如果有新的业务类型时,支持配置独立TAB,展示对应的页面内容。导航栏中的扩展分类,也可以对其进行排序调整及下线业务操作。在一些实施例中,导航栏可包括的内容:影视、教育、旅游、应用、我的。在一些实施例中,导航栏被配置为可展示大业务类别TAB,且支持配置更多的分类,其图标支持配置。
在一些实施例中,由于虚拟用户界面的主视角区域显示的是用户使用频次最高的媒资、应用和游戏等内容,其显示的内容以页面为单位,一个页面由一个或者多个模板组合在一起显示。为了便于用户操作,根据VR的空间特点,一般会同时显示三个页面,即中间主页面,左侧和右侧同时显示展示页面。
在进行页面布局时,通常采用平铺方式,将主页面设置在中间,人眼正对的位置,左侧页面位于主页面的左侧,右侧页面位于主页面的右侧。三维显示设备中存在相机的概念,相机的位置可以理解为人的眼睛的位置,眼睛看到的内容就是相机可以拍摄出来的内容。
这种平铺方式布局简单,但是如果要看清两侧的内容,需要用户通过转头的方式进行查看。但是,由于在水平方向上人眼的能看清楚的视角范围是一定的,两侧已经超出人眼水平方向清晰视角的范围,导致通过转头的方式查看两侧页面的内容十分困难。
为此,为便于用户在虚拟空间中能够轻松地看到主视角区域两侧页面的内容,本申请实施例提供一种正交页面布局方式,利用正交特点和人眼视角特点规划主视角区域界面区域大小及距离、左右扩展区域角度及大小、距离等,对显示主页采用正交页面布局方式进行布局调整,保证所有布局均在舒适体验范围内进行操作,便于用户查看每一个页面。
在一些实施例中,在采用正交页面布局方式时,控制器在执行将显示主页显示在内容推荐区,被进一步配置为执行下述步骤:在内容推荐区以正交页面布局方式进行页面显示时,获取正多边形边数,在主视角方向上人眼与页面之间的预设景深距离,相邻两个页面之间的预设页面间距,以及,显示主页中进行显示的页面数量;基于预设景深距离、预设页面间距和正多边形边数,在内容推荐区生成用于进行正交页面布局的正多边形,正多边形为透明状态;将显示主页中进行显示的多个页面呈现在所述正多边形的指定边上,指定边的数量与显示主页中进行显示的页面数量相等。
正交页面布局方式是指将每个页面按照距离人眼的位置完全一致的特点进行布局,相当于将每个页面设置在一个正多边形的边上。
为此,为保证人眼在查看任一个页面时,视觉上页面与人眼的距离一致,需获取正多边形边数,在主视角方向上人眼与页面之间的预设景深距离,相邻两个页面之间的预设页面间距,以及,显示主页中进行显示的页面数量。
正多边形边数用于确定进行页面展示的正多边形,通常正多边形边数与显示主页中需要进行显示的页面数量相关。如果显示主页中需要进行显示的页面数量较多,则可选用边数较多的正多边形,如正八边形、正十边形、正十二边形等;如果显示主页中需要进行显示的页面数量较少,则可选用边数较少的正多边形,如正四边形、正六边形等。
图3B示出了根据一些实施例的正交页面布局方式的示意图。如图3B所示,其选用的正多边形为正六边形。图3B中的圆为正六边形的内切圆(虚线部分),圆心0为设备相机的位置,即人眼的位置;正六边形顶部的三个矩形为三个页面。
在主视角方向上人眼与页面之间的预设景深距离为空间中Z轴距离,即人眼观看到正对页面之间的距离,通常可设定为9米,也可为其他数值,此处不做具体限定。预设景深距离可看作是正多边形所在内切圆的半径,如图3B中的r。
相邻两个页面之间的预设页面间距可等同于两个页面中点之间的距离,用于限定正多边形的面积大小。如果预设页面间距较大,则正多边形的面积较大;如果预设页面间距较小,则正多边形的面积较小。
显示主页中进行显示的页面数量用于表征在内容推荐区中可同时展示出来的页面数量,例如,图3B所示的可同时展示出左侧页面3201、中间主页面3202、右侧页面3203这3个页面,则显示主页中进行显示的页面数量为3个。
由于预设景深距离、预设页面间距和正多边形边数均可对正多边形的面积大小进行限定,因此,可根据预设景深距离、预设页面间距和正多边形边数生成用于进行正交页面布局的正多边形。为避免影响用户查看页面内容,可将正多边形设定为透明状态,并呈现在内容推荐区,使得最终的视觉效果为三个页面以正交页面布局方式的状态,而正多边形不可见。
为便于用户查看,在生成的正多边形中,仅会利用位于用户前方的几条边显示页面,即选择位于圆心上方的几条边用于显示页面。由于圆心为人眼的位置,因此,可呈现出人位于正多边形的中心,利用 人眼前的几条边显示相应页面的效果。
具体选择的可显示页面的边的数量根据显示主页中进行显示的页面数量而定,进而可根据显示主页中进行显示的页面数量确定正多边形中用于显示页面的指定边。最后,将显示主页中进行显示的多个页面呈现在正多边形的指定边上,指定边的数量与显示主页中进行显示的页面数量相等。
在一些实施例中,在虚拟现实空间中,通常会同时展示三个页面,即中间主页面、左侧页面和右侧页面,每个页面中均可呈现至少一个海报,在展示多个海报时刻采用不同的模板进行展示。
海报是指媒资对应的宣传图片,海报位即显示主页上用于显示海报的位置。模板:定义一个或者若干个海报的显示样式。一个模板中可以只显示一张海报,也可以显示多张海报。模板可根据用户体验、视觉效果等设计其界面展现形式,不同的模板展现形式不同。技术上对每个模板定义一个类型即Template Type,用于标识不同的模板,并且根据模板设计将其展现形式转换为模板数据结构。模板如图3A中(1)部分所示的上端两个大矩形,下端三个小矩形。而每个矩形位置即为一个海报,如专题海报、应用海报、VIP海报、商品海报等。
在一些实施例中,在基于显示主页中的页面进行交互时,不论是平铺的布局方式还是正交的布局方式,其交互过程通常是将需要观看的页面切换到中间的方式进行。
图3C示出了根据一些实施例的基于传统方式对页面进行交互时的展示效果图。如图3C中的(a)部分所示,在初始显示页面时,通常在中间主页面和右侧页面中呈现内容推荐数据,而左侧页面为空白状态。此时,点击右侧页面,参见图3C中的(b)部分,则中间主页面向左移动至左侧页面,右侧页面向左移动至中间,同时向服务器继续请求下一页面的内容推荐数据并缓存,如有新数据则显示在右侧页面。
继续点击右侧页面,左侧页面消失,中间主页面切换到左侧,右侧页面切换到中间,同时向服务器下载更多数据作为右侧页面的显示内容并缓存。依次操作,当下载完所有数据时,状态停留在图3C中的(c)部分的界面,即左侧页面和中间主页面显示内容推荐数据,而右侧页面呈空白的状态。此时,点击左侧页面,从缓存中读取数据,依次向右滑动,直至返回初始交互状态。
但是,由于上述交互方式无法形成循环显示,而在另一种实现方式中,为实现循环显示,可在图3C中的(c)部分所示状态下,继续点击右侧页面形成循环。但是,当数据未完全下载时,点击左侧页面到头后返回图3C中的(a)部分的状态,不能循环,只有所有数据下载完成后才能左右循环。究其原因,是传统的后端实现都是顺序取数据的,当没有完全取完数据时,此时向左循环其实时需要从服务器拿最后一页数据,传统的后端实现难以支持。
例如,如果显示主页中需要展示的页面为10页,用户持续点击右侧页面进行向左翻页,依次从第一页数据开始持续获取后续每个页面的数据,在将第6页数据显示在中间主页面中时(此时已获取到第一页至第六页的数据),用户开始点击左侧页面进行向由翻页。此时,若持续点击后回到图3C中的(a)部分的状态,即第一页显示在中间主页面,左侧页面为空白时,按照循环展示特点,在左侧页面本应展示第十页的数据。
但是,鉴于传统的按顺序读取数据的方式,在之前的翻页操作中设备端仅获取到六页数据,并未获取到第十页数据,导致左侧页面无法显示第十页数据,即无法实现循环。
可见,上述两种基于显示主页的交互方式,存在无法实现循环或在可以循环时易受数据下载状态的影响,导致无法任意进行左右循环的操作方式。
为此,为实现任意循环翻页的操作方式,本申请实施例提供一种可以不受数据下载状态影响的操作方式,服务器侧根据用户请求生成对应数据的实时缓存,支持快速数据检索;并可支持用户从任意页面开始读取数据,无需按照顺序读取数据。
在一些实施例中,为实现数据缓存,设备端不再仅生成3个页面,而是生成5个页面,其中,三个页面用于显示内容推荐数据(可被用户看到),另外2个用于缓存界面但并不进行显示(用户无法看到,需移动页面后才可被看到)。
此时,显示主页包括主页面、左侧页面、右侧页面、左侧隐藏页面和右侧隐藏页面。在初始时刻,主页面位于中间,用于显示第一页数据;右侧页面位于主页面的右侧,用于显示第二页数据;右侧隐藏页面位于右侧页面的右侧,用于缓存第三页数据,但不进行显示。左侧页面位于主页面的左侧,左侧隐藏页面位于左侧页面的左侧,左侧页面和左侧隐藏页面不显示数据,且左侧隐藏页面为隐藏状态,不显示出来。从视觉上,用户所能查看到的页面仅为主页面、左侧页面和右侧页面。
由于显示主页中可同时生成5个页面,为此,用于承载显示主页中各页面进行展示的正多边形的指定边数量也为5个,正多边形的指定边包括中间指定边、左侧指定边、右侧指定边、左侧隐藏指定边和右侧隐藏指定边。中间指定边、左侧指定边和右侧指定边上展示的页面可被用户看到;左侧隐藏指定边和右侧隐藏指定边仅用于缓存页面,相应页面不会被用户看到。
在一些实施例中,为实现任意左右循环的操作方式,将显示主页中进行显示的多个页面呈现在正多边形的指定边上,控制器被进一步配置为:将左侧页面显示在左侧指定边上,将主页面显示在中间指定边上,将右侧页面显示在右侧指定边上,中间指定边为主视角中心线对应的指定边,左侧指定边位于中间指定边的左侧,右侧指定边位于中间指定边的右侧;将左侧隐藏页面设置在左侧隐藏指定边上,左侧隐藏指定边位于左侧指定边的左侧,左侧隐藏页面用于缓存左侧页面的前一页面的内容推荐数据,左侧隐藏页面不进行显示;将右侧隐藏页面设置在右侧隐藏指定边上,右侧隐藏指定边位于右侧指定边的右侧,右侧隐藏页面用于缓存右侧页面的后一页面的内容推荐数据,右侧隐藏页面不进行显示。
由于显示主页中可同时生成5个页面,则对应确定正多边形的指定边也为5个。中间指定边为主视角中心线对应的指定边,与主页面进行对应,便于用户查看;左侧指定边位于中间指定边的左侧,与左侧页面对应;右侧指定边位于中间指定边的右侧,与右侧页面对应;右侧隐藏指定边位于右侧指定边的右侧,与右侧隐藏页面对应;左侧隐藏指定边位于左侧指定边的左侧,与左侧隐藏页面对应。
为此,在对显示主页中各页面进行正交布局时,将左侧页面显示在左侧指定边上,将主页面显示在中间指定边上,将右侧页面显示在右侧指定边上,将左侧隐藏页面设置在左侧隐藏指定边上,将右侧隐藏页面设置在右侧隐藏指定边上。
图3D示出了根据一些实施例的显示主页采用正交布局方式的一种示意图。参见图3D,在正多边形采用正六边形时,选择的指定边为序号1、2、3、4、5,分别对应中间指定边3413、左侧指定边3412、右侧指定边3414、左侧隐藏指定边3411和右侧隐藏指定边3415。显示主页中同时生成5个页面,分别为主页面3403、左侧页面3402、右侧页面3404、左侧隐藏页面3401和右侧隐藏页面3405。
左侧隐藏指定边上展示左侧隐藏页面,左侧指定边上展示左侧页面,中间指定边上展示主页面,右侧指定边上展示右侧页面,右侧隐藏指定边上展示右侧隐藏页面。由于在正六边形中,位于人眼(内切圆圆心0)正前方的指定边为中间指定边、左侧指定边和右侧指定边,而左侧隐藏指定边和右侧隐藏指定边均位于人眼的后方。但由于左侧隐藏指定边和右侧隐藏指定边上展示的页面均为隐藏页面,并不进行展示,因此,并不妨碍用户的查看。
图3E示出了根据一些实施例的显示主页采用正交布局方式的另一种示意图。参见图3E,在正多边形采用正十边形时,选择的指定边为序号1、2、3、4、5,分别对应中间指定边3513、左侧指定边3512、右侧指定边3514、左侧隐藏指定边3511和右侧隐藏指定边3515。显示主页中同时生成5个页面,分别为主页面3503、左侧页面3502、右侧页面3504、左侧隐藏页面3501和右侧隐藏页面3505。
左侧隐藏指定边上展示左侧隐藏页面,左侧指定边上展示左侧页面,中间指定边上展示主页面,右侧指定边上展示右侧页面,右侧隐藏指定边上展示右侧隐藏页面。在正十边形中,上述5个指定边均位于人眼(内切圆圆心0)正前方,各个指定边上展示的页面均可便于用户查看到。
在一些实施例中,在选择正多边形时,只需保证中间指定边、左侧指定边和右侧指定边位于人眼前方即可,而由于左侧隐藏指定边和右侧隐藏指定边上展示的页面并不显示出来,因此,即使在空间上左侧隐藏指定边和右侧隐藏指定边位于人眼后方,但在进行交互时,位于该隐藏指定边上的页面将移动至人眼前方位置,因此,这并不影响用户查看。
在一些实施例中,为保证三维显示设备可以从任意页面读取数据,避免按照顺序读取数据导致页面无法循环操作的问题,可利用左侧隐藏页面和右侧隐藏页面对当前操作页面的邻近页面的数据进行提前读取并缓存。即左侧隐藏页面用于缓存左侧页面的前一页面的内容推荐数据,左侧隐藏页面不进行显示。右侧隐藏页面用于缓存右侧页面的后一页面的内容推荐数据,右侧隐藏页面不进行显示。
在一些实施例中,在进行页面交互时,用户可通过与三维显示设备搭配的手柄进行页面选择,或者利用三维显示设备上安装的注视部件进行页面选择,注视部件为眼睛盯的前方,可等同于眼睛看到的位置。
在一些实施例中,若用户要点击某个页面中的某个媒资,需先将该页面移动至主视角的正前方,即将相应页面移动至中间指定边上,替代原展示的主页面的内容。在将页面移动中间位置后,用户触发该页面中的任一个媒资或应用等,即可实现启动该媒资或应用的过程。
在一些实施例中,用户在基于前述页面布局方式所得到的显示主页进行交互时,控制器被进一步配置为:
在正多边形的指定边上呈现包括内容推荐数据的页面时,响应于触发右侧指定边上的页面时产生的页面选择指令,将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧指定边的页面向左移动至中间指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示;响应于触发左侧指定边上的页面时产生的页面选择指令,将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧指定边的页面向右移动至中间指定边上,将位于左侧隐藏指定 边的隐藏页面向右移动至左侧指定边上并进行显示。
正多边形中的各个指定边均展示有页面,且每个页面上均呈现内容推荐数据。若用户在基于显示主页中的各个页面进行选择查看时,可点击右侧指定边上的页面,产生向左浏览显示主页中各个页面的过程;而在点击左侧指定边上的页面,产生向右浏览显示主页中各个页面的过程。
在启动虚拟现实应用时,在虚拟空间生成虚拟用户界面,并在虚拟用户界面的主视角区域内的内容推荐区呈现显示主页。初始化时,三维显示设备一次向服务器请求显示主页中的前3页对应的内容推荐数据,并分别生成主页面(第一页数据)、右侧页面(第二页数据)和右侧隐藏页面(第三页数据),依次展示在中间指定边、右侧指定边和右侧隐藏指定边。而左侧页面并未展示内容。
在一些实施例中,由于在初始时刻,为便于循环操作方式,在主页面展示第一页数据时,则在左侧隐藏页面展示最后一页数据。
图3F示出了根据一些实施例的交互时显示主页中的页面向右移动的展示效果图。例如,显示主页中包括10个页面,在初始时刻,参见图3F中的(a)部分,第一个页面为主页面,显示在中间指定边3613上;第二个页面为右侧页面,显示在右侧指定边3614上;第三个页面为右侧隐藏页面,显示在右侧隐藏指定边3615上。左侧页面为空白页,显示在左侧指定边上3612。
如果在初始时刻用户点击左侧页面,说明用户想要从最后一页开始进行页面选择,即页面向右移动倒着依次显示在中间指定边上,此时,需要第十个页面替换当前的主页面,显示在中间指定边上。因此,可在初始时刻将第十个页面作为左侧隐藏页面,呈现在左侧隐藏指定边3611上,但不显示出来。
参见图3F中的(b)部分,在用户第一次点击左侧指定边上的页面时,左侧隐藏指定边上的第十个页面向右移动至左侧指定边上,即第十个页面为左侧页面;左侧隐藏指定边替换呈现第九个页面(不显示处理),即第九个页面为左侧隐藏页面。此时,中间指定边、右侧指定边和右侧隐藏指定边上的页面不动。
参见图3F中的(c)部分,在用户第二次点击左侧指定边上的页面时,当前显示主页中的5个页面整体向右移动一个位置,即将位于左侧隐藏指定边的隐藏页面(第九个页面)向右移动至左侧指定边上并进行显示,此时,左侧隐藏指定边上缓存第八个页面,即第八个页面为左侧隐藏页面;将位于左侧指定边的第十个页面向右移动至中间指定边上,即第十个页面为主页面;将位于中间指定边上的第一个页面向右移动至右侧指定边上,即第一个页面为右侧页面;将位于右侧指定边的第二个页面向右移动至右侧隐藏指定边上并进行隐藏,即第二个页面为右侧隐藏页面;右侧隐藏指定边上原呈现的第三个页面消失。基于此过程,可实现显示主页中各页面的循环交互。
可见,在用户基于显示主页中呈现的5个页面(3个显示,2个不显示)进行交互时,用户可直接对位于中间指定边上的页面中显示的媒资或应用进行触发操作。若用户想要触发其他页面中的媒资或应用,可点击左侧指定边上的页面,产生页面选择指令,使得显示主页整体向右移动一个位置,由位于左侧的页面向右替换邻边上的页面,即将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧指定边的页面向右移动至中间指定边上,将位于左侧隐藏指定边的隐藏页面向右移动至左侧指定边上并进行显示。此时,左侧隐藏指定边上缓存原隐藏页面的前一个页面,而右侧隐藏指定边原缓存的隐藏页面消失。
在一些实施例中,在初始化时,三维显示设备一次向服务器请求显示主页中的前3页对应的内容推荐数据,并依次展示在中间指定边、右侧指定边和右侧隐藏指定边上。此时,如果点击右侧页面,则从中间指定边上的主页面开始依次向左移动。最终中间页面移至左侧页面,右侧页面移至中间,右侧缓存页面显示出来,左侧隐藏页面移到最右侧,左侧页面变成左侧隐藏页面。
图3G示出了根据一些实施例的交互时显示主页中的页面向左移动的展示效果图。例如,显示主页中包括10个页面,在初始时刻,参见图3G中的(a)部分,第一个页面为主页面,显示在中间指定边3713上;第二个页面为右侧页面,显示在右侧指定边3714上;第三个页面为右侧隐藏页面,显示在右侧隐藏指定边3715上;左侧页面为空白页,显示在左侧指定边3712上;左侧隐藏页面可为最后一个页面,位于左侧隐藏指定边3711上,不显示出来。
参见图3G中的(b)部分,在用户第一次点击右侧指定边上的页面时,5个指定边上的页面整体向左移动一个位置,即将位于中间指定边上的第一个页面向左移动至左侧指定边上;将位于右侧指定边的第二个页面向左移动至中间指定边上,将位于右侧隐藏指定边的隐藏页面(第三个页面)向左移动至右侧指定边上并进行显示。此时,右侧隐藏指定边上缓存第四个页面。
参见图3G中的(c)部分,在用户第二次点击右侧指定边上的页面时,5个指定边上的页面整体再向左移动一个位置,即位于左侧指定边的第一个页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的第二个页面向左移动至左侧指定边上,将位于右侧指定边的第三个页面向左移动至中间指定边上,将位于右侧隐藏指定边的隐藏页面(第四个页面)向左移动至右侧指定边上并进行显示。此时, 右侧隐藏指定边上缓存第五个页面。
在一些实施例中,在初始时刻向左第一次移动时,原位于左侧隐藏指定边上的最后一个页面可向左移动,产生循环,移动至最右侧,即右侧隐藏指定边上等待缓存的页面队列中。右侧隐藏指定边上等待缓存的页面队列为当前已经进行显示页面的后续页面,后续页面按顺序排列。即参见图3G中的(b)部分,在第一个页面为左侧页面(左侧指定边)时,左侧隐藏页面(左侧隐藏指定边)不缓存页面。
例如,在右侧缓存指定边上缓存第三个页面时,此时,左侧隐藏指定边上缓存第十个页面,则页面队列中存在第四个至第九个页面。若向左移动一次,即右侧缓存指定边上缓存第四个页面时,则页面队列中存在第五个至第十个页面,其他循环过程依此类推。
同样的,左侧隐藏指定边也对应有页面队列,该页面队列中包括当前已经进行显示页面的前续页面,前续页面按倒序排列。例如,在左侧缓存指定边上缓存第十个页面(最后一个页面)时,此时,右侧缓存指定边上缓存第三个页面,则页面队列中存在第九个至第四个页面。若向右移动一次,则左侧缓存指定边上缓存第九个页面时,则页面队列中存在第八个至第三个页面,其他循环过程依此类推。
在一些实施例中,参见图3G中的(d)部分,在初始时刻向左第一次移动时,原位于左侧隐藏指定边上的最后一个页面不进行移动,依然停留在左侧隐藏指定边上。此时,左侧指定边上显示第一个页面,左侧隐藏指定边上显示最后一个页面(第十个页面),相邻两个指定边显示的页面使得显示主页的所有页面呈首尾相连状态,进而可以实现循环交互。若用户点击左侧页面向右移动,则第一个页面回到中间指定边上,而最后一个页面(第十个页面)则显示在左侧指定边上。
可见,在用户基于显示主页中呈现的5个页面(3个显示,2个不显示)进行交互时,用户可直接对位于中间指定边上的页面中显示的媒资或应用进行触发操作。若用户想要触发其他页面中的媒资或应用,可点击右侧指定边上的页面,产生页面选择指令,使得显示主页整体向左移动一个位置,由位于右侧的页面向左替换邻边上的页面,即将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧指定边的页面向左移动至中间指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示。此时,右侧隐藏指定边上缓存原隐藏页面的下一个页面,而左侧隐藏指定边原缓存的隐藏页面消失。
在一些实施例中,在基于显示主页中的各页面进行选择时,在对显示主页中的每个页面进行移动时,对每个可见页面间的移动过程,从不可见到可见的移动过程,以及,从可见到不可见的移动过程,均添加动画效果,以进行平滑操作,避免影响用户的观感。动画效果包括缓入、缓出等。
可见,在进行循环交互时,三维显示设备可一次读取多页数据,并可将相邻页的数据进行缓存,使得在移动时不需要在进行一次网络交互,提升操作流畅度。
在一些实施例中,由于该循环操作方式可从任意页面开始读取数据,因此,在产生页面选择指令时,可在页面选择指令中携带页面索引参数,发送至服务器,以获取页面索引参数对应页的数据。例如,在当前显示任意三个页面时,若用户通过点击左侧页面想要尽快查看最后一页数据,则产生携带第十页的页面索引参数,由服务器下发第十页的数据,无需按顺序读取数据,进而可以不受数据下载状态影响的任意左右循环对显示主页的页面进行交互,提高用户体验。
在一些实施例中,如果显示主页中包括的页面数量小于等于5个,在初始化时,相当于将5个页面的数据全部缓存下来。因此,在进行交互时,只需保留对应的页面,左右循环即可。
在一些实施例中,内容推荐区显示有显示主页和导航栏,在基于显示主页进行循环交互时,也可对导航栏进行交互。导航栏如图3A中(2)所示部分,导航栏的交互与对应的页面集合对应,默认为“推荐”、“影视”、“教育”、“应用”、“我的”五个导航按钮。导航栏信息通过服务器配置生成,应用通过向服务器请求导航功能数据获取导航栏信息,根据获取到的数据进行展示。
为了更好地区分当前焦点导航与页面的关系以及指示用户操作反馈,定义正常、获焦和遗留三个状态,并分别在对应的导航按钮上添加对应的标识图案,以指示用户该导航按钮已获焦。
在一些实施例中,在基于导航栏进行交互时,控制器被进一步配置为:在基于导航栏切换不同的导航按钮时,如果每个导航按钮均未获得控制焦点,则为每个导航按钮均添加表征正常状态的标识图案;如果其中一个导航按钮获得控制焦点,则为导航按钮添加表征获焦状态的标识图案;如果其中一个导航按钮获得触发操作后又丢失控制焦点,则为导航按钮添加表征遗留状态的标识图案。
用户每点击一个导航按钮,则在显示主页中呈现对应的页面。例如,点击“推荐”按钮时,在显示主页中呈现推荐页面;点击“影视”按钮时,在显示主页中呈现媒资页面。且点击导航按钮切换的页面显示在中间指定边上,便于用户直接进行选择。
在生成虚拟用户界面时,显示主页中默认显示一个页面,此时,导航栏中的一个对应导航按钮呈默认选中状态。此时,对于默认选中的导航按钮等同于用户点击了这个导航按钮,因此,该导航按钮呈遗留状态,则为导航按钮添加表征遗留状态的标识图案。如果用户将控制焦点移到某个导航按钮上,则为 该导航按钮添加获焦状态的标识图标,获焦状态的标识图案可为高亮形式。而其他导航按钮未获得控制焦点,则为每个导航按钮均添加表征正常状态的标识图案,正常状态的标识图案可为透明形式。若获得控制焦点的导航按钮被触发后,该控制焦点移动到其他导航按钮上后,则为执行触发操作的导航按钮添加表征遗留状态的标识图案,遗留状态的标识图案可为颜色标识或带有边框的透明矩形。
图3H示出了根据一些实施例的导航栏在交互时的展示效果图。当用户操作控制焦点移动到某个导航按钮时高亮显示(获焦状态的标识图案),指示当前获取焦点;当焦点未点击离开时恢复正常状态(正常状态的标识图案)。例如,参见图3H中的(a)部分所示,在用户将控制焦点移动到“推荐”按钮上时,“推荐”按钮高亮显示,其余按钮为正常状态。
参见图3H中的(b)部分所示“影视”按钮的状态,当用户点击后离开为遗留状态,则在“影视”按钮上添加表征遗留状态的标识图案,指示当前导航栏位置。
在一些实施例中,根据运营需要,支持增加或者删除导航栏,通过服务器配置生成新的导航条下发到应用,应用根据配置信息即时生成对应的导航栏。
在一些实施例中,在判断某个导航按钮是否获得控制焦点时,可通过判断用户操作的手柄射出的光线是否与导航按钮相撞。相撞操作是指线的坐标是否与导航栏中的导航按钮的坐标相交,如果相交,则说明该光线与该导航按钮相撞,并确定该导航按钮获得控制焦点。此时,如果用户点击手柄的确定键,则可执行触发操作,以切换导航。
在一些实施例中,为便于用户能够基于虚拟用户界面快速地启动某个应用,可在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。应用切换区可展示系统为用户推荐的应用,还可展示本地安装应用,即不同属性的应用包括系统推荐应用和本地安装应用。本地安装应用包括系统预置应用和用户安装的第三方应用。
应用切换区展示的应用数量有限,并非将上述不同属性的应用全部展示,而是仅展示用户最近使用、历史频繁使用、当前热度较高或商业价值较高的应用,目的是给予上述应用更多曝光,以指引用户启动上述应用。
在一些实施例中,在展示应用切换区时,控制器在执行在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区,被进一步配置为:在系统推荐应用的当前数量为零时,生成包括翻页显示区的应用切换区,翻页显示区用于显示本地安装应用;在系统推荐应用的当前数量不为零时,生成包括固定显示区、翻页显示区和间隔标记的应用切换区,固定显示区用于显示系统推荐应用,翻页显示区用于显示本地安装应用,间隔标记位于固定显示区和翻页显示区之间。
应用切换区为应用快捷入口,用于快速打开其它应用。快捷入口的布局考虑运营需要,采用两段式布局,即左半部分为系统端配置下发的应用,右半部分为本机安装的其它应用,为了区分和便于用户理解,中间设计间隔标记。
由于系统推荐应用可由服务器根据用户操作虚拟现实应用时自动生成,也可能是用户手动配置的,通过服务器操作界面配置具体的生成策略。如果服务器没有自动生成或者用户并未手动配置推荐的应用,则可能不会产生系统推荐应用。因此,在生成应用切换区时,可不采用两段式布局,仅采用一段式布局。
为准确确定是采用一段式布局方式还是两段式布局方式,可先获取系统推荐应用的当前数量,即由虚拟现实应用向服务器获取应用切换区的配置信息,以获得系统推荐应用的当前数量。
图3I示出了根据一些实施例的应用切换区在交互时的展示效果图。如果在系统推荐应用的当前数量为零时,说明不存在系统推荐的应用,此时仅需展示本地安装应用。因此,生成包括翻页显示区的应用切换区,翻页显示区用于显示本地安装应用。参见图3I中的(a)部分所示,翻页显示区3901显示七个本地安装应用B1-B7。
如果在系统推荐应用的当前数量不为零时,说明存在系统推荐的应用,此时需同时展示系统推荐应用和本地安装应用。因此,生成包括固定显示区、翻页显示区和间隔标记的应用切换区,在固定显示区显示系统推荐应用,在翻页显示区显示本地安装应用,间隔标记位于固定显示区和翻页显示区之间,间隔标记3913用于区分系统推荐应用和本地安装应用。参见图3I中的(b)部分所示,固定显示区3912显示三个系统推荐应用X1-X3,翻页显示区3911显示四个本地安装应用B1-B4。
在一些实施例中,应用切换区可显示的应用数量有限,使得系统推荐应用的显示数量和本地安装应用的显示数量均有限。为便于在系统推荐应用和/或本地安装应用的总数量超出应用切换区的可显示应用总数量,可通过翻页的形式查看其余未显示在应用切换区的应用。
因此,在系统推荐应用的总数量较多时,控制器被进一步配置为:在系统推荐应用的当前数量不为零时,获取固定显示区的可配置应用的预设数量;如果系统推荐应用的当前数量小于或等于可配置应用的预设数量,则在固定显示区显示系统推荐应用,在翻页显示区显示本地安装应用;如果系统推荐应用的当前数量大于可配置应用的预设数量时,计算配置应用超出数量,以及,在固定显示区显示与可配置 应用的预设数量对应的系统推荐应用,在翻页显示区显示本地安装应用和配置应用超出数量对应的系统推荐应用。
在系统推荐应用的当前数量不为零时,应用切换区包括固定显示区和翻页显示区。固定显示区的可配置应用的预设数量即为固定显示区可显示的最多应用数量。
如果系统推荐应用的当前数量小于或等于可配置应用的预设数量,说明固定显示区可完整展示所有系统推荐应用,则在固定显示区显示系统推荐应用,在翻页显示区显示本地安装应用。
如果系统推荐应用的当前数量大于可配置应用的预设数量时,说明固定显示区不可完整显示所有系统推荐应用,此时,仅在固定显示区显示可配置应用的预设数量对应数量的系统推荐应用,之后显示间隔标记,再之后在翻页显示区显示超出的系统推荐应用。
具体地,由系统推荐应用的当前数量减去可配置应用的预设数量,得到配置应用超出数量。以及,在固定显示区显示与可配置应用的预设数量对应的系统推荐应用,在翻页显示区显示本地安装应用和配置应用超出数量对应的系统推荐应用。
参见图3I中的(c)部分所示,例如,如果固定显示区的可配置应用的预设数量为3个,而系统推荐应用的当前数量为5个时,则计算得到配置应用超出数量为2个。此时,将前三个系统推荐应用X1-X3显示在固定显示区3912,将后两个系统推荐应用X4-X5显示在翻页显示区3911。
此时,由于翻页显示区要同时显示系统推荐应用和本地安装应用,为避免显示混乱,可将超出的系统推荐应用放置在翻页显示区的前端,将本地安装应用放置在系统推荐应用的后端。
在一些实施例中,如果翻页显示区当前需要显示的应用数量超过翻页显示区的可显示应用总数量,则需要对翻页显示区进行翻页操作。翻页显示区的可显示应用总数量为翻页显示区可同时显示的最大应用数量。
具体地,在进行翻页操作时,控制器被进一步配置为:在翻页显示区显示数个应用时,获取翻页显示区的可显示应用总数量和当前显示应用的总数量;如果当前显示应用的总数量大于可显示应用总数量,则基于当前显示应用的总数量对应的应用生成应用列表,应用包括可显示的本地安装应用和配置应用超出数量对应的系统推荐应用;按照所述应用列表在翻页显示区呈现可显示应用总数量对应的应用,以及,在翻页显示区的两侧显示翻页按钮,翻页按钮用于触发应用列表中的应用显示在翻页显示区。
在确定应用切换区是否需要执行翻页操作时,获取翻页显示区的可显示应用总数量和当前显示应用的总数量。如果当前显示应用的总数量大于可显示应用总数量,说明翻页显示区不足以全部展示所有可显示应用,需要进行翻页操作。
此时,根据当前显示应用的总数量对应的应用生成应用列表,应用包括可显示的本地安装应用和配置应用超出数量对应的系统推荐应用。
在一些实施例中,应用列表中系统推荐应用位列前端,本地安装应用位列后端。而本地安装应用包括系统预置应用和第三方应用,则将系统预置应用放在前方,第三方应用放在后方。因此,应用列表中的各应用顺序为系统推荐应用、系统预置应用、第三方应用。
在一些实施例中,在同一属性中,如对于系统推荐应用,将系统推荐的本地还未安装的应用放在前端,以便于指示用户下载安装;对于本地安装应用,按照最近使用、频繁使用的顺序对应用进行排序,而不经常使用的应用位于后端。
在翻页显示区需要通过翻页操作来展示所有可显示的应用时,按照应用列表中的顺序,将可显示应用总数量对应的应用呈现在翻页显示区,以及,在翻页显示区的两侧显示翻页按钮,翻页按钮用于触发应用列表中的应用显示在翻页显示区。
图3J示出了根据一些实施例的翻页显示区在进行翻页交互时的展示效果图。参见图3J中的(a)部分所示,例如,在系统推荐应用为零时,应用切换区仅包括翻页显示区。如果翻页显示区的可显示应用总数量为7个,当前显示应用的总数量为10个,则根据10个应用生成应用列表,将该应用列表中前7个应用B1-B7显示在翻页显示区。
同时,在翻页显示区的左右两侧分别显示翻页按钮3931。参见图3J中的(b)部分所示,在触发向左翻页按钮时,翻页显示区的所有应用向左移动,位于第一位的应用B1被隐藏,而从应用列表中选择位列当前首位的应用B8显示在翻页显示区的最后一位。此时,翻页显示区中呈现的本地安装应用为B2-B8。
若再次触发向左翻页按钮,参见图3J中的(c)部分所示,则将位于第一位的应用B2被隐藏,而从应用列表中选择位列当前首位的应用B9显示在翻页显示区的最后一位。此时,翻页显示区中呈现的本地安装应用为B3-B9。
若在图3J中的(b)部分所示状态下,触发向右翻页按钮,则翻页显示区的所有应用向右移动,恢复到图3J中的(a)部分所示状态。
在一些实施例中,如果翻页显示区的当前显示应用的总数量小于或等于可显示应用总数量,则当前需要显示的应用可完全展示在翻页显示区,此时无需展示翻页按钮。
图3K示出了根据一些实施例的应用切换区在进行翻页交互时的展示效果图。参见图3K中的(a)部分所示,例如,在系统推荐应用不为零时,应用切换区包括固定显示区3912和翻页显示区3911。如果固定显示区的可配置应用的预设数量为3个,而系统推荐应用的当前数量为5个时,则计算得到配置应用超出数量为2个。此时,将前三个系统推荐应用(系统推荐应用X1、X2、X3)显示在固定显示区,将后两个系统推荐应用(系统推荐应用X4、X5)显示在翻页显示区。
如果翻页显示区的可显示应用总数量为4个,需要显示的本地安装应用为5个,则计算当前显示应用的总数量为7个,其中,当前显示应用的总数量包括两个超出的系统推荐应用(系统推荐应用X4、X5)和五个本地安装应用(B1-B5)。
则根据两个超出的系统推荐应用(系统推荐应用X4、X5)和五个本地安装应用生成应用列表,将该应用列表中前4个应用显示在翻页显示区,即将系统推荐应用X4、系统推荐应用X5、本地安装应用B1、本地安装应用B2显示在翻页显示区。
同时,在翻页显示区的左右两侧分别显示翻页按钮。参见图3K中的(b)部分所示,在触发向左翻页按钮时,翻页显示区的所有应用向左移动,位于翻页显示区第一位的系统推荐应用X4被隐藏,而从应用列表中选择位列当前首位的本地安装应用B3显示在翻页显示区的最后一位。此时,翻页显示区展示的应用分别为系统推荐应用X5、本地安装应用B1、本地安装应用B2、本地安装应用B3。
若再次触发向左翻页按钮,参见图3K中的(c)部分所示,则将位于翻页显示区第一位的系统推荐应用X5被隐藏,而从应用列表中选择位列当前首位的本地安装应用B4显示在翻页显示区的最后一位。此时,翻页显示区展示的应用分别为本地安装应用B1、本地安装应用B2、本地安装应用B3、本地安装应用B4。
若在图3K中的(b)部分所示状态下,触发向右翻页按钮,则翻页显示区的所有应用向右移动,恢复到图3K中的(a)部分所示状态。其余翻页状态可按照前述方法进行循环。
在一些实施例中,在基于翻页按钮进行翻页浏览时,可响应翻页指令的仅为翻页显示区,而固定显示区不可执行翻页操作,其展示内容为固定状态。
在一些实施例中,若系统基于用户的应用操作习惯重新生成系统推荐应用,或更新本地安装应用时,可在应用切换区更新显示系统推荐应用和本地安装应用。
在一些实施例中,在初始展示应用切换区时,如果存在需要翻页的情况,可只在应用切换区的左侧显示向左翻页的翻页按钮,以指示还有更多应用。此时,当用户点击向左的翻页按钮后,间隔标记左侧的固定显示区的应用不动,间隔标记右侧的翻页显示区中的应用整体向左移动,并在最后的位置上显示下一应用。此设计是为了突出运营配置的入口,引导用户使用。向左翻页后,根据状态情况如果还有更多则继续显示向左箭头,否则隐藏;同时显示向右翻页的翻页按钮,指示用户可以向回翻页。
在一些实施例中,当用户浏览应用切换区展示的某个应用时,即某个应用获取焦点时,该应用图标放大并高亮,指示用户已获得焦点,同时显示该应用对应的名称。可选的,可以拓展配置信息显示应用简介等其它信息。此时点击该按钮即跳转到对应的应用,若为未安装应用,则跳转至下载页面供用户进行下载安装。
在一些实施例中,为便于用户在操作虚拟现实应用时,为用户提供特别推荐,例如,当前存在的活动、热映电影等信息,还可在虚拟用户界面中展示三维模型动画,三维模型动画即为消息推荐入口,UI状态可参见图1中的(4)部分所示内容。
消息推荐入口为可配置的三维动画,相比于二维图片形式,该三维动画可以灵活配置文字、图片、动画、声音等,根据运营活动需要配置,应用主动请求。
具体地,在生成虚拟用户界面时,控制器被进一步配置为:响应于触发虚拟现实应用时产生的应用启动指令,在虚拟用户界面的主视角顶部区域呈现消息推荐入口,消息推荐入口用于实现消息推荐,消息推荐入口为通过三维动画形式呈现的区域。
在启动虚拟现实应用时,在虚拟用户界面中呈现消息推荐入口。消息推荐入口可为悬浮物区域,将其以悬浮形式配置在主视角顶部区域的左斜侧上方、或右斜侧上方。
在一些实施例中,消息推荐入口可配置为可替换形象、或配置为跳转链接。例如,悬浮物接收到确认操作后跳转至某个消息、应用、或显示指定的功能页。在一些实施例中,悬浮物也可不配置跳转链接,单纯的用于形象展示。
在一些实施例中,消息推荐入口可配置为动画形式,其对应的动画曲线可根据不同的运营内容设计对应的动画轨迹,应用根据下发的轨迹进行展示。
在一些实施例中,在消息推荐入口获取焦点时,其对应的动画可以更新,比如暂停在空间中的运动, 而触发新的动画用于指示或者展示需要推荐给用户的内容;点击时可选触发不一样的动画或者声音等。
在一些实施例中,消息推荐入口还可具备调皮功能,即可以智能躲避用户选中,并以有趣的动画或者声音向用户介绍运营活动。
可见,本申请实施例提供的三维显示设备,在进行虚拟用户界面的布局时,启动虚拟现实应用,在虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。显示主页采用正交布局方式,可保证所有页面布局均在舒适体验范围内进行操作,便于用户查看每一个页面。将导航栏布置在主视角区域内,便于用户切换导航按钮;将应用切换区显示在主视角底部区域,便于用户能够快速切换应用。上述三维空间内的布局方式可使得用户在交互时体验最佳。
在一些实施例中,在采用前述方式对启动虚拟现实应用后生成虚拟用户界面进行布局后,用户可方便地与虚拟用户界面中的内容进行交互。
图3L示出了根据一些实施例的虚拟用户界面的交互方法的流程图。本申请实施例提供一种三维显示设备,包括:虚拟显示器,被配置为呈现虚拟用户界面;与虚拟显示器连接的控制器,在执行图3L所示的虚拟用户界面的交互方法时,控制器被配置为:
S301、响应于触发虚拟现实应用时产生的应用启动指令,生成包括显示主页、导航栏和应用切换区的虚拟用户界面。
S302、在基于显示主页进行页面切换时,响应于触发显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示。
S303、在基于导航栏进行导航按钮切换时,响应于触发导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案。
S304、在基于应用切换区进行应用切换时,响应于触发应用切换区中任一个应用时产生的应用切换指令,启动所述应用。
用户在操作三维显示设备,启动其配置的虚拟现实应用时,可在虚拟空间中生成虚拟用户界面。虚拟用户界面的内容可参照图1所示的内容,包括显示主页、导航栏、应用切换区和消息推荐入口。
在一些实施例中,在基于显示主页进行页面切换时,用户可将需要查看的页面切换至主视角中心线对应的位置,便于用户以直视的状态查看该页面内容。
具体地,控制器在执行响应于触发显示主页中任一个页面时产生的页面选择指令,将页面切换至主视角中心线对应的位置显示,被进一步配置为:在显示主页以正交页面布局方式进行页面显示时,显示主页中的每个页面显示在实现正交页面布局方式的正多边形的指定边上,所述指定边包括用于显示页面的中间指定边、左侧指定边和右侧指定边,以及,用于隐藏页面的左侧隐藏指定边和右侧隐藏指定边,所述中间指定边为主视角中心线对应的指定边;响应于触发所述右侧指定边上的页面时产生的页面选择指令,将位于右侧指定边的页面向左移动至中间指定边上,以及,将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示;响应于触发左侧指定边上的页面时产生的页面选择指令,将位于左侧指定边的页面向右移动至中间指定边上,以及,将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧隐藏指定边的隐藏页面向右移动至左侧指定边上并进行显示。
在基于显示主页进行页面切换时,相应的实现过程可参照前述实施例中的相关内容,此处不再赘述。
在一些实施例中,在基于导航栏进行导航按钮切换时,可为每个执行操作的导航按钮添加标识图案,已提示用户该导航按钮已获得焦点。
具体地,控制器在执行响应于触发导航栏中任一个导航按钮时产生的导航选择指令,为导航按钮添加与所述操作对应的标识图案,被进一步配置为:在基于所述导航栏切换不同的导航按钮时,如果每个导航按钮均未获得控制焦点,则为每个所述导航按钮均添加与所述操作对应的表征正常状态的标识图案;响应于触发所述导航栏中任一个导航按钮时产生的表征获得控制焦点的导航选择指令,为所述导航按钮添加与所述操作对应的表征获焦状态的标识图案;响应于触发所述导航栏中任一个导航按钮时产生的表征获得触发操作后又丢失控制焦点的导航选择指令,为所述导航按钮添加与所述操作对应的表征遗留状态的标识图案。
在基于导航栏进行导航按钮切换时,相应的实现过程可参照前述实施例中的相关内容,此处不再赘述。
在一些实施例中,在基于应用切换区进行应用切换时,用户可点击应用切换区中展示的任一个应用,并产生应用切换指令,三维显示设备可直接启动应用,实现快速的应用切换。
可见,本申请实施例提供的一种三维显示设备,在进行虚拟用户界面的交互时,在基于显示主页进 行页面切换时,响应于触发显示主页中任一个页面时产生的页面选择指令,将页面切换至主视角中心线对应的位置显示。在基于导航栏进行导航按钮切换时,响应于触发导航栏中任一个导航按钮时产生的导航选择指令,为导航按钮添加与操作对应的标识图案。在基于应用切换区进行应用切换时,响应于触发应用切换区中任一个应用时产生的应用切换指令,启动应用。可见,该设备可以实现最佳的交互体验。
本申请实施例提供的一种虚拟用户界面的布局方法,由前述实施例中提供的三维显示设备的控制器执行,所述方法包括:
响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。
图3L示出了根据一些实施例的虚拟用户界面的交互方法的流程图。参见图3L,本申请实施例提供的一种虚拟用户界面的交互方法,由前述实施例中提供的三维显示设备的控制器执行,所述方法包括:
响应于触发虚拟现实应用时产生的应用启动指令,生成包括显示主页、导航栏和应用切换区的虚拟用户界面;在基于所述显示主页进行页面切换时,响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示;在基于所述导航栏进行导航按钮切换时,响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案;在基于所述应用切换区进行应用切换时,响应于触发所述应用切换区中任一个应用时产生的应用切换指令,启动所述应用。
由以上实施方式可知,本申请实施例提供的一种虚拟用户界面的布局、交互方法及三维显示设备,在进行虚拟用户界面布局时,启动虚拟现实应用,在虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。显示主页采用正交布局方式,可保证所有页面布局均在舒适体验范围内进行操作,便于用户查看每一个页面。在进行虚拟用户界面的交互时,触发显示主页中任一个页面将其切换至主视角中心线对应的位置显示。触发导航栏中任一个导航按钮,为导航按钮添加与操作对应的标识图案。触发应用切换区中任一个应用进行应用启动。可见,本申请实施例提供的方法及三维显示设备,利用三维空间特点和视觉特点,在三维空间内采用正交布局方式生成虚拟用户界面,该虚拟用户界面中的内容均在用户的主视角范围内,便于用户在舒适体验范围内交互操作,提高交互体验。
第二部分
在一些实施例中,在虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区,将应用切换区作为应用快捷入口,以快速启动应用在主页展示系统推荐的应用、热度较高、用户频繁使用的应用等,提高相应应用的更多曝光度,将上述应用推荐给用户进行使用或安装。应用切换区可展示系统为用户推荐的应用,还可展示本地安装应用,即不同属性的应用包括系统推荐应用和本地安装应用。系统推荐应用包括系统推荐安装应用和系统推荐使用应用,本地安装应用包括系统预置应用和用户安装的第三方应用。应用切换区如图1中(3)所示区域。
应用切换区位于虚拟用户界面的主页,以展示为用户推荐的应用。但是,由于各个应用的属性不同,不同属性的应用包括系统推荐应用和本地安装应用,导致在虚拟现实用户界面展示时,无法区分不同属性的应用,用户体验不好。
为此,为了在展示应用时能够区分不同属性,以及,能够兼顾运营需求和用户需求,本申请实施例提供一种三维显示设备,在展示虚拟用户界面时,将应用切换区进行划分,将同一属性的应用展示在同一区域内,便于用户有目的地选择交互,避免出现混乱,交互体验更好。
图4A示出了根据一些实施例的虚拟用户界面中应用图标的展示方法的流程图。本申请实施例提供的一种三维显示设备,包括:虚拟显示器,被配置为呈现包括应用切换区的虚拟用户界面;与虚拟显示器连接的控制器,在执行图4A所示的虚拟用户界面中应用图标的展示方法时,控制器被配置为执行下述步骤:
S401、响应于触发虚拟现实应用时产生的应用启动指令,获取需要展示的第一应用和第二应用,以及,用于表征本端是否配置有推荐展示功能的系统配置信息。
三维显示设备的交互不同于传统的电视、手机等,一般通过头触控点或者手柄进行交互,不再像遥控器方式进行顺序操作,而是类似鼠标一样可以自由地选择虚拟用户界面中呈现的任一UI控件进行操作。
用户佩戴三维显示设备,并触发该三维显示设备中配置的虚拟现实应用,在虚拟的三维空间中生成虚拟用户界面。虚拟用户界面可参见图1所示内容,在需要进行应用的展示时,可在图1中(3)所示的应用切换区进行展示。
为此,在产生应用启动指令时,三维显示设备向服务器获取需要展示的第一应用和第二应用,以及, 用于表征本端是否配置有推荐展示功能的系统配置信息。服务器为系统端,服务器中存储有三维显示设备所需的各种类型数据。
在一些实施例中,第二应用为系统推荐应用,第一应用为本地安装应用。系统推荐应用是指系统向三维显示设备推荐使用或推荐安装的应用,包括系统推荐安装应用和系统推荐使用应用;本地安装应用是指三维显示设备中已进行配置的应用,包括系统预置应用和用户安装的第三方应用。
在一些实施例中,应用切换区展示的应用数量有限,并非将上述不同属性的应用全部展示,而是仅展示用户最近使用、历史频繁使用、当前热度较高或商业价值较高的应用,目的是给予上述应用更多曝光,以指引用户启动上述应用。
例如,在应用切换区展示系统推荐应用时,该应用可为系统根据用户喜好推荐的还未进行安装的应用,还可为系统推荐的用户已经安装的应用。如果推荐的是还未安装的应用,则在触发该应用时,可直接跳转到应用下载页面,进行下载安装;如果推荐的是已进行安装的应用,则在触发该应用时,可直接启动该应用。
在一些实施例中,为对上述不同的属性应用进行分隔展示,可在应用切换区生成固定显示区和翻页显示区,此时,应用切换区加载第二模板界面。第二模板界面中的固定显示区配置数个固定展示位,每个固定展示位用于展示系统推荐应用;第二模板界面中的翻页显示区配置数个翻页展示位,每个翻页展示位用于展示本地安装应用。而固定显示区和翻页显示区并非一直同时展示,在系统端未向设备端推荐应用或者设备端不需要展示推荐应用时,则固定显示区被取消展示,而只展示翻页显示区。此时,应用切换区加载第一模板界面,第一模板界面中只存在翻页展示位。
在一些实施例中,系统端是否为用户推荐应用以及设备端是否进行展示的功能,可由开发人员根据设备参数进行选择性配置。因此,在虚拟用户界面中展示应用时,可根据系统配置信息来判断三维显示设备是否具有推荐展示功能。
推荐展示功能用于表征系统端是否为设备端推荐了应用,以及,三维显示设备是否需要对系统端推荐的应用进行展示。如果本端具有推荐展示功能,则在应用切换区加载第二模板界面,以同时展示固定显示区和翻页显示区,即同时展示固定展示位和翻页展示位;如果本端不具有推荐展示功能,则在应用切换区加载第一模板界面,只展示翻页显示区,即只展示翻页展示位。
在一些实施例中,控制器在根据系统配置信息判断本端是否配置有推荐展示功能,被进一步配置为:获取系统配置信息中的第二应用的当前展示数量和系统配置的固定展示位的配置数量;如果固定展示位的配置数量为零,则确定系统配置信息表征本端未配置有推荐展示功能;如果第二应用的当前展示数量为零,则将固定展示位的配置数量设置为零,以及,确定系统配置信息表征本端未配置有推荐展示功能;如果固定展示位的配置数量不为零,以及,第二应用的当前展示数量不为零时,则确定系统配置信息表征本端配置有推荐展示功能。
在判断本端是否配置推荐展示功能时,其判断条件包括两个,分别为用于展示系统推荐应用的固定展示位的配置数量和系统端推送的第二应用(系统推荐应用)的当前展示数量,第二应用的当前展示数量是指系统端推荐的需要在三维显示设备中进行展示的应用的数量。而配置数量和当前展示数量均存储在系统配置信息中,因此,可根据系统配置信息获得第二应用的当前展示数量和系统配置的固定展示位的配置数量。
在一些实施例中,固定展示位为固定显示区中可进行系统推荐应用展示的位置,如果固定显示区的固定展示位的配置数量为零,说明三维显示设备端并未配置固定显示区,即应用切换区呈现第一模板界面。此时,无论系统端是否向设备端推荐可展示的应用,均无法在固定显示区进行展示。因此,可根据系统配置信息确定本端未配置有推荐展示功能。
在一些实施例中,如果第二应用的当前展示数量为零时,说明系统端并未向设备端推荐可展示的第二应用,同时也说明设备端不会展示固定展示位。例如,如果系统端并未推荐应用时,若设备端仍展示固定展示位,则每个固定展示位上无可展示的内容,将导致固定显示区的显示内容为空。空白的固定显示区仍占据应用切换区的空间,导致翻页显示区中可展示的应用数量减少,影响界面布局和用户体验。因此,在第二应用的当前展示数量为零时,设备端即使配置有固定展示位也不会再展示出来。此时,可根据系统配置信息确定本端未配置有推荐展示功能。
在一些实施例中,如果固定显示区的固定展示位的配置数量为零,说明设备并未配置固定展示位。如果第二应用的当前展示数量为零时,说明系统端并未推荐可展示的应用,即无需在固定展示位进行内容展示,因此,设备无需配置固定展示位,此时,可将固定展示位的配置数量设置为零。基于此,可根据系统配置信息确定本端未配置有推荐展示功能。
可见,在判断三维显示设备未配置有推荐展示功能时,其判断依据包括三种情况,分别为(1)固定显示区的固定展示位的配置数量为零,(2)第二应用的当前展示数量为零,(3)固定显示区的固定 展示位的配置数量为零,以及,第二应用的当前展示数量为零。
在一些实施例中,如果固定展示位的配置数量不为零,以及,第二应用的当前展示数量不为零时,说明设备端配置有固定显示区(固定展示位),以及,系统端向设备端推荐可展示的应用。此时,需要在固定显示区展示第二应用,即根据系统配置信息确定本端配置有推荐展示功能。
可见,在判断三维显示设备配置有推荐展示功能时,其判断依据包括一种情况,为固定展示位的配置数量和第二应用的当前展示数量均不为零。
S402、如果系统配置信息表征本端未配置有推荐展示功能,则在应用切换区加载包括翻页展示位的第一模板界面,在翻页展示位展示第一应用的图标,以及,在接收到移动指令时,翻页展示位中展示的图标向移动指令所指示的方向移动。
在根据系统配置信息确定出本端未配置有推荐展示功能时,说明固定显示区的固定展示位的配置数量为零,和/或,第二应用的当前展示数量为零,设备端无需在固定显示区展示第二应用的图标,只需在翻页展示位展示第一应用的图标。因此,则在应用切换区加载包括翻页展示位的第一模板界面,以在翻页展示位展示第一应用的图标,应用切换区显示在虚拟用户界面的主视角底部区域。
图4B示出了根据一些实施例的本端未配置有推荐展示功能时翻页显示区4201的展示效果图。如果在固定展示位的配置数量为零,和/或,第二应用的当前展示数量为零时,说明设备端未配置固定展示位,且不存在系统推荐的第二应用,此时仅需展示第一应用,如本地安装应用。因此,在应用切换区展示只包括翻页显示区的第一模板界面,翻页显示区中呈现数个翻页展示位,翻页展示位用于显示本地安装应用。参见图4B中的(a)部分所示,应用切换区包括翻页显示区,翻页显示区中呈现七个翻页展示位,分别展示七个本地安装应用B1-B7。
在一些实施例中,如果需要在翻页展示位上展示的第一应用的总数量超过翻页展示位的配置数量,则无法同时展示所有第一应用。此时,可通过翻页操作,触发翻页展示位上的应用图标移动,以查看后序或前序的应用图标。
例如,用户通过手柄触发应用切换区两侧的翻页按钮,产生移动指令。若触发右侧翻页按钮,实现向左翻页,则移动指令对应的方向为向左移动,进而控制各个翻页展示位上的应用图标整体向左移动一个位置,并在最右侧的翻页展示位上重新展示一个新的应用图标,而最左侧的翻页展示位上原展示的应用图标被隐藏。
再例如,若触发左侧翻页按钮,实现向右翻页,则移动指令对应的方向为向右移动,进而控制各个翻页展示位上的应用图标整体向右移动一个位置,并在最左侧的翻页展示位上重新展示一个新的应用图标,而最右侧的翻页展示位上原展示的应用图标被隐藏。翻页操作的具体实现过程可参照后续内容,此处不赘述。
在一些实施例中,由于在系统配置信息表征本端未配置有推荐展示功能的情况下,无论系统端是否向设备端推荐可展示的应用,均无法在固定展示位进行展示。因此,无需再判断第二应用的当前展示数量是否为零,即可根据系统配置信息确定本端未配置有推荐展示功能。
但是,如果在固定展示位的配置数量为零,而第二应用的当前展示数量不为零时,此时,虽然设备端未配置固定展示位,但系统端仍向设备端推荐可展示的应用。此时,应用切换区仍需要展示第二应用。
为此,在这种场景下,控制器被进一步配置为:在应用切换区加载包括翻页展示位的第一模板界面的情况下,获取系统配置信息中的第二应用的当前展示数量;如果第二应用的当前展示数量不为零,则在翻页展示位展示第一应用的图标和第二应用的图标。
在固定展示位的配置数量为零时,设备端并未配置固定展示位,但是存在系统端推荐的应用,此时,可将系统推荐应用展示在翻页展示位,即由翻页显示区同时展示系统推荐应用的图标和本地安装应用的图标。
在一些实施例中,控制器在执行在翻页展示区展示第一应用的图标和第二应用的图标,被进一步配置为:获取所述系统配置信息中的翻页展示位的配置数量和指定应用的总应用数量,指定应用包括第一应用和需要在翻页展示位展示的第二应用;如果翻页展示位的配置数量大于或等于指定应用的总应用数量,则由每个翻页展示位依次加载所述第二应用的图标和第一应用的图标;如果翻页展示位的配置数量小于指定应用的总应用数量,则基于第二应用和第一应用的顺序生成应用列表;将应用列表中的与总应用数量对应的指定应用展示在翻页展示位,以及,在应用切换区的两侧显示翻页按钮,翻页按钮用于触发应用列表中的指定应用展示在翻页展示位。
在需要由翻页显示区同时展示系统推荐应用和本地安装应用时,由于翻页显示区的长度有限,其配置的翻页展示位的数量有限,使得可展示的应用数量有限,因此,需要判断翻页显示区是否需要采用翻页的形式进行展示。
翻页显示区包括用于展示应用图标的翻页展示位,获取翻页展示位的配置数量和指定应用的总应用 数量,指定应用包括第一应用(本地安装应用)和需要在翻页显示区展示的第二应用(系统推荐应用)。如果翻页展示位的配置数量大于或等于指定应用的总应用数量,说明翻页展示区可同时将全部需要展示的系统推荐应用和本地安装应用进行展示,则将系统推荐应用和本地安装应用展示在翻页显示区的各个翻页展示位,此时,不需要展示翻页按钮。
翻页显示区各个翻页展示位的应用图标展示顺序按照系统推荐应用和本地安装应用的顺序进行排序,即先展示系统推荐应用,再展示本地安装应用,此时,以从左至右的顺序,由位列左侧前端的翻页展示位先加载第二应用的图标,下一翻页展示位加载下一个第二应用的图标,在第二应用的图标被全部显示完毕后,再由下一个翻页展示位加载第一应用的图标,依此类推,直至翻页显示区的各个翻页展示位上均展示有内容。
而对于具有相同属性的系统推荐应用来说,其排序顺序为先展示系统推荐安装的应用,再展示系统推荐使用的应用;对于具有相同属性的本地安装应用来说,其排序顺序可为最近安装的顺序、用户最近使用的顺序、历史频繁使用的顺序、当前热度较高的顺序或商业价值较高的顺序的应用。
参见图4B中的(b)部分,在固定展示位的配置数量为零,以及,第二应用的当前展示数量不为零的情况下,例如,如果系统推荐应用为2个,本地安装应用为4个,则指定应用的总应用数量为6个。而如果翻页展示位的配置数量为7个,则可将两个系统推荐应用X1-X2和四个本地安装应用B1-B4分别展示在翻页展示区,最后一个展示位为空。
在一些实施例中,如果翻页展示位的配置数量小于指定应用的总应用数量,说明翻页显示区不可同时将全部需要展示的系统推荐应用和本地安装应用进行展示,此时,需采用翻页的方式则将系统推荐应用和本地安装应用展示在翻页显示区。
为进行翻页展示,基于系统推荐应用和本地安装应用的顺序生成应用列表,并在应用列表中选取与总应用数量对应的指定应用展示在翻页显示区,应用列表中的其余应用则暂不进行展示。为便于进行翻页操作,在应用切换区的两侧显示翻页按钮,翻页按钮用于触发应用列表中的指定应用展示在翻页显示区。
在一些实施例中,应用列表的生成顺序可采用前述说明的翻页显示区的应用展示顺序。
参见图4B中的(c)部分,在固定展示位的配置数量为零,以及,第二应用的当前展示数量不为的情况下,例如,如果系统推荐应用为4个,本地安装应用为6个,则指定应用的总应用数量为10个。而如果翻页展示位的配置数量为7个,则生成的应用列表包括四个系统推荐应用X1-X4和六个本地安装应用B1-B6。展示时,选取应用列表中的前7个应用,即四个系统推荐应用X1-X4和三个本地安装应用B1-B3分别展示在翻页展示区的七个翻页展示位中。同时,在应用切换区的右侧显示右侧翻页按钮,以提示用户可向左翻页以查看应用列表中的其他应用。在执行一次向左翻页后,在应用切换区的左侧显示左侧翻页按钮,实现向右翻页。
在一些实施例中,由于翻页显示区同时展示系统推荐应用和本地安装应用,为便于对两个不同属性的应用图标进行区分,可在应用切换区展示间隔标记4203,如图4B中的(b)部分和(c)所示,间隔标记位于系统推荐应用和本地安装应用之间。在基于第一模板界面进行翻页操作时,间隔标记跟随翻页展示位中的各个应用图标一起移动位置。
S403、如果系统配置信息表征本端配置有推荐展示功能,则在应用切换区加载包括固定展示位和翻页展示位的第二模板界面,在固定展示位展示第二应用的图标,在翻页展示位展示第一应用的图标,以及,在接收到移动指令时,固定展示位中的图标不动,翻页展示位中的图标向移动指令所指示的方向移动。
在根据系统配置信息确定出本端配置有推荐展示功能,说明设备端配置有固定显示区,固定显示区配置数个固定展示位,且系统端产生向设备端推荐的应用,设备端需要在应用切换区同时展示第一应用和第二应用。因此,在应用切换区加载包括固定展示位和翻页展示位的第二模板界面,以在固定展示位展示第二应用的图标,在翻页展示位展示第一应用的图标。例如,在固定显示区展示系统推荐应用,在翻页显示区展示本地安装应用。
在一些实施例中,在系统配置信息表征本端配置有推荐展示功能时,应用切换区需同时展示系统推荐应用和本地安装应用,此时,应用切换区加载包括固定展示位和翻页展示位的第二模板界面,为便于对两个不同属性的应用进行进一步区分,可在应用切换区展示间隔标记,间隔标记位于固定展示位和翻页展示位之间。利用间隔标记将系统推荐应用和本地安装应用分隔开,可便于用户快速并准确地选取其感兴趣的应用。在基于第二模板界面进行翻页操作时,固定显示区的固定展示位和间隔标记不跟随翻页显示区中的各个翻页展示位一起移动位置。
在一些实施例中,在应用切换区需要展示的总应用数量超过应用切换区配置的固定展示位和翻页展示位的总配置数量时,可通过翻页的方式查看前续或后续应用图标。例如,在触发左侧翻页按钮时,产 生向右翻页的移动指令,第二模板界面中的翻页展示位响应该移动指令,而固定展示位并不响应该移动指令。因此,固定展示位中的应用图标不随移动指令移动,而翻页展示位中的图标向移动指令所指示的方向移动,即翻页展示位上的应用图标整体向右移动一个位置。若触发右侧翻页按钮,则产生向左翻页的移动指令,此时,翻页展示位上的应用图标整体向左移动一个位置。在基于第二模板界面进行翻页操作时,具体的实现过程可参照后续内容,此处不赘述。
在一些实施例中,应用切换区配置的固定展示位和翻页展示位的数量有限,使得系统推荐应用的显示数量和本地安装应用的显示数量均有限。为便于在系统推荐应用和/或本地安装应用的总数量超出应用切换区的各展示位总数量,可通过翻页的形式查看其余未显示在应用切换区的应用。
因此,控制器在执行在固定展示位展示第二应用的图标,在翻页展示位展示第一应用的图标,被进一步配置为:在应用切换区加载包括固定展示位和翻页展示位的第二模板界面时,获取系统配置信息中的固定展示位的配置数量和第二应用的当前展示数量;如果第二应用的当前展示数量小于或等于固定展示位的配置数量,则在固定展示位展示第二应用的图标,在翻页展示位展示第一应用的图标;如果第二应用的当前展示数量大于固定展示位的配置数量,则计算推荐应用超出数量,以及,在固定展示位展示与固定展示位的配置数量对应的第二应用,在翻页展示位展示第一应用的图标和推荐应用超出数量对应的第二应用的图标。
在第二应用的当前展示数量不为零时,应用切换区加载的第二模板界面中包括固定显示区和翻页显示区。
在一些实施例中,如果第二应用的当前展示数量小于或等于固定展示位的配置数量,说明固定显示区可完整展示所有系统推荐应用,则在固定显示区的各个固定展示位依次显示系统推荐应用,在翻页显示区的各个翻页展示位依次显示本地安装应用。
图4C示出了根据一些实施例的本端配置有推荐展示功能时应用切换区的展示效果图。在固定展示位的配置数量不为零,以及,第二应用的当前展示数量不为零的场景下,参见图4C中的(a)部分,例如,如果系统推荐应用的当前展示数量为3,固定显示区4202的固定展示位的配置数量为3,则可在固定显示区完整展示三个系统推荐应用X1-X3。翻页显示区4201配置四个翻页展示位,以展示对应的本地安装应用,例如,翻页显示区显示四个本地安装应用B1-B4。
在一些实施例中,如果第二应用的当前展示数量大于固定展示位的配置数量时,说明固定显示区不可完整显示所有系统推荐应用,此时,仅在固定显示区的各个固定展示位上显示与固定展示位的配置数量对应数量的系统推荐应用,之后显示间隔标记,再之后在翻页显示区显示超出的系统推荐应用,即将超过的系统推荐应用展示在翻页展示位上。
具体地,由系统推荐应用的当前展示数量减去固定展示位的配置数量,得到推荐应用超出数量,使得在固定显示区显示与固定展示位的配置数量对应的系统推荐应用,在翻页显示区显示本地安装应用和推荐应用超出数量对应的系统推荐应用。
参见图4C中的(b)部分所示,例如,如果固定显示区的固定展示位的配置数量为3个,而系统推荐应用的当前数量为5个时,则计算得到推荐应用超出数量为2个。此时,将前三个系统推荐应用X1-X3显示在固定显示区的三个固定展示位上,将后两个系统推荐应用X4-X5显示在翻页显示区的前两个翻页展示位上。
此时,由于翻页显示区要同时显示系统推荐应用和本地安装应用,为避免显示混乱,可将超出的系统推荐应用放置在翻页显示区的前端翻页展示位,将本地安装应用放置在系统推荐应用的后端。
在一些实施例中,在各个固定展示位展示对应第二应用的图标时,展示顺序可依据第二应用的热度值的大小顺序进行展示;在各个翻页展示位展示对应第一应用的图标时,展示顺序可依据第一应用的历史使用时间来展示。该展示方式应用在应用切换区加载第二模板界面的场景下。
在一些实施例中,在进行应用图标展示时,控制器在执行在固定展示位展示第二应用的图标,在翻页展示位展示所述第一应用的图标,被进一步配置为:在应用切换区加载包括固定展示位和翻页展示位的第二模板界面时,获取第二应用的热度值和第一应用的历史使用时间;根据每个第二应用的热度值的大小顺序,依次将对应的第二应用的图标展示在每个固定展示位上;根据每个第一应用的历史使用时间的由晚至早的时间顺序,依次将对应的第一应用的图标展示在每个翻页展示位上。
在应用切换区加载第二模板界面时,第二模板界面中可同时展示第二应用和第一应用。
在固定展示位进行第二应用的图标展示时,可根据每个第二应用的热度值进行展示,即将每个第二应用的热度值由高至低进行排序,由左侧第一个固定展示位展示热度值最高的第二应用的图标;最侧第二个固定展示位展示热度值其次的第二应用的图标,依此类推。
在翻页展示位展示第二应用的图标和第一应用的图标时,将第二应用的图标也按照热度值的大小顺序依次展示在前端的翻页展示位上。在第二应用的图标展示完毕后,继续展示第一应用的图标。第一应 用的图标展示按照历史使用时间进行展示,将最近使用的第一应用的图标展示在空闲的最左侧的翻页展示位,即展示在第二应用的图标的右侧;将再早一些使用的第一应用的图标展示在下一个空闲的翻页展示位上,即位于前一个展示的第一应用的图标的右侧,其他第二应用图标依此类推。
在一些实施例中,如果翻页显示区当前需要显示的应用数量超过翻页显示区的翻页展示位的配置数量,则需要对翻页显示区进行翻页操作。翻页显示区的翻页展示位的配置数量为翻页显示区可同时显示的最大应用数量。
因此,控制器在执行在翻页显示区展示系统推荐应用和本地安装应用,被进一步配置为:获取系统配置信息中的翻页展示位的配置数量和指定应用的总应用数量,指定应用包括第一应用和需要在翻页显示区展示的第二应用;如果翻页展示位的配置数量大于或等于指定应用的总应用数量,则由每个翻页展示位依次加载所述第二应用的图标和第一应用的图标;如果翻页展示位的配置数量小于指定应用的总应用数量,则第二应用和第一应用的顺序生成应用列表;将应用列表中的与总应用数量对应的指定应用展示在翻页展示位,以及,在应用切换区的两侧显示翻页按钮,翻页按钮用于触发所述应用列表中的指定应用展示在翻页展示位。
在确定应用切换区是否需要执行翻页操作时,获取翻页显示区的翻页展示位的配置数量和指定应用的总应用数量。如果指定应用的总应用数量大于翻页展示位的配置数量,说明翻页显示区不足以全部展示所有可显示应用,需要进行翻页操作。
其中,指定应用包括本地安装应用和需要在翻页显示区展示的系统推荐应用,需要在翻页显示区展示的系统推荐应用是指所有系统推荐应用中除在固定显示区进行展示之外的推荐应用超过数量对应的系统推荐应用。
在需要对翻页显示区执行翻页操作时,翻页显示区展示各个属性应用的实现过程可参照前述实施例提供的步骤所示内容,此处不再赘述。
在翻页显示区需要通过翻页操作来展示所有可显示的应用图标时,按照应用列表中的顺序,将可显示应用总数量对应的应用呈现在翻页显示区,以及,在应用切换区的两侧显示翻页按钮,翻页按钮用于触发应用列表中的应用显示在翻页显示区的翻页展示位。
在一些实施例中,在翻页展示位上展示第二应用的图标的场景包括两种情况,一种是应用切换区加载第一模板界面时,此时,固定展示位的配置数量为零,但存在系统推荐的第二应用,因此,需将系统推荐的第二应用和第一应用同时展示在翻页展示位上。另一种是应用切换区加载第二模板界面时,此时,固定展示位的配置数量不为零,且系统推荐的第二应用的数量超过固定展示位的配置数量,因此,需将超出固定展示位展示的第二应用与第一应用同时展示在翻页展示位上。
在一些实施例中,在应用切换区加载第二模板界面时,控制器在执行在翻页展示区展示第一应用的图标和第二应用的图标,被进一步配置为:在应用切换区加载包括固定展示位和翻页展示位的第二模板界面,以及,存在需要在翻页展示位展示的第二应用的图标时,获取第二应用的热度值和第一应用的历史使用时间;根据每个第二应用的热度值的大小顺序,依次将对应的第二应用的图标展示在位列前端的翻页展示位上,以及,根据每个第一应用的历史使用时间的由晚至早的时间顺序,依次将对应的第一应用的图标展示在位列后端的翻页展示位上,第一应用的图标展示在第二应用的图标的右侧。
在应用切换区加载第二模板界面时,第二模板界面中可同时展示第二应用和第一应用。如果固定展示位的配置数量小于第二应用的当前展示数量,则在固定展示位展示对应数量的第二应用的图标,在翻页展示位上展示第一应用的图标和其余未展示在固定展示位的第二应用的图标。
在固定展示位进行第二应用的图标展示时,可根据每个第二应用的热度值进行展示,即将每个第二应用的热度值由高至低进行排序,由左侧第一个固定展示位展示热度值最高的第二应用的图标;最侧第二个固定展示位展示热度值其次的第二应用的图标,依此类推。
在翻页展示位展示第二应用的图标和第一应用的图标时,将第二应用的图标也按照热度值的大小顺序依次展示在前端的翻页展示位上。在第二应用的图标展示完毕后,继续展示第一应用的图标。第一应用的图标展示按照历史使用时间进行展示,将最近使用的第一应用的图标展示在空闲的最左侧的翻页展示位,即展示在第二应用的图标的右侧;将再早一些使用的第一应用的图标展示在下一个空闲的翻页展示位上,即位于前一个展示的第一应用的图标的右侧,其他第二应用图标依此类推。
在一些实施例中,在应用切换区加载第一模板界面时,控制器在执行在翻页展示区展示第一应用的图标和第二应用的图标,被进一步配置为:在应用切换区加载包括翻页展示位的第一模板界面,以及,存在需要在翻页展示位展示的第二应用的图标时,获取第二应用的热度值和第一应用的历史使用时间;根据每个第二应用的热度值的大小顺序,依次将对应的第二应用的图标展示在位列前端的翻页展示位上,以及,根据每个第一应用的历史使用时间的由晚至早的时间顺序,依次将对应的第一应用的图标展示在位列后端的翻页展示位上,第一应用的图标展示在第二应用的图标的右侧。
在应用切换区加载第一模板界面时,第二模板界面中利用翻页展示位同时展示第二应用和第一应用的图标。翻页展示位上展示第一应用的图标和第二应用的图标的实现方式可参照前述实施例的内容,此处不再赘述。
在一些实施例中,第一应用的展示顺序和第二应用的展示顺序,以及生成应用列表的顺序也可采用其他排序方式,此处不做具体限定。
在一些实施例中,在需要对翻页显示区中展示的应用进行翻页操作时,可触发应用切换区两侧的翻页按钮。而翻页动作可触发应用移动一个位置,还可触发一个页面的应用整体移动位置。
在一些实施例中,在每触发一次翻页按钮控制应用移动一个展示位置的场景下,控制器被进一步配置为:在查看应用列表中未展示在翻页展示位的指定应用时,接收对右侧翻页按钮的操作,将应用列表中的位于末位展示应用的后一指定应用的图标向左移动展示在末位翻页展示位,末位展示应用是指展示在翻页显示区的末位翻页展示位的应用;接收对左侧翻页按钮的操作,将应用列表中的位于首位展示应用的前一指定应用的图标向右移动展示在首位翻页展示位,首位展示应用是指展示在翻页显示区的首位翻页展示位的应用。
在各个翻页展示位展示的应用并非用户所感兴趣的应用时,用户可触发翻页按钮,以查看位于应用列表中还未展示在翻页展示位的应用。
对翻页展示位的应用图标执行翻页操作时,可应用在应用切换区仅展示翻页显示区的场景下,即加载第一模板界面的场景,还可应用在应用切换区同时展示固定显示区和翻页显示区的场景下,即加载第二模板界面的场景。
图4D示出了根据一些实施例的翻页显示区在进行翻页交互时的一种展示效果图。参见图4D中的(a)部分所示,例如,在系统推荐应用为零时,应用切换区加载仅包括翻页显示区的第一模板界面,翻页显示区配置数个翻页展示位。如果翻页展示位的配置数量为7个,当前显示应用的总数量为10个,则根据10个应用生成应用列表,将该应用列表中前7个应用B1-B7显示在翻页显示区。
同时,在应用切换区的左右两侧分别显示翻页按钮,在初始时刻,仅在右侧显示右侧翻页按钮,在执行一次向左翻页后,再在左侧显示左侧翻页按钮。需要向左翻页时,触发右侧翻页按钮产生向左翻页指令。响应于向左翻页指令,控制当前翻页展示位中展示的所有应用整体向左一个位置,此时,翻页显示区的首位翻页展示位上的第一位应用图标被隐藏,而末位展示位上出现空位。同时,在应用列表中未进行展示的应用中选取一个待展示应用图标,该待展示应用为位于原展示在末位翻页展示位的末位展示应用的后一指定应用,将该后一个指定应用的图标向左移动一个位置展示在末位翻页展示位。
参见图4D中的(b)部分所示,在触发右侧翻页按钮4204时,翻页显示区的当前展示的所有应用图标向左移动,位于第一位的应用B1被隐藏,而从应用列表中选择原展示在末位翻页展示位的末位展示应用的后一指定应用B8的图标显示在翻页显示区的最后一位,即末位翻页展示位。此时,翻页显示区中呈现的本地安装应用为B2-B8。
若再次触发右侧翻页按钮,参见图4D中的(c)部分所示,则将位于第一位的应用B2被隐藏,而从应用列表中选择后一指定应用B9显示在翻页显示区的最后一位。此时,翻页显示区中呈现的本地安装应用为B3-B9。
若在图4D中的(c)部分所示状态下,用户想要回看已经翻过去的应用,则触发左侧翻页按钮4205产生向右翻页指令。响应于向右翻页指令,控制翻页展示位的所有应用B3-B9向右移动一个位置,此时,翻页显示区的末位翻页展示位上的未位应用B9被隐藏,而首位展示位上出现空位。同时,在应用列表中未进行展示的应用中选取一个待展示应用,该待展示应用为位于原展示在首位翻页展示位的首位展示应用B3的前一指定应用B2,将该前一个指定应用B2向右移动一个位置展示在首位翻页展示位。此时,翻页显示区中呈现的本地安装应用为B2-B8,恢复到图4D中的(b)部分所示状态。
在一些实施例中,在应用切换区仅展示翻页展示位,利用翻页展示位同时展示系统推荐应用和本地安装应用时,其执行翻页操作的过程可参照图4D所示的过程,此处不再赘述。如果在该场景下,翻页显示区中存在间隔标记,则在翻页时,间隔标记也随之移动位置。
图4E示出了根据一些实施例的应用切换区在进行翻页交互时的一种展示效果图。参见图4E中的(a)部分所示,例如,在固定展示位不为零以及系统推荐应用不为零时,应用切换区加载包括固定显示区和翻页显示区的第二模板界面,固定显示区配置数个固定展示位,翻页显示区配置数个翻页展示位。如果固定展示位的配置数量为3个,而系统推荐应用的当前数量为5个时,则计算得到推荐应用超出数量为2个。此时,将前三个系统推荐应用(系统推荐应用X1、X2、X3)的图标显示在固定显示区的三个固定展示位上,将后两个系统推荐应用(系统推荐应用X4、X5)的图标显示在翻页显示区的前两个翻页展示位上。
如果翻页显示区的翻页展示位的配置数量为4个,需要显示的本地安装应用为5个,则计算当前显 示应用的总应用数量为7个,其中,当前显示应用的总应用数量包括两个超出的系统推荐应用(系统推荐应用X4、X5)和五个本地安装应用(B1-B5)。
则根据两个超出的系统推荐应用(系统推荐应用X4、X5)和五个本地安装应用生成应用列表,将该应用列表中前4个应用显示在翻页显示区的四个翻页展示位上,即将系统推荐应用X4、系统推荐应用X5、本地安装应用B1、本地安装应用B2显示在翻页展示位。
同时,在应用切换区的左右两侧分别显示翻页按钮。参见图4E中的(b)部分所示,在触发右侧翻页按钮时,固定显示区的三个应用图标不动,翻页显示区当前展示的所有应用向左移动,位于翻页显示区第一位的系统推荐应用X4被隐藏,而从应用列表中选择原展示在末位翻页展示位的末位展示应用的后一指定应用B3显示在翻页显示区的最后一位,即末位翻页展示位。此时,翻页显示区展示的应用分别为系统推荐应用X5、本地安装应用B1、本地安装应用B2、本地安装应用B3。
若再次触发右侧翻页按钮,参见图4E中的(c)部分所示,翻页显示区当前展示的所有应用再次向左移动,则将位于翻页显示区第一位的系统推荐应用X5被隐藏,而从应用列表中选择后一本地安装应用B4显示在翻页显示区的最后一位。此时,翻页显示区展示的应用分别为本地安装应用B1、本地安装应用B2、本地安装应用B3、本地安装应用B4。
若在图4E中的(c)部分所示状态下,用户想要回看已经翻过去的应用,则触发左侧翻页按钮产生向右翻页指令。响应于向右翻页指令,控制翻页显示区的所有应用B1-B4向右移动一个位置,此时,翻页显示区的末位翻页展示位上的未位应用B4被隐藏,而首位展示位上出现空位。同时,在应用列表中未进行展示的应用中选取一个待展示应用,该待展示应用为位于原展示在首位翻页展示位的首位展示应用B1的前一指定应用X5(系统推荐应用),将该前一个指定应用X5向右移动一个位置展示在首位翻页展示位。此时,翻页显示区中呈现的应用为系统推荐应用X5、本地安装应用B1、本地安装应用B2、本地安装应用B3,恢复到图4E中的(b)部分所示状态。其余翻页状态可按照前述方法进行循环。
在一些实施例中,在每触发一次翻页按钮控制整页应用整体移动展示位置的场景下,控制器被进一步配置为:在查看应用列表中未展示在翻页展示位的指定应用时,接收对右侧翻页按钮的操作,将应用列表中的位于所述翻页展示位当前展示应用所在页的后一页对应的应用图标展示在翻页展示位;接收对左侧翻页按钮的操作,将应用列表中的位于翻页展示位当前展示应用所在页的前一页对应的应用图标展示在翻页展示位。
在各个翻页展示位展示的应用并非用户所感兴趣的应用时,用户可触发翻页按钮,以查看位于应用列表中还未展示在翻页显示区的应用。对翻页显示区显示的应用图标执行翻页操作时,即加载第一模板界面的场景,可应用在应用切换区仅展示翻页显示区的场景下,还可应用在应用切换区同时展示固定显示区和翻页显示区的场景下,即加载第二模板界面的场景。
图4F示出了根据一些实施例的翻页显示区在进行翻页交互时的另一种展示效果图。参见图4F中的(a)部分所示,例如,在系统推荐应用为零时,应用切换区加载仅包括翻页显示区的第一模板界面,翻页显示区配置数个翻页展示位。如果翻页展示位的配置数量为7个,当前显示的本地安装应用的总数量为12个,则根据12个应用生成应用列表,将12个本地安装应用按照翻页展示位的配置数量进行分页划分,即将前7个本地安装应用B1-B7划分为第一页,后5个本地安装应用B8-B12划分为第二页。在初始展示时,将该应用列表中第一页对应的前7个应用B1-B7显示在各个翻页展示位。
同时,在应用切换区的左右两侧分别显示翻页按钮,在初始时刻,仅在右侧显示右侧翻页按钮,在执行一次向左翻页后,再在左侧显示左侧翻页按钮。需要向左翻页时,触发右侧翻页按钮产生向左翻页指令。响应于向左翻页指令,控制当前翻页展示位中展示的所有应用整体向左翻一页,此时,翻页显示区的各个翻页展示位上的应用图标全部被隐藏,同时,在应用列表中未进行展示的应用中选取下一页的应用,将该下一页的各个应用图标向左移动展示在各个翻页展示位。
参见图4F中的(b)部分所示,如果在图4F中的(a)部分所示的状态下触发右侧翻页按钮,则将当前展示的第一页对应的7个应用B1-B7全部向左移动被隐藏,同时从应用列表中获取第二页对应的5个应用B8-B12展示在翻页展示位。如果还存在第三页的应用图标时,则再触发右侧翻页按钮,将第三页的应用展示在各个翻页展示位。
如果第二页为应用列表的最后一页,且第二页中的应用数量小于翻页展示位的数量,此时,剩余两个展示位空闲。以及,将右侧翻页按钮隐藏,此时,可通过触发左侧翻页按钮回看已经翻过去的页面。
在一些实施例中,用户想要回看已经翻过去的页面,则触发左侧翻页按钮产生向右翻页指令。响应于向右翻页指令,控制当前翻页显示区中展示的所有应用整体向右翻一页,此时,翻页显示区的各个翻页展示位上的应用图标全部被隐藏,同时,在应用列表中未进行展示的应用中选取前一页的应用图标,将该前一页的各个应用图标向右移动展示在各个翻页展示位。
例如,如果在图4F中的(b)部分所示的状态下,翻页显示区当前展示第二页应用B8-B12,用户 触发左侧翻页按钮,则当前展示的第二页对应的5个应用B8-B12全部向右移动被隐藏,同时从应用列表中获取第一页对应的7个应用B1-B7展示在翻页展示位,恢复到图4F中的(a)部分所示状态。
其他向左翻页和向右翻页过程可依据前述方法进行循环,此处不赘述。
图4G示出了根据一些实施例的应用切换区在进行翻页交互时的另一种展示效果图。参见图4G中的(a)部分所示,例如,在固定展示位的配置数量不为零以及系统推荐应用不为零时,应用切换区加载包括固定显示区和翻页显示区的第二模板界面,固定显示区配置数个固定展示位,翻页显示区配置数个翻页展示位。如果固定展示位的配置数量为3个,而系统推荐应用的当前数量为5个时,则计算得到推荐应用超出数量为2个。此时,将前三个系统推荐应用(系统推荐应用X1、X2、X3)显示在固定显示区的三个固定展示位上,将后两个系统推荐应用(系统推荐应用X4、X5)显示在翻页显示区的前两个翻页展示位上。
如果翻页显示区的翻页展示位的配置数量为4个,需要显示的本地安装应用为10个,则计算当前显示应用的总应用数量为12个,其中,当前显示应用的总应用数量包括两个超出的系统推荐应用(系统推荐应用X4、X5)和十个本地安装应用(B1-B10)。
则根据两个超出的系统推荐应用(系统推荐应用X4、X5)和10个本地安装应用生成应用列表,将该应用列表中前4个应用图标显示在翻页显示区的四个翻页展示位上,即将系统推荐应用X4、系统推荐应用X5、本地安装应用B1、本地安装应用B2显示在翻页显示区的四个翻页展示位上。
同时,在应用切换区的左右两侧分别显示翻页按钮,在初始时刻,仅在右侧显示右侧翻页按钮,在执行一次向左翻页后,再在左侧显示左侧翻页按钮。需要向左翻页时,触发右侧翻页按钮产生向左翻页指令。响应于向左翻页指令,固定显示区展示的各个应用图标不动,控制当前翻页显示区中展示的所有应用整体向左翻一页,此时,翻页显示区的各个翻页展示位上的应用图标全部被隐藏,同时,在应用列表中未进行展示的应用中选取下一页的应用,将该下一页的应用图标向左移动展示在翻页显示区的各个翻页展示位上。
参见图4G中的(b)部分所示,如果在图4G中的(a)部分所示的状态下触发右侧翻页按钮,则将翻页显示区当前展示的第一页对应的4个应用(系统推荐应用X4、系统推荐应用X5、本地安装应用B1、本地安装应用B2)图标全部向左移动被隐藏,同时从应用列表中获取第二页对应的4个应用B3-B6展示在翻页显示区的四个翻页展示位上。参见图4G中的(c)部分所示,若继续向左翻页,则将第三页的应用B7-B10展示在翻页显示区的四个翻页展示位上。
在图4G中的(c)部分所示的状态下,翻页显示区当前展示第三页应用B7-B10。如果用户想要回看已经翻过去的页面,用户触发左侧翻页按钮,则当前展示的第三页对应的4个应用B7-B10全部向右移动被隐藏,同时从应用列表中获取第二页对应的4个应用B3-B6展示在翻页显示区,恢复到图4G中的(b)部分所示状态。
如果还存在第四页的应用时,则再触发右侧翻页按钮,将第四页的应用展示在翻页显示区。如果第三页为应用列表的最后一页,且第三页中的应用数量等于翻页展示位的数量,将右侧翻页按钮隐藏,此时,可通过触发左侧翻页按钮回看已经翻过去的页面。
其他向左翻页和向右翻页过程可依据前述方法进行循环,此处不赘述。
在一些实施例中,在基于翻页按钮进行翻页浏览时,可响应翻页指令的仅为翻页显示区的各个翻页展示位上的应用图标,而固定显示区不可执行翻页操作,其展示内容为固定状态,不可移动。
在一些实施例中,若系统基于用户的应用操作习惯重新生成系统推荐应用,或更新本地安装应用时,可在应用切换区更新显示系统推荐应用和本地安装应用。
在一些实施例中,在初始展示应用切换区时,如果存在需要翻页的情况,可只在应用切换区的右侧显示用于向左翻页的右侧翻页按钮,以指示还有更多应用。此时,当用户点击右侧翻页按钮后,间隔标记左侧的固定显示区的应用不动,间隔标记右侧的翻页显示区中的应用图标整体向左移动,并在最后的位置上显示下一应用图标。此设计是为了突出运营配置的入口,引导用户使用。向左翻页后,根据状态情况如果还有更多则继续显示右侧箭头,否则隐藏;同时显示用于向右翻页的左侧翻页按钮,指示用户可以向回翻页。
在一些实施例中,在翻页显示的场景下,如果应用列表中剩余的数据小于或等于一页,则完全显示该页数据,并隐藏右侧翻页按钮,只显示左侧翻页按钮,如图4G中的(c)部分所示的状态。此时,如果用户点击左侧翻页按钮,则将前一页数据进行展示,并显示右侧翻页按钮,以指示用户可以查看已经翻过去的页面中的应用,如图4G中的(b)部分所示的状态。
在一些实施例中,当用户浏览应用切换区展示的某个应用时,即某个应用获取焦点时,该应用图标放大并高亮,指示用户已获得焦点,同时显示该应用对应的名称。可选的,可以拓展配置信息显示应用简介等其它信息。此时点击该按钮即跳转到对应的应用,若为未安装应用,则跳转至下载页面供用户进 行下载安装。
具体地,在触发应用切换区中的某个应用时,控制器被进一步配置为:在应用切换区中展示的任一个应用获得控制焦点时,获取应用的应用信息;将应用信息展示在应用所在展示位的下方。
为使得用户在触发某个应用时,能够及时获得该应用的更多信息,以便确定用户是否对该应用感兴趣,则在用户控制手柄将控制焦点移动到某个应用上时,获取该应用的应用信息。
应用信息包括应用名称、简介信息等,用于对该应用进行简单的介绍。特别是对系统推荐应用且本端还未安装的应用,应用信息便于用户了解该应用的详情,以确定是否需要触发安装过程或使用过程。
将该应用信息展示在该应用图标的下方,即该应用所在展示位的下方。如果该应用为系统推荐应用,则将对应的应用信息展示在推荐展示位的下方;如果该应用为本地安装应用,则将对应的应用信息展示在翻页展示位的下方。
图4H示出了根据一些实施例的应用切换区展示应用信息的展示效果图。参见图4H中的(a)部分,若用户触发翻页显示区的应用B2,如果应用B2为“视频应用A”应用,则在对应翻页展示位的下方显示应用名称“视频应用A”和“简介内容”。
参见图4H中的(b)部分,若用户触发固定显示区的应用X2,如果应用X2为“K歌”应用,则在对应推荐展示位的下方显示应用名称“K歌”和“简介内容”。
在一些实施例中,为了更好地区分当前应用切换区展示的各个应用以及指示用户操作反馈,定义正常、获焦和遗留三个状态,并分别在对应的展示位上添加对应的标识图案,以指示用户该展示位上的应用已获焦。
在基于应用切换区进行交互时,用户操作手柄或头部触控点将控制焦点移动至某个应用上,则为该应用所在展示位添加表征获焦状态的标识图案,获焦状态的标识图案可为高亮形式。而其他应用所在展示位未获得控制焦点,则为每个导航按钮均添加表征正常状态的标识图案,正常状态的标识图案可为透明形式。若获得控制焦点的应用被触发之后,该控制焦点又移动到其他应用所在展示位上时,则为执行触发操作的应用所在展示位添加表征遗留状态的标识图案,遗留状态的标识图案可为颜色标识或带有边框的透明矩形。
图4I示出了根据一些实施例的应用切换区在交互时的展示效果图。当用户操作控制焦点移动到某个应用所在展示位时高亮显示(获焦状态的标识图案),指示当前应用获取焦点;若焦点未点击离开时恢复正常状态(正常状态的标识图案)。例如,参见图4I中的(a)部分所示,在用户将控制焦点移动到“视频应用A”应用上时,“视频应用A”应用高亮显示,同时展示该应用信息,其余应用所在展示位为正常状态。
参见图4I中的(b)部分所示,若用户对获得焦点的“视频应用A”应用进行触发操作,则启动该应用。而后用户操作控制焦点移动到“K歌”应用上,则失去控制焦点的“视频应用A”应用为遗留状态,则在“视频应用A”应用所在展示位上添加表征遗留状态的标识图案,即带有边框的透明矩形,并取消应用信息的展示。同时,在当前获得控制焦点的“K歌”应用所在展示位上添加表征获焦状态的标识图案,即高亮显示,并展示该应用信息。
在一些实施例中,在判断某个应用所在展示位是否获得控制焦点时,可通过判断用户操作的手柄射出的光线是否与应用所在展示位相撞。相撞操作是指线的坐标是否与应用切换区中的应用所在展示位的坐标相交,如果相交,则说明该光线与该应用所在展示位相撞,并确定该应用所在展示位获得控制焦点。此时,如果用户点击手柄的确定键,则可执行触发操作,以启动该应用。
在一些实施例中,应用切换区展示的应用通常以应用图标的形式进行展示。但是,应用图标较为单调,因此,还可以通过系统端下发三维模型及动画。用户在将控制焦点移动到某个应用上时,以动画的形式展示该应用图标、名称和应用信息,或者,仅展示单独的模型动画,以通过不同的模型和不同状态显示不同的动画来提升用户体验。
可见,本申请实施例提供的一种三维显示设备,在展示虚拟用户界面时,将应用切换区进行划分,将同一属性的应用展示在同一区域内,以对不同属性的应用进行区分展示,并能够兼顾运营需求和用户需求,便于用户有目的地选择交互,避免出现混乱,交互体验更好。
由以上实施方式可知,本申请实施例提供的一种虚拟用户界面中应用图标的展示方法及三维显示设备,在启动虚拟现实应用时,如果系统配置信息表征本端未配置有推荐展示功能,则在应用切换区加载包括翻页展示位的第一模板界面,在翻页展示位展示第一应用的图标;如果系统配置信息表征本端配置有推荐展示功能,则在应用切换区加载包括固定展示位和翻页展示位的第二模板界面,在固定展示位展示第二应用的图标,在翻页展示位展示所述第一应用的图标。在接收到移动指令时,固定展示位中的图标不动,翻页展示位中的图标向移动指令所指示的方向移动。可见,该方法及设备,在为用户展示推荐使用或推荐安装的应用时,将应用切换区划分为两段区域,以将不同属性的应用进行区分,便于用户有 目的地选择交互,避免出现混乱,交互体验更好。
第三部分
在一些实施例中,由于虚拟现实应用中配置有实现不同功能的应用,过多的应用展示在虚拟用户界面中,不便于用户快速启动自己感兴趣的应用。或者,在影视分类下,其可提供成千上万部媒资,用户无法快速观看感兴趣的媒资。因此,在基于虚拟用户界面查找用户感兴趣的内容时,可为三维显示设备配置搜索功能,查找的内容包括不同功能的应用、媒资、教育课程、游戏等。
目前常用的搜索功能是通过对内容进行分类后,将同一分类的内容以列表形式展示,若数量较多时,可展示在多个列表页中,最后通过翻页操作查找目标内容,例如视频应用A的客户端在查找媒资时所采用的翻页查找方式。但是,如果用户感兴趣的内容位于最后几页,将会造成频繁的翻页,使得查找目标内容不够便利。
在目前的VR/AR设备中,大多是使用手柄或者头盔来进行交互操作,频繁的翻页操作会很不便。因此,本申请实施例提供一种三维显示设备,在基于虚拟用户界面查找目标内容时,以便于交互为出发点,提出避免频繁翻页增加操作成本的内容搜索方法,让用户更简易的使用搜索。在执行内容搜索方法时,用户无需返回初始搜索界面即可进行再次搜索的方式,即用户可基于搜索结果连续进行搜索,使用户能够快速地查找到自己感兴趣的内容,提高用户搜索便利性。
图5A示出了根据一些实施例的内容搜索方法的流程图;图5B示出了根据一些实施例的内容搜索方法的时序图;图5C示出了根据一些实施例的内容搜索方法的数据流图。本申请实施例提供的一种三维显示设备,包括:虚拟显示器,被配置为呈现展示有搜索按钮的虚拟用户界面;与所述虚拟显示器连接的控制器,在执行图5A、图5B和图5C所示的内容搜索方法时,控制器被配置为执行下述步骤:
S501、接收对搜索按钮的操作,在虚拟用户界面中展示包括输入框的搜索初始界面。
用户佩戴三维显示设备,并触发该三维显示设备中配置的虚拟现实应用,在虚拟的三维空间中生成虚拟用户界面。
图5D示出了根据一些实施例的虚拟用户界面主页的示意图。如图5D所示,虚拟用户界面主页(内容推荐区)的顶部展示搜索按钮5401,搜索按钮为三维显示设备主页的统一搜索入口。用户通过点击搜索入口图标后进入统一搜索,其搜索结果的媒资范围例如可实施为全部业务的应用、应用媒资、影视媒资、教育业务媒资,例如教育、少儿、VR课堂等;其中,业务包括但不限于首页推荐、热门游戏、精选专题、热播剧集等。
用户触发搜索按钮后,生成搜索初始页面,并展示在虚拟用户界面主页中,此时虚拟用户界面中切换展示的内容为搜索初始页面。
在一些实施例中,三维显示设备中的光标可以自由的随手柄定位在显示窗口的任一位置。无需根据界面的显示栏目设置焦点的移动逻辑。
图5E示出了根据一些实施例的搜索初始页面的示意图。参见图5E,用户点击搜索按钮后生成的搜索初始页面中包括输入框5501、语音输入框5502、搜索历史5503、热门搜索5504和输入法键盘5505。
在一些实施例中,用户将光标移动至搜索框的位置,在遥控器上的确认按键被按压时,三维显示设备根据光标的位置和页面中各个栏目对象的位置进行比对,确定执行操作的是搜索按钮,因此执行搜索按钮对应确定指令逻辑。不同按钮/控件/对象对应的指令逻辑可以不同。
输入框为搜索输入框,输入框的光标闪烁,标识输入状态;输入框默认显示提示语支持后台配置,无配置时显示“请输要搜索的内容名称”,在用户输入文本后搜索提示语消失;搜索输入框可配置为最多输入50个字符;在超过50个字符后无法继续输入,点击字符时,用户界面提示“最多输入50个字”;输入字符长度超过文本框长度,文字中间显示“…”,展示最近和最前输入的字符。
语音输入框动态显示语音引导语,轮播随机展示,轮播的时间间隔可调整,轮播有动画展示;语音引导语数据来源于“语音说法语料库”,从中随机获取数据进行轮播;语音说法语料库例如可以配置为,运营配置的说法,如“语音说xxx即可搜索”、“试试说xxx”、其中xxx来源于前业务搜索的热门TOP媒资名称。
例如,影视仅显示影视的热搜TOP数据、游戏仅显示游戏的TOP数据,运营可配置需要TOP多少的数据;从其他业务的独立入口进入时,输入框仅显示当前业务的热搜内容的语音引导语。
搜索历史为历史记录展示区,用户第一次进入搜索或清空记录后均无历史记录,搜索初始页面的热门推荐上移;进入详情页记录一次历史记录,显示当前记录,即从搜索结果点击进入详情页,按返回键返回至搜索结果界面,当历史记录模块出现在屏幕上时,即刷新显示最新的历史记录;历史记录按时间倒序排列,即最近的历史记录排在前,最多可配置为2行。历史记录是指搜索历史,并非播放历史,即用户每次搜索时所使用的搜索词条,并非搜索内容。每执行一次搜索结果时,生成一次搜索历史词条,同时,刷新一次历史记录展示区中的搜索历史界面,将最新产生的搜索历史词条显示在搜索历史界面的 前端。若搜索历史界面中所能展示的搜索历史词条数量超过最大限度,则将最早产生的搜索历史词条删除。
用户点击清空后,热门推荐内容有个平滑上移的动画效果;用户点击历史记录,直接显示搜索结果,不进行联想词配置;用户从其他业务的独立入口进入时,显示当前业务的历史记录;历史记录的诗句规则例如可包括定义每个cell的最大长度、最多展示字数,如果长度过长则显示省略号,聚焦后跑马灯进行展示。
热门搜索为热门搜索展示区,可以从三维显示设备的主页搜索入口(搜索按钮)进入,搜索初始页面显示影视的热门搜索内容;用户从其他业务的独立入口进入时,热门搜索显示当前搜索业务的人们搜索内容,点击后进入对应页面。
输入法键盘可以为搜索键盘,与主屏幕分层显示;用户在点击输入框时,才弹出搜索键盘。在三维显示设备中,输入法键盘无法采用系统配置的自带键盘(2D键盘),会出现显示异常的问题,因此,本申请中搜索键盘为3D键盘。基于3D键盘输入文本时,文本显示在输入框中。
图5F示出了根据一些实施例的基于搜索初始页面进行搜索的示意图。参见图5F,在基于搜索初始页面进行搜索时,用户点击输入框,弹出搜索键盘。搜索键盘显示在输入框的底部,基于搜索键盘输入文本时,文本显示在输入框中。
在一些实施例中,由于用户在触发三维显示设备主页的搜索按钮生成的搜索初始界面中展示有热门搜索和搜索历史两项内容。因此,为实现上述两项内容的展示,设备端需向服务器获取对应的数据,以进行相应内容的展示。
在搜索初始界面展示热门搜索数据和历史搜索数据时,控制器在执行接收对搜索按钮的操作,在虚拟用户界面中展示包括输入框的搜索初始界面,被进一步配置为:响应于触发搜索按钮的内容搜索指令,发送搜索数据请求至服务器,搜索数据请求用于指示服务器获取热门搜索数据和历史搜索数据;接收服务器返回的热门搜索数据和历史搜索数据,在虚拟用户界面中生成包括输入框、历史记录展示区和热门搜索展示区的搜索初始界面,热门搜索展示区用于展示热门搜索数据,历史记录展示区用于展示历史搜索数据,输入框用于输入触发搜索过程的目标文本。
用户通过与三维显示设备搭配使用的手柄或头盔触发主页中的搜索按钮,产生内容搜索指令,控制器响应于内容搜索指令后生成搜索数据请求,并发送至服务器。
服务器接收到搜索数据请求后,向三维显示设备端返回热门搜索数据和历史搜索数据。热门搜索数据用于提供不同的热门媒资的展示,历史搜索数据用于提供用户不同时期搜索时所使用的搜索词条的展示。
在一些实施例中,搜索数据请求包括热门搜索数据请求和历史搜索数据请求。在进入搜索初始界面时,向服务器发送热门搜索的数据请求,服务器返回热门搜索的数据,数据包括对应的媒资ID、海报图、权益等信息。三维显示设备根据服务器返回的媒资图片链接显示图片,根据媒资标题数据显示相应的标题文字。
在进入搜索初始界面时,向服务器发送历史搜索的数据请求,服务器返回历史搜索的数据,数据包括用户历史搜索时使用的搜索词条信息。
在一些实施例中,当用户进入搜索后,显示初始搜索界面如图5E所示,内容为预制的热门搜索和搜索历史。热门搜索通过大数据计算出时下不同用户的高频搜索资源,并进行初始展示。搜索历史为用户历史搜索时使用的搜索词条信息,并进行初始展示。
设备端在接收到服务器返回的热门搜索数据和历史搜索数据,在虚拟用户界面中生成包括输入框、历史记录展示区和热门搜索展示区的搜索初始界面。历史记录展示区位于搜索初始界面的顶部,其下方展示热门搜索展示区,输入框位于搜索初始界面的底部。
在热门搜索展示区展示各个热门搜索数据时,每个热门搜索数据可按照热度指数排序展示,展示内容为媒资海报、媒资名称等信息。在历史记录展示区展示各个历史搜索数据时,各个历史搜索数据对应的搜索词条以倒序的顺序进行展示。输入框用于展示触发搜索过程的目标文本,目标文本为用户进行搜索时所使用的搜索词条。如果以目标文本进行一次搜索,则该目标文本对应的搜索词条展示在历史记录展示区的首位,原展示的其余搜索词条均向后移动一个位置。
在一些实施例中,用户可基于热门搜索展示区展示的热门搜索数据,直接跳转进入对应的媒资结果,而无需进行额外的操作,便于用户操作。
因此,在基于热门搜索展示区进行交互时,控制器被进一步配置为:响应于触发热门搜索展示区中的一个热门搜索数据的选中操作,发送携带内容ID的内容详情请求至服务器,内容详情请求用于指示服务器查询与内容ID对应的内容详情信息,内容ID用于表征热门搜索数据;接收服务器返回的与内容ID对应的内容详情信息,在虚拟用户界面中生成内容详情界面,内容详情界面中展示内容详情信息。
用户在点击热门搜索展示区中的任一个热门搜索数据时,发送带有内容ID的内容详情请求,向服务器请求数据,获取此热门搜索数据的内容详情信息。设备端在接收到服务器返回的内容详情信息后,跳转至内容详情界面,并展示用户选择的热门搜索数据对应的内容详情信息。
图5G示出了根据一些实施例的内容详情界面的示意图。参见图5G,如果热门搜索展示区展示媒资内容,用户触发的媒资为“甲电影”,则设备端发送“甲电影”的媒资ID至服务器。在接收到服务器返回的“甲电影”的媒资详情信息后,在虚拟用户界面中展示内容详情界面。时,虚拟用户界面中展示的界面由搜索初始界面左滑切换展示为内容详情界面,搜索初始界面被隐藏在内容详情界面的下层,不可见。
在一些实施例中,用户可基于历史记录展示区中展示的各个搜索词条进行快捷搜索。当用户点击历史记录展示区中的任一个历史搜索数据时,可立即执行该搜索词条的搜索,并在搜索结果区域展示搜索结果。
因此,在基于历史记录展示区进行交互时,控制器被进一步配置为:响应于触发历史记录展示区中的一个历史搜索数据的选中操作,发送内容搜索请求至服务器,内容搜索请求用于指示服务器查询与选中的历史搜索数据对应的内容搜索结果;接收服务器返回的与选中的历史搜索数据对应的内容搜索结果,在虚拟用户界面中生成搜索结果界面,搜索结果界面中展示所述内容搜索结果。
图5H示出了根据一些实施例的搜索结果界面的示意图。参见图5H,如果历史记录展示区中展示“甲动画片”的历史搜索数据,用户点击“甲动画片”,则发送内容搜索请求至服务器,服务器进行媒资搜索。而后设备端接收服务器返回的与选中的历史搜索数据对应的内容搜索结果,基于“甲动画片”的内容搜索结果生成搜索结果界面,展示在虚拟用户界面中。此时,虚拟用户界面中展示的界面由搜索初始界面左滑切换展示为搜索结果界面,搜索初始界面被隐藏在搜索结果界面的下层,不可见。
搜索结果界面中包括与“甲动画片”这一搜索词条相关的媒资,用户可点击搜索结果界面中展示的任一媒资,进行观看。用户点击图5H中展示的任一媒资后,则界面跳转至如图5G所示的内容详情界面,此处不赘述。
在一些实施例中,在虚拟用户界面中展示包括输入框、历史记录展示区和热门搜索展示区的搜索初始界面后,用户还可进行新一次的搜索过程。用户自行搜索的过程可为初始搜索过程和连续搜索过程。初始搜索过程是指用户首次针对特定的关键词进行搜索的过程,连续搜索过程是指在初始搜索过程之后用户基于初始搜索的结果继续进行下一次的搜索过程。
S502、在进行初始搜索时,获取与输入框中输入的目标文本对应的内容搜索结果,基于内容搜索结果生成搜索结果界面,将搜索结果界面展示在虚拟用户界面中。
在进行初始搜索时,再次参见图5E所示的搜索初始界面,用户可在搜索初始界面中呈现的输入框中输入目标文本,目标文本即为触发搜索过程的搜索词条。设备端向服务器获取与该目标文本对应的内容搜索结果,以根据内容搜索结果生成搜索结果界面,并展示在虚拟用户界面中。此时,虚拟用户界面中展示的界面由搜索初始界面左滑切换展示为搜索结果界面,搜索初始界面被隐藏在搜索结果界面的下层,不可见。
在一些实施例中,在进行初次搜索时,控制器在执行在进行初始搜索时,获取与输入框中输入的目标文本对应的内容搜索结果,被进一步配置为:在进行初始搜索时,接收对输入框的操作,在搜索初始界面中展示搜索键盘,搜索键盘位于输入框的下方;接收基于搜索键盘输入的目标文本,发送内容搜索请求至服务器,内容搜索请求用于指示服务器查询与目标文本对应的内容搜索结果,目标文本显示在输入框中;接收服务器返回的与目标文本对应的内容搜索结果。
在进行初始搜索时,用户通过手柄或者头盔焦点点击输入框区域时,在搜索初始界面中弹出搜索键盘,搜索键盘位于输入框的下方。
再次参见图5F,搜索键盘为3D虚拟键盘。在进行初始搜索时,在视觉上搜索键盘悬浮于搜索初始界面显示,具体实现为:搜索键盘Z轴位置=搜索初始界面Z轴位置-4,Z轴位置是指在主视角方向上人眼与界面之间的景深距离,即人眼观看到正对界面之间的距离,通常可设定为9米,也可为其他数值,此处不做具体限定。4是指4个像素点,即搜索键盘与搜索初始界面之间间隔4个像素点的距离,搜索键盘X轴旋转角度为30度。
在搜索初始界面中显示搜索键盘前,由于用户并未点击输入框,因此输入框内无焦点聚焦,无光标显示。显示搜索键盘后,输入框获得焦点,显示光标。当用户点击搜索键盘内区域进行输入时,输入的内容会实时追加到输入框中的光标后面。当用户点击搜索键盘以外的区域时,搜索键盘不进行任何响应;当用户点击搜索键盘上的隐藏按钮时,搜索键盘隐藏,输入框失去焦点,输入框内光标隐藏。
在一些实施例中,搜索键盘中设置隐藏按钮,如果用户无需操作搜索键盘,则可触发隐藏按钮,将搜索键盘隐藏。
在一些实施例中,搜索键盘还可在生成搜索结果界面时取消显示,即在虚拟用户界面中呈现搜索结果界面后,表示完成一次搜索过程,则可将搜索键盘隐藏。在进行下一次搜索过程时,再次点击输入框,可再次弹出搜索键盘。
用户操作搜索键盘即可产生目标文本,并将目标文本实时显示在输入框中。随着用户的不断输入,输入框中显示的文本内容不断变化。
在确定进行搜索过程的目标文本后,设备端基于目标文本生成内容搜索请求,并发送至服务器,服务器基于目标文本查询对应的内容搜索结果。设备端接收到服务器返回的内容搜索结果后,即可生成搜索结果界面,展示在虚拟用户界面中。
图5I示出了根据一些实施例的基于搜索键盘输入目标文本的示意图;图5J示出了根据一些实施例的基于目标文本生成的搜索结果界面的示意图。参见图5I,如果用户操作搜索键盘,输入“ABCD”,并显示在搜索键盘中。参见图5J,设备端基于目标文本“ABCD”生成内容搜索请求至服务器,在接收到服务器返回的内容搜索结果后生成搜索结果界面。搜索结果界面中展示与“ABCD”相关的不同类型的媒资。
在一些实施例中,用户在基于搜索键盘输入目标文本时,设备端可同步显示与目标文本相关联的联想词,以便于用户能够快速选择符合自己的搜索词条。联想词的词条内容包括目标文本的所有内容或至少一个内容,当用户搜索“A”时,可出现“ABCD”等的联想词。
因此,在设备端显示联想词列表时,控制器被进一步配置为执行下述步骤:在基于搜索键盘输入目标文本时,发送联想词获取请求至服务器,联想词获取请求用于指示服务器查询与目标文本对应的联想词;接收服务器返回的与目标文本对应的联想词,生成联想词列表,联想词列表以浮层的形式展示在搜索初始界面的上层。
在用户每次使用搜索键盘输入文字或者删除时,即输入框的内容较之前出现变化时,设备端会实时向服务器获取与输入框中的内容相关联的联想词。此时,随着输入框中的内容发生变化,设备端基于当前输入框中的内容生成联想词获取请求,并发送至服务器,以请求获取与目标文本对应的联想词。
如果与目标文本对应的联想词的数量较多时,可生成联想词列表,并以浮层的形式展示在搜索初始界面的上层。用户无需完全输入其想要的搜索词条,可在随着文本输入的过程中,在联想词列表中选择其中一个与自己想要的搜索词条相符的联想词作为搜索词条,以进行快捷搜索。
图5K示出了根据一些实施例的联想词列表的示意图。如果用户操作搜索键盘,输入目标文本“AB”时,则产生的联想词列表如图5K所示,与“AB”关联的联想词可为“ABCDEFG”、“ABCDHIJK”等。
在一些实施例中,联想词列表中展示的各个联想词,与目标文本具有相同内容的部分文本高亮展示,如联想词“ABCDEFG”,其中的“ABCD”与目标文本“AB”内容相同,则将联想词“ABCDEFG”中的“AB”高亮显示。为对联想词中与目标文本具有相同内容的部分文本和其余文本进行区分,还可分别设置不同的颜色,此处不做具体限定。
在一些实施例中,并非所有目标文本均对应有联想词。因此,在存在联想词时,可在搜索初始界面上显示联想词列表;而若不存在联想词时,则不在搜索初始界面上显示联想词列表。
在一些实施例中,用户在搜索初始界面输入文本时,设备使用3D输入法进行文本输入,主界面可实时显示联想词;联想词配置为显示一屏即可,用户无需翻页、上滑或下滑。用户点击某个联想词时,用户界面可左滑切换到搜索结果界面,展示联想词的搜索结果;在用户界面无联想词时显示无结果的反馈,给用户推荐当前业务的热搜内容。
在一些实施例中,由于在用户每次输入文字或者删除时,即输入框的内容较之前出现变化时,联想词列表中的联想词也会实时随之变化。若没有联想词时,则不显示,若有联想词时,则显示。因此,会实时出现基于输入框内文字的联想词列表展示。故会存在随着用户的输入或删除,联想词列表显示->隐藏,隐藏->显示的逻辑。
在一些实施例中,在进行初始搜索的场景下,联想词列表显示时,叠加在搜索初始界面之上显示;当无联想词时,联想词列表隐藏,显示出在联想词列表之下的搜索初始界面。
在一些实施例中,用户每次进行输入和删除时,设备端实时向服务器发起请求,联想词存储在服务器的媒资库中。服务器接收到请求后在媒资库内的媒资进行大数据计算,将计算结果以Json格式返回到设备端。为保证数据传递实时快速,该数据只包括联想词词条内容。
设备端在获取到联想词数据之后,通过终端本地预制的位置,进行联想词“Z”型排列显示,即先第一排从左到右,再从第二排从左到右,得到联想词列表。联想词图层大小根据获取到的联想词词条个数动态扩展。如只有一排数据(小于等于3条数据)时,图层大小为500*200,有两排数据时(大于3条小于等于6条)时图层大小为500*400。图层大小以像素点为单位。
在一些实施例中,用户可基于联想词列表中展示的各个联想词进行快捷搜索,即点击任一个联想词, 即可获得内容搜索结果。
因此,在基于联想词列表进行快捷搜索时,控制器被进一步配置为:在基于联想词进行搜索时,响应于触发联想词列表中的一个联想词的选中操作,发送内容搜索请求至服务器,内容搜索请求用于指示服务器查询与选中的联想词对应的内容搜索结果;接收服务器返回的与选中的联想词对应的内容搜索结果,选中的联想词展示在输入框中。
当联想词列表中出现用户想搜索的联想词时,可直接点击联想词,即可执行完整搜索。此时,用户触发该联想词,生成内容搜索请求,并发送至服务器。服务器接收到内容搜索请求后查询与该联想词对应的内容搜索结果。
设备端接收服务器返回的内容搜索结果后,即可生成搜索结果界面展示在虚拟用户界面中。此时,选中的联想词展示在输入框中,替换输入框中原展示的用户输入的文本。虚拟用户界面中展示的界面由搜索初始界面切换展示为搜索结果界面,搜索初始界面被隐藏在搜索结果界面的下层,不可见。
在一些实施例中,在实现快捷搜索时,在用户点击联想词的事件中,通过获取输入框中的Text组件,将联想词字符串赋值给该Text组件,Text组件进行显示刷新。例如,在用户输入文本“AB”,联想词列表中存在联想词“ABCD”。若“ABCD”为用户想要搜索的内容,则可直接点击“ABCD”联想词。此时输入框内的内容会由“AB”变为“ABCD”,如图5K所示。此时,搜索结果界面展示“ABCD”的搜索结果,如图5J所示。
在一些实施例中,展示热门搜索的图层与展示输入框的图层以及展示搜索结果的图层为同一个图层,展示联想词的界面为另一个层级的图层。也就是说,热门搜索、搜索结果和输入框均展示在搜索初始界面所在图层,而联想词列表悬浮在搜索初始界面之上。
在一些实施例中,如果搜索结果界面中展示的内容搜索结果较多时,在同一个页面中无法完全展示,则可以采用分页的形式进行展示。用户若想查看其他页面的内容,则可通过向右或者向左滑动界面,进行滑动翻页操作。
图5L示出了根据一些实施例的基于搜索结果界面执行滑动翻页操作的效果示意图。搜索结果界面中的各个页面可采用正交布局方式进行布局,用户正视角区域的页面为主页面,用户可直接点击该页面中展示的各个内容搜索结果。参见图5L,如果用户想要查看右侧页面的内容,则触发右侧页面,将右侧页面向左滑动至主页面所在位置(中间位置),再点击该页面中展示的各个内容搜索结果。如果用户想要查看左侧页面的内容,则触发左侧页面,将左侧页面向右滑动至主页面所在位置(中间位置),再点击该页面中展示的各个内容搜索结果。
在一些实施例中,虚拟用户界面中展示的各个界面均采用正交布局方式进行布局,因此,均可采用滑动翻页的方式,例如搜索初始界面、搜索结果界面等。向左滑动,查看下一界面,向右滑动,查看前一界面。
在一些实施例中,搜索结果界面中可按照不同类型的内容搜索结果进行分类,为每个分类配置对应的Tab按钮,例如,图5L中“影视精选”、“电影”和“电视剧”。用户通过点击Tab按钮,切换至对应Tab的媒资内容进行查看。
可见,在进行初始搜索时,用户可在搜索初始界面中的热门搜索展示区展示的热门搜索数据,直接跳转进入对应的媒资结果,而无需进行额外的操作,便于用户操作。还可基于历史记录展示区中展示的各个搜索词条进行快捷搜索。当用户点击历史记录展示区中的任一个历史搜索数据时,可立即执行该搜索词条的搜索,并在搜索结果区域展示搜索结果。用户可基于输入框自行输入目标文本进行搜索,还可基于目标文本的联想词进行快捷搜索。上述搜索方式均可为用户提供快捷遍历的搜索体验,避免频繁翻页增加操作成本,用户体验好。
S503、在进行连续搜索时,获取与输入框中输入的连续文本对应的新内容搜索结果,将新内容搜索结果展示在搜索结果界面中,连续文本包括目标文本和新输入的文本。
如果在完成初始搜索或其他次的搜索过程中,用户想要基于前次的搜索结果进行下一次的搜索过程,则产生连续搜索过程。连续搜索过程是指在初始搜索过程之后用户基于初始搜索的结果继续进行下一次的搜索过程。
在进行连续搜索时,用户无需返回初始搜索界面即可进行再次搜索的方式,即用户可基于搜索结果连续进行搜索,使用户能够快速地查找到自己感兴趣的内容,提高用户搜索便利性。
在执行连续搜索时,其执行搜索的界面为上一次搜索完成后的搜索结果界面,如图5J所示。搜索结果界面中除展示内容搜索结果外,还始终展示输入框,便于用户实时更改输入框中的文本内容,以进行下一次的搜索过程。
在完成一次搜索后,输入框中展示前一次输入的目标文本。此时,用户再次触发输入框,输入框获得焦点,且光标位于目标文本的后方。用户再次基于弹出的搜索键盘输入新文本,此时,由上一次使用 的目标文本与本次输入的新文本构成连续文本。设备端基于连续文本进行全新一次的搜索过程,获得新内容搜索结果,并展示在搜索结果界面中。此时,搜索结果界面中展示的内容由前一次基于目标文本得到的内容搜索结果替换为当前次基于连续文本得到的新内容搜索结果。
在一些实施例中,在进行连续搜索时,控制器在执行在进行连续搜索时,获取与输入框中输入的连续文本对应的新内容搜索结果,被进一步配置为:在进行连续搜索时,接收基于展示有目标文本的输入框输入的新文本,发送内容搜索请求至服务器,内容搜索请求用于指示服务器查询与连续文本对应的新内容搜索结果,连续文本包括目标文本和新文本,连续文本显示在输入框中;接收服务器返回的与连续文本对应的新内容搜索结果。
在进行连续搜索时,输入框中显示前一次搜索使用的目标文本,将新输入的新文本与目标文本作为连续文本进行全新一次的搜索过程。此时,设备端生成内容搜索请求发送至服务器,并接收服务器返回的与连续文本对应的新内容搜索结果,设备端将新内容搜索结果展示在搜索结果界面中。具体实现过程可参照前述实施例提出的初始搜索过程,此时不再赘述。
在一些实施例中,当前一次搜索过程中,用户点击“ABCD”联想词后,此时输入框内的内容变为“ABCD”,用户可在此结果的基础上,继续进行搜索。用户操作手柄或者头盔焦点到输入框内,弹出搜索键盘。例如继续输入“E”,则此时输入框的内容变为“ABCDE”,即连续文本为“ABCDE”。此时,基于连续文本为“ABCDE”执行新一次的搜索过程,将获取的新内容搜索结果展示在搜索结果界面中。
在一些实施例中,在连续搜索过程中,设备端还可提供基于连续文本的联想词,以便于用户能够快速选择符合自己的搜索词条。
因此,在连续搜索过程提供联想词功能时,控制器被进一步配置为:在输入框中展示连续文本时,发送联想词获取请求至服务器,联想词获取请求用于指示服务器查询与连续文本对应的联想词;接收服务器返回的与连续文本对应的联想词,生成联想词列表,联想词列表以浮层的形式展示在搜索结果界面的上层。
在输入框中存在前一次搜索使用的目标文本场景下。在用户每次使用搜索键盘输入新文字或者删除时,即输入框的内容较之前出现变化时,设备端会实时向服务器获取与输入框中的内容相关联的联想词。此时,随着输入框中的内容发生变化,设备端基于当前输入框中的连续文本生成联想词获取请求,并发送至服务器,以请求获取与连续文本对应的联想词。
如果与连续文本对应的联想词的数量较多时,可生成联想词列表,并以浮层的形式展示在搜索结果界面的上层。用户无需完全输入其想要的搜索词条,可在随着文本输入的过程中,在联想词列表中选择其中一个与自己想要的搜索词条相符的联想词作为搜索词条,以进行快捷搜索。
用户点击联想词列表中的联想词进行新一次的快捷搜索的实现过程,可参照前述实施例中在执行初始搜索过程时提出的内容,此处不再赘述。
在一些实施例中,在进行连续搜索的场景下,由于当前呈现的界面为搜索结果界面。因此,联想词列表显示时,叠加在搜索结果界面之上显示;当无联想词时,联想词列表隐藏,显示出在联想词列表之下的搜索结果界面。
在一些实施例中,当前一次搜索过程中,用户点击“ABCD”联想词后,此时输入框内的内容变为“ABCD”,用户可在此结果的基础上,继续进行搜索。例如继续输入“E”,则此时输入框的内容变为“ABCDE”,由于输入框内的内容发生了变化,基于大数据算法的联想词列表也发生变化,此时联想词列表会出现“ABCDEFGH”、“ABCDEOPQ”等。用户可继续点击“ABCDEFGH”联想词,执行“ABCDEFGH”关键字的搜索。此时搜索结果界面刷新,出现“ABCDEFGH”的搜索结果。
在完成当前次的搜索过程后,此时输入框内容变为“ABCDEFGH”,用户可继续进行输入,例如输入“X”,则联想词列表继续进行刷新,例如出现“ABCDEFGHXY”等。用户点击该联想词,则执行“ABCDEFGHXY”的搜索,同时刷新搜索结果区域。并刷新输入框内容为“ABCDEFGHXY”。
可见,用户可以在搜索过程中不断的上述搜索过程,实现无需返回搜索初始界面即可进行再次搜索的功能。其他连续搜索过程可循环此过程,此处不再赘述。
在一些实施例中,如果用户不想基于前一次使用的目标文本继续进行搜索,则可在触发输入框时,将输入框中显示的目标文本删除,以重新输入新文本。此时,基于新文本执行下一次的搜索过程。
基于重新输入的新文本进行的搜索过程,也可提供联想词功能,相关过程可参照前述内容,此处不再赘述。
可见,在进行连续搜索时,用户可基于前次的搜索结果进行下一次的搜索过程,此时,无需返回初始搜索界面即可进行再次搜索的方式,即用户可基于搜索结果连续进行搜索,使用户能够快速地查找到自己感兴趣的内容,提高用户搜索便利性。
在一些实施例中,无论是在初始搜索过程还是在连续搜索过程,设备提供给用户输入文本的方式为 搜索键盘的方式,还可为语音输入的方式。
在执行语音输入时,用户可触发图5E所示的搜索初始界面中的语音输入框,在弹出的语音输入界面中输入语音指令,以实现内容搜索。
因此,在采用语音输入方式时,控制器被进一步配置为:在进行初始搜索或者连续搜索时,接收对搜索初始界面中语音输入框的操作,在虚拟用户界面中展示语音输入界面;、接收用户输入的语音文本,将语音文本展示在语音输入界面中;发送内容搜索请求至服务器,内容搜索请求用于指示服务器查询与语音文本对应的内容搜索结果;接收服务器返回的与语音文本对应的内容搜索结果,展示在搜索结果界面中。
在一些实施例中,在进行初始搜索过程时,再次参见图5E,用户触发搜索初始界面中的语音输入框,弹出语音输入界面。此时,虚拟用户界面中展示的界面由搜索初始界面滑动切换展示为语音输入界面。
图5M示出了根据一些实施例的语音输入界面的示意图;图5N示出了根据一些实施例的语音输入界面在收音步骤的示意图;图5O示出了根据一些实施例的语音输入界面在识别步骤的示意图。参见图5M、(b)和(c),用户触发语音输入框,在虚拟用户界面中展示语音输入界面,语音输入界面显示“正在聆听”;语音输入界面包括收音步骤;收音页面包括语音引导,所述语音引导的数量可根据需要进行配置。
语音引导语数据库来源于“语音说法语料库”,随机取数据进行展示,每次调起语音界面时刷新;从各业务独立入口进入时,仅显于当前业务的语音引导语。
在一些实施例中,在搜索初始界面将光标移动至语音搜索控件,如语音输入框,在输入确认的操作后,启动三维显示设备上的声音采集来进行语音的采集,并在显示界面上显示语音输入界面,在用户退出语音采集/退出语音采集界面/预设时长后关闭三维显示设备的声音采集。在一些实施例中,在接收到三维显示设备上的预设按键后,启动声音采集并显示语音输入界面。
在一些实施例中,三维显示设备在接收到服务器反馈的搜索结果后退出语音输入界面,显示搜索结果界面。
在一些实施例中,声音的采集可以是硬件上启动或关闭声音采集元件,或者软件上启动声音数据的转换。
用户进入语音输入界面设备开始收音,在接收到用户的语音指令后,将语音指令转换为语音文本,并显示在语音输入界面中。
在产生语音文本后,设备端生成内容搜索请求,并发送至服务器,以向服务器获取与语音文本对应的内容搜索结果。设备在接收服务器返回的与语音文本对应的内容搜索结果后,将内容搜索结果展示在搜索结果界面中。
在一些实施例中,显示识别在接收到用户的语音指令之后,其识别界面如图5O所示,三维显示设备采用流式识别,实时展示识别到的内容;识别完成后进入搜索结果界面。
在一些实施例中,在搜索结果页面,以下情况会直接启动播放,包括:搜索结果与语音文本精确匹配;语料中有“播放xxx”、“我想看xxx”、“我要看xxx”;此时,虚拟用户界面不显示搜索结果界面,启动播放的后续逻辑依据各业务具体逻辑进行。
在一些实施例中,如果用户语音指令不标准,或语音识别功能出现异常,则会出现无法接收到用户语音指令的情况。此时,控制器被进一步配置为:在未接收到用户输入的语音文本时,在语音输入界面中展示异常操作提示信息;接收基于异常操作提示信息后输入的新语音文本,基于新语音文本执行内容搜索过程。
语音输入界面中收音等待15秒,如果还不能识别到任何语音内容,则显示未收到用户语音的反馈信息,即异常操作提示信息。
图5P示出了根据一些实施例的展示异常操作提示信息的语音输入界面的示意图。参见图5P,在收音15秒后仍然无法识别到语音文本,则在语音输入界面中展示异常操作提示信息,如“未检测到语音”。并同步显示语音引导,以指示用户应以正确的方式输入语音指令。
如果用户重新输入新语音指令,并识别到新语音文本,可基于新语音文本执行内容搜索过程。具体的实现过程可参照前述实施例的内容,此处不再赘述。
在一些实施例中,在进行连续搜索过程时,再次参见图5J,用户触发搜索结果界面中的语音输入框,弹出语音输入界面。此时,虚拟用户界面中展示的界面由搜索结果界面滑动切换展示为语音输入界面。
在连续搜索过程中执行的语音输入搜索的实现过程可参照前述实施例的内容,此处不再赘述。
在一些实施例中,语音输入支持转义,例如,用户说“我想看C演员的电影”,则实际上搜索是根 据转义的内容“C演员电影”来进行搜索,并显示相应搜索结果和联想词。
可见,在基于语音输入方式执行内容搜索时,在输入触发内容搜索过程的文本时,可由语音输入方式代替使用搜索键盘输入的方式,该输入方式更加便利,可避免频繁的交互,用户体验好。
由以上实施方式可知,本申请实施例提供的一种三维显示设备,在进行内容搜索时,触发搜索按钮以展示包括输入框的搜索初始界面;在进行初始搜索时,获取与输入框中输入的目标文本对应的内容搜索结果,生成搜索结果界面并进行展示;在进行连续搜索时,获取与输入框中输入的连续文本对应的新内容搜索结果,将新内容搜索结果展示在搜索结果界面中,连续文本包括目标文本和新输入的文本。可见,该三维显示设备在查找目标内容时,以便于交互为出发点,提出避免频繁翻页增加操作成本的内容搜索方法,让用户更简易的使用搜索功能。并在执行连续内容搜索时,用户无需返回初始搜索界面即可进行再次搜索的方式,即用户可基于搜索结果连续进行搜索,使用户能够快速地查找到自己感兴趣的内容,提高用户搜索便利性。
第四部分
在一些实施例中,虚拟用户界面中呈现可实现不同功能的应用,通常利用Tab栏来展示不同属性、类别或功能的内容。Tab栏中包括多个Tab标签,一个Tab标签对应一个属性、类别或功能,同一个Tab标签下展示的内容的属性、类别或功能想相同。
在虚拟用户界面中展示Tab栏时,传统的Tab栏中每个Tab标签的数据长度是规则的,使得界面设计时按照规则布局,不会产生位于Tab栏的左右两头的Tab标签显示不全的问题。
但是,当前的应用都是基于互联网实现,界面数据不再是按照规则的形式定义,很多数据来自于大数据智能推荐,使得Tab栏中每个Tab标签的数据为互联网大数据自动推荐的数据,这些数据长度、格式存在不确定性,导致每个Tab标签的数据长度不规则。Tab标签的数据长度不规则会在Tab栏同时展示多个Tab标签时产生位于Tab栏左右两侧的Tab标签显示不全的情况。而Tab标签显示不全使得用户无法一次性查看到标签名称,导致用户无法理解该Tab标签的信息,影响用户体验。
图6A示出了根据一些实施例的大数据信息组成的Tab栏的展示示意图。如图6A所示,若在Tab栏中6101展示5个Tab标签C6102时,分别为“猜你喜欢喜剧电影”“猜你喜欢”“猜你喜欢”“猜你喜欢”“猜你喜欢XXXX的电影”。可见,每个Tab标签的数据长度并不相同,而Tab栏的预设展示宽度有限,使得第5个Tab标签在Tab栏的右侧出现显示不全的情况。用户可看到的第5个Tab标签内容为“猜你喜欢X…”,导致用户无法具体了解该标签的实际内容,影响用户体验。
在一些实施例中,对于位于电视上的用户界面中的Tab栏,在进行交互时,通常需要持续触发遥控器方向键以将控制焦点移动到未完全显示的Tab标签上,触发该Tab标签以获知其具体信息。但是,对于三维显示设备,其交互方式不同于传统的电视、手机等,一般通过头触控点或者手柄进行交互,不再像遥控器方式进行顺序操作,而是类似鼠标一样可以自由地选择虚拟用户界面中呈现的任一UI控件进行操作。可以看出,三维显示设备的自有操作方式可以直接选中未完全显示的Tab标签来获得该标签的信息。因此,若采用传统的交互方式来获知某一Tab标签的具体信息,会从展示和交互方式角度对用户的体验带来新的问题。
在图6A所示状态下,Tab栏最右侧实际上已经显示不开最后一个Tab标签,最后一个Tab标签超出的部分将不被显示。因此,为了对上述现象进行处理,传统的处理方法包括采用省略法展示Tab标签、采用跑马灯法展示Tab标签以及采用完全隐藏法展示Tab标签。
省略法是定义规则的Tab标签的显示长度,超出部分使用“…”表示。跑马灯法同样定义规则的Tab标签的显示长度,超出部分当获取焦点时以跑马灯的形式展示。完全隐藏法是对于不能完全展示Tab标签的全部隐藏不显示,但是这样Tab栏存在空白区域,不美观。可见,上述三种方法对用户的交互和体验来说,UI没关和查看信息都有一定的障碍,并不便于用户的操作,影响用户体验。
基于前述在展示Tab栏时存在的不允许显示不全的情况以及在允许显示不全时无法及时查看到具体信息的各种问题,本申请实施例提供一种三维显示设备,结合三维显示设备通过手柄或者头控触点可以自由操作的特点,结合每个Tab标签数据的不确定性,允许Tab栏显示一个或多个Tab标签,而不是固定数量的Tab标签。显示的Tab标签数量根据Tab标签本身内容动态计算,Tab栏左右两侧的Tab标签允许显示不全。
初始状态如图6A所示,从Tab栏最左侧依次向右显示,只要Tab栏没有被Tab标签完全填充就显示下一个Tab标签,所以下一个Tab标签可能完全显示也可能只显示一部分。且在交互时,未完全显示的Tab标签在获得控制焦点时,可控制Tab栏的内容整体进行移动,以将该未完全显示的Tab标签完整地展示出来,以便用户查看。
在一些实施例中,可以定义TabMenuWidth:Tab栏宽度;FilledWidth:表示已经Tab栏中已经被填充的宽度;CurrentTabWidth:当前要展示的Tab宽度。在展示Tab标签时,根据Tab栏宽度和Tab 栏中已经被填充的宽度的大小关系,判断是否需要渲染显示后续的Tab标签,如果Tab栏中已经被填充的宽度小于Tab栏宽度,则确定显示后续的Tab标签,在剩余宽度小于当前要展示的Tab标签宽度时,显示当前要展示的Tab标签的部分,在剩余宽度等于当前要展示的Tab标签宽度时,完全显示当前要展示的Tab标签,不再渲染显示后续的Tab标签,在剩余宽度大于当前要展示的Tab标签宽度时,完全显示当前要展示的Tab标签,并重新定义下一Tab标签作为当前要展示的Tab标签进行展示逻辑的判断。
在一些实施例中,Tab标签获得控制焦点的操作并非传统的触发遥控器方向键逐渐移动到该Tab标签的情况,而是通过与三维显示设备搭配使用的头触控点或者手柄进行交互,例如控制光标,用户可直接将控制焦点落在对应的Tab标签上,在该Tab标签获得控制焦点的过程中,无需经过其他Tab标签。因此,结合Tab栏的展示特点和三维显示设备的交互特点,相对于不能完全展示则不展示的逻辑,本申请通过Tab标签的部分展示可及时查看到未完全显示的Tab标签的具体信息,并进行光标焦点的获取,用户体验好。
图6B示出了根据一些实施例的Tab栏的动态展示方法的流程图。本申请实施例提供的一种三维显示设备,包括:虚拟显示器,被配置为呈现展示有Tab栏的虚拟用户界面;与虚拟显示器连接的控制器,在执行图6B所示的Tab栏的动态展示方法时,控制器被配置为执行下述步骤:
S601、获取待展示的至少一个Tab标签;
S602、如果Tab标签的标签宽度小于或等于Tab栏的待展示宽度,则将Tab标签以完全显示状态展示在Tab栏中;
S603、如果Tab标签的标签宽度大于Tab栏的待展示宽度,则将Tab标签以未完全显示状态展示在Tab栏中。
用户佩戴三维显示设备,并触发该三维显示设备中配置的虚拟现实应用,在虚拟的三维空间中生成虚拟用户界面。虚拟用户界面可参见图2A所示内容,在需要进行应用的展示时,可在图2A中(3)所示的应用切换区进行展示。
在启动虚拟现实应用时,在虚拟三维空间中呈现虚拟用户界面。在不同的交互场景下,虚拟用户界面中呈现适配不同交互场景的Tab栏。交互场景包括但不限于:触发如图2A中(2)处的导航栏中的任一个导航按钮时,在虚拟用户界面中展示对应的页面,例如,触发“教育”导航按钮时,在虚拟用户界面的内容推荐区展示“教育”功能对应的内容,上述功能对应的不同分类通过Tab标签的形式展示在顶部。在搜索某个视频媒资时,对演员信息进行展示的场景,每个演员信息对应一个Tab标签,由多个表征演员信息的Tab标签组成的Tab栏显示在视频媒资名称的底部。在基于某个搜索框进行信息搜索时,弹出的搜索历史界面中呈现不同的历史搜索信息,每个历史搜索信息对应一个Tab标签,数个Tab标签统一呈现在搜索历史界面中,历史搜索信息可以关键词的形式存在。
在不同的交互场景下,会存在不同的Tab标签。在进行展示时,将某一交互场景下对应的待展示的至少一个Tab标签,并在该交互场景下对应的虚拟用户界面中生成Tab栏,将至少一个Tab标签展示在Tab栏。
不同的Tab标签对应不同的属性名称、功能名称、分类名称、关键词名称等,使得每个Tab标签的数据长度不同,在视觉上,体现在每个Tab标签的标签宽度不同,标签宽度是指该Tab标签所占据位置的宽度。
在将Tab标签展示在Tab栏中时,将同一交互场景下的数个Tab标签按照既定顺序进行排列,并依次展示在Tab栏中。因虚拟用户界面的布局限制,Tab栏所能展示的内容有限,仅可在其预设展示宽度内展示Tab标签,预设展示宽度为Tab栏所能展示内容的最大宽度。可见,如果Tab标签的标签宽度较大时,Tab栏中所能展示的Tab标签的数量较少;如果Tab标签的标签宽度较小时,Tab栏中所能展示的Tab标签的数量较多。
在一些实施例中,由于Tab栏的预设展示宽度有限,且每个Tab标签的标签宽度不同,使得在展示时,会存在某个Tab标签展示不全的情况。因此,在展示某个Tab标签时,可根据Tab标签的标签宽度小于或等于Tab栏的待展示宽度的大小关系,来确定该Tab标签是否可被展示在Tab栏中,以及,若可以展示时,该Tab标签的展示形式。Tab栏的待展示宽度是指Tab栏的预设展示宽度与已经被填充的宽度的差值,即剩余宽度。
在某一交互场景下,获取对应的待展示的数个Tab标签,每个Tab标签的标签宽度不同。在进行Tab标签展示时,需判断该Tab标签是否可以展示在Tab栏的可展示范围内。因此,获取Tab栏的待展示宽度和待展示的具有不同标签宽度的至少一个Tab标签,Tab栏的待展示宽度是指Tab栏中可进行标签展示的剩余宽度。如果待展示的Tab标签的标签宽度小于或等于Tab栏的待展示宽度,说明该Tab标签可以被完全展示,则将Tab标签以完全显示状态展示在Tab栏中。如果待展示的Tab标签的标签宽度大于Tab栏的待展示宽度,说明该Tab标签无法被完全展示,仅可展示一部分,此时,将Tab标签以 未完全显示状态展示在Tab栏中。
在Tab标签以未完全显示状态进行展示时,可先确定Tab标签的可展示宽度将Tab标签的可展示宽度对应的部分以未完全显示状态展示在Tab栏中,在这种情况下,Tab标签的可展示宽度与Tab栏的待展示宽度相等。
在一些实施例中,为对Tab栏的可展示范围进行限定,可以待展示宽度来表征Tab栏的可展示范围。待展示宽度对应的范围为Tab栏中未展示Tab标签的空闲区域,Tab栏的待展示宽度是指Tab栏中可进行标签展示的剩余宽度。
图6C示出了根据一些实施例的Tab栏的区域示意图。参见图6C中的(a)部分,在初始时刻,Tab栏6301中未展示任何Tab标签时,Tab栏的待展示宽度与其预设展示宽度相等,Tab栏的全部区域均为空闲区域6302(如图中虚线框位置),都可进行标签展示;Tab栏的待展示宽度即为空闲区域的宽度。参见图6C中的(b)部分,在展示过程中,Tab栏的全部区域中的部分区域会被至少一个Tab标签C6304填充,此时,未填充Tab标签的区域即为空闲区域6303,Tab栏的待展示宽度小于其预设展示宽度。若要填充下一个Tab标签,则将该Tab标签的标签宽度与该空闲区域进行对比,以确定该Tab标签的展示形式。
因此,在按照顺序依次展示每个Tab标签时,需要将指定Tab标签的标签宽度与Tab栏的待展示宽度进行对比。
图6D示出了根据一些实施例的Tab标签以完全显示状态进行展示的示意图。参见图6D中的(a)部分,在进行宽度对比时,可基于Tab栏6401建立二维坐标系,坐标原点位于Tab栏的左上角,或者位于虚拟用户界面的左上角,由左至右的方向为X轴正向,由上至下的方向为Y轴正向。
在二维坐标系中,获取Tab栏的空闲区域的左侧位置坐标A(x1,y0)和Tab栏的右侧边界的位置坐标B(x2,y0),基于空闲区域的左侧位置坐标和Tab栏的右侧边界的位置坐标,计算坐标差值L1=x2-x1,作为Tab栏的待展示宽度(空闲区域的宽度)L1。
其中,若Tab栏中原展示有Tab标签C6402,且每个相邻Tab标签无缝隙展示时,则Tab栏的空闲区域的左侧位置坐标即为展示的最后一个Tab标签的右侧位置坐标;若Tab栏中未展示有Tab标签,则Tab栏的空闲区域的左侧位置坐标即为Tab栏的左侧边界的位置坐标。
在一些实施例中,若Tab栏为横向设置的状态,则可仅以X轴坐标值进行计算过程;若Tab栏为纵向设置的状态,则可仅以Y轴坐标值进行计算过程。若Tab栏为不规则设置的状态,则可以完整的X轴和Y轴坐标值进行计算过程。
在一些实施例中,参见图6D中的(b)部分,若下一个待展示的指定Tab标签C6403的标签宽度为H1,如果指定Tab标签的标签宽度H1小于或等于Tab栏的待展示宽度L1,说明Tab栏的空闲区域可展示得下该指定Tab标签,则将Tab标签以完全显示状态展示在Tab栏中。如果此时Tab栏中已经存在前一次展示的Tab标签,则将指定Tab标签展示在前一Tab标签的后方。参见图6D中的(c)部分,如果此时Tab栏中未展示Tab标签,则将指定Tab标签展示在Tab栏的左侧初始位置。
图6E示出了根据一些实施例的Tab标签以未完全显示状态进行展示的示意图。在一些实施例中,参见图6E中的(a)部分,指定Tab标签的标签宽度为H2,基于前述方法获取Tab栏6501的空闲区域的左侧位置坐标C(x3,y0)和Tab栏的右侧边界的位置坐标D(x4,y0),计算出Tab栏的待展示宽度(空闲区域的宽度)L2=x4-x3。如果Tab标签的标签宽度H2大于Tab栏的待展示宽度L2,说明Tab栏的空闲区域无法展示得下该指定Tab标签,此时,Tab标签需以未完全显示状态展示在Tab栏中。
为确定指定Tab标签展示在Tab栏中的部分内容,需确定Tab标签的可展示宽度。在一些实施例中,Tab标签的可展示宽度与Tab栏的待展示宽度相等,即Tab标签的可展示宽度为L2。
参见图6E中的(b)部分,将Tab标签的可展示宽度L2对应的部分展示在Tab栏中,此时,由于该Tab标签仅部分内容展示在Tab栏中,因此,该Tab标签的展示形式为未完全显示状态。而该Tab标签的其余部分则不显示在Tab栏中,此时,该Tab标签的其余部分H2’=H2-L2则隐藏在Tab栏的边界外侧。
在一些实施例中,Tab栏中各个Tab标签的展示顺序为从左到右的顺序进行展示,各个Tab标签之间可留存有缝隙进行区分,也可无缝隙首尾相连展示。每展示一个Tab标签均执行上述判断是否可进行展示的过程,即确定是否可展示,以及,在可展示时的展示形式(完全显示状态和未完全显示状态)。那么,在基于Tab栏的预设展示宽度进行展示时,位于Tab栏的右侧边界的Tab标签可为完全显示状态位于Tab栏中,也可为未完全显示状态位于Tab栏中(一半显示一半隐藏)。
S604、在未完全显示的Tab标签获得控制焦点时,向第一方向移动Tab栏中的每个Tab标签,以将未完全显示的Tab标签以完全显示状态展示在Tab栏中,第一方向是指从未完全显示的Tab标签至相邻的完全显示的Tab标签的方向。
在Tab栏中展示的所有Tab标签均为完全显示状态时,用户可一次性看到每个Tab标签的具体信息,用户可在展示的多个Tab标签中选择自己感兴趣的一个进行点击触发,交互体验好。
但是,若Tab栏中展示的所有Tab标签中存在未完全显示状态的Tab标签时,用户无法看到该Tab标签的具体信息。因此,为便于对每个Tab标签进行交互,可在控制焦点落在未完全显示的Tab标签上时,通过控制Tab栏中展示的所有Tab标签整体向第一方向移动,以将未完全显示的Tab标签以完全显示状态展示在Tab栏中。
如果未完全显示的Tab标签位于Tab栏的右侧,则第一方向为由右向左的方向;如果未完全显示的Tab标签位于Tab栏的左侧,则第一方向为由左向右的方向。
在一些实施例中,为确定Tab栏中的某个Tab标签获得控制焦点时,是否需要移动所有Tab标签的位置,需先判断Tab栏中是否存在未完全显示的Tab标签。判断方式可与在Tab栏中展示各个Tab标签时的方式相似,具体地,按照Tab标签的展示顺序,依次累积每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度。如果累积宽度大于预设展示宽度,则确定累积的最后一个Tab标签为未完全显示的Tab标签。
未完全显示的Tab标签为以未完全显示状态进行展示的Tab标签,即一部分内容展示在Tab栏中,另一部分内容则隐藏在Tab栏的边界外侧。因此,可根据Tab栏的预设展示宽度和Tab栏中展示的每个Tab标签的标签宽度来判断是否存在未完全显示的Tab标签。
以初始展示状态为例,Tab栏从左侧开始依次展示各个Tab标签,即位于Tab栏左侧的首位Tab标签通常为完全显示状态的标签。因此,从Tab栏的最左侧开始依次将每个Tab标签的标签宽度进行累积,累积顺序为各个Tab标签的展示顺序。
图6F示出了根据一些实施例的Tab栏展示数个Tab标签的示意图。每执行一次累积过程,即判断得到的累积宽度是否超过Tab栏的预设展示宽度。参见图6F,Tab栏的预设展示宽度为L0,第一次累积过程,计算第一个Tab标签对应的累积宽度D1=H1,D1<L0;第二次累积过程,计算前两个Tab标签对应的累积宽度D2=H1+H2,D2<L0;第三次累积过程,计算前三个Tab标签对应的累积宽度D3=H1+H2+H3,D3<L0;第四次累积过程,计算前四个Tab标签对应的累积宽度D4=H1+H2+H3+H4,D4<L0;第五次累积过程,计算前五个Tab标签对应的累积宽度D5=H1+H2+H3+H4+H5,D5>L0。
此时,在执行第五次累积过程时产生累积宽度大于预设展示宽度,说明最后一个累积的Tab标签并非完全显示在Tab栏中,则确定累积的最后一个Tab标签为未完全显示的Tab标签。
在一些实施例中,由于用户可以看到完全显示的Tab标签的具体信息,因此,可直接选择其中一个感兴趣的Tab标签触发。但是,如果用户想要查看未完全显示的Tab标签的具体信息,需要在未完全显示的Tab标签获得控制焦点时,移动该Tab标签的显示位置。
具体地,在查看未完全显示的Tab标签时,控制器在执行在未完全显示的Tab如果未完全显示的Tab标签位于Tab栏的右侧,则在未完全显示的Tab标签获得控制焦点时,将位于Tab栏左侧的Tab标签向左移动隐藏或以未完全显示状态展示,以及,将未完全显示的Tab标签向左移动以完全显示状态展示在Tab栏的右侧位置,第一方向为向左移动方向;如果未完全显示的Tab标签位于Tab栏的左侧,则在未完全显示的Tab标签获得控制焦点时,将位于Tab栏右侧的Tab标签向右移动隐藏或以未完全显示状态展示,以及,将未完全显示的Tab标签向右移动以完全显示状态展示在Tab栏的左侧位置,第一方向为向右移动方向。
在一些实施例中,在Tab栏的右侧存在未完全显示的Tab标签的场景下,如果用户通过手柄或头部触控点将控制焦点落在未完全显示的Tab标签上,则控制Tab栏中当前展示的所有Tab标签整体向左移动。此时,以将未完全显示的Tab标签以完全显示状态展示在Tab栏右侧位置为准,将位于Tab栏左侧的Tab标签向左移动进行隐藏或以未完全显示状态展示,需要被隐藏的Tab标签的数量可根据未完全显示的Tab标签的未显示部分宽度进行确定。
具体地,控制器在执行将位于Tab栏左侧的Tab标签向左移动隐藏或以未完全显示状态展示时,被进一步配置为执行下述步骤:基于位于Tab栏右侧的未完全显示的Tab标签的左侧坐标位置和标签宽度,计算未完全显示的Tab标签的未显示部分宽度;在Tab栏中展示的所有Tab标签向左移动未显示部分宽度的距离时,从Tab栏左侧开始依次累积Tab栏中展示的每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度;如果累积宽度小于或等于未显示部分宽度,则将累积宽度对应的至少一个Tab标签隐藏;如果累积宽度大于未显示部分宽度,则将累积宽度对应的最后一个累积的Tab标签以未完全显示状态展示在Tab栏的左侧位置,最后一个累积的Tab标签的展示宽度为对应的标签宽度与未显示部分宽度的差值。
在触发Tab栏右侧展示的未完全显示的Tab标签时,Tab栏中的各个Tab标签整体向左移动。此时,为保证未完全显示的Tab标签能够完全显示在Tab栏中,需要将未完全显示的Tab标签的其余部分内容 向左移动,因此,整体向左移动的距离即为未完全显示的Tab标签的其余部分的宽度,即未显示部分宽度。
图6G示出了根据一些实施例的计算未显示部分宽度的一种示意图。参见图6G中的(a)部分,Tab栏中展示的标签分别为Tab标签C1、C2、C3、C4、C5,Tab标签C5为未完全显示的标签,其余为完全显示的标签。此时,获取该未完全显示的Tab标签C5的标签宽度H5和左侧位置坐标A(x1,y0),基于左侧位置坐标A(x1,y0)和Tab栏的右侧边界位置坐标B(x2,y0),确定出未完全显示的Tab标签C5展示在Tab栏中的展示宽度H51=x2-x1,此时,确定未完全显示的Tab标签的未显示部分宽度H52=H5-H51。
可见,Tab栏中各个Tab标签向左移动的幅度均为H52。因此,在Tab栏中展示的所有Tab标签向左移动未显示部分宽度的距离H52时,从Tab栏左侧开始依次累积Tab栏中展示的每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度。累积宽度的计算方式可参照前述内容,此处不再赘述。累积方向为从左到右。
如果前n个Tab标签对应的累积宽度小于或等于未显示部分宽度,说明在移动距离H52时,该n个Tab标签将从左侧移出Tab栏的展示范围,此时,将累积宽度对应的n个Tab标签隐藏。
在此基础上,如果前n+1个Tab标签对应的累积宽度大于未显示部分宽度,说明在移动距离H52时,前n个Tab标签将移出Tab栏的展示范围,而第n+1个Tab标签未完全移出Tab栏的展示范围,此时,将累积宽度对应的第n+1个(最后一个)累积的Tab标签以未完全显示状态展示在Tab栏的左侧位置。第n+1个累积的Tab标签的标签宽度为Hn+1,且移动的距离为H52,因此,第n+1个累积的Tab标签的展示宽度Hn+1’=Hn+1-H52。
参见图6G中的(b)部分,在Tab栏中展示的各个Tab标签整体向左移动时,位于最左侧的Tab标签C1对应的累积宽度小于距离H52,则将Tab标签C1隐藏。位于左侧前两个Tab标签C1、2对应的累积宽度大于距离H52,则将Tab标签C1隐藏,以及,将Tab标签C2以未完全显示的状态展示在Tab栏中。Tab标签C2的展示宽度H2’=H2-H52。
在一些实施例中,在触发Tab栏右侧未完全显示的Tab标签向左移动以完整展示的场景下,将位于Tab栏左侧的Tab标签向左移动隐藏或以未完全显示状态展示的方式,除采用上述计算累积宽度的方式,还可根据每个Tab标签的左右侧位置坐标与Tab栏的左侧位置坐标的大小关系进行判断。
向左移动时,如果某个Tab标签的左右侧位置坐标x左和x右均大于Tab栏的左侧位置坐标x栏左,则说明该Tab标签未移出Tab栏,可完全显示;如果x左<x栏左,x右>x栏左,则说明该Tab标签半移出Tab栏,则以未完全显示状态进行展示;如果x左<x栏左,x右<x栏左,则说明该Tab标签完全移出Tab栏,则将该Tab标签隐藏。
在一些实施例中,在Tab栏的左侧存在未完全显示的Tab标签的场景下,如果用户通过手柄或头部触控点将控制焦点落在未完全显示的Tab标签上,则控制Tab栏中当前展示的所有Tab标签整体向右移动。此时,以将未完全显示的Tab标签以完全显示状态展示在Tab栏左侧位置为准,将位于Tab栏左侧的Tab标签向右移动进行隐藏,需要被隐藏的Tab标签的数量可根据未完全显示的Tab标签的未显示部分宽度进行确定。
具体地,控制器在执行将位于Tab栏右侧的Tab标签向右移动隐藏或以未完全显示状态展示时,被进一步配置为:基于位于Tab栏左侧的未完全显示的Tab标签的右侧坐标位置和标签宽度,计算未完全显示的Tab标签的未显示部分宽度;在Tab栏中展示的所有Tab标签向右移动未显示部分宽度的距离时,从Tab栏右侧开始依次累积Tab栏中展示的每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度;如果累积宽度小于或等于未显示部分宽度,则将累积宽度对应的至少一个Tab标签隐藏;如果累积宽度大于未显示部分宽度,则将累积宽度对应的最后一个累积的Tab标签以未完全显示状态展示在Tab栏的右侧位置,最后一个累积的Tab标签的展示宽度为对应的标签宽度与未显示部分宽度的差值。
在触发Tab栏左侧展示的未完全显示的Tab标签时,Tab栏中的各个Tab标签整体向右移动。此时,为保证未完全显示的Tab标签能够完全显示在Tab栏中,需要将未完全显示的Tab标签的其余部分内容向右移动,因此,整体向右移动的距离即为未完全显示的Tab标签的其余部分的宽度,即未显示部分宽度。
图6H示出了根据一些实施例的计算未显示部分宽度的另一种示意图。参见图6H中的(a)部分,Tab栏中展示的标签分别为Tab标签C3、C4、C5、C6,Tab标签C3为未完全显示的标签,其余为完全显示的标签。此时,获取该未完全显示的Tab标签的标签宽度H3和右侧位置坐标C(x3,y0),基于右侧位置坐标(x3,y0)和Tab栏的左侧边界位置坐标D(x4,y0),确定出未完全显示的Tab标签展示在Tab栏中的展示宽度H31=x3-x4。最后,确定未完全显示的Tab标签的未显示部分宽度H32=H3-H31。
可见,Tab栏中各个Tab标签向右移动的幅度均为H32。因此,在Tab栏中展示的所有Tab标签向 右移动未显示部分宽度的距离H32时,从Tab栏右侧开始依次累积Tab栏中展示的每个Tab标签的标签宽度,得到数个Tab标签对应的累积宽度。累积宽度的计算方式可参照前述内容,此处不再赘述。累积方向为从右到左。
如果前n个Tab标签对应的累积宽度小于或等于未显示部分宽度,说明在移动距离H32时,该n个Tab标签将从右侧移出Tab栏的展示范围,此时,将累积宽度对应的n个Tab标签隐藏。
在此基础上,如果前n+1个Tab标签对应的累积宽度大于未显示部分宽度,说明在移动距离H32时,前n个Tab标签将移出Tab栏的展示范围,而第n+1个Tab标签未完全移出Tab栏的展示范围,此时,将累积宽度对应的第n+1个(最后一个)累积的Tab标签以未完全显示状态展示在Tab栏的右侧位置。第n+1个累积的Tab标签的标签宽度为Hn+1,且移动的距离为H52,因此,第n+1个累积的Tab标签的展示宽度Hn+1’=Hn+1-H32。
参见图6H中的(b)部分,在Tab栏中展示的各个Tab标签整体向右移动时,位于最右侧的Tab标签C6对应的累积宽度小于距离H32,则将Tab标签C6隐藏。位于右侧两个Tab标签C5、C6对应的累积宽度大于距离H32,则将Tab标签C6隐藏,以及,将Tab标签C5以未完全显示的状态展示在Tab栏中。Tab标签C5的展示宽度H5’=H5-H32。
在一些实施例中,在触发Tab栏左侧未完全显示的Tab标签向右移动以完整展示的场景下,将位于Tab栏右侧的Tab标签向右移动隐藏或以未完全显示状态展示的方式,除采用上述计算累积宽度的方式,还可根据每个Tab标签的左右侧位置坐标与Tab栏的右侧位置坐标的大小关系进行判断。
向右移动时,如果某个Tab标签的左右侧位置坐标x左和x右均小于Tab栏的右侧位置坐标x栏右,则说明该Tab标签未移出Tab栏,可完全显示;如果x左<x栏右,x右>x栏右,则说明该Tab标签半移出Tab栏,则以未完全显示状态进行展示;如果x左>x栏左,x右>x栏右,则说明该Tab标签完全移出Tab栏,则将该Tab标签隐藏。
图6I示出了根据一些实施例的Tab栏中存在未完全显示的Tab标签的效果示意图;图6J示出了根据一些实施例的触发Tab栏中存在的未完全显示的Tab标签的效果示意图。在虚拟用户界面中导航栏的交互场景下,基于前述内容对Tab栏中的各个Tab标签进行交互。参见图6I,用户触发导航栏中的“教育”按钮,在虚拟用户界面中生成“教育”展示界面,同时在该界面中存在包括多个Tab标签的Tab栏,Tab标签依次分别为“全部小学生课程”、“课前预习”、“古诗词赏析”、“期末复习”和“我爱学习一年级…”,可见,最右侧的Tab标签为未完全显示的标签。
参见图6J,若在触发最右侧的未完全显示的“我爱学习一年级…”标签时,Tab栏中的内容整体向左移动,其中,Tab栏左侧超出部分不再显示,最右侧Tab标签获得控制焦点,并完整显示信息内容“我爱学习一年级语文”,而左侧的“全部小学生课程”标签不再完全显示,仅显示“…小学生课程”的部分内容。
可见,本申请实施例提供的三维显示设备,在对Tab栏中展示的各个Tab标签进行交互时,如果触发的是未完全显示的Tab标签,则在该Tab标签获得控制焦点时,将Tab栏中展示的各个Tab标签整体进行移动,移动方向与该Tab标签位于Tab栏的位置方向相反。移动的幅度为未完全显示的Tab标签的未显示部分宽度,在移动后,位于另一侧的Tab标签被隐藏或以未完全显示状态进行展示,而该侧的Tab标签则以完全显示状态展示在Tab栏中。因此,通过该交互过程,可使得用户在将控制焦点落在未完全显示的Tab标签上时,能够及时查看到该标签的具体信息,用户体验好。
在一些实施例中,如果待展示的Tab标签的数量较多时,无法一次性全部展示在Tab栏中,则Tab栏中可首次展示部分Tab标签,其余Tab标签可以翻页的形式进行展示。且在进行翻页时,如果当前展示的Tab标签中存在未完全显示的标签,为便于用户查看到该标签的具体信息,可在执行一次翻页时,将该未完全显示的Tab标签作为下一页展示的第一个Tab标签,即完全显示该Tab标签。
为此,为进行翻页操作,控制器被进一步配置为:获取待展示的Tab标签的标签数量和Tab栏中展示的Tab标签的当前展示数量,Tab栏中展示的Tab标签包括以完全显示状态展示的Tab标签和以未完全显示状态展示的Tab标签;如果标签数量大于当前展示数量,则在Tab栏的两侧展示翻页按钮,翻页按钮用于触发翻页操作。
由于Tab栏的展示区域有限,若需要展示的Tab标签的标签数量大于Tab标签的当前展示数量,则Tab栏无法同时展示上述数个Tab标签,此时,在Tab栏的两侧展示翻页按钮,翻页按钮用于触发翻页操作。
再次参见图6I,如果Tab栏中当前展示的Tab标签的右侧,即按照展示顺序的后序还存在Tab标签,则在Tab的右侧展示右侧翻页按钮6203。在触发右侧翻页按钮6203时,实现向左翻页,以查看后序待展示的Tab标签。
再次参见图6J,如果Tab栏中当前展示的Tab标签的左侧,即按照展示顺序的前序还存在Tab标 签,则在Tab的左侧展示左侧翻页按钮6204。在触发左侧翻页按钮6204时,实现向左翻页,以查看前序待展示的Tab标签。
在一些实施例中,在执行翻页操作时,如果当前Tab栏中展示的Tab标签均为完全显示状态,则在进行翻页时,可直接获取下一标签展示页的内容并展示在Tab栏中。如果当前Tab栏中展示的Tab标签中存在未完全显示状态的标签,则在进行翻页时,将该未完全显示的Tab标签完整地展示在Tab栏的端部位置,端部位置是指Tab栏的最左侧或最右侧位置。
在一些实施例中,在操作翻页按钮对Tab栏中的内容进行翻页操作时,控制器被进一步配置为:接收对翻页按钮的操作,如果Tab栏中存在未完全显示的Tab标签,则将未完全显示的Tab标签以完全显示状态展示在Tab栏的端部位置;如果Tab栏中不存在未完全显示的Tab标签,则按照Tab栏的待展示宽度和未展示的Tab标签的标签宽度,将至少一个未展示的Tab标签展示在Tab栏中。
在对Tab栏中的内容进行翻页操作时,会存在两种应用场景。一种是Tab栏中展示的Tab标签均为完全显示状态的标签,此时,可直接按照顺序获取其他未展示的Tab标签展示在Tab栏中,以由新获取的内容替换原展示的内容,实现翻页。新获取的内容在进行展示时,按照Tab栏的待展示宽度和未展示的Tab标签的标签宽度,依次判断每个Tab标签是否可完全显示,具体实现过程可参照前述实施例的内容,此处不再赘述。
另一种是Tab栏中存在一个未完全显示的Tab标签时,此时,为便于用户能够查看到该Tab标签的完整信息,可在执行一次翻页时,将该未完全显示的Tab标签依然展示在Tab栏中,且以完全显示状态进行展示。为便于用户查看和保证每个Tab标签的展示顺序,可将未完全显示的Tab标签以完全显示状态展示在所述Tab栏的端部位置,端部位置可为Tab栏的左侧或右侧。
在一些实施例中,在执行向左翻页时,控制器在执行将未完全显示的Tab标签以完全显示状态展示在Tab栏的端部位置,被进一步配置为执行下述步骤:响应于触发Tab栏右侧翻页按钮产生的向左翻页指令,将未完全显示的Tab标签以完全显示状态展示在Tab栏的左侧端部位置,以及,获取未展示的后序Tab标签;将未展示的后序Tab标签按从左至右的顺序依次展示在完全显示的Tab标签的右侧。
在Tab栏展示的所有Tab标签中存在未完全显示的Tab标签的场景下,如果用户触发Tab栏右侧翻页按钮时,则产生向左翻页指令,执行向左翻页操作。
为便于用户能够在翻页的过程中获知未完全显示的Tab标签的具体信息,可将该未完全显示的Tab标签依然展示在Tab栏的左侧端部位置。
同时,获取未展示的后序Tab标签。后序Tab标签是指按照展示顺序位于当前展示的Tab标签之后的标签,后序Tab标签的获取数量以Tab栏的预设展示宽度为基准来确定,具体确定方法可参照前述实施例的内容,此处不再赘述。
在向左翻页时,各个Tab标签的展示顺序为从左至右依次排序,即未完全显示的Tab标签位于Tab栏的最左侧首位,其余后序Tab标签依次位于未完全显示的Tab标签的右侧。即执行一次向左翻页后,未完全显示的Tab标签展示在Tab栏的左侧端部位置,使得未完全显示的Tab标签左侧与Tab栏的左侧对齐,其余后序Tab标签依次向右排列展示。
在执行向左翻页时,无论未完全显示的Tab标签是位于Tab栏的右侧还是左侧,均在翻页时,将该未完全显示的Tab标签展示在Tab栏的最左侧,以在展示后序Tab标签的同时,完整地展示原未完全显示的Tab标签。
图6K示出了根据一些实施例的基于Tab栏进行向左翻页的效果示意图。参见图6K中的(a)部分,Tab栏中展示4个Tab标签C2、C3、C4、C5,Tab标签C5为未完全显示的标签,且位于Tab栏的右侧。参见图6K中的(b)部分,在触发右侧翻页按钮,执行向左翻页时,获取后序Tab标签C6、C7,将标签C5、C6、C7按照由左至右的顺序展示在Tab栏中,此时,标签C5位于Tab栏的最左侧,且完整显示。
在一些实施例中,在执行向右翻页时,控制器在执行将未完全显示的Tab标签以完全显示状态展示在Tab栏的端部位置,被进一步配置为执行下述步骤:响应于触发Tab栏左侧翻页按钮产生的向右翻页指令,将未完全显示的Tab标签以完全显示状态展示在Tab栏的右侧端部位置,以及,获取未展示的前序Tab标签;将未展示的前序Tab标签按从右至左的顺序依次展示在完全显示的Tab标签的左侧。
在Tab栏展示的所有Tab标签中存在未完全显示的Tab标签的场景下,如果用户触发Tab栏左侧翻页按钮时,则产生向右翻页指令,执行向右翻页操作。
为便于用户能够在翻页的过程中获知未完全显示的Tab标签的具体信息,可将该未完全显示的Tab标签依然展示在Tab栏的右侧端部位置。
同时,获取未展示的前序Tab标签。前序Tab标签是指按照展示顺序位于当前展示的Tab标签之前的标签,前序Tab标签的获取数量以Tab栏的预设展示宽度为基准来确定,具体确定方法可参照前述实施例的内容,区别在于展示的方向为由右至左(前述实施例的展示方向为由左至右),此处不再赘述。
在向右翻页时,各个Tab标签的展示顺序为从右至左依次排序,即未完全显示的Tab标签位于Tab栏的最右侧首位,其余后序Tab标签依次位于未完全显示的Tab标签的左侧。即执行一次向右翻页后,未完全显示的Tab标签展示在Tab栏的右侧端部位置,使得未完全显示的Tab标签右侧与Tab栏的右侧对齐,其余前序Tab标签依次向左排列展示。
在执行向右翻页时,无论未完全显示的Tab标签是位于Tab栏的右侧还是左侧,均在翻页时,将该未完全显示的Tab标签展示在Tab栏的下一标签展示页的最右侧,以在展示前序Tab标签的同时,完整地展示原未完全显示的Tab标签。
图6L示出了根据一些实施例的基于Tab栏进行向右翻页的效果示意图。参见图6L中的(a)部分,Tab栏中展示4个Tab标签C10、C11、C12、C13,Tab标签C13为未完全显示的标签,且位于Tab栏的右侧。参见图6L中的(b)部分,在触发左侧翻页按钮,执行向右翻页时,获取前序Tab标签C7、C8、C9,将标签C7、C8、C9、C13按照由左至右的顺序展示在Tab栏中,此时,标签C13依然位于Tab栏的最右侧,且完整显示。
可见,本申请实施例提供的一种三维显示设备,在基于Tab栏中展示的各个Tab标签进行翻页操作时,获取前序或后序的内容替换当前展示的内容。而如果当前展示的内容中存在未完全显示的Tab标签,则在翻页时,依然将该未完全显示的Tab标签以完全显示状态完整地展示在Tab栏的端部位置。因此,在进行翻页时,用户可在查看前序或后序Tab标签的同时,同步查看到当前页中未完全显示的Tab标签的具体信息,用户体验好。
在一些实施例中,由于在基于虚拟用户界面产生的不同交互场景下,虚拟用户界面中呈现适配不同交互场景的Tab栏。那么,在Tab栏中展示对应的Tab标签时,可采取的展示方式也会存在不同。
在一些实施例中,在搜索某个视频媒资时,对演员信息进行展示的场景,控制器在执行将至少一个Tab标签展示在Tab栏,被进一步配置为执行下述步骤:在展示媒资信息时,基于媒资信息包括的数个人物信息,生成具有不同标签宽度的数个Tab标签,以及,在虚拟用户界面中展示包括Tab栏的人物信息展示界面;基于每个人物信息的展示顺序,累积至少一个Tab标签的标签宽度,得到累积宽度;如果累积宽度小于或等于Tab栏的预设展示宽度,则将累积宽度对应的Tab标签展示在Tab栏中;如果累积宽度大于Tab栏的预设展示宽度,则将累积宽度对应的最后一个累积的Tab标签作为下一标签展示页的内容,以及,将累积宽度对应的除最后一个累积的Tab标签以外的其他Tab标签作为当前标签展示页的内容展示在Tab栏中。
在搜索某个视频媒资时,虚拟用户界面中展示媒资信息,媒资信息包括视频媒资名称、人物信息等,人物信息可为演员信息。同一个视频媒资中会存在多个演员,因此,可基于每个人物信息生成对应的Tab标签。
视频媒资名称通常展示在人物信息展示界面的顶部,而由多个表征演员信息的Tab标签组成的Tab栏显示在视频媒资名称的底部。
在一些实施例中,对于演员信息展示,只展示当前背景内可以显示完全的演员名字;左右翻页仍然保证显示出来的都是可以完全展示的。可见,在此场景下,Tab栏中只存在完全显示的Tab标签,而不存在未完全显示的Tab标签。
因此,为保证每个展示出来的Tab标签均为完全显示状态,则按照演员信息的顺序依次累积每个对应的Tab标签的标签宽度,得到对应的累积宽度。计算累积宽度的方法可参照前述实施例的内容,此处不再赘述。
如果n个Tab标签对应的累积宽度小于或等于Tab栏的预设展示宽度,说明Tab栏可完整展示该n个Tab标签,则将累积宽度对应的Tab标签展示在Tab栏中。
如果n+1个Tab标签对应的累积宽度大于Tab栏的预设展示宽度,说明Tab栏不可完整展示该n+1个Tab标签。此时,将累积宽度对应的除最后一个累积的Tab标签以外的其他Tab标签作为当前标签展示页的内容展示在Tab栏中,即将前n个Tab标签完整地展示在Tab栏中。以及,将累积宽度对应的最后一个累积的Tab标签作为下一标签展示页的内容,即将第n+1个Tab标签展示在下一标签展示页中。
图6M示出了根据一些实施例的在人物信息展示界面中展示Tab栏的效果示意图。参见图6M,当前Tab栏中仅完整展示两个演员的名称,而实际上还存在第三个演员“演员丙”。此时类似上述处理,通过整个Tab栏的预设展示宽度和计算已经显示的演员信息占据的累积宽度,判断是否还能完整显示第三个演员信息。
如不能完全显示,可以采用上述方式实现,即将第三个演员“演员丙”展示在下一标签展示页中。同时根据视觉效果也可以选择翻页显示,增加向右的箭头指示还有更多演员,而不会只显示第三个演员的一部分。在向左翻页时,可参照前述实施例提供的内容,以在下一标签展示页中呈现其余的完全显示的演员信息,此处不再赘述。
在一些实施例中,在基于某个搜索框进行信息搜索的场景下,搜索时弹出的搜索历史界面中呈现不同的历史搜索信息,每个历史搜索信息对应一个Tab标签,数个Tab标签统一呈现在搜索历史界面中,历史搜索信息可以关键词的形式存在。
具体地,在搜索历史界面展示Tab栏的场景下,控制器在执行将至少一个Tab标签展示在Tab栏,被进一步配置为执行下述步骤:接收对虚拟用户界面中呈现的搜索框的操作,获取历史搜索信息,生成具有不同标签宽度的数个Tab标签,以及,在虚拟用户界面中展示包括Tab栏的搜索历史界面,Tab栏包括数个标签展示行;基于每个Tab标签生成时间的时间顺序,累积至少一个Tab标签的标签宽度,得到累积宽度;如果累积宽度小于或等于Tab栏的预设展示宽度,则将累积宽度对应的Tab标签展示在Tab栏的底部标签展示行;如果累积宽度大于Tab栏的预设展示宽度,则将累积宽度对应的最后一个累积的Tab标签展示在底部标签展示行的上一标签展示行,以及,将累积宽度对应的除最后一个累积的Tab标签以外的其他Tab标签展示在底部标签展示行。
用户在利用虚拟用户界面中展示的搜索框来查询自己感兴趣的应用或媒资等时,用户可能会查询之前已经查询过的内容,因此,为便于用户的快捷搜索,可将历史搜索时使用的搜索关键词展示给用户。
图6N示出了根据一些实施例的虚拟用户界面中呈现搜索历史界面的示意图。参见图6N,为此,用户将控制焦点落在搜索框上并进行点击触发,可在搜索用户界面中展示搜索历史界面,搜索历史界面中包括呈现数个标签展示行的Tab栏。同时,可获取用户在临近一段时间内进行搜索时产生的历史搜索信息,历史搜索信息可为用户每次搜索信息时使用的搜索关键词。搜索关键词的长度不同,使得在基于每个搜索关键词生成对应的Tab标签时,每个Tab标签的标签宽度不同。
在一些实施例中,历史搜索信息会同时展示给用户,便于用户快速选择一个之前使用的搜索关键词进行再次搜索。因此,需要将生成的各个Tab标签统一进行展示,且需保证每个展示出来的Tab标签均为完全显示状态。而Tab栏的预设展示宽度有限,在同一行中无法同时展示过多的Tab标签,因此,可在Tab栏中呈现多个标签展示行。
每个标签展示行由上至下依次排列,且每个标签展示行的展示宽度与Tab栏的预设展示宽度相等。位于底部的标签展示行用于展示最早产生的搜索关键词,位于顶部的标签展示行用于展示最晚(最新)产生的搜索关键词。
因此,从Tab栏的底部标签展示行开始先展示数个最早产生的历史搜索信息对应的Tab标签。展示时,按照每个Tab标签的生成时间的时间顺序,即按照从最早产生到最晚产生的时间顺序,依次累积至少一个Tab标签的标签宽度,得到累积宽度。计算累积宽度的具体实现过程可参照前述实施例的内容,此处不再赘述。Tab标签的生成时间即为对应的历史搜索信息的产生时间。
为保证每个展示出来的Tab标签均为完全显示状态,在最底部标签展示行展示多个Tab标签后,下一个Tab标签将展示在另一标签展示行中。
如果前n个Tab标签对应的累积宽度小于或等于Tab栏的预设展示宽度,说明Tab栏的底部标签展示行可完整展示该n个Tab标签,则将累积宽度对应的前n个Tab标签展示在Tab栏的底部标签展示行。
如果n+1个Tab标签对应的累积宽度大于Tab栏的预设展示宽度,说明Tab栏的底部标签展示行不可完整展示该n+1个Tab标签。此时,将累积宽度对应的除最后一个累积的Tab标签以外的其他Tab标签展示在底部标签展示行,即将前n个Tab标签完整地展示在Tab栏的底部第一标签展示行6205中。以及,将累积宽度对应的最后一个累积的Tab标签展示在底部标签展示行的上一标签展示行,即将第n+1个Tab标签展示在底部标签展示行的上一标签展示即第二标签展示行6206或第三标签展示行6207。
在一些实施例中,位于同一标签展示行中的数个Tab标签,其展示顺序为从左至右的方向上按照Tab标签的生成时间由晚到早的顺序进行展示,即最早生成的Tab标签位于标签展示行的最右侧,最晚生成的Tab标签位于标签展示行的最左侧。
在一些实施例中,Tab栏中展示的Tab标签的总数量与标签展示行的数量、预设展示宽度和标签宽度有关,此处不具体进行限定。
在一些实施例中,由于搜索历史中的每一条历史搜索信息长度不一致,每个Tab标签的标签长度不同,使得具有相同预设展示宽度的数个标签展示行中展示的总标签宽度不同。为了展示更多的历史,采用多行显示方式,每一行都要求完整展示,展示不完整的自动切到下一样展示。
图6O示出了根据一些实施例的在搜索历史界面中展示Tab栏的效果示意图。参见图6O,历史搜索信息“XX”、“XXX”、“XXXXXXX”是最早搜索的内容,根据标签展示行的预设展示宽度正好在一行完全显示,则显示为一行,展示在Tab栏底部第一标签展示行6205中。
接着搜索的“XXXXXXXXXXXXXX”,由于累积宽度大于预设展示宽度,无法再在底部的第一标签展示行6205中展示,所以另起一行展示。接着搜索的“XXXX”、“XXXXX”按照前述方法判断也需要另起一行,但是由于在一行范围内能够完全显示,所以这两条历史也会在一行显示。
按此逻辑,通过计算一行范围内能够显示的内容和已经显示的内容,来判断即将需要显示的内容是否还可以在这一行能够完全展示,如果能完全展示则现在该行;否则整体下移,在最上边起一新行进行显示。
可见,在不同的交互场景下,Tab栏中展示各个Tab标签时,部分场景下允许Tab标签以未完全显示状态进行展示,另一部分场景下只允许Tab标签完整显示。部分场景下可通过翻页操作展示Tab栏中未展示的Tab标签,另一部分场景下可同时将所有Tab标签完整展示出来。无论采用何种展示方式,均可便于用户交互,提高用户体验。
在一些实施例中,在用户基于Tab栏中的各个Tab标签进行交互时,为了更好地区分各个Tab标签的触发状态以及指示用户操作反馈,定义正常、获焦和遗留三个状态,并分别在对应的Tab标签上添加对应的标识图案,以指示用户该Tab标签已获焦。
在基于Tab栏中的各个Tab标签进行交互时,用户操作手柄或头部触控点将控制焦点移动至某个Tab标签上,则为该Tab标签添加表征获焦状态的标识图案,获焦状态的标识图案可为高亮形式。而其他Tab标签未获得控制焦点,则为每个Tab标签添加表征正常状态的标识图案,正常状态的标识图案可为透明形式。若获得控制焦点的Tab标签被触发之后,该控制焦点又移动到其他Tab标签上时,则为执行触发操作的Tab标签添加表征遗留状态的标识图案,遗留状态的标识图案可为颜色标识或带有边框的透明矩形。
在一些实施例中,在为Tab标签添加标识图案时,控制器被进一步配置为:在Tab栏中的任一个Tab标签获得控制焦点时,为Tab标签添加表征获焦状态的标识图案6501;如果获得控制焦点的Tab标签未进行触发操作后又丢失控制焦点,则为Tab标签添加表征正常状态的标识图案6503;如果获得控制焦点的Tab标签进行触发操作后又丢失控制焦点,则为Tab标签添加表征遗留状态的标识图案6502。
当用户操作控制焦点移动到某个Tab标签时高亮显示(获焦状态的标识图案),指示当前Tab标签获取焦点;而其余未获得控制焦点的Tab标签为正常状态的标识图案。例如,再次参见图6J所示,在用户将控制焦点移动到Tab栏最右侧的未完全显示的Tab标签“我爱学习一年级…”上时,该Tab标签高亮显示,其余Tab标签为正常状态。
由于未完全显示的Tab标签获得控制焦点后,Tab栏中展示的内容整体向左移动,此时,获焦状态的标识图案跟随该Tab标签进行移动。
若获得控制焦点的Tab标签,未执行点击操作即离开时恢复正常状态(正常状态的标识图案)。
图6P示出了根据一些实施例的在Tab标签上添加遗留状态标识图案的效果示意图。参见图6P,若获得控制焦点的Tab标签为“古诗词赏析”,触发该Tab标签后,切换虚拟用户界面中呈现与“古诗词赏析”对应的内容。在执行触发操作后,用户又将控制焦点从该Tab标签上离开,落在“我爱学习一年级语文”上,则为Tab标签“古诗词赏析”添加表征遗留状态的标识图案,以及,为Tab标签“我爱学习一年级语文”添加高亮显示,其余Tab标签为正常状态。
在一些实施例中,在判断某个Tab标签是否获得控制焦点时,可通过判断用户操作的手柄射出的光线是否与Tab标签相撞。相撞操作是指线的坐标是否与Tab标签的坐标相交,如果相交,则说明该光线与该Tab标签相撞,并确定该Tab标签获得控制焦点。此时,如果用户点击手柄的确定键,则可执行触发操作,以启动该Tab标签。
在一些实施例中,当用户选择Tab栏中的某个Tab标签时,即某个Tab标签获取焦点时,为展示更多的信息以便于用户可以对该Tab标签进行了解,可以同步展示标签简介等其它信息。
在一些实施例中,在展示标签信息时,控制器被进一步配置为执行下述步骤:在Tab栏中的任一个Tab标签获得控制焦点时,获取Tab标签的标签信息。基于标签信息生成浮层提示框,将浮层提示框展示在Tab标签所在位置的一侧。
Tab栏中展示有多个Tab标签,如果用户使用某个应用时对其对应的Tab标签不是很熟悉,例如不熟悉某个分类、属性、功能下对应的内容,则可将控制焦点落在该Tab标签上,将该Tab标签的标签信息生成浮层提示框,将浮层提示框展示在Tab标签所在位置的一侧。
浮层提示框中展示该Tab标签的标签信息,标签信息包括Tab标签对应的分类、属性或功能名称、简介信息等,用于对该应用进行简单的介绍,以便于用户无需触发该Tab标签即可获知其具体信息,提高用户体验。
可见,本申请实施例提供的一种三维显示设备,可根据不同的交互场景展示不同形式的Tab栏,实现Tab栏的动态展示,Tab栏按照不同展示方式展示Tab标签,可便于用户查看和交互,提高用户体验。
图6B示出了根据一些实施例的Tab栏的动态展示方法的流程图。参见图6B,本申请实施例提供的一种Tab栏的动态展示方法,由前述实施例提供的三维显示设备中的控制器执行,该方法包括:获取待展示的至少一个Tab标签;如果所述Tab标签的标签宽度小于或等于Tab栏的待展示宽度,则将所述 Tab标签以完全显示状态展示在所述Tab栏中;如果所述Tab标签的标签宽度大于所述Tab栏的待展示宽度,则将所述Tab标签以未完全显示状态展示在所述Tab栏中;在所述未完全显示的Tab标签获得控制焦点时,向第一方向移动所述Tab栏中的每个Tab标签,以将所述未完全显示的Tab标签以完全显示状态展示在所述Tab栏中,所述第一方向是指从未完全显示的Tab标签至相邻的完全显示的Tab标签的方向。
由以上实施方式可知,本申请实施例提供的一种Tab栏的动态展示方法及三维显示设备,在Tab栏中展示数个Tab标签时,按照Tab标签的标签宽度与Tab栏的待展示宽度的大小关系,将每个Tab标签以完全显示状态或未完全显示状态进行展示。在未完全显示的Tab标签获得控制焦点时,向第一方向移动Tab栏中的每个Tab标签,以将未完全显示的Tab标签以完全显示状态展示在Tab栏中,以便用户查看。可见,本申请实施例提供的方法及三维显示设备,结合三维显示设备可以自由操作和每个Tab标签数据长度的不确定性等特点,Tab栏中显示的Tab标签数量根据Tab标签本身内容动态计算,且在未完全显示的Tab标签获得控制焦点时,可以将该未完全显示的Tab标签完整地展示出来,以便用户查看。
第五部分
在一些实施例中,三维显示设备搭配手柄或头触控点进行使用,用户通过操作手柄或调整头触控点的方向实现与虚拟现实应用中提供的各个业务进行交互。例如,控制三维显示设备中的光标可以自由的随手柄定位在显示窗口的任一位置。
在一些实施例中,在判断虚拟用户界面中某个业务或应用是否获得控制焦点时,可通过判断用户操作的手柄射出的光线是否与业务或应用相撞。相撞操作是指线的坐标是否与业务或应用的坐标相交,如果相交,则说明该光线与该业务或应用相撞,并确定该业务或应用获得控制焦点。此时,如果用户点击手柄的确定键,则可执行触发操作。
图7A示出了根据一些实施例的用户佩戴三维显示设备操作手柄的场景示意图。参见图7A,在一些实施例中,在用户佩戴三维显示设备7100后,用户通过手操作手柄7200,以与三维显示设备中配置的虚拟现实应用提供的各个业务或应用进行交互。手柄上设有触控板7201和按键7202,触控板可作为应用键,单击执行确认操作。按键可执行单击和双击操作,单击操作执行返回动作,双击操作执行调起主屏幕动作。
根据不同的使用需求,虚拟现实应用中提供的部分业务或应用通常需要进行账号登录后方可使用。若用户要启动某个应用或业务,则需要用户先进行账号登录。
在操作时,用户通过手柄点击虚拟用户界面中的某个应用,如果该应用需要进行账号登录,则在虚拟用户界面中弹出登录界面。登录界面中通常包括用户名输入框和密码输入框,如果用户想要输入用户名,则通过手柄点击用户名输入框,并同步弹出输入法区域,此时,用户名输入框和输入法区域需同时显示,以便于用户输入。
而由于三维显示设备中的AR设备受制于角分辨率、亮度、对比度、透光率、图像伪影、失真、一致性,或者非显示问题,如:适眼区、大小、重量、电池、成本、耐用性等一系列原因,目前主流的AR设备的FOV角度一般在40°x30°左右,使得三维显示设备的显示视窗较小。
三维显示设备的显示视窗较小,在保证用户可以清晰看到视窗中界面的情况下,显示视窗无法显示太多内容,使得用户输入框显示区域及输入法区域受限,无法同时在视窗中完整显示。故针对于较大界面的用户操作,例如用户通过输入法输入进行登录时,由于无法在视窗中完整显示输入区域界面和输入法键盘界面,用户需通过频繁转动头部调整视角来看清登录界面的内容,才可进行输入操作。可见,这种操作极其不友好,使得账号登录方式较为繁琐,不便于用户操作,可能会导致用户放弃登录,影响用户体验。
因此,针对用户在操作三维显示设备进行账号登录的场景,为便于用户能够便捷、快速地进行账号登录,本申请提供一种三维显示设备,不仅为其配置传统的手动输入的账号登录方式,还为其提供无需用户手动输入的扫码登录方式。三维显示设备中配置的无需用户输入,极其便利的扫码登录方式,可用于各种类型的AR/VR的硬件头戴设备,也适用于任何需要账号登录的场景。
需要说明的是,三维显示设备中的VR设备的FOV显示角度比较大,其显示视窗较大,因此,本申请提出的扫码登录方式具体应用在显示视窗较小的AR设备中,但该扫码登录方式应用在VR设备中也可行。下文以扫码登录方式应用在AR设备中为例进行说明。
图7B示出了根据一些实施例的账号登录方法的一种流程图;图7C示出了根据一些实施例的账号登录方法的交互图。在实现无需用户输入即可实现快速登录的方法时,本申请实施例提供一种三维显示设备,包括:虚拟显示器,被配置为呈现显示有不同应用的虚拟用户界面;摄像头,被配置为采集图像信息;分别与虚拟显示器和摄像头连接的控制器,在执行图7B和图7C所示的账号登录方法时,控制器被 配置为执行下述步骤S701至S703:
S701、接收对虚拟用户界面中任一应用的操作,在虚拟用户界面中呈现包括扫码登录控件的账号登录界面。
三维显示设备需要进行账号登录的场景,包括但不限于三维显示设备内配置的各个系统应用和第三方应用的账号登录,也包括虚拟现实应用的账号登录。各个系统应用和第三方应用显示在由虚拟现实应用生成的虚拟用户界面中。
在需要对某个应用进行启动操作时,由用户佩戴三维显示设备,并拿起手柄进行操作,如图7A所示的场景图。用户操作手柄点击虚拟用户界面中的任一应用,若用户选择启动的应用需要登录账号后方可获得更多的使用权限,但该应用还未登录账号时,则需要用户进行账号登录。
图7D示出了根据一些实施例的账号登录界面的显示示意图。参见图7D,在用户操作手柄启动虚拟用户界面7401中的任一应用,但该应用还未登录账号时,在启动该应用的同时,弹出账号登录界面7402,账号登录界面显示在虚拟用户界面中。
在一些实施例中,三维显示设备提供传统的手动输入的账号登录方式,为实现快速登录,三维显示设备还提供无需用户输入的扫码登录方式。此时,账号登录界面中包括手动登录控件和扫码登录控件,手动登录控件和扫码登录控件可进行点击和切换。
手动登录控件用于调出手动登录界面并显示在账号登录界面中,手动登录界面7403中显示用户名输入框、密码输入框、登录确认键、申请账号、跳过控件等内容。扫码登录控件用于调出扫码登录界面并显示在账号登录界面中,扫描登录界面包括图像显示区和跳过控件等内容。
在一些实施例中,用户可通过手柄点击账号登录界面中的手动登录控件或扫码登录控件,以切换手动登录界面和扫码登录界面的显示。
在一些实施例中,在默认状态下,账号登录界面在初始生成并显示时,账号登录界面中默认优先显示手动登录界面,此时,账号登录界面中还显示手动登录控件和扫码登录控件。若用户想要采用扫码登录方式,则可点击扫码登录控件,此时,账号登录界面中切换显示扫码登录界面。在此场景下,若用户想要再次采用手动输入方式,则点击手动登录控件,此时,账号登录界面中再次切换回显示手动登录界面。
可见,不论账号登录界面中显示哪一种登录界面,手动登录控件和扫码登录控件均固定显示在账号登录界面中,以便于用户实时切换账号登录方式。
S702、接收对扫码登录控件的操作,开启摄像头,以及,在账号登录界面中呈现包括图像显示区的扫码登录界面,图像显示区用于显示摄像头采集的图像信息。
为便于用户快速进行账号登录,用户可通过手柄点击账号登录界面中的扫码登录控件,以采用扫码登录方式进行账号登录。
在采用扫码登录方式时,为便于进行扫码操作,三维显示设备需同步开启其配置的摄像头,同时,切换扫码登录界面显示在账号登录界面中。
图7E示出了根据一些实施例的扫码登录界面的显示示意图。参见图7E,在用户点击扫码登录控件后切换显示扫码登录界面7404,同步弹出扫码提示,扫码提示显示在扫码登录界面的显示图像显示区7405,如“请将手机登录二维码对准摄像头”等。
三维显示设备的摄像头用于进行图像信息采集,如扫描手机提供的登录二维码。扫码登录界面中显示有图像显示区,在摄像头开启后,图像显示区用于实时显示摄像头采集的图像信息。
在一些实施例中,为便于在扫码登录界面显示时,用户能够通过图像显示区看到摄像头采集的图像信息,需要摄像头的开启时刻要早于扫码登录界面的显示时刻,即在扫码登录界面显示之前,摄像头已完成开启操作。这种方案可避免在摄像头的开启时刻晚于扫码登录界面的显示时刻时,图像显示区因未显示任何内容,易误使用户认为设备出现故障,如摄像头故障、设备显示故障等,影响用户体验。
在一些实施例中,为保证摄像头的开启时刻要早于扫码登录界面的显示时刻,可在用户点击扫码登录控件时,控制器先生成摄像头开启指令,并发送至摄像头,以启动摄像头。在摄像头开启后,再调出扫码登录界面进行显示,这样可使扫码登录界面显示时,图像显示区可直接显示摄像头实时捕捉到的画面。
需要说明的是,也可采用其他方式实现摄像头的开启时刻要早于扫码登录界面的显示时刻的方案,此处不进行具体限定。
在用户点击扫码登录控件,开启摄像头,并显示扫码登录界面后,用户即可利用摄像头采集登录二维码,实现其所启动的应用的账号登录。
S703、获取摄像头采集登录二维码得到的账号登录信息,基于账号登录信息登录应用对应的账号,登录二维码是指由智能终端基于配置的登录有账号的应用的账号信息生成的二维码。
三维显示设备的摄像头设置在三维显示设备的外侧,如与用户额头正对的位置,便于摄像头采集用户视线前方的图像内容;并随着用户头部的转动,摄像头也随之采集转动后用户所能看到的内容,实现用户所看到的内容即为摄像头采集的图像信息的效果。
图7F示出了根据一些实施例的摄像头采集智能终端7300提供的登录二维码7301的场景示意图。参见图7F,在需要进行扫码登录时,用户可将登录二维码移动至摄像头的采集范围内,由摄像头扫描登录二维码以获取其启动应用的账号登录信息,实现该应用的账号登录。
在一些实施例中,登录二维码由智能终端提供,提供登录二维码的智能终端中配置有三维显示设备启动的应用,以及,智能终端中配置的应用登录有对应的账号,也就是说,登录二维码是由智能终端基于配置的登录有账号的应用的账号信息生成。
在一些实施例中,智能终端可为手机、pad等移动终端。智能终端中配置的应用与三维显示设备中配置的且需要启动的应用相同,例如,智能终端配置视频应用A的客户端,三维显示设备中也配置有视频应用A的客户端。在三维显示设备中的视频应用A的客户端需要登录账号时,可通过扫描智能终端中视频应用A的客户端提供的登录二维码进行登录。
在摄像头需要扫描登录二维码以实现三维显示设备中启动应用的账号登录时,用户需打开智能终端中配置的同一应用。如果智能终端中该应用未登录账号,则需要先在智能终端进行账号登录。在智能终端的应用登录账号状态下,点击该应用中的登录二维码控件,生成登录二维码,呈现在智能终端的显示器中。
此时,用户通过操作三维显示设备,利用摄像头采集智能终端提供的登录二维码,即将三维显示设备的扫码登录界面中的图像显示区对准登录二维码,使得登录二维码显示在图像显示区中,进行扫码登录。
在三维显示设备识别到登录二维码后,可直接进行账号登录操作,无需用户在智能终端侧的二次确认,实现账号快速登录;而在其他实施例中,也可需用户在智能终端侧的二次确认,保证账号安全性。这两种实现方案可根据实际应用情况而定,此处不进行具体限定。
在一些实施例中,三维显示设备采用的扫码登录方式不同于一般的扫码登录方式,如不同于社交应用B的扫码登录。
在社交应用B的扫码登录账号流程中,例如,在网页版登录社交应用B时,手机作为扫码端,手机的社交应用B的账号需处于登录状态;网页版作为被扫码端,网页版为未登录状态。网页版登录社交应用B时,通过登录社交应用B的账号的手机端扫描网页版提供的二维码实现网页版社交应用B的登录。
而在三维显示设备登录账号流程中,三维显示设备作为扫码端,三维显示设备中的应用未登录账号;智能终端作为被扫码端,智能终端中的应用账号处于登录状态。此时,在三维显示设备登录应用账号时,通过未登录账号的三维显示设备扫描登录有账号的智能终端提供的登录二维码,实现三维显示设备中应用的账号登录。
可见,三维显示设备的扫码登录方式与一般扫码登录方式的不同之处在于,本申请是由未登录账号的扫码端扫描登录账号的被扫码端提供的登录二维码,实现扫码端的账号登录。而一般的扫码登录方式是由登录有账号的扫码端扫描未登录账号的被扫码端提供的二维码,实现被扫码端的账号登录。
在一些实施例中,三维显示设备在进行扫码登录账号时,首先需要智能终端中的应用登录账号,若未登录,则在智能终端的应用生成登录二维码时提示用户进行登录。
图7G示出了根据一些实施例的登录账号时智能终端的框架图。参见图7G,智能终端中的应用登录账号的流程为,账号SDK提供账号参数、登录状态和用户信息三个静态回调接口以及登录、登出和刷新令牌(Token)三个功能调用接口,其中静态回调支持Add(增加)和Remove(删除)操作。账号SDK与系统端(服务器)交互通过统一网络层通信SDK(统一数据访问层)实现,该SDK底层代码内部封装了DNS解析和GSLB。上下行数据验签方法使用Appkey/Appsecret方式对上行请求和下行数据进行签名和加解密。用户信息本地缓存管理通过Android Shared Preferences(Android数据持久化)机制保存,当用户退出登录时清除用户信息,每次重新登录或Token刷新时同步更新Shared Preferences中的用户信息。
基于上述框架智能终端的具体处理流程如下:(1)App(即应用)启动时首先通过账号SDK静态接口注册回调函数,然后创建账号管理实例。(2)账号SDK实例化时根据本地缓存的用户信息情况确定需要重新登录还是刷新Token。如需登录或者刷新Token失败则通过App注册的登录状态回调接口返回,App根据状态确定是否弹出登录界面。(3)账号SDK登录流程:每次登录时首先通过query接口获取初始密码(该密码为全局通用密码,系统端维护)和新修改密码强度要求并回调App,App根据要求显示UI。登录结果及错误码需回调App,如需强制修改密码则进入强制修改页面修改密码,App判断新密码是否满足密码强度要求。(4)账号SDK Token维护,包括刷新时机及与其它模块的同步处理。
Token刷新时机:(1)每次登录成功后:App启动时即实例化账号实例时刷新;网络重新连接时刷新。(2)定时刷新:到达Token有效期90%,刷新Token;Token刷新时Refreshtoken也会刷新,而且在有效期内的Token都可以用。比如刷新10次,只要都在有效期,10个都可以用。(3)异常时刷新:刷新失败后比如外网不通、服务器繁忙等异常情况则每隔1分钟重新刷新一次。(4)请求系统端数据时返回Token失效,需刷新Token。
数据同步机制:同步给统一数据请求SDK。同步给App注册的回调函数。
在一些实施例中,在基于上述流程实现智能终端中应用的账号登录后,智能终端即可操作该应用生成登录二维码。
在生成登录二维码时,智能终端获取该应用的账号信息,账号信息包括用户名、密码、UID等。UID为该应用及其账号的唯一标识。智能终端向账号服务器发送携带账号信息的二维码生成请求。
账号服务器接收到二维码生成请求后,对该请求中携带的用户名和密码进行加密,并基于UID重新随机生成一个UID。账号服务器将加密后的用户名、密码以及随机生成的UID等信息发送至智能终端,智能终端中的应用根据系统端(即账号服务器)返回的数据以及随机生成的UID信息生成登录二维码,数据包括加密后的用户名和密码。加密后的用户名、密码以及随机生成的UID等信息即为通过扫描登录二维码获得的账号登录信息。
在一些实施例中,随机生成的UID用于保证二维码的有效期。UID有效期为40s,当UID过期后系统端会重新生成一个UID并通知智能终端中的应用,智能终端中的应用根据最新的数据重新生成一个登录二维码,并刷新登录二维码。
三维显示设备通过摄像头扫描最新生成的登录二维码,以保证应用账号的顺利登录。
在一些实施例中,三维显示设备通过RGB摄像头扫描智能终端提供的登录二维码,获取登录二维码中的加密后的用户名、密码、UID等数据(账号登录信息),同时拼接上三维显示设备本地的设备来源字段,将数据发送给账号服务器,由账号服务器进行校验,以实现三维显示设备中应用的账号登录。
具体地,控制器在执行获取摄像头采集登录二维码得到的账号登录信息,基于账号登录信息登录应用对应的账号时,被进一步配置为执行下述步骤:获取摄像头采集智能终端提供的登录二维码得到的账号登录信息,以及,用于表征本端设备来源的设备来源字段信息;基于账号登录信息和设备来源字段信息,生成账号登录请求,发送至服务器,账号登录请求用于指示服务器基于账号登录信息和设备来源字段信息进行账号校验;接收服务器响应账号登录请求后返回的账号校验结果,基于账号校验结果实现应用对应账号的登录。
在采用扫码登录方式登录应用的账号时,三维显示设备通过摄像头扫描智能终端提供的登录二维码,即可获得账号登录信息,账号登录信息由智能终端基于应用的账号信息生成,具体生成过程可参照前述实施例的内容,此处不再赘述。
在获取到登录二维码中的账号登录信息后,三维显示设备还需在本地获取设备来源字段信息,设备来源字段信息用于表征本端设备来源,例如,设备来源可理解为本端设备为三维显示设备、手机或电视等设备。
三维显示设备要登录应用账号时,需由服务器校验通过后才可实现登录,以确定智能终端中应用的账号是否可登录在三维显示设备的应用中。因此,三维显示设备需将由账号登录信息和设备来源字段信息生成的账号登录请求,发送至服务器,由服务器基于账号登录信息和设备来源字段信息进行账号校验,以保证三维显示设备可进行账号登录。服务器的账号校验过程可参照后续实施例提供的步骤S21至S23及相关实现内容,此处不进行赘述。
服务器在完成账号校验后,向三维显示设备返回账号校验结果,基于账号校验结果,即可实现应用对应账号的登录,即由三维显示设备中的应用登录智能终端中应用对应的账号。
在一些实施例中,在服务器完成账号校验后,将账号校验结果数据以Https或者Http的方式发送给三维显示设备。服务器与三维显示设备之间、三维显示设备与智能终端之间、智能终端与服务器之间的数据传输方式皆以Https或者Http的方式进行传输,以及,以上的信息传递中信息皆使用Json数据格式进行传递。其中,具体的数据传输方式可依据实际应用情况而定,此处不做具体限定。相对而言,Https的传输方式要比Http的传输方式数据安全性更高一些。
在一些实施例中,账号校验结果包括登录成功和登录失败两种结果,因此,三维显示设备基于账号校验结果可确定是否进行账号登录过程,即确定是否可登录智能终端中应用的帐号。
具体地,控制器在执行接收服务器响应账号登录请求后返回的账号校验结果,基于账号校验结果实现应用对应账号的登录时,被进一步配置为执行下述步骤:接收服务器响应账号登录请求后返回的账号校验结果,对账号校验结果进行解析,得到账号校验参数;在账号校验参数表征登录成功时,执行应用对应账号的登录过程;在账号校验参数表征登录失败时,不执行应用对应账号的登录过程。
服务器在进行账号校验时,账号校验结果中包括账号校验参数,账号校验参数用于表征本次账号登录过程是否登录成功或登录失败。
因此,三维显示设备在接收到服务器返回的账号校验结果后进行json解析,得到账号校验参数。账号校验参数中存在表征登录成功或登录失败的标识,基于标识进行对应的登录成功以及登录失败的界面显示。登录成功的标识是指允许三维显示设备中的应用登录对应账号的标识,登录失败的标识是指不允许三维显示设备中的应用登录对应账号的标识。其中,该账号是指智能终端中配置应用的账号。
如果账号校验参数中的标识表征本次账号登录过程为登录成功,则三维显示设备可执行智能终端中应用对应账号的登录过程。如果账号校验参数中的标识表征本次账号登录过程为登录失败,则三维显示设备不执行智能终端中应用对应账号的登录过程。
在一些实施例中,在执行应用账号登录过程时,控制器在执行在账号校验参数表征登录成功时,执行应用对应账号的登录过程,被进一步配置为执行下述步骤:在账号校验参数表征登录成功时,获取账号校验结果中的用户信息;基于用户信息生成应用的应用主页,将应用主页显示在虚拟用户界面中。
在账号校验参数表征登录成功时,说明当前三维显示设备请求进行账号登录的过程可执行,即可登录智能终端中应用的账号。此时,三维显示设备解析账号校验结果,获得用户信息。用户信息为服务器返回的数据包括头像、昵称、权益等信息。在场景下,账号校验结果包括用户信息和用于表征本次账号登录过程登录成功的账号校验参数。
三维显示设备基于用户信息执行应用的启动操作,生成应用主页,应用主页显示应用提供的相关内容以及用户信息,并将应用主页显示在虚拟用户界面中。在此过程中,进行界面刷新,虚拟用户界面中原显示的账号登录界面(扫码登录界面)取消显示,切换显示为应用主页,完成应用启动和账号登录的过程。
在一些实施例中,在摄像头扫描智能终端提供的登录二维码,并由服务器校验成功后,可先在扫码登录界面中显示“登录成功”的提示信息。在该提示信息取消显示后,刷新界面,取消扫码登录界面的显示,并显示应用主页,实现应用启动和账号登录。
在一些实施例中,在不执行应用账号登录过程时,控制器在执行在账号校验参数表征登录失败时,不执行应用对应账号的登录过程,被进一步配置为:在账号校验参数表征登录失败时,获取账号校验结果中的登录失败信息;基于登录失败信息生成登录失败提示,将登录失败提示显示在扫码登录界面中。
在账号校验参数表征登录失败时,说明当前三维显示设备请求进行账号登录的过程不可执行,即不可登录智能终端中应用对应的账号。此时,三维显示设备解析账号校验结果,获得登录失败信息,登录失败信息用于表征本次账号登录失败的失败原因。在该场景下,账号校验结果包括登录失败信息和用于表征本次账号登录过程登录失败的账号校验参数。
为提示用户本次应用账号登录过程失败,需基于登录失败信息生成登录失败提示,并将登录失败提示显示在扫码登录界面中,不再执行应用账号登录过程。
可见,本申请实施例提供的一种三维显示设备,为解决传统的账号登录方式需要用户操作且显示视窗较小而不便利的问题,提出一种新的登录方式,即本申请采用扫码登录方式实现账号登录。在应用需要进行账号登录时,在虚拟用户界面中呈现包括扫码登录控件的账号登录界面;对扫码登录控件进行操作,开启摄像头并在账号登录界面中呈现包括图像显示区的扫码登录界面;利用摄像头扫描智能终端提供的登录二维码,获取扫描登录二维码后得到的账号登录信息,以基于账号登录信息实现应用的账号登录。因此,本申请提供的三维显示设备提供扫码登录方式,无需用户手动输入,通过扫描配置有相应应用的智能终端提供的登录二维码,即可快速实现三维显示设备中该应用的账号登录,操作便捷、便利,用户体验好。
图7H示出了根据一些实施例的账号登录方法的另一种流程图。本申请实施例提供一种服务器,包括:存储器,被配置为存储有应用对应账号的注册账号信息;与存储器连接的控制器,在执行图7H所示的账号登录方法时,控制器被配置为执行下述步骤S711至S713:
S711、在三维显示设备进行应用的账号登录时,接收三维显示设备发送的账号登录请求,账号登录请求中携带账号登录信息和设备来源字段信息,账号登录信息是指由三维显示设备扫描智能终端提供的登录二维码后获得的信息,登录二维码是指由智能终端基于配置的登录有账号的应用的账号信息生成的二维码,设备来源字段信息用于表征设备来源。
在用户操作三维显示设备时,如果三维显示设备中需要启动的应用需要进行账号登录,则产生账号登录场景。此时,三维显示设备需利用其配置的摄像头扫描智能终端提供的登录二维码,登录二维码是基于智能终端内配置的登录有账号的应用的账号信息生成,智能终端中配置的应用与三维显示设备中需要启动的应用相同。扫描后,三维显示设备即可获得智能终端中应用的账号登录信息。
三维显示设备为实现应用的账号登录,需要对其获得的账号登录信息进行校验,以保证登录过程的 顺利进行。校验过程由服务器执行,因此,三维显示设备获取其设备来源字段信息,基于设备来源字段信息和账号登录信息生成账号登录请求,并发送至服务器。
在一些实施例中,用于实现账号校验的服务器可为账号服务器。账号服务器接收到三维显示设备在需要进行账号登录时发送的账号登录请求后,对该账号登录请求进行解析,获得账号登录请求中携带的账号登录信息和设备来源字段信息。账号登录信息是指由三维显示设备扫描智能终端提供的登录二维码后获得的信息,登录二维码是指由智能终端基于配置的登录有账号的应用的账号信息生成的二维码,设备来源字段信息用于表征设备来源。
服务器在接收到三维显示设备发送的账号登录请求,即可对账号登录信息进行校验,以确定智能终端中应用的账号是否可登录在三维显示设备的应用中,即确定该次登录过程是否成功,保证账号登录过程的顺利进行,提高用户体验。
S712、响应于账号登录请求,基于账号登录信息和设备来源字段信息进行账号校验,得到账号校验结果。
服务器响应三维显示设备发送的账号登录请求,并获取到账号登录请求中携带的账号登录信息和设备来源字段信息进行账号校验,得到账号校验结果。账号校验结果包括登录成功和登录失败两种结果,因此,三维显示设备基于账号校验结果可确定是否进行账号登录过程,即确定是否登录智能终端中应用的账号。
在一些实施例中,控制器在执行基于账号登录信息和设备来源字段信息进行账号校验,得到账号校验结果时,被进一步配置为执行下述步骤E:获取应用对应的注册账号信息,对比注册账号信息和账号登录信息是否一致;如果注册账号信息和账号登录信息对比不一致,则生成登录失败信息和用于表征登录失败的账号校验参数,账号校验结果包括登录失败信息和用于表征登录失败的账号校验参数;如果注册账号信息和账号登录信息对比一致,则基于设备来源字段信息,确定账号是否允许三维显示设备中的应用登录;在账号允许三维显示设备中的应用登录时,生成用于进行账号登录的用户信息和用于表征登录成功的账号校验参数,账号校验结果包括用户信息和用于表征登录成功的账号校验参数。
在服务器对三维显示设备发送的账号登录请求中携带的账号登录信息和设备来源字段信息进行校验时,先基于账号登录信息进行用户名、密码的对比,确定三维显示设备所需登录的账号是否与智能终端中应用的账号一致。
在某一个应用在进行账号注册时,用户会创建对应的账号,即用户名和密码,并发送至服务器进行存储。因此,服务器在进行账号校验时,可从存储器内获取到该应用的注册账号信息。
为保证服务器能够准确获取到三维显示设备中需要启动的应用对应的注册账号信息,可基于账号登录信息中的UID进行获取。账号登录信息包括加密后的用户名、密码、UID等数据,UID用于对应用及其账号进行唯一标识。服务器对账号登录信息进行解析,即可获取加密后的用户名、密码和UID。如果三维显示设备需要启动且进行账号登录的应用注册有账号,则服务器可以基于UID获取到对应应用的注册账号信息。
将注册账号信息和账号登录信息进行对比,如果三维显示设备需要启动且进行账号登录的应用对应的账号登录信息与注册时的注册账号信息对比一致,说明该次账号登录过程可进行,即三维显示设备中的应用可登录智能终端中应用的账号。如果三维显示设备需要启动且进行账号登录的应用对应的账号登录信息与注册时的注册账号信息对比不一致,说明该次账号登录过程出现异常,不可进行,即三维显示设备中的应用不可登录智能终端中应用的账号。
在一些实施例中,在注册账号信息和账号登录信息对比不一致时,为提示用户其操作是三维显示设备的当前次账号登录过程不可继续进行,则生成登录失败信息和用于表征登录失败的账号校验参数。在此场景下,账号校验结果包括登录失败信息和用于表征登录失败的账号校验参数。其中,用于表征登录失败的账号校验参数中存在登录失败的标识,登录失败的标识是指不允许三维显示设备中的应用登录对应账号的标识。登录失败信息用于表征本次账号登录失败的失败原因,失败原因如账号不一致、网络异常等。
在一些实施例中,在注册账号信息和账号登录信息对比一致时,说明三维显示设备可以进行账号登录。但是,由于同一个账号可以登录在不同设备以进行多端登录;而对于同一种设备,同一账号则可只能登录一个设备中。因此,为便于确定是否存在与三维显示设备相同的设备已登录有该账号(即智能终端中应用的账号),则需要根据设备来源字段信息判断此种设备中是否已经有登录该账号(即智能终端中应用的账号)的设备,即确定该账号(即智能终端中应用的账号)是否允许发送账号登录请求的三维显示设备中的应用登录。
在账号允许三维显示设备中的应用登录时,说明发送账号登录请求的三维显示设备中的应用可以登录该账号,则生成用于进行账号登录的用户信息和用于表征登录成功的账号校验参数。在此场景下,账 号校验结果包括用户信息和用于表征登录成功的账号校验参数。其中,用户信息为服务器返回的数据包括头像、昵称、权益等信息。用于表征登录成功的账号校验参数中存在表征登录成功的标识,登录成功的标识是指允许三维显示设备中的应用登录对应账号的标识。
在一些实施例中,在注册账号信息和账号登录信息对比一致时,需要基于设备来源字段信息,确定账号是否允许三维显示设备中的应用登录。在该过程中,控制器在执行基于设备来源字段信息,确定账号是否允许三维显示设备中的应用登录时,被进一步配置为执行下述步骤:基于设备来源字段信息,确定发送账号登录请求的三维显示设备的目标设备来源;获取与目标设备来源相同的其他设备的用户状态,基于用户状态判断对应其他设备中的应用是否登录有账号;如果其他设备中的应用登录有;如果其他设备未登录有所述账号,则生成允许三维显示设备中的应用登录账号的标识。
在判断智能终端中配置应用对应的账号是否允许发送账号登录请求的三维显示设备中的应用进行登录时,需要先判断该账号是否登录在其他三维显示设备中。由于对于同一种类的设备,同一账号只能登录在其中一个设备中。因此,可根据三维显示设备的设备来源字段信息,判断是否存在其他与三维显示设备的设备来源字段信息表中的设备来源相同的设备登录有该账号。
设备来源字段信息用于标识不同设备的来源,即类型。在判断是否存在其他与三维显示设备的目标设备来源相同的设备中已登录该账号,则获取与目标设备来源相同的其他设备,并获取其他设备的用户状态,用户状态可表征对应设备登录账号的信息。对于三维显示设备来说,与其目标设备来源相同的其他设备也为三维显示设备。若对于手机来说,与其目标设备来源相同的其他设备也为手机。
根据每个其他设备的用户状态,即可确定每个其他设备中登录的账号信息。如果存在其中一个其他设备登录的账号信息与智能终端中配置应用对应的账号信息一致,说明该其他设备中的应用登录有该账号。此时,发送账号登录请求的三维显示设备不可直接进行账号登录。
为保证发送账号登录请求的三维显示设备的账号顺利登录,基于账号优先最新请求的登录原则,可使最新发送账号登录请求的三维显示设备进行账号登录。此时,需要将已登录该账号的其他设备中的该账号退出,实现发送账号登录请求的三维显示设备的顶号登录。在此场景下,在完成顶号登录操作后,发送账号登录请求的三维显示设备方可实现本次的账号登录过程,因此,在顶号登录操作后对应生成允许三维显示设备中的应用登录该账号的标识。
如果根据每个其他设备的用户状态,判断出任何一个其他设备均未登录有智能终端中配置应用对应的账号,此时,发送账号登录请求的三维显示设备可直接进行正常的账号登录过程。因此,在此场景下,可直接生成允许三维显示设备中的应用登录账号的标识。
基于此,服务器基于三维显示设备发送的账号登录请求进行账号校验,即可获得包括登录成功和登录失败的两种账号校验结果。表征登录成功的账号校验结果,可使三维显示设备继续进行后续的账号登录过程;表征登录失败的账号校验结果,可使三维显示设备不再执行后续账号登录过程。
S713、将账号校验结果发送至三维显示设备,以使三维显示设备基于账号校验结果实现应用对应账号的登录。
服务器基于前述的方法获得账号校验结果后,将账号校验结果发送至三维显示设备,由三维显示设备基于账号校验结果中的内容,执行对应的账号登录过程。具体实现过程可参照前述实施例步骤及相关具体实现过程,此处不再赘述。
可见,本申请实施例提供一种服务器,在三维显示设备需要进行相应应用的账号登录时,响应三维显示设备发送的账号登录请求,基于账号登录请求中携带的账号登录信息和设备来源字段信息进行账号校验,得到账号校验结果;将账号校验结果发送至三维显示设备,以使三维显示设备基于账号校验结果实现应用对应账号的登录。账号校验结果包括登录成功和登录失败两种结果,表征登录成功的账号校验结果可使三维显示设备继续进行后续的账号登录过程;表征登录失败的账号校验结果可使三维显示设备不再执行后续账号登录过程。因此,本申请提供的服务器在三维显示设备采用扫码登录方式进行账号登录时,对由智能终端提供的相应应用的账号登录信息进行账号校验,在校验通过时,可允许三维显示设备执行正常的账号登录过程,保证账号登录过程的正常进行。
由以上实施方式可知,本申请实施例提供的一种账号登录方法及三维显示设备、服务器,为解决传统的账号登录方式需要用户操作且显示视窗较小而不便利的问题,本申请采用扫码登录方式实现账号登录。在应用需要进行账号登录时,在虚拟用户界面中呈现包括扫码登录控件的账号登录界面;对扫码登录控件进行操作,开启摄像头并在账号登录界面中呈现包括图像显示区的扫码登录界面;利用摄像头扫描智能终端提供的登录二维码,获取扫描登录二维码后得到的账号登录信息,发送至服务器进行账号校验,在校验通过时,基于账号登录信息实现应用的账号登录。可见,本申请实施例提供的方法、三维显示设备及服务器,提供扫码登录方式,无需用户手动输入,通过扫描配置有相应应用的智能终端提供的登录二维码,即可快速实现三维显示设备中该应用的账号登录,操作便捷、便利,用户体验好。

Claims (15)

  1. 一种三维显示设备,包括:
    虚拟显示器,被配置为呈现虚拟用户界面;
    与所述虚拟显示器连接的控制器,所述控制器被配置为:
    响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。
  2. 根据权利要求1所述的三维显示设备,所述控制器在执行所述在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,被进一步配置为:
    获取用于实现不同推荐内容展示的多个内容推荐数据以及用于实现不同导航功能的多个导航功能数据;
    基于多个所述内容推荐数据生成包括多个页面的显示主页,将所述显示主页显示在内容推荐区;
    基于多个所述导航功能数据生成包括多个导航按钮的导航栏,将所述导航栏显示在内容推荐区,所述导航栏显示在所述显示主页的下方,一个导航按钮对应一个导航功能数据。
  3. 根据权利要求2所述的三维显示设备,所述控制器在执行所述将所述显示主页显示在内容推荐区,被进一步配置为:
    在所述内容推荐区以正交页面布局方式进行页面显示时,获取正多边形边数,在主视角方向上人眼与页面之间的预设景深距离,相邻两个页面之间的预设页面间距,以及,所述显示主页中进行显示的页面数量;
    基于所述预设景深距离、预设页面间距和正多边形边数,在所述内容推荐区生成用于进行正交页面布局的正多边形,所述正多边形为透明状态;
    将所述显示主页中进行显示的多个页面呈现在所述正多边形的指定边上,所述指定边的数量与所述显示主页中进行显示的页面数量相等。
  4. 根据权利要求3所述的三维显示设备,所述控制器在执行所述将所述显示主页中进行显示的多个页面呈现在所述正多边形的指定边上,被进一步配置为:
    所述显示主页包括主页面、左侧页面、右侧页面、左侧隐藏页面和右侧隐藏页面,所述正多边形的指定边包括中间指定边、左侧指定边、右侧指定边、左侧隐藏指定边和右侧隐藏指定边;
    将所述左侧页面显示在左侧指定边上,将所述主页面显示在中间指定边上,将所述右侧页面显示在右侧指定边上,所述中间指定边为主视角中心线对应的指定边,所述左侧指定边位于所述中间指定边的左侧,所述右侧指定边位于中间指定边的右侧;
    将所述左侧隐藏页面设置在左侧隐藏指定边上,所述左侧隐藏指定边位于所述左侧指定边的左侧,所述左侧隐藏页面用于缓存所述左侧页面的前一页面的内容推荐数据,所述左侧隐藏页面不进行显示;
    将所述右侧隐藏页面设置在右侧隐藏指定边上,所述右侧隐藏指定边位于所述右侧指定边的右侧,所述右侧隐藏页面用于缓存所述右侧页面的后一页面的内容推荐数据,所述右侧隐藏页面不进行显示。
  5. 根据权利要求4所述的三维显示设备,所述控制器被进一步配置为:
    在所述正多边形的指定边上呈现包括内容推荐数据的页面时,响应于触发所述右侧指定边上的页面时产生的页面选择指令,将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧指定边的页面向左移动至中间指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示;
    响应于触发所述左侧指定边上的页面时产生的页面选择指令,将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧指定边的页面向右移动至中间指定边上,将位于左侧隐藏指定边的隐藏页面向右移动至左侧指定边上并进行显示。
  6. 根据权利要求2所述的三维显示设备,所述控制器被进一步配置为:
    在基于所述导航栏切换不同的导航按钮时,如果每个导航按钮均未获得控制焦点,则为每个所述导航按钮均添加表征正常状态的标识图案;
    如果其中一个导航按钮获得控制焦点,则为所述导航按钮添加表征获焦状态的标识图案;
    如果其中一个导航按钮获得触发操作后又丢失控制焦点,则为所述导航按钮添加表征遗留状态的标识图案。
  7. 根据权利要求1所述的三维显示设备,所述控制器在执行所述在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区,被进一步配置为:
    所述不同属性应用包括系统推荐应用和本地安装应用;
    在所述系统推荐应用的当前数量为零时,生成包括翻页显示区的应用切换区,所述翻页显示区用于显示本地安装应用;
    在所述系统推荐应用的当前数量不为零时,生成包括固定显示区、翻页显示区和间隔标记的应用切换区,所述固定显示区用于显示系统推荐应用,所述翻页显示区用于显示本地安装应用,所述间隔标记位于所述固定显示区和翻页显示区之间。
  8. 根据权利要求7所述的三维显示设备,所述控制器被进一步配置为:
    在所述系统推荐应用的当前数量不为零时,获取所述固定显示区的可配置应用的预设数量;
    如果所述系统推荐应用的当前数量小于或等于可配置应用的预设数量,则在所述固定显示区显示系统推荐应用,在所述翻页显示区显示本地安装应用;
    如果所述系统推荐应用的当前数量大于可配置应用的预设数量时,计算配置应用超出数量,以及,在所述固定显示区显示与可配置应用的预设数量对应的系统推荐应用,在所述翻页显示区显示本地安装应用和配置应用超出数量对应的系统推荐应用。
  9. 根据权利要求8所述的三维显示设备,所述控制器被进一步配置为:
    在所述翻页显示区显示数个应用时,获取所述翻页显示区的可显示应用总数量和当前显示应用的总数量;
    如果所述当前显示应用的总数量大于可显示应用总数量,则基于所述当前显示应用的总数量对应的应用生成应用列表,所述应用包括可显示的本地安装应用和配置应用超出数量对应的系统推荐应用;
    按照所述应用列表在所述翻页显示区呈现所述可显示应用总数量对应的应用,以及,在所述翻页显示区的两侧显示翻页按钮,所述翻页按钮用于触发所述应用列表中的应用显示在所述翻页显示区。
  10. 根据权利要求1所述的三维显示设备,所述控制器被进一步配置为:
    响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角顶部区域呈现消息推荐入口,所述消息推荐入口用于实现消息推荐,所述消息推荐入口为通过三维动画形式呈现的区域。
  11. 一种三维显示设备,包括:
    虚拟显示器,被配置为呈现虚拟用户界面;
    与所述虚拟显示器连接的控制器,所述控制器被配置为:
    响应于触发虚拟现实应用时产生的应用启动指令,生成包括显示主页、导航栏和应用切换区的虚拟用户界面;
    在基于所述显示主页进行页面切换时,响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示;
    在基于所述导航栏进行导航按钮切换时,响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案;
    在基于所述应用切换区进行应用切换时,响应于触发所述应用切换区中任一个应用时产生的应用切换指令,启动所述应用。
  12. 根据权利要求11所述的三维显示设备,所述控制器在执行所述响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示,被进一步配置为:
    在所述显示主页以正交页面布局方式进行页面显示时,所述显示主页中的每个页面显示在实现正交页面布局方式的正多边形的指定边上,所述指定边包括用于显示页面的中间指定边、左侧指定边和右侧指定边,以及,用于隐藏页面的左侧隐藏指定边和右侧隐藏指定边,所述中间指定边为主视角中心线对应的指定边;
    响应于触发所述右侧指定边上的页面时产生的页面选择指令,将位于右侧指定边的页面向左移动至中间指定边上,以及,将位于左侧指定边的页面向左移动至左侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向左移动至左侧指定边上,将位于右侧隐藏指定边的隐藏页面向左移动至右侧指定边上并进行显示;
    响应于触发所述左侧指定边上的页面时产生的页面选择指令,将位于左侧指定边的页面向右移动至中间指定边上,以及,将位于右侧指定边的页面向右移动至右侧隐藏指定边上并进行隐藏,将位于中间指定边的页面向右移动至右侧指定边上,将位于左侧隐藏指定边的隐藏页面向右移动至左侧指定边上并进行显示。
  13. 根据权利要求11所述的三维显示设备,所述控制器在执行所述响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案,被进一步配置为:
    在基于所述导航栏切换不同的导航按钮时,如果每个导航按钮均未获得控制焦点,则为每个所述导航按钮均添加与所述操作对应的表征正常状态的标识图案;
    响应于触发所述导航栏中任一个导航按钮时产生的表征获得控制焦点的导航选择指令,为所述导航按钮添加与所述操作对应的表征获焦状态的标识图案;
    响应于触发所述导航栏中任一个导航按钮时产生的表征获得触发操作后又丢失控制焦点的导航选择指令,为所述导航按钮添加与所述操作对应的表征遗留状态的标识图案。
  14. 一种虚拟用户界面的布局方法,所述方法包括:
    响应于触发虚拟现实应用时产生的应用启动指令,在所述虚拟用户界面的主视角区域呈现包括显示主页和导航栏的内容推荐区,以及,在所述虚拟用户界面的主视角底部区域呈现包括不同属性应用的应用切换区。
  15. 一种虚拟用户界面的交互方法,所述方法包括:
    响应于触发虚拟现实应用时产生的应用启动指令,生成包括显示主页、导航栏和应用切换区的虚拟用户界面;
    在基于所述显示主页进行页面切换时,响应于触发所述显示主页中任一个页面时产生的页面选择指令,将所述页面切换至主视角中心线对应的位置显示;
    在基于所述导航栏进行导航按钮切换时,响应于触发所述导航栏中任一个导航按钮时产生的导航选择指令,为所述导航按钮添加与所述操作对应的标识图案;
    在基于所述应用切换区进行应用切换时,响应于触发所述应用切换区中任一个应用时产生的应用切换指令,启动所述应用。
PCT/CN2021/124457 2020-10-19 2021-10-18 用户界面的布局、交互方法及三维显示设备 WO2022083554A1 (zh)

Applications Claiming Priority (12)

Application Number Priority Date Filing Date Title
CN202011119774.8 2020-10-19
CN202011119774 2020-10-19
CN202110324732.6A CN114385052B (zh) 2020-10-19 2021-03-26 一种Tab栏的动态展示方法及三维显示设备
CN202110324509.1 2021-03-26
CN202110324732.6 2021-03-26
CN202110324509.1A CN114442872B (zh) 2020-10-19 2021-03-26 一种虚拟用户界面的布局、交互方法及三维显示设备
CN202110361156.2 2021-04-02
CN202110360910.0 2021-04-02
CN202110361156.2A CN114443945A (zh) 2020-10-19 2021-04-02 一种虚拟用户界面中应用图标的展示方法及三维显示设备
CN202110360910.0A CN114385886A (zh) 2020-10-19 2021-04-02 一种内容搜索方法及三维显示设备
CN202110640803.3A CN113377472B (zh) 2020-10-19 2021-06-09 一种账号登录方法及三维显示设备、服务器
CN202110640803.3 2021-06-09

Publications (1)

Publication Number Publication Date
WO2022083554A1 true WO2022083554A1 (zh) 2022-04-28

Family

ID=81291561

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/124457 WO2022083554A1 (zh) 2020-10-19 2021-10-18 用户界面的布局、交互方法及三维显示设备

Country Status (1)

Country Link
WO (1) WO2022083554A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115421599A (zh) * 2022-11-07 2022-12-02 荣耀终端有限公司 输入法显示控制方法及相关装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106873995A (zh) * 2017-02-10 2017-06-20 联想(北京)有限公司 一种显示方法以及头戴式电子设备
US20180095633A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Three-dimensional user interface
CN108429927A (zh) * 2018-02-08 2018-08-21 聚好看科技股份有限公司 智能电视以及搜索用户界面中虚拟商品信息的方法
CN110443083A (zh) * 2018-05-04 2019-11-12 脸谱科技有限责任公司 虚拟现实环境中的用户界面安全性
CN111327931A (zh) * 2020-03-02 2020-06-23 青岛海信传媒网络技术有限公司 观看历史显示方法及显示设备
CN113377472A (zh) * 2020-10-19 2021-09-10 聚好看科技股份有限公司 一种账号登录方法及三维显示设备、服务器

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180095633A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Three-dimensional user interface
CN106873995A (zh) * 2017-02-10 2017-06-20 联想(北京)有限公司 一种显示方法以及头戴式电子设备
CN108429927A (zh) * 2018-02-08 2018-08-21 聚好看科技股份有限公司 智能电视以及搜索用户界面中虚拟商品信息的方法
CN110443083A (zh) * 2018-05-04 2019-11-12 脸谱科技有限责任公司 虚拟现实环境中的用户界面安全性
CN111327931A (zh) * 2020-03-02 2020-06-23 青岛海信传媒网络技术有限公司 观看历史显示方法及显示设备
CN113377472A (zh) * 2020-10-19 2021-09-10 聚好看科技股份有限公司 一种账号登录方法及三维显示设备、服务器

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115421599A (zh) * 2022-11-07 2022-12-02 荣耀终端有限公司 输入法显示控制方法及相关装置
CN115421599B (zh) * 2022-11-07 2023-03-14 荣耀终端有限公司 输入法显示控制方法及相关装置

Similar Documents

Publication Publication Date Title
CN111698557B (zh) 用户界面显示方法及显示设备
US9247303B2 (en) Display apparatus and user interface screen providing method thereof
US20130326583A1 (en) Mobile computing device
WO2020000973A1 (zh) 信息访问方法、客户端、装置、终端、服务器和存储介质
US9628744B2 (en) Display apparatus and control method thereof
WO2019120008A1 (zh) 智能电视及电视画面截图的图形用户界面的显示方法
US20140337792A1 (en) Display apparatus and user interface screen providing method thereof
CN107113468B (zh) 一种移动计算设备以及实现的方法、计算机存储介质
US20140337749A1 (en) Display apparatus and graphic user interface screen providing method thereof
WO2021088320A1 (zh) 显示设备和内容显示方法
EP3345401B1 (en) Content viewing device and method for displaying content viewing options thereon
US20140282061A1 (en) Methods and systems for customizing user input interfaces
US11706485B2 (en) Display device and content recommendation method
KR20140133353A (ko) 디스플레이 장치 및 그 ui 화면 제공 방법
US11507180B2 (en) Methods and systems for associating input schemes with physical world objects
CN112463269B (zh) 用户界面显示方法及显示设备
KR20160087649A (ko) 사용자 단말 장치, 시스템 및 그 제어 방법
KR20150054631A (ko) 디스플레이 장치 및 그 제어 방법
US20160048314A1 (en) Display apparatus and method of controlling the same
WO2022083554A1 (zh) 用户界面的布局、交互方法及三维显示设备
KR20150055528A (ko) 디스플레이 장치 및 그 제어 방법
KR20170125004A (ko) 디스플레이 장치 및 그 ui 화면 제공 방법
CN115695844A (zh) 一种显示设备、服务器及媒资内容推荐方法
CN112367550A (zh) 一种媒资列表多标题动态展示的实现方法及显示设备
CN115129280A (zh) 一种虚拟现实设备及投屏媒资播放方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21881970

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 090823)

122 Ep: pct application non-entry in european phase

Ref document number: 21881970

Country of ref document: EP

Kind code of ref document: A1