WO2020207115A1 - 一种提供菜单项的图形用户界面方法及显示设备 - Google Patents

一种提供菜单项的图形用户界面方法及显示设备 Download PDF

Info

Publication number
WO2020207115A1
WO2020207115A1 PCT/CN2020/075606 CN2020075606W WO2020207115A1 WO 2020207115 A1 WO2020207115 A1 WO 2020207115A1 CN 2020075606 W CN2020075606 W CN 2020075606W WO 2020207115 A1 WO2020207115 A1 WO 2020207115A1
Authority
WO
WIPO (PCT)
Prior art keywords
menu item
menu
display
display device
display area
Prior art date
Application number
PCT/CN2020/075606
Other languages
English (en)
French (fr)
Inventor
张欣
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Priority to US16/822,756 priority Critical patent/US11343583B2/en
Publication of WO2020207115A1 publication Critical patent/WO2020207115A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42202—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4221—Dedicated function buttons, e.g. for the control of an EPG, subtitles, aspect ratio, picture-in-picture or teletext
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4856—End-user interface for client configuration for language selection, e.g. for the menu or subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Definitions

  • This application relates to the field of display technology, and in particular to a graphical user interface method and display device for providing menu items.
  • display devices can not only provide users with various traditional program content received through data broadcasting, but also provide users with various applications and service content set by content manufacturers.
  • the display device While displaying the above various contents, the display device also provides menu items for performing functional operations on the above various contents. However, the display positions of these menu items provided by the display device are usually fixed. After the user instructs the display device to switch languages, these menu items are usually displayed in a disorderly manner, which affects the user's visual experience.
  • the length of the English vocabulary and the length of Portuguese vocabulary may be different, which may result in the incomplete display of the text in the reserved space, and even the overlap or overlap of the text on the user interface. , To a certain extent, the layout and/or visual effects of the original user interface may be lost.
  • the embodiments of the present application provide a graphical user interface method and display device for providing menu items, which are used to automatically adjust the display position of the menu items according to the setting language of the display device, thereby improving the user's perception and experience.
  • an embodiment of the present application provides a method for presenting a graphical user interface.
  • the method includes:
  • the first image content is displayed in the content display area of the display; based on the setting language of the display device, it is calculated and used as the first image content configuration At least one menu item required to execute the function of the first image content is in the first layout position of the menu display area of the display; and the at least one menu item is displayed based on the calculated first layout position.
  • the at least one menu item is configured by default or configured according to user settings.
  • the at least one menu item is arranged from one boundary of the menu display area to another boundary, so that the menu items maintain a distance without overlapping each other.
  • calculating the first layout position of at least one menu item in the menu display area includes:
  • the first layout position of the at least one menu item in the menu display area is determined.
  • the menu item includes a menu item name and a menu item icon.
  • calculating the width occupied by at least one menu item in the menu display area includes:
  • it further includes:
  • the second image content is displayed in the content display area of the display, wherein the second image content corresponds to the first image content in the updated setting language An image content; and, based on the updated display device’s setting language, at least one menu item calculated as the second image content configuration and used to perform the function required by the second image content is in the first menu display area of the display 2.
  • the function information corresponding to the menu item has a mapping relationship with the color key information on the control device used to provide user input to the display device.
  • an embodiment of the present application provides a display device.
  • the display device includes:
  • Display used to display images
  • the first image content is displayed in the content display area of the display; based on the setting language of the display device, it is calculated as the first image content configuration and used for execution
  • the at least one menu item of the function required by the first image content is in the first layout position of the menu display area of the display; the at least one menu item is displayed based on the calculated first layout position.
  • the at least one menu item is configured by default or configured according to user settings.
  • the at least one menu item is arranged from one boundary of the menu display area to another boundary, so that the menu items maintain a distance without overlapping each other.
  • the controller calculates the first layout position of the at least one menu item in the menu display area by executing: calculate the width occupied by the at least one menu item in the menu display area based on the setting language of the display device;
  • the first layout position of the at least one menu item in the menu display area is determined.
  • the menu item includes a menu item name and a menu item icon.
  • the controller calculates the width occupied by at least one menu item in the menu display area by executing the following:
  • the controller is also used to:
  • the second image content is displayed in the content display area of the display, wherein the second image content corresponds to the first image in the updated setting language Content; based on the updated display device's setting language, at least one menu item configured for the second image content and used to perform the functions required by the second image content is calculated at the second layout position of the menu display area of the display; The display of the at least one menu item in the content display area is updated based on the calculated second layout position.
  • the function information corresponding to the menu item has a mapping relationship with the color key information on the control device used to provide user input to the display device.
  • an embodiment of the present application provides a television, including:
  • Remote control including multiple color buttons
  • Display equipment including displays and controllers, among which,
  • the display is used to display images
  • the controller is used for:
  • the first control instruction In response to the first control instruction, display the first image content in the content display area of the display; based on the setting language of the display device, it is calculated as the first image content configuration and used to execute the first image content.
  • the at least one menu item that needs a function is in the first layout position of the menu display area of the display; the at least one menu item is displayed based on the calculated first layout position.
  • one of the at least one menu item is configured to be controllable by one of a plurality of color keys of the remote control.
  • the display device can provide image content; and can calculate the actual layout position of at least one menu item used to perform functions required by the image content according to the currently set system language, so as to realize the layout of menu items in different system languages It is self-adaptive to avoid that the menu items in different system languages cannot be displayed completely, or overlap each other, or overlap due to the fixed display position, so as to improve the user's visual experience.
  • FIG. 1A exemplarily shows a schematic diagram of an operation scenario between a display device 200 and a control apparatus 100 in an embodiment of the present application;
  • FIG. 1B exemplarily shows a configuration block diagram of the control device 100 in FIG. 1A;
  • FIG. 1C exemplarily shows a configuration block diagram of the display device 200 in FIG. 1A;
  • FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200 in an embodiment of the present application
  • FIG. 2 exemplarily shows a first schematic diagram of a GUI 400 provided by a display device 200 in an embodiment of the present application
  • FIG. 3A exemplarily shows a second schematic diagram of the GUI 400 provided by the display device 200 in the embodiment of the present application
  • FIG. 3B exemplarily shows a first schematic diagram of a GUI 500 provided by a display device 200 in an embodiment of the present application
  • FIG. 3C exemplarily shows a second schematic diagram of the GUI 500 provided by the display device 200 in the embodiment of the present application
  • FIG. 3D exemplarily shows a third schematic diagram of the GUI 400 provided by the display device 200 in the embodiment of the present application.
  • FIG. 3E exemplarily shows a fourth schematic diagram of the GUI 400 provided by the display device 200 in the embodiment of the present application.
  • Fig. 3F exemplarily shows a third schematic diagram of the GUI 500 provided by the display device 200 in the embodiment of the present application.
  • FIG. 3G exemplarily shows a fourth schematic diagram of the GUI 500 provided by the display device 200 in the embodiment of the present application.
  • FIG. 3H exemplarily shows a fifth schematic diagram of the GUI 500 provided by the display device 200 in the embodiment of the present application.
  • FIG. 4 exemplarily shows a schematic diagram of the control device 100 in the embodiment of the present application
  • FIG. 5A exemplarily shows a fifth schematic diagram of the GUI 400 provided by the display device 200 in the embodiment of the present application
  • FIG. 5B exemplarily shows a first schematic diagram of a GUI 600 provided by the display device 200 in an embodiment of the present application
  • FIG. 5C exemplarily shows a second schematic diagram of the GUI 600 provided by the display device 200 in the embodiment of the present application
  • FIG. 5D exemplarily shows a third schematic diagram of the GUI 600 provided by the display device 200 in the embodiment of the present application.
  • FIG. 5E exemplarily shows a fourth schematic diagram of the GUI 600 provided by the display device 200 in the embodiment of the present application.
  • FIG. 6A exemplarily shows the sixth schematic diagram of the GUI 400 provided by the display device 200 in the embodiment of the present application
  • FIG. 6B exemplarily shows a sixth schematic diagram of the GUI 500 provided by the display device 200 in the embodiment of the present application
  • FIG. 7A exemplarily shows a first schematic diagram of a GUI 700 provided by a display device 200 in an embodiment of the present application
  • FIG. 7B exemplarily shows a second schematic diagram of the GUI 700 provided by the display device 200 in the embodiment of the present application.
  • FIG. 7C exemplarily shows a third schematic diagram of the GUI 700 provided by the display device 200 in the embodiment of the present application.
  • FIG. 7D exemplarily shows a schematic diagram of a GUI 800 provided by the display device 200 in an embodiment of the present application
  • FIG. 8A exemplarily shows a flow chart of a method for providing a graphical user interface of a menu item for executing functions required by image content in a display device of an embodiment of the present application
  • FIG. 8B exemplarily shows a flowchart of another method for providing a graphical user interface of a menu item for executing functions required by image content in a display device of an embodiment of the present application
  • FIG. 9 exemplarily shows a schematic diagram of a method for calculating the actual layout position of each menu item in the menu display area.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware or/and software code that can perform functions related to the element.
  • gesture used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
  • FIG. 1A exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control apparatus 100 in an embodiment of the present application.
  • the control device 100 and the display device 200 may communicate in a wired or wireless manner.
  • control device 100 is configured to control the display device 200.
  • the control device 100 can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and play an intermediary role in the interaction between the user and the display device 200.
  • the user can operate the channel addition and subtraction keys on the control device 100, and the display device 200 can respond to the channel addition and subtraction operations.
  • control device 100 may be a remote controller 100A, which may control the display device 200 in a wireless or other wired manner.
  • the remote controller 100A can control the display device 200 through infrared protocol communication, Bluetooth protocol communication, or other short-distance communication methods.
  • the user can control the display device 200 by inputting user instructions through buttons, voice input, control panel input and other components on the remote control 100A.
  • the user can input the corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch button, etc. on the remote control 100A Display device 200.
  • control device 100 may also be a smart device, such as a mobile terminal 100B such as a mobile phone, a tablet computer, a computer, and a notebook computer.
  • a smart device such as a mobile terminal 100B such as a mobile phone, a tablet computer, a computer, and a notebook computer.
  • the user can control the display device 200 through an application program running on a smart device.
  • the application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 100B and the display device 200 can install a software application, and realize a communication connection through a network communication protocol, thereby achieving the purpose of one-to-one control operation and data communication.
  • a control command protocol between the mobile terminal 100B and the display device 200 can be established, and then various function keys or virtual buttons of the user interface provided on the mobile terminal 100B can be operated to realize the functions of the physical keys arranged in the remote control 100A.
  • the audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.
  • the display device 200 can be implemented as a television, which can provide smart network television functions such as broadcast receiving television functions, computer support functions and the like.
  • the display device 200 may be a digital TV, a web TV, a smart TV, or an Internet Protocol TV (IPTV), etc.
  • IPTV Internet Protocol TV
  • the display device 200 may be a liquid crystal display, an organic light emitting display, a projection display device, or the like.
  • the type, size and resolution of the display device 200 are not limited.
  • the display device 200 also performs data communication with the server 300 through multiple communication methods.
  • the display device 200 may communicate with the server 300 through a local area network (LAN), a wireless local area network (WLAN), or other networks.
  • the server 300 may provide various contents and interactions to the display device 200.
  • the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library.
  • EPG electronic program guide
  • the server 300 may include one or more groups of servers, and may be one or more types of servers.
  • the server 300 may also provide other network service contents such as video on demand and advertising services.
  • FIG. 1B exemplarily shows a configuration block diagram of the control device 100 in the embodiment of the present application.
  • the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
  • the controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a communication interface (not shown), and a communication bus (not shown).
  • RAM random access memory
  • ROM read only memory
  • processor 113 a communication interface
  • communication bus not shown
  • the controller 110 is used to control the operation and operation of the control device 100, as well as the communication cooperation between internal components, and external and internal data processing functions.
  • the memory 120 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller 110.
  • the memory 120 can store various control signal instructions input by the user.
  • the communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132.
  • the user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can use voice, touch, gesture, press, etc. operations to control the user instructions of the display device 200 , Input to the control device 100.
  • the output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibrations, a sound output interface 153 that outputs sounds, a display 154 that outputs images, and the like.
  • the power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110.
  • the form can be battery and related control circuit.
  • FIG. 1C exemplarily shows a hardware configuration block diagram of the display device 200 in the embodiment of the present application.
  • the display device 200 may further include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, Audio output interface 285, power supply 290.
  • the tuner and demodulator 210 receives broadcast and television signals in a wired or wireless manner, and can perform modulation and demodulation processing such as amplification, mixing, and resonance.
  • the tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.
  • the tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, digital modulation methods can be used Or analog modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.
  • different broadcasting formats of TV signals such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting
  • digital modulation methods can be used Or analog modulation method
  • analog signals can be demodulated.
  • the tuner demodulator 210 may also be in an external device, such as an external set-top box.
  • the set-top box outputs a television signal after modulation and demodulation, and inputs it to the display device 200 through the external device interface 240.
  • the communicator 220 is a component used to communicate with external devices or external servers according to various communication protocol types.
  • the communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth communication protocol module 222, and a wired Ethernet communication protocol module 223 or a near field communication protocol module.
  • the detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside.
  • the detector 230 may include an image collector 231, which can be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect user attributes or interact with the user gestures to achieve communication between the display device and the user Interactive function. It may also include a light receiver 232, which is used to collect ambient light intensity to adapt to changes in display parameters of the display device 200.
  • the detector 230 may also include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image.
  • the detector 230 may also include a sound collector, such as a microphone, which may be used to receive a user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, may be used to collect The environmental sound of the environmental scene type is recognized, so that the display device 200 can adapt to the environmental noise.
  • the external device interface 240 is a component that provides the controller 210 to control the data transmission between the display device 200 and external devices.
  • the external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), additional information (such as Program menu (Electronic Program Guide, EPG) and other data.
  • the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, a component terminal ( (Not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • USB universal serial bus
  • component terminal (Not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
  • the controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
  • various software control programs such as an operating system and various application programs
  • the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256.
  • RAM random access memory
  • ROM read only memory
  • CPU CPU
  • the controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
  • the object can be any one of the selectable objects, such as a hyperlink or an icon.
  • the operation related to the selected object for example, the operation of displaying the page, document, image, etc. connected to the hyperlink, or the operation of executing the program corresponding to the icon.
  • the user input command for selecting the GUI object may be a command input through various input devices (e.g., mouse, keyboard, touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200.
  • FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200 in the embodiment of the present application.
  • the operating system architecture from top to bottom is the application layer, the middleware layer and the kernel layer.
  • the application layer, system built-in applications and non-system-level applications belong to the application layer, which is responsible for direct interaction with users.
  • the application layer can include multiple applications, such as NETFLIX applications, settings applications, media center applications, and so on. These applications can be implemented as web applications, which are executed based on the WebKit engine, and specifically can be developed and executed based on HyperText Markup Language (HTML), Cascading Style Sheet (CSS) and JavaScript.
  • HTML HyperText Markup Language
  • CSS Cascading Style Sheet
  • JavaScript JavaScript
  • HTML is a standard markup language used to create web pages.
  • the web pages are described by markup tags.
  • HTML tags are used to describe text, graphics, animation, sounds, tables, links, etc.
  • the browser will read HTML documents and interpret the documents
  • the content of the inner tag is displayed in the form of a web page.
  • CSS is a computer language used to express the style of HTML files, and it can be used to define style structures, such as fonts, colors, and positions. CSS styles can be directly stored in HTML web pages or in separate style files to achieve control over styles in web pages.
  • JavaScript is a language used in web page programming, which can be inserted into HTML pages and interpreted and executed by the browser.
  • the interaction logic of the web application is implemented through JavaScript.
  • JavaScript can communicate with the kernel layer by encapsulating the JavaScript extension interface through the browser.
  • the middleware layer can provide some standardized interfaces to support various environments and system operations.
  • the middleware layer can be implemented as a multimedia and hypermedia information encoding expert group (Multimedia and Hypermedia Information Encoding Expert Group, MHEG) for middleware related to data broadcasting, and can also be implemented as a digital middleware communication related to external equipment
  • MHEG Multimedia and Hypermedia Information Encoding Expert Group
  • DLNA Digital Living Network Alliance
  • middleware can also be implemented as middleware that provides a browser environment for each application in the display device.
  • the kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services.
  • the kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
  • the kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provides WiFi driver, audio driver for audio output interface, power management driver for Power Management (PM) module, etc.
  • PM Power Management
  • the user interface 265 receives various user interactions. Specifically, it is used to send the user's input signal to the controller 250, or to transmit the output signal from the controller 250 to the user.
  • the remote control 100A may send input signals such as a power switch signal, a channel selection signal, and a volume adjustment signal input by the user to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 through the controller 250 and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI.
  • GUI graphical user interface
  • the user interface 265 may receive a user input command for controlling the position of the selector in the GUI to select different objects or items.
  • the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.
  • the video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal displayed or played directly on the display 275.
  • the display 275 is used to receive the image signal output from the video processor 270, and display the video, image, and menu control interface.
  • the display may display the video in the broadcast signal received from the tuner and demodulator 210, may also display the video input from the communicator 220 or the external device interface 240, and may also display the image stored in the memory 260.
  • the display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used for controlling the display device 200.
  • the display 275 may include a display screen component for presenting a picture and a driving component for driving image display.
  • the display 275 may also include a projection device and a projection screen.
  • the audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing.
  • the audio signal to be played is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing.
  • the audio processor 280 may support various audio formats. For example, MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.
  • AAC Advanced Audio Coding
  • HE-AAC High Efficiency AAC
  • the audio output interface 285 is used to receive audio signals output from the audio processor 280.
  • the audio output interface can output audio in the broadcast signal received via the tuner demodulator 210, can also output audio input via the communicator 220 or the external device interface 240, and can also output audio stored in the memory 260.
  • the audio output interface 285 may include a speaker 286, or an external audio output terminal 287 output to a sound device of an external device, such as a headphone output terminal.
  • the video processor 270 may include one or more chips.
  • the audio processor 280 may also include one or more chips.
  • the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.
  • the power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250.
  • the power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.
  • Fig. 2 exemplarily shows a first schematic diagram of the GUI 400 provided by the display device 200 in the embodiment of the present application.
  • the display device may provide a GUI 400 to the display.
  • the GUI 400 includes multiple display areas that provide different image content. Each display area includes one or more different items arranged. For example, the items 411 to 416 are arranged in the first display area 41, and the items 421 to 426 are arranged in the second display area 42.
  • the GUI 400 also includes a selector 43 indicating that any item is selected. The user can move the position of the selector 43 in the GUI 400 or move the position of each item in the GUI 400 by operating the control device to select different items. For example, in FIG. 2, the selector 43 indicates that the item 411 in the first display area 41 is selected.
  • an item refers to a visual object displayed in each display area of the GUI of the display device 200 to represent corresponding content such as icons, thumbnails, video clips, links and the like.
  • the item may represent image content or video clips of movies, TV shows, audio content of music, applications, or other user access content history information.
  • the project when the project is a movie or TV series, the project can be displayed as a movie or TV series poster, a movie or TV series trailer video clip dynamic picture.
  • the poster of the music album can be displayed.
  • the project when the project is an application, it can be displayed as an icon of the application, or a screenshot of the content of the application captured when the application was executed most recently.
  • the project is a user's access history, it can be displayed as a screenshot of the content during the most recent execution.
  • the item may indicate an interface or a collection of interfaces through which the display device 200 is connected to an external device, or may indicate the name of an external device connected to the display device.
  • signal source input interface collection or HDMI interface, USB interface, PC terminal interface, etc.
  • the presentation of items is usually diversified.
  • the item may include text content and/or an image for displaying thumbnails related to the text content, or video clips related to the text.
  • the item can be the text and/or icon of the application.
  • selector 43 is used to indicate that any item has been selected, for example, the selected item can be used as the focus object.
  • the movement of the focus object displayed in the display device 200 can be controlled to select or control items.
  • the user can control the movement of the focus object between items through the arrow keys on the control device 100 to select and control items.
  • the movement of each item displayed in the display device 200 can be controlled to control the focus object selection or control item.
  • the user can control each item to move left and right through the arrow keys on the control device 100, so as to control the focus object selection and control items while keeping the position of the focus object unchanged.
  • the identification form of the selector 43 is generally diverse. For example, as shown in FIG. 2 by zooming in the item to realize or identify the position of the focus object corresponding to the selector 43; or, as shown in FIG. 5B to 5E by setting the item background color to realize or identify the focus object corresponding to the selector 43 Alternatively, the position of the focus object corresponding to the selector 43 can be identified by changing the border line, size, color, transparency and outline and/or font of the text or image of the focused item.
  • 3A to 3H respectively exemplarily show schematic diagrams of the GUI 400 or the GUI 500 provided by the display device 200 in an embodiment of the present application.
  • the GUI 400 may be implemented as the home page of the display device.
  • the first display area 41 includes items 411-416 that provide users with common service content.
  • items 411 to 416 are Apps (installed applications), Inputs (input interfaces), Media (media center applications), NETFLIX (a video application), YouTube (a video application), Amazon (a shopping application).
  • the second display area 42 includes items 421-424 that provide users with quick service content.
  • items 421 to 424 are Settings (setting application), Search (search), Notifications (notification center application), TV Browser (browser).
  • the current selector 43 indicates that Apps 411 is selected.
  • the GUI content provided by the display device is also English.
  • the display device displays the GUI 500 associated with Apps 411 in response to the input instruction to activate Apps 411.
  • the GUI 500 includes a content display area 51 for providing information on a plurality of installed applications and a menu display area 52 for performing at least one menu item required for the information on the plurality of installed applications.
  • the current selector 43 indicates that the NETFLIX application is selected.
  • the display device can respond to the instruction to activate the NETFLIX application, thereby accessing related services provided by the NETFLIX application.
  • the menu display area 52 provides at least one menu item for performing related functions on multiple installed applications in the content display area 51, such as Uninstall521 (such as uninstalling an application from the display device), Add to home522 (such as Execute to add an application from the GUI500 to the first display area of the GUI400 (i.e. the home page of the display device), Remove from home523 (such as execute an application from the first display area of the GUI400 (i.e. the home page of the display device) Remove), Sort 524 (such as sorting the multiple installed applications in the content display area 51 according to the installation name or installation time), so as to allow the user to input the operation intention to execute the functions required by the multiple applications.
  • Uninstall521 such as uninstalling an application from the display device
  • Add to home522 such as Execute to add an application from the GUI500 to the first display area of the GUI400 (i.e. the home page of the display device)
  • Remove from home523 such as execute an application from the first display area of the GUI400 (i.e. the home
  • the menu items in the menu display area 52 can be represented by menu item names and menu item icons.
  • the name of the Uninstall521 menu item is Uninstall, and the icon is R (red) rectangular bar
  • the name of the Add to home522 menu item is Add to home, and the icon is G (green) rectangular bar
  • the name of the Remove from home523 menu item is corresponding Is Remove from home, the icon is a Y (yellow) rectangular bar
  • the name of the Sort524 menu item is Sort, and the icon is a B (blue) rectangular bar.
  • the menu item name and menu item icon are arranged up and down, and the menu item name is arranged in a left-aligned manner with the menu item icon.
  • the menu item name Uninstall is located above the red rectangular bar of the menu item icon, And the left end of the menu item name Uninstall is flush with the left end of the red rectangular bar of the menu item icon.
  • the menu items are arranged left and right according to the preset display positions.
  • the menu items 521 to 524 are arranged in a row in the menu display area 52 according to the preset display positions.
  • the display device provides multiple menu items for selecting functions.
  • the control device configured to control the display device may include A plurality of color keys are used to select functions to prompt the user that the display device can execute the menu item function adapted to the color key by operating the color key on the control device.
  • the function information corresponding to the above-mentioned menu item has a mapping relationship with the color key information on the control device. Specifically, when the display device receives the key event value corresponding to each color key on the control device input by the user, the display device can perform the function operation corresponding to the key event value based on the mapping relationship, so that the user can visualize Match the color keys on the control device with the functions provided by each menu item.
  • the menu display area 52 in the GUI 500 shown in FIG. 3B provides menu items 521 to 524 including Uninstall, Add to home, Remove from home, and Sort functions, and the menu item icons corresponding to the menu items 521 to 524 are in accordance with R,
  • the G, Y, and B colors are arranged in order to allow execution or selection of the above-mentioned predetermined function according to the application service provided in the content display area 51.
  • the control device 100 shown in FIG. 4 arranges the color keys in the order of R, G, Y, and B colors, so that the user can operate the color keys on the control device to make the display device perform the desired functions in the menu items 521 to 524 .
  • the user when the user wants to uninstall the NETFLIX application from the display device, the user can press the red button on the control device (the button color corresponds to the color of the menu item icon of the uninstall function provided by the menu item 521 ), the display device can receive the key event value of the button, extract the mapping information "R-Uninstall function" from the display device, and then perform the function of uninstalling the NETFLIX application.
  • the NETFLIX application is no longer displayed in the content display area 51, and only the remaining applications are displayed.
  • the user when the user desires to add the 4KNOW application to the homepage, in the case that the selector 43 indicates that the 4KNOW application is selected, the user can press the green button on the control device (the button color and menu Item 522 provides the color of the menu item icon added to the home page function), the display device can receive the key event value of the button, extract the mapping information "G-Add to home function" from the display device, and then execute the 4KNOW application The function that the program adds to the homepage.
  • the item 417 corresponding to the added 4KNOW application is displayed in the first display area 41, and the original items 411 to 416 are displayed at the same time.
  • the user when the user desires to remove the NETFLIX application from the home page of the display device, the user can press the yellow button on the control device (the button color is the same as the menu item 523 to remove the function from the home page.
  • the color of the item icon corresponds)
  • the display device can receive the key event value of the button, extract the mapping information "Y-Remove from home function" from the display device, and then execute the function of removing the NETFLIX application from the home page.
  • the item 414 corresponding to the NETFLIX application program is no longer displayed in the first display area 41, and only the remaining items 411-413 and 415-416 are displayed.
  • the user when the user desires to sort the installed applications in the content display area, the user can press the blue button on the control device (the button color and the menu item of the sorting function provided by the menu item 524 The color of the icon corresponds to), the display device can receive the key event value of the button, extract the mapping information "B-Sort function" from the display device, and then execute the function of sorting applications according to installation time.
  • the GUI 500 as shown in FIG. 3F, the re-ordered applications are displayed in the content display area 51.
  • the display device can receive the key event value of the color key, search for and execute and receive the key from the mapping information
  • the function corresponding to the event value intuitively considers that the color key on the control device corresponds to the menu item of the function required by the image content in terms of color to perform the desired function.
  • the number, name, color, shape and arrangement order of the menu items provided in the menu display area can be set by default according to the content.
  • the background server of the display device is configured with two menu items in the content display area 51 in the GUI 500 shown in FIG. 3B, which are the menu item 521 whose menu item name is Uninstall and the menu item icon is a red rectangular bar, and The menu item name is Add to home, and the menu item icon is a menu item 522 with a green rectangular bar.
  • the menu items 521 to 522 can be displayed normally according to the display position shown in FIG. 3B, and the menu items 523 to 524 can be displayed distinguished from the menu items 521 to 522 according to the display position shown in FIG.
  • menu item names and menu item icons of menu items 523 to 524 are grayed out, the menu item icons of menu items 523 to 524 are displayed but the menu item name is not displayed, or the menu item names and menu item icons of menu items 523 to 524 are not displayed Display, thereby prompting the user that the current menu display area only provides menu items 521 to 522, but does not provide menu items 523 to 524.
  • the number, name, color, shape and arrangement order of the menu items provided in the menu display area can also be set according to the configuration input by the user.
  • the number of menu items configured for the content display area 51 in the GUI 500 shown in FIG. 3B is two, which are the menu item 521 whose menu item name is Uninstall and the menu item icon is a red rectangular bar, and the menu The item name is Rename (for example, the name of an application is customized to be named), and the menu item icon is the menu item 523 with a yellow rectangular bar.
  • the menu items 521 and 523 can be displayed normally according to the display position shown in Figure 3B, and the menu items 522 and 524 can be displayed differently from the menu items 521 and 523 according to the display position shown in Figure 3B, such as
  • the menu item names and menu item icons of menu items 522 and 524 are grayed out, the menu item icons of menu items 522 and 524 are displayed but the menu item name is not displayed, or the menu item names and menu item icons of menu items 522 and 524 are not displayed Displayed, thereby prompting the user that the current menu display area only provides menu items 521 and 523, but does not provide menu items 522 and 524.
  • the display device can modify its own setting language based on user input, thereby changing the image content provided by the display device and/or the language corresponding to the menu items required to perform the image content. Meet the habitual needs of different users for language.
  • the display device controls the selector 43 to indicate the Settings 421 in the second display area 42 in response to the input downward direction instruction. be chosen.
  • the display device responds to the input command to activate Settings 421 and displays the GUI 600 associated with Settings 421.
  • the GUI 600 includes a menu page 61 and a menu page 61.
  • Provide items 611-616 such as Picture, Sound, System, Channel, Network, Support.
  • the current selector 43 indicates that System 613 is selected, and System 613 provides its corresponding sub-menus, such as items 6131 to 6136, which are Time, Time Settings, SystemPIN, Language and Location, Advanced Settings, and Bluetooth, respectively.
  • the display device may control the selector 43 in response to the input direction command to indicate that Language and location 6134 is selected.
  • the display device responds to the input command to activate Language and location 6134, and displays the sub-menu corresponding to Language and location 6134, such as items 6134-1 to 6134-2. They are Language and Location respectively.
  • the display device can respond to the input command to activate Language6134-1, and display the submenu corresponding to Language6134-1, such as English, Chinese , Portuguese, Russian, French, etc.
  • Language6134-1 such as English, Chinese , Portuguese, Russian, French, etc.
  • the display device can modify the current system language of the display device from English to Portuguese in response to the inputted instruction to activate Portuguese.
  • the display device can respond to the input instruction to exit Settings 421 and display the GUI 400 as shown in FIG. 6A.
  • the GUI 400 provides the language corresponding to the image content in the home page of the display device. Switch to Portuguese. For example, item 411 is displayed as (apps), item 421 is displayed as (settings).
  • the display device responds to the activation of the input (Apps) 411 instructions, showing (Apps)411 associated GUI500.
  • the language corresponding to the content in the content display area 51 and the menu display area 52 provided by the GUI 500 is switched to Portuguese.
  • the names of the menu items corresponding to the menu items 521 to 524 are displayed as Desinstalar, Adiciffà página Principal, Removerda página Principal, and Ordenar, respectively.
  • menu item name of menu item 523 is displayed completely, it will exceed a large part of its own menu item icon, and even extend to the menu item icon of menu item 524, and the menu item name of menu item 523 and the menu The menu item names of item 524 overlap each other, causing inconvenience to the user.
  • FIG. 7A-7D respectively exemplarily show schematic diagrams of the GUI 700 or the GUI 800 provided by the display device 200 in an embodiment of the present application.
  • the GUI 700 associated with Apps 411 in the GUI 400 shown in FIG. 3A is displayed.
  • the GUI 700 includes a content display area 71 for providing information about a plurality of installed applications and a menu display area 72 for performing at least one menu item required by the information about the plurality of installed applications.
  • the menu display area 72 provides three menu items for performing related functions on multiple installed applications in the content display area 71, such as Sort 721 (such as executing the multiple installed applications in the content display area 71).
  • Applications are sorted by installation name or installation time), Add to home722 (such as executing to add an application from GUI700 to the first display area in GUI400 (that is, the home page of the display device)), Uninstall723 (such as executing an application to add Uninstall from the display device) for the user to input the operation intention to execute the functions required by multiple applications.
  • menu items in the menu display area 72 are still represented by menu item names and menu item icons.
  • the menu item icon and the menu item name are arranged left and right.
  • the menu item name Sort in the menu item 721 and the menu item icon blue rectangle are arranged horizontally left and right.
  • the menu item name Add to home in item 722 and the green rectangular bar of the menu item icon are arranged horizontally
  • the menu item name Uninstall in the menu item 723 and the red rectangular bar of the menu item icon are arranged horizontally.
  • the menu items are arranged in a direction from one boundary to another boundary in the menu display area.
  • the menu items 721 to 723 are arranged in a row from right to left in the menu display area 72.
  • the menu items are displayed according to the actual menu items configured for the installed applications in the content display area and the actual positions calculated for these menu items.
  • the installed application is configured with 3 menu items 721 to 723 that perform its related functions by default.
  • 3 menu items are displayed according to the actual layout position determined in the menu display area 72 arranged from right to left; instead of the unconfigured menu shown in Figure 3G
  • the icon of the menu item in the item is displayed but the name of the menu item is not displayed.
  • the configured menu item is still displayed according to the preset fixed position and arrangement.
  • the unconfigured menu item shown in Figure 3H is not displayed, and the configured menu item still follows The preset fixed position and arrangement are displayed.
  • the display device when the display device executes the operation process shown in FIGS. 5A-5E based on the user input and changes its own system language from English to Portuguese, the display device can be activated again based on the user input (Apps) 411 instructions, as shown in Figure 7B, display and (Apps)411 associated GUI700.
  • the language corresponding to the content in the content display area 71 and the menu display area 72 provided by the GUI 700 is switched to Portuguese.
  • the menu display area 72 the menu item names corresponding to the menu items 721 to 723 arranged from right to left are displayed as Ordenar, Adiciffà página Principal, and Desinstalar, respectively.
  • the display device when the display device performs the operation process shown in FIGS. 5A-5E based on the user input, and changes its own system language from English to Chinese, the display device can activate applications (Apps) again based on the user input
  • the instruction of 411 displays the GUI 700 associated with the application (Apps) 411.
  • the language corresponding to the content in the content display area 71 and the menu display area 72 provided by the GUI 700 is switched to Chinese.
  • the menu display area 72 the menu item names corresponding to the menu items 721 to 723 arranged from right to left are respectively displayed as sort, add to homepage, and uninstall.
  • the display positions of the menu items 721-723 in the menu display area 72 are different in the English system language and the Chinese system language.
  • the actual width of the menu display area 72 occupied by the menu item 723 in English is larger than that in Chinese, which further causes the menu item 723 to be in the menu display area.
  • the display position in 72 is different in the two system languages.
  • each menu item is not as shown in Figures 3B and 6B-the menu item icon is displayed in a fixed position, and the menu item name is aligned to the left of the menu item icon.
  • the display is arranged in a way, but according to the text width corresponding to the menu item name in the current system language (such as English, Portuguese, Chinese) and the width of the preset menu item icon, and each menu is determined from right to left In this way, it can avoid that when the text width corresponding to the menu item name is too wide, it will exceed a large part of the icon area of its own menu item or omit part of the text, so that the distance between the menu items does not overlap each other, and Full display.
  • the current system language such as English, Portuguese, Chinese
  • the foregoing embodiment only exemplarily shows a plurality of installed application information provided by Apps411 on the home page of the display device shown in FIG. 3A and a menu item for performing functions required by the plurality of installed application information.
  • this embodiment is not limited to this.
  • FIG. 7D shows a GUI 800 associated with Inputs 412 shown in FIG. 3A.
  • the GUI 800 includes a content display area 81 that provides a plurality of input interfaces connected with external devices and a menu display area 82 for performing at least one menu item required by the multiple input interfaces.
  • the content display area 81 provides multiple input interfaces connected with external devices, such as HDMI, USB, AV, etc., for the user to access the service content provided by the corresponding external device.
  • the menu display area 82 provides two menu items used to perform related functions on multiple input interfaces in the content display area 81, such as Rename821 (such as executing a custom name for an input interface), Add to home822 (such as executing A certain input interface is added from the GUI 800 to the first display area (that is, the home page of the display device) in the GUI 400, so that the user can input the operation intention to perform the functions required by the multiple input interfaces.
  • the display device calculates the layout of the menu items 821 to 822 in the menu display area 82 from right to left according to the text width corresponding to the menu item name under the current system language-English, and the preset menu item icon width. Position to display the menu items 821 to 822 in the calculated layout positions, so as to ensure that the names of the menu items in each menu item are displayed completely and that the menu items do not overlap with each other.
  • FIGS. 8A-8B exemplarily show a flow chart of a graphical user interface method for a menu item that is provided in a display device of an embodiment of the present application to perform functions required by image content.
  • the method includes the following steps:
  • Step S81 Receive a control instruction to display image content input by the user by operating the control device through the user interface.
  • the user interface may receive an instruction to activate Apps 411 in FIG. 3A corresponding to the confirmation key input by the user by pressing the confirmation key on the control device.
  • Step S82 Performed by the controller: GUI is displayed on the display. Specifically:
  • the display device may respond to an instruction to activate Apps411 corresponding to the confirmation key.
  • the content display area 71 displays information such as Information about multiple installed applications such as NETFLIX, YouTube, 4KNOW, etc.; and, in the menu display area 72, according to the current system language-English to determine information such as Uninstall, Add to home, Sort, etc. for executing multiple installed applications
  • the layout positions of the menu items 721 to 723 of the required functions, and each menu item is displayed at the determined layout positions.
  • Step S83 Receive a control instruction input by the user to operate the control device through the user interface and instruct to modify the setting language of the display device.
  • the user interface may receive instructions entered by the user to modify the system language shown in FIGS. 5A-5E by pressing the arrow keys and the confirmation key on the control device.
  • Step S84 the controller also executes: modifying the setting language of the display device to another language. For example, after the display device performs the operations shown in FIGS. 5A-5E, it changes its system language from English to Portuguese.
  • Step S85 Receiving a control instruction to display image content inputted by the user operating the control device through the user interface.
  • the user interface may again receive an instruction to activate Apps 411 in FIG. 3A corresponding to the confirmation key input by the user by pressing the confirmation key on the control device.
  • Step S86 The controller also executes: displaying the GUI on the display. Specifically:
  • the display device can execute the operation process shown in FIGS. 5A-5E based on user input, and modify its own system language from English to Portuguese. Afterwards, in Figure 6A, the display device can again be activated based on user input (Apps) 411 instructions, as shown in Figure 7B, display information of multiple installed applications in the content display area 71; and, in the menu display area 72, re-determine the execution of multiple applications according to the current system language-Portuguese
  • the layout positions of the menu items 721 to 723 of the functions required by the application have been installed, and the menu items are displayed at the determined layout positions.
  • the language corresponding to the content in the content display area 71 and the menu display area 72 is switched to Portuguese.
  • FIG. 9 exemplarily shows a schematic diagram of a method for calculating the actual layout position of each menu item in the menu display area.
  • px represents a pixel unit, which is relative to the screen resolution of the display.
  • W0 represents the gap between the rightmost menu item in the menu display area and the rightmost menu display area; among them, W0 is preset to 1.6.
  • W1 represents the gap between the menu item name and the menu item icon in each menu item; among them, W1 is preset to 0.4.
  • the gap between the menu item name and the menu item icon in different menu items is the same.
  • W2 represents the gap between two adjacent menu items in each menu item; among them, W2 is preset to 0.8. Here, the gaps between adjacent menu items are the same.
  • the display device can obtain the actual width occupied by the string corresponding to the menu item name in the webpage in the current system language by calling the clientWidth method in the JavaScript attribute.
  • B represents the width of the menu item icon in each menu item; among them, B is preset to 1.2.
  • the width of the menu item icon in different menu items is the same.
  • Li Ai +B+W1.
  • S i represents the actual display position of each menu item in the menu display area.
  • W0, W1, W2, and B can be set according to actual needs.
  • the gap between the menu item name and the menu item icon in different menu items can be different, the width of the menu item icon in different menu items can be different, and the gap between adjacent menu items in different menu items can be different.
  • the menu display area 72 in the GUI shown in FIG. 7A is shown.
  • the menu items 721 to 723 used to perform related functions for multiple installed applications in the content display area 71 are obtained, where the menu items 721 to 723 are represented by menu item names and menu item icons.
  • the actual layout positions of the corresponding menu item names and menu item icons among the menu items 721 to 723 are sequentially calculated.
  • the menu items 721 to 723 are displayed at the calculated actual layout positions.
  • the display position of the first menu item 721 on the right side of the menu display area is determined, as follows:
  • the actual position S 1 of the menu item 721 in the menu display area is at a position that is 1.6 (W0) to 4.2 (W0+L 1 ) from the rightmost gap of the menu display area.
  • the display position of the second menu item 722 on the right side of the menu display area is determined as follows:
  • the actual position S 2A of Add to home in the menu display area is: the gap from the far right of the menu display area is 5.0 (4.2+W2) ⁇ 7.6 (5.0+A 2 ).
  • the actual position S 2 of the menu item 722 in the menu display area is: the gap from the far right side of the menu display area is 5.0(W0+L 1 +W2) ⁇ 9.2(W0+L 1 +W2+L 2 ) Location.
  • the display position of the third menu item 723 on the right side of the menu display area is determined, as follows:
  • the actual position S 3 of the menu item 723 in the menu display area is: the gap from the far right of the menu display area is 10.0(W0+L 1 +2*W2+L 2 ) ⁇ 13.7(W0+L 1 + 2*W2+L 2 +L 3 ).
  • the menu item name and menu item icon of each menu item are displayed based on the determined actual layout position.
  • the menu items in the menu display area are arranged in the horizontal direction (horizontal direction) to illustrate the calculation method of the menu item layout position.
  • the menu items in this embodiment The calculation method of the layout position is also applicable to the situation where the menu items in the menu display area are arranged in the vertical direction (vertical).
  • the display positions of the menu items 721 to 723 in the menu display area 72 can be determined in the following manner:
  • "ColorButton” can represent the menu display area 72
  • "hotKeyImg” can represent the icon of each menu item in the menu items 721-723
  • "hotKeyName” can represent the name of each menu item in the menu items 721-723
  • "rightHotKeys” can It characterizes the menu items on the right side of the menu item whose display position is currently determined.
  • "nameLength” can characterize the total width of the previous menu item
  • “lastLength” can characterize the total width of all menu items before the menu item whose display position is currently determined.
  • the display device can be based on the text width corresponding to the menu item name in the current system language (such as English, Portuguese, Chinese) and the width of the preset menu item icon, and according to the menu display area
  • the direction from the boundary to the other boundary determines the actual layout position of the menu item name and menu item icon in each menu item in turn.
  • the layout position of the menu item in different system languages can be adapted to keep the distance between the menu items. They overlap each other and are displayed completely.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Ecology (AREA)
  • Emergency Management (AREA)
  • Environmental & Geological Engineering (AREA)
  • Environmental Sciences (AREA)
  • Remote Sensing (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种提供菜单项的图形用户界面方法及显示设备，用以根据显示设备的设置语言自动调整菜单项的显示位置。该方法包括：响应于用户输入的指示显示图像内容的第一控制指令，在显示器的内容显示区，显示图像内容；以及，基于显示设备的设置语言，计算为所述图像内容配置且用于执行所述图像内容所需功能的至少一个菜单项在显示器的菜单显示区的布局位置，并基于计算出的布局位置显示至少一个菜单项。

Description

一种提供菜单项的图形用户界面方法及显示设备
相关申请的交叉引用
本申请要求在2019年04月11日提交中国专利局、申请号为201910290320.8、申请名称为“一种提供菜单项的图形用户界面方法及显示设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示技术领域，尤其涉及一种提供菜单项的图形用户界面方法及显示设备。
背景技术
为了满足用户个性化需求，显示设备不仅可以为用户提供通过数据广播接收的各种传统节目内容，而且可以为用户提供由内容制造商设置的各种应用和服务内容。
在显示上述各种内容的同时，显示设备还提供用于对上述各种内容进行功能操作的菜单项。然而，显示设备提供的这些菜单项的显示位置通常固定，在用户指示显示设备切换语言后，这些菜单项通常错乱显示，影响用户观感体验。
例如，在表示相同含义时，使用英语词汇的长度和使用葡萄牙语词汇的长度可能不相同，可能造成在预留空间内不能完整显示文本，甚至造成用户界面上出现文本重叠或覆盖等现象，如此，在一定程度上，可能会丢失原有用户界面的布局和/或视觉效果。
发明内容
本申请实施例提供一种提供菜单项的图形用户界面方法及显示设备，用以根据显示设备的设置语言，自动调整菜单项的显示位置，从而提高用户观感体 验。
第一方面，本申请实施例提供一种呈现图形用户界面方法。该方法包括：
响应于用户输入的指示显示第一图像内容的第一控制指令，在显示器的内容显示区，显示所述第一图像内容；基于显示设备的设置语言，计算为所述第一图像内容配置且用于执行所述第一图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第一布局位置；并基于计算出的第一布局位置显示至少一个菜单项。
一些实施例中，所述至少一个菜单项根据缺省而配置或根据用户设置而配置。
一些实施例中，所述至少一个菜单项从菜单显示区的一边界开始向另一边界排列，使得菜单项之间保持距离而不彼此重叠。
一些实施例中，计算至少一个菜单项在菜单显示区的第一布局位置，包括：
基于显示设备的设置语言，计算至少一个菜单项在菜单显示区占用的宽度；
基于计算出的宽度以及从菜单显示区的一边界至另一边界的排列方向，确定至少一个菜单项在菜单显示区的第一布局位置。
一些实施例中，所述菜单项包括菜单项名称和菜单项图标。
一些实施例中，计算至少一个菜单项在菜单显示区占用的宽度，包括：
计算菜单项中菜单项名称在显示设备的设置语言下对应的文本宽度；
获取菜单项中菜单项图标对应的宽度；
将菜单项名称的宽度和菜单项图标的宽度之和确定为菜单项占用的宽度。
一些实施例中，还包括：
响应于用户输入的指示修改显示设备的设置语言的第二控制指令，更新显示设备的设置语言；
响应于用户输入的指示显示第二图像内容的第三控制指令，在显示器的内容显示区显示所述第二图像内容，其中，所述第二图像内容对应在更新的设置语言中的所述第一图像内容；以及，基于更新后显示设备的设置语言，计算为 所述第二图像内容配置且用于执行所述第二图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第二布局位置，并基于计算出的第二布局位置更新所述至少一个菜单项在内容展示区的展示。
一些实施例中，所述菜单项对应的功能信息与用于将用户输入提供给显示设备的控制装置上的颜色按键信息具有映射关系。
第二方面，本申请实施例提供一种显示设备。该显示设备包括：
显示器，用于展示图像；
控制器，用于执行：
响应于用户输入的指示显示第一图像内容的第一控制指令，在显示器的内容显示区，显示第一图像内容；基于显示设备的设置语言，计算为所述第一图像内容配置且用于执行所述第一图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第一布局位置；基于计算出的第一布局位置显示至少一个菜单项。
一些实施例中，所述至少一个菜单项根据缺省而配置或根据用户设置而配置。
一些实施例中，所述至少一个菜单项从菜单显示区的一边界开始向另一边界排列，使得菜单项之间保持距离而不彼此重叠。
一些实施例中，所述控制器通过下述执行计算至少一个菜单项在菜单显示区的第一布局位置：基于显示设备的设置语言，计算至少一个菜单项在菜单显示区占用的宽度；
基于计算出的宽度以及从菜单显示区的一边界至另一边界的排列方向，确定至少一个菜单项在菜单显示区的第一布局位置。
一些实施例中，所述菜单项包括菜单项名称和菜单项图标。
一些实施例中，所述控制器通过下述执行计算至少一个菜单项在菜单显示区占用的宽度：
计算菜单项中菜单项名称在显示设备的设置语言下对应的文本宽度；
获取菜单项中菜单项图标对应的宽度；
将菜单项名称的宽度和菜单项图标的宽度之和确定为菜单项占用的实际宽度。
一些实施例中，所述控制器还用于：
响应于用户输入的指示修改显示设备的设置语言的第二控制指令，更新显示设备的设置语言；
响应于用户输入的指示显示第二图像内容的第三控制指令，在显示器的内容显示区显示第二图像内容，其中，所述第二图像内容对应在更新的设置语言中的所述第一图像内容；基于更新后显示设备的设置语言，计算为所述第二图像内容配置且用于执行所述第二图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第二布局位置；基于计算出的第二布局位置更新所述至少一个菜单项在内容展示区的展示。
一些实施例中，所述菜单项对应的功能信息与用于将用户输入提供给显示设备的控制装置上的颜色键信息具有映射关系。
第三方面，本申请实施例提供一种电视，包括：
遥控器，包括复数个颜色按键；
显示设备，包括显示器和控制器，其中，
所述显示器，用于展示图像；
所述控制器，用于：
接收所述遥控器发出的指示显示第一图像内容的第一控制指令；
响应于所述第一控制指令，在显示器的内容显示区显示所述第一图像内容；基于显示设备的设置语言，计算为所述第一图像内容配置且用于执行所述第一图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第一布局位置；基于计算出的第一布局位置显示至少一个菜单项。
一些实施例中，所述至少一个菜单项中的一者配置为能够被所述遥控器的复数个颜色按键中的一者控制。
上述实施例中，显示设备能够提供图像内容；以及能够根据当前设置的系统语言，计算用于执行图像内容所需功能的至少一个菜单项的实际布局位置，从而能够实现不同系统语言下菜单项布局的自适应，避免由于显示位置固定而出现不同系统语言下菜单项不能完整显示、或相互重叠、或覆盖，以提高用户视觉体验。
附图说明
图1A中示例性示出了本申请实施例中显示设备200与控制装置100之间操作场景的示意图；
图1B中示例性示出了图1A中控制装置100的配置框图；
图1C中示例性示出了图1A中显示设备200的配置框图；
图1D中示例性示出了本申请实施例中显示设备200存储器中操作系统的架构配置框图；
图2中示例性示出了本申请实施例中显示设备200提供的GUI400的第一示意图；
图3A中示例性示出了本申请实施例中显示设备200提供的GUI400的第二示意图；
图3B中示例性示出了本申请实施例中显示设备200提供的GUI500的第一示意图；
图3C中示例性示出了本申请实施例中显示设备200提供的GUI500的第二示意图；
图3D中示例性示出了本申请实施例中显示设备200提供的GUI400的第三示意图；
图3E中示例性示出了本申请实施例中显示设备200提供的GUI400的第四示意图；
图3F中示例性示出了本申请实施例中显示设备200提供的GUI500的第 三示意图；
图3G中示例性示出了本申请实施例中显示设备200提供的GUI500的第四示意图；
图3H中示例性示出了本申请实施例中显示设备200提供的GUI500的第五示意图；
图4中示例性示出了本申请实施例中控制装置100的一个示意图；
图5A中示例性示出了本申请实施例中显示设备200提供的GUI400的第五示意图；
图5B中示例性示出了本申请实施例中显示设备200提供的GUI600的第一示意图；
图5C中示例性示出了本申请实施例中显示设备200提供的GUI600的第二示意图；
图5D中示例性示出了本申请实施例中显示设备200提供的GUI600的第三示意图；
图5E中示例性示出了本申请实施例中显示设备200提供的GUI600的第四示意图；
图6A中示例性示出了本申请实施例中显示设备200提供的GUI400的第六示意图；
图6B中示例性示出了本申请实施例中显示设备200提供的GUI500的第六示意图；
图7A中示例性示出了本申请实施例中显示设备200提供的GUI700的第一示意图；
图7B中示例性示出了本申请实施例中显示设备200提供的GUI700的第二示意图；
图7C中示例性示出了本申请实施例中显示设备200提供的GUI700的第三示意图；
图7D中示例性示出了本申请实施例中显示设备200提供的GUI800的示意图；
图8A中示例性示出了本申请实施例的显示设备中的一种提供执行图像内容所需功能的菜单项的图形用户界面的方法流程图；
图8B中示例性示出了本申请实施例的显示设备中的另一种提供执行图像内容所需功能的菜单项的图形用户界面的方法流程图；
图9示例性示出了计算各个菜单项在菜单显示区内实际布局位置的方法示意图。
具体实施方式
为使本申请示例性实施例的目的、技术方案和优点更加清楚，下面将结合本申请示例性实施例中的附图，对本申请示例性实施例中的技术方案进行清楚、完整地描述，显然，所描述的示例性实施例仅是本申请一部分实施例，而不是全部的实施例。
基于本申请中示出的示例性实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。此外，虽然本申请中公开内容按照示范性一个或几个实例来介绍，但应理解，可以就这些公开内容的各个方面也可以单独构成一个完整技术方案。
本申请中使用的术语“包括”和“具有”以及他们的任何变形，意图在于覆盖但不排他的包含，例如，包含了一系列组件的产品或设备不必限于清楚地列出的那些组件，而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。
本申请中使用的术语“模块”，是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合，其能够执行与该元件相关的功能。
本申请中使用的术语“手势”，是指用户通过一种手型的变化或手部运动等 动作，用于表达预期想法、动作、目的/或结果的用户行为。
图1A中示例性示出了本申请实施例中显示设备200与控制装置100之间操作场景的示意图。如图1A所示，控制装置100和显示设备200之间可以进行有线或无线方式的通信。
在一些实施例中，控制装置100被配置为控制显示设备200。控制装置100可接收用户输入的操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起着用户与显示设备200之间交互的中介作用。如：用户可以操作控制装置100上的频道加减键，而显示设备200可以响应频道加减的操作。
在一些实施例中，控制装置100可以是遥控器100A，其可以通过无线或其他有线方式来控制显示设备200。例如，遥控器100A可以通过红外协议通信，蓝牙协议通信，或其他短距离通信方式等来控制显示设备200。
用户可以通过遥控器100A上的按键、语音输入、控制面板输入等部件，输入用户指令，来控制显示设备200。如：用户可以通过遥控器100A上的音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等，输入相应的控制指令，来控制显示设备200。
在一些实施例中，控制装置100也可以是智能设备，如手机、平板电脑、计算机、笔记本电脑等移动终端100B。例如，用户可以通过在智能设备上运行的应用程序来控制显示设备200。该应用程序通过配置可以在与智能设备关联的屏幕上，通过直观的用户界面(UI)为用户提供各种控制。
在一些实施例中，移动终端100B和显示设备200可以安装软件应用，并通过网络通信协议实现通信连接，进而实现一对一控制操作和数据通信的目的。如：可以建立移动终端100B与显示设备200的控制指令协议，然后通过操作移动终端100B上提供的用户界面的各种功能按键或虚拟按钮，来实现如遥控器100A布置的实体按键的功能。或者，也可以将移动终端100B上显示的音视频内容传输到显示设备200上，实现同步显示功能。
在一些实施例中，显示设备200可被实施为电视机，可提供如广播接收电 视功能，计算机支持功能等智能网络电视功能。显示设备200可以为数字电视、网络电视、智能电视，或互联网协议电视(IPTV)等。
在一些实施例中，显示设备200，可以是液晶显示器、有机发光显示器、投影显示设备等。本申请实施例中，显示设备200的类型、尺寸和分辨率等不作限定。
在一些实施例中，显示设备200还与服务器300通过多种通信方式进行数据通信。例如，显示设备200可以通过局域网(LAN)、无线局域网(WLAN)或其他网络与服务器300进行通信连接。服务器300可以向显示设备200提供各种内容和互动。示例的，显示设备200可以发送和接收信息，例如：接收电子节目指南(EPG)数据、接收软件程序更新、或访问远程储存的数字媒体库。服务器300可以包括一组或多组服务器，可以为一类或多类服务器。服务器300还可以提供视频点播和广告服务等其他网络服务内容。
图1B中示例性示出了本申请实施例中控制装置100的配置框图。控制装置100包括控制器110、存储器120、通信器130、用户输入接口140、输出接口150、供电电源160。
控制器110包括随机存取存储器(RAM)111、只读存储器(ROM)112、处理器113、通信接口(未示出)以及通信总线(未示出)。
控制器110用于控制控制装置100的运行和操作，以及内部各部件之间的通信协作、外部和内部的数据处理功能。
存储器120，用于在控制器110的控制下，存储用于驱动和控制控制装置100的各种运行程序、数据和应用。存储器120，可以存储用户输入的各类控制信号指令。
通信器130可以包括红外信号接口131和射频信号接口132。
用户输入接口140，可包括麦克风141、触摸板142、传感器143、按键144等中的至少一者，使得用户可以通过语音、触摸、手势、按压等操作，将用于控制显示设备200的用户指令，输入到控制装置100。
输出接口150可以包括LED接口151、产生振动的振动接口152、输出声音的声音输出接口153和输出图像的显示器154等。供电电源160，用于在控制器110的控制下为控制装置100各元件提供运行电力支持。形式可以为电池及相关控制电路。
图1C中示例性示出了本申请实施例中的显示设备200的硬件配置框图。显示设备200中可以进一步包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、存储器260、用户接口265、视频处理器270、显示器275、音频处理器280、音频输出接口285、供电电源290。
调谐解调器210，通过有线或无线方式接收广播电视信号，可以进行放大、混频和谐振等调制解调处理。
调谐解调器210，可根据用户选择，以及由控制器250控制，响应用户选择的电视频道的频率以及该频率所携带的电视信号。
调谐解调器210，根据电视信号的广播制式不同，可以接收信号的途径有很多种，诸如：地面广播、有线广播、卫星广播或互联网广播等；以及根据调制类型的不同，可以采用数字调制方式或模拟调制方式；以及根据接收电视信号的种类不同，可以解调模拟信号和数字信号。
在其他一些示例性实施例中，调谐解调器210也可在外部设备中，如外部机顶盒等。这样，机顶盒通过调制解调后输出电视信号，经过外部装置接口240输入至显示设备200中。
通信器220，是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。通信器220可以包括WIFI模块221、蓝牙通信协议模块222、有线以太网通信协议模块223等网络通信协议模块或近场通信协议模块。
检测器230，是显示设备200用于采集外部环境或与外部交互的信号的组件。检测器230可以包括图像采集器231，可以用于采集外部环境场景，以自适应变化显示设备200的显示参数；以及用于采集用户的属性或与用户交互手势，以实现显示设备与用户之间互动的功能。还可以包括光接收器232，用于 采集环境光线强度，以自适应显示设备200的显示参数变化等。
在其他一些示例性实施例中，检测器230，还可以包括温度传感器，如通过感测环境温度，显示设备200可自适应调整图像的显示色温。在其他一些示例性实施例中，检测器230，还可以包括声音采集器，如麦克风，可以用于接收用户的声音，如用户控制显示设备200的控制指令的语音信号；或者，可以采集用于识别环境场景类型的环境声音，实现显示设备200可以自适应环境噪声。
外部装置接口240，是提供控制器210控制显示设备200与外部设备间数据传输的组件。外部装置接口240可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等外部设备连接，可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如电子节目菜单(Electronic Program Guide，EPG))等数据。
外部装置接口240可以包括：高清多媒体接口(HDMI)端子241、复合视频消隐同步(CVBS)端子242、模拟或数字分量端子243、通用串行总线(USB)端子244、组件(Component)端子(图中未示出)、红绿蓝(RGB)端子(图中未示出)等任一个或多个。
控制器250，通过运行存储在存储器260上的各种软件控制程序(如操作系统和各种应用程序)，来控制显示设备200的工作和响应用户的操作。
控制器250包括随机存取存储器(RAM)251、只读存储器(ROM)252、图形处理器253、CPU处理器254、通信接口255、以及通信总线256。
控制器250可以控制显示设备200的整体操作。例如：响应于接收到用于选择在显示器275上显示的GUI对象的用户输入命令，控制器250便可以执行与由用户输入命令选择的对象有关的操作。
其中，该对象可以是可选对象中的任何一个，例如超链接或图标。该与所选择的对象有关的操作，例如显示连接到超链接页面、文档、图像等操作，或者执行与图标相对应的程序的操作。该用于选择GUI对象的用户输入命令，可 以是通过连接到显示设备200的各种输入装置(例如，鼠标、键盘、触摸板等)输入命令或者是与用户说出语音相对应的语音命令。
存储器260，用于存储驱动和控制显示设备200运行的各种类型的数据、软件程序或应用程序。
图1D中示例性示出了本申请实施例中显示设备200的存储器中操作系统的架构配置框图。该操作系统架构从上到下依次是应用层、中间件层和内核层。
应用层，系统内置的应用程序以及非系统级的应用程序都属于应用层，其负责与用户进行直接交互。应用层可包括多个应用程序，如NETFLIX应用程序、设置应用程序、媒体中心应用程序等。这些应用程序可被实现为Web应用，其基于WebKit引擎来执行，具体可基于超级文本标记语言(HyperText Markup Language，HTML)、层叠样式表(Cascading Style Sheet，CSS)和JavaScript来开发并执行。
这里，HTML是一种用于创建网页的标准标记语言，通过标记标签来描述网页，HTML标签用以说明文字、图形、动画、声音、表格、链接等，浏览器会读取HTML文档，解释文档内标签的内容，并以网页的形式显示出来。
CSS是一种用来表现HTML文件样式的计算机语言，可以用来定义样式结构，如字体、颜色、位置等的语言。CSS样式可以直接存储与HTML网页或者单独的样式文件中，实现对网页中样式的控制。
JavaScript，是一种应用于Web网页编程的语言，可以插入HTML页面并由浏览器解释执行。其中Web应用的交互逻辑都是通过JavaScript实现。JavaScript可以通过浏览器，封装JavaScript扩展接口，实现与内核层的通信。
中间件层，可以提供一些标准化的接口，以支持各种环境和系统的操作。例如，中间件层可以实现为与数据广播相关的中间件的多媒体和超媒体信息编码专家组(Multimedia and Hypermedia information Encoding expert Group，MHEG)，还可以实现为与外部设备通信相关的中间件的数字生活网络联盟(Digital Living Network Alliance，DLNA)中间件，还可以实现为提供显示设备 内各应用程序所运行的浏览器环境的中间件等。
内核层，提供核心系统服务，例如：文件管理、内存管理、进程管理、网络管理、系统安全权限管理等服务。内核层可以被实现为基于各种操作系统的内核，例如，基于Linux操作系统的内核。
内核层也同时提供系统软件和硬件之间的通信，为各种硬件提供设备驱动服务，例如：为显示器提供显示驱动程序、为摄像头提供摄像头驱动程序、为遥控器提供按键驱动程序、为WIFI模块提供WiFi驱动程序、为音频输出接口提供音频驱动程序、为电源管理(Power Management，PM)模块提供电源管理驱动等。
用户接口265，接收各种用户交互。具体的，用于将用户的输入信号发送给控制器250，或者，将从控制器250的输出信号传送给用户。示例性的，遥控器100A可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户接口265，再由用户接口265转送至控制器250；或者，遥控器100A可接收经控制器250处理从用户接口265输出的音频、视频或数据等输出信号，并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。
在一些实施例中，用户可在显示器275上显示的图形用户界面(GUI)输入用户命令，则用户接口265通过GUI接收用户输入命令。确切的说，用户接口265可接收用于控制选择器在GUI中的位置以选择不同的对象或项目的用户输入命令。
或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户接口265通过传感器识别出声音或手势，来接收用户输入命令。
视频处理器270，用于接收外部的视频信号，根据输入信号的标准编解码协议，进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理，可得到直接在显示器275上显示或播放的视频信号。
显示器275，用于接收源自视频处理器270输出的图像信号，进行显示视 频、图像以及菜单操控界面。例如，显示器可以显示来自调谐解调器210接收的广播信号中的视频，也可以显示来自通信器220或外部装置接口240输入的视频，还可以显示在存储器260中存储的图像。显示器275，同时显示显示设备200中产生且用于控制显示设备200的用户操控界面UI。
以及，显示器275可以包括用于呈现画面的显示屏组件以及驱动图像显示的驱动组件。或者，倘若显示器275为一种投影显示器，还可以包括一种投影装置和投影屏幕。
音频处理器280，用于接收外部的音频信号，根据输入信号的标准编解码协议，进行解压缩和解码，以及降噪、数模转换、和放大处理等音频数据处理，得到可以在扬声器286中播放的音频信号。
示例性的，音频处理器280可以支持各种音频格式。例如MPEG-2、MPEG-4、高级音频编码(Advanced Audio Coding，AAC)、高效AAC(HE-AAC)等格式。
音频输出接口285，用于接收源自音频处理器280输出的音频信号。例如，音频输出接口可以输出经由调谐解调器210接收的广播信号中的音频，也可以输出经由通信器220或外部装置接口240输入的音频，还可以输出在存储器260中存储的音频。音频输出接口285可包括扬声器286，或输出至外接设备的发声装置的外接音响输出端子287，如耳机输出端子。
在其他一些示例性实施例中，视频处理器270可以包括一个或多个芯片组成。音频处理器280，也可以包括一个或多个芯片组成。
以及，在其他一些示例性实施例中，视频处理器270和音频处理器280，可以为单独的芯片，也可以与控制器250一起集成在一个或多个芯片中。
供电电源290，用于在控制器250的控制下，将外部电源输入的电力为显示设备200提供电源供电支持。供电电源290可以是安装在显示设备200内部的内置电源电路，也可以是安装在显示设备200外部的电源。
图2中示例性示出了本申请实施例中显示设备200提供的GUI400的第一 示意图。
如图2所示，显示设备可向显示器提供GUI400。该GUI400包括提供不同图像内容的多个展示区。各个展示区中包括布置的一个或多个不同项目。例如，第一展示区41内布置项目411～416，第二展示区42内布置项目421～426。GUI400还包括指示任一项目被选择的选择器43。用户可通过操作控制装置的输入，而移动选择器43在GUI400中的位置，或移动各项目在GUI400中的位置，以选择不同的项目。例如，图2中，选择器43指示第一展示区41内的项目411被选择。
需要说明的是，本申请实施例中，项目是指在显示设备200中的GUI的各展示区中显示、以表示诸如图标、缩略图、视频剪辑、链接等对应内容的视觉对象。这些项目可以为用户提供通过数据广播接收的各种传统节目内容、以及由内容制造商设置的各种应用和服务内容。
一些实施例中，项目可以表示电影、电视剧的图像内容或视频剪辑、音乐的音频内容、应用程序，或其他用户访问内容历史信息。如项目为电影或电视剧时，项目可显示为电影或电视剧的海报、电影或电视剧的预告片的视频剪辑动态画面。如项目为音乐时，可显示音乐专辑的海报。如项目为应用程序时，可显示为应用程序的图标，或当应用程序被执行最近执行时捕捉到应用程序的内容截图。如项目为用户访问历史时，可显示为最近执行过程中内容截图。
一些实施例中，项目可以表示显示设备200与外部设备连接的接口或接口集合，或可表示连接至显示设备的外部设备名称等。如：信号源输入接口集合、或HDMI接口、USB接口、PC端子接口等。
项目的展示形式通常多样化。例如，项目可以包括文本内容和/或用于显示与文本内容相关的缩略图的图像，或与文本相关的视频剪辑。又如，项目可以是应用程序的文本和/或图标。
还需说明的是，选择器43用于指示其中任一项目已被选择，如该被选择的项目可以作为焦点对象。
一方面，可根据用户通过控制装置100的输入，控制显示设备200中显示的焦点对象的移动，来选择或控制项目。如：用户可通过控制装置100上的方向键，控制焦点对象在项目之间的移动，来选择和控制项目。
另一方面，可根据用户通过控制装置100的输入，控制显示设备200中显示的各项目的移动，来控制焦点对象选择或控制项目。如：用户可通过控制装置100上的方向键，控制各项目进行左右移动，以在保持焦点对象的位置不变的同时，控制焦点对象选择和控制项目。
选择器43的标识形式通常多样化。示例的，如图2中通过放大项目来实现或标识选择器43所对应的焦点对象的位置；或者，如图5B～5E中通过设置项目背景色来实现或标识选择器43所对应的焦点对象的位置；或者，也可以通过改变聚焦项目的文本或图像的边框线、尺寸、颜色、透明度和轮廓和/或字体等标识选择器43所对应的焦点对象的位置。
图3A～3H中分别示例性示出了本申请实施例中显示设备200提供的GUI400或GUI500的示意图。
如图3A所示，GUI400可实现为显示设备的首页。其中，第一展示区41包括为用户提供常用服务内容的项目411～416。例如，项目411～416分别为Apps(已安装应用程序)、Inputs(输入接口)、Media(媒体中心应用程序)、NETFLIX(一视频应用程序)、YouTube(一视频应用程序)、Amazon(一购物应用程序)。第二展示区42包括为用户提供快捷服务内容的项目421～424。例如，项目421～424分别为Settings(设置应用程序)、Search(搜索)、Notifications(通知中心应用程序)、TV Browser(浏览器)。当前选择器43指示Apps 411被选择。
此外，由于显示设备在首次启动后设置的系统语言或者显示设备启动后基于用户输入设置的系统语言为英语，所以显示设备提供的GUI内容也为英语。
在图3A中，当用户按压控制装置100上的确认键，如图3B所示，显示设备响应于输入的激活Apps 411的指令，显示与Apps 411相关联的GUI500。其中，该GUI500包括提供多个已安装应用程序信息的内容显示区51和用于执 行该多个已安装应用程序信息所需功能的至少一个菜单项的菜单显示区52。
其中，内容显示区51中提供多个已安装应用程序，例如NETFLIX、YouTube、4KNOW等，以供用户进行访问。例如，当前选择器43指示NETFLIX应用程序被选择，当用户按压控制装置上确认键时，显示设备可以响应于激活NETFLIX应用程序的指令，从而访问NETFLIX应用程序提供的相关服务。
菜单显示区52中提供用于对内容显示区51中多个已安装应用程序执行相关功能的至少一个菜单项，例如Uninstall521(如执行将某应用程序从显示设备中卸载)、Add to home522(如执行将某应用程序从GUI500添加到GUI400中的第一展示区(即显示设备的首页))、Remove from home523(如执行将某应用程序从GUI400中的第一展示区(即显示设备的首页)移除)、Sort524(如按照安装名称或安装时间,对内容显示区51中的多个已安装应用程序进行排序)，以实现，供用户输入执行多个应用程序所需功能的操作意图。
这里，菜单显示区52中的菜单项可以菜单项名称和菜单项图标来表示。例如，Uninstall521菜单项对应的名称为Uninstall、图标为R(红色)矩形条；Add to home522菜单项对应的名称为Add to home、图标为G(绿色)矩形条；Remove from home523菜单项对应的名称为Remove from home、图标为Y(黄色)矩形条；Sort524菜单项对应的名称为Sort、图标为B(蓝色)矩形条。
此外，一个菜单项中，菜单项名称与菜单项图标上下排布、且菜单项名称按照与菜单项图标左对齐的方式排布，例如，菜单项名称Uninstall位于菜单项图标红色矩形条的上方、且菜单项名称Uninstall的左端与菜单项图标红色矩形条的左端平齐。而各个菜单项之间按照预设的显示位置呈左右排布，例如，菜单项521～524在菜单显示区52内按照预先设置的显示位置排列为一行。
需要说明的是，为了选择并执行显示设备提供的图像内容服务所需的相关功能，显示设备提供了用于选择功能的多个菜单项，同时，被配置为控制显示设备的控制装置中可以包括用于选择功能的多个颜色键，以向用户提示可以通过操作控制装置上的颜色键而使显示设备执行与该颜色键适配的菜单项功能。
这里，上述菜单项对应的功能信息与控制装置上的颜色键信息具有映射关系。具体的，当显示设备接收到用户输入的与控制装置上各个颜色键对应的键事件值时，显示设备可以基于该映射关系执行与键事件值对应的功能操作，这样，能够便于用户可视的将控制装置上的颜色键与各菜单项提供的功能进行匹配。
例如，图3B所示的GUI500中的菜单显示区52提供了包括Uninstall、Add to home、Remove from home、Sort功能的菜单项521～524，并且菜单项521～524对应的菜单项图标按照R、G、Y和B颜色的顺序布置，以允许根据内容显示区51所提供的应用服务执行或选择上述预定功能。图4所示的控制装置100上按R、G、Y和B颜色的顺序布置各颜色键，以供用户通过操作控制装置上的颜色键而使显示设备执行菜单项521～524中期望的功能。
结合图3B和图4来说，当用户期望从显示设备中卸载NETFLIX应用程序时，用户可以按压控制装置上的红色按键(该按键颜色与菜单项521提供的卸载功能的菜单项图标的颜色对应)，显示设备可以接收该按键的键事件值，从显示设备内提取到映射信息“R-Uninstall功能”，进而执行卸载NETFLIX应用程序的功能。如图3C所示的GUI500中，内容显示区51内不再显示NETFLIX应用程序，仅显示剩余应用程序。
结合图3B和图4来说，当用户期望将4KNOW应用程序添加到首页时，在选择器43指示4KNOW应用程序被选择的情况下，用户可以按压控制装置上的绿色按键(该按键颜色与菜单项522提供的添加到首页功能的菜单项图标的颜色对应)，显示设备可以接收该按键的键事件值，从显示设备内提取到映射信息“G-Add to home功能”，进而执行将4KNOW应用程序添加到首页的功能。如图3D所示的GUI400中，第一展示区41内显示添加的4KNOW应用程序对应的项目417，同时显示原有项目411～416。
结合图3B和图4来说，当用户期望将NETFLIX应用程序从显示设备首页移除时，用户可以按压控制装置上的黄色按键(该按键颜色与菜单项523提 供的从首页移除功能的菜单项图标的颜色对应)，显示设备可以接收该按键的键事件值，从显示设备内提取到映射信息“Y-Remove from home功能”，进而执行将NETFLIX应用程序从首页移除的功能。如图3E所示的GUI400中，第一展示区41内不再显示NETFLIX应用程序对应的项目414，仅显示剩余项目411～413以及415～416。
结合图3B和图4来说，当用户期望对内容显示区的已安装应用程序进行排序时，用户可以按压控制装置上的蓝色按键(该按键颜色与菜单项524提供的排序功能的菜单项图标的颜色对应)，显示设备可以接收该按键的键事件值，从显示设备内提取到映射信息“B-Sort功能”，进而执行按照安装时间对应用程序排序的功能。如图3F所示的GUI500中，内容显示区51内显示重新排序后的各应用程序。
这样，在显示器上提供图像内容的情况下，用户通过按压控制装置上具有其期望执行功能的颜色键，显示设备可以接收该颜色键的键事件值，从映射信息中搜索并执行与接收的键事件值对应的功能，直观地考虑了控制装置上的颜色键在颜色方面与图像内容所需功能的菜单项对应来执行期望的功能。
还需说明的是，菜单显示区中提供的菜单项的个数、名称、颜色、形状和布置顺序等可以根据内容而被缺省设置。
例如，显示设备的后台服务器为图3B所示GUI500中的内容显示区51配置的菜单项个数为2个，分别是菜单项名称为Uninstall、菜单项图标为红色矩形条的菜单项521，以及菜单项名称为Add to home、菜单项图标为绿色矩形条的菜单项522。此时如图3G所示，菜单项521～522可以按照图3B所示显示位置进行正常显示，而菜单项523～524可以按照图3B所示显示位置与菜单项521～522进行区分显示，如菜单项523～524的菜单项名称和菜单项图标均置为灰色、菜单项523～524的菜单项图标显示而菜单项名称不显示、或者菜单项523～524菜单项名称和菜单项图标均不显示，从而向用户提示当前菜单显示区仅提供菜单项521～522，而不提供菜单项523～524。
菜单显示区中提供的菜单项的个数名称、颜色、形状和布置顺序等也可以根据用户输入的配置而被设置。
例如，基于用户输入，为图3B所示GUI500中的内容显示区51配置的菜单项个数为2个，分别是菜单项名称为Uninstall、菜单项图标为红色矩形条的菜单项521，以及菜单项名称为Rename(如执行将某应用程序的名称进行自定义命名)、菜单项图标为黄色矩形条的菜单项523。
此时如图3H所示，菜单项521和523可以按照图3B所示显示位置进行正常显示，而菜单项522和524可以按照图3B所示显示位置与菜单项521和523进行区分显示，如菜单项522和524的菜单项名称和菜单项图标均置为灰色、菜单项522和524的菜单项图标显示而菜单项名称不显示、或者菜单项522和524菜单项名称和菜单项图标均不显示，从而向用户提示当前菜单显示区仅提供菜单项521和523，而不提供菜单项522和524。
一些实施例中，如图5A-5E所示，显示设备可以基于用户输入修改自身的设置语言，从而改变显示设备提供的图像内容和/或执行图像内容所需功能的菜单项对应的语言，以满足不同用户对语言的习惯需求。
具体的，在图3A中，当用户按压控制装置上的向下方向键，如图5A所示，显示设备响应于输入的向下方向指令而控制选择器43指示第二展示区42内Settings 421被选择。当用户继续按压控制装置上的确认键，如图5B所示，显示设备响应于输入的激活Settings 421的指令，显示与Settings 421相关联的GUI600，该GUI600中包括菜单页面61，菜单页面61中提供诸如Picture、Sound、System、Channel、Network、Support的项目611～616。其中，当前选择器43指示System613被选择，且System613提供其对应的子菜单，例如项目6131～6136，分别为Time、TimeSettings、SystemPIN、Language and Location、AdvancedSettings、Bluetooth。
在图5B中，当用户多次按压控制装置上的方向键，如图5C所示，显示设备可以响应于输入的方向指令而控制选择器43指示Language and  location6134被选择。当用户继续按压控制装置上的确认键，如图5D所示，显示设备响应于输入的激活Language and location6134的指令，显示与Language and location6134对应的子菜单，例如项目6134-1～6134-2，分别为Language、Location。
在图5D中，当用户按压控制装置上的确认键，如图5E所示，显示设备可以响应于输入的激活Language6134-1的指令，显示与Language 6134-1对应的子菜单，例如English、Chinese、Portuguese、Russian、French等。当用户继续按压控制装置上的确认键时，显示设备可以响应于输入的激活Portuguese的指令，将显示设备的当前系统语言由英语修改为葡萄牙语。
接着，当用户连续按压控制装置上的返回键，显示设备可以响应于输入的退出Settings 421的指令，显示如图6A所示的GUI400，其中GUI400提供的显示设备的首页中的图像内容对应的语言切换为葡萄牙语。例如，项目411显示为
Figure PCTCN2020075606-appb-000001
(apps)，项目421显示为
Figure PCTCN2020075606-appb-000002
(settings)。
在图6A中，当用户按压控制装置上的确认键，如图6B所示，显示设备响应于输入的激活
Figure PCTCN2020075606-appb-000003
(Apps)411的指令，显示与
Figure PCTCN2020075606-appb-000004
(Apps)411相关联的GUI500。其中，该GUI500提供的内容显示区51和菜单显示区52的内容对应的语言均切换为葡萄牙语。例如，菜单显示区52内，菜单项521～524对应的菜单项名称分别显示为Desinstalar、Adicionarà página Principal、Removerda página Principal、Ordenar。
由图3B和图6B可知，菜单显示区内，由于英语和葡萄牙语在表示相同菜单项名称时对应的文本宽度不同，而菜单项图标的显示位置固定不变、菜单项名称按照与菜单项图标左对齐的方式排布，所以导致菜单显示区内各菜单项显示混乱，影响用户观感体验。例如图3B所示：菜单项523的菜单项名称若完整显示，则超出自身菜单项图标很大部分，因而采取省略部分文本的显示方式。又如图6B所示：菜单项523的菜单项名称若完整显示，则超出自身菜单项图标很大部分、甚至延伸至菜单项524的菜单项图标处，且菜单项523的菜 单项名称与菜单项524的菜单项名称相互重叠，给用户造成不便。
图7A-7D分别示例性示出了本申请实施例中显示设备200提供的GUI700或GUI800的示意图。
在图7A中，显示与图3A所示GUI400中Apps 411相关联的GUI700。其中，该GUI700包括提供多个已安装应用程序信息的内容显示区71和用于执行该多个已安装应用程序信息所需功能的至少一个菜单项的菜单显示区72。
其中，内容显示区71中提供多个已安装应用程序，例如NETFLIX、YouTube、4KNOW等，以供用户进行访问。菜单显示区72中根据缺省配置而提供用于对内容显示区71中多个已安装应用程序执行相关功能的三个菜单项，例如Sort721(如执行将内容显示区71中的多个已安装应用程序按照安装名称或安装时间进行排序)、Add to home722(如执行将某应用程序从GUI700添加到GUI400中的第一展示区(即显示设备的首页))、Uninstall723(如执行将某应用程序从显示设备中卸载)，以供用户输入执行多个应用程序所需功能的操作意图。
这里，菜单显示区72中的菜单项仍然以菜单项名称和菜单项图标来表示。
此外，一个菜单项中，菜单项图标与菜单项名称左右排布，例如图7A所示，菜单项721中的菜单项名称Sort与菜单项图标蓝色矩形条呈水平方向的左右排布，菜单项722中的菜单项名称Add to home与菜单项图标绿色矩形条呈水平方向的左右排布，菜单项723中的菜单项名称Uninstall与菜单项图标红色矩形条呈水平方向的左右排布。而各个菜单项之间按照从菜单显示区内一边界至另一边界的方向排布。例如图7A所示，菜单项721～723在菜单显示区72内按照从右至左方向排列成一行。
此外，菜单显示区中，根据为内容显示区内已安装应用程序配置的实际菜单项以及为这些菜单项计算的实际位置，来显示菜单项。
例如图7A所示，为已安装应用程序根据缺省配置了执行其相关功能的3个菜单项721～723，同时，为保证各菜单项中菜单项名称完整显示、菜单项名 称不超出自身菜单项图标部分、以及各菜单项之间不彼此重叠，这3个菜单项按照在菜单显示区72中从右至左方向排列确定的实际布局位置来显示；而非图3G所示未配置的菜单项中菜单项图标显示而菜单项名称不显示、配置的菜单项仍然按照预设的固定位置和排布方式显示，也非图3H所示未配置的菜单项不显示、配置的菜单项仍然按照预设的固定位置和排布方式显示。
一些实施例中，当显示设备基于用户输入执行如图5A-5E所示的操作过程，将自身的系统语言由英语修改为葡萄牙语后，显示设备可以再次基于用户输入的激活
Figure PCTCN2020075606-appb-000005
(Apps)411的指令，如图7B所示，显示与
Figure PCTCN2020075606-appb-000006
(Apps)411相关联的GUI700。其中，该GUI700提供的内容显示区71和菜单显示区72的内容对应的语言均切换为葡萄牙语。例如，菜单显示区72内，从右至左排列的菜单项721～723对应的菜单项名称分别显示为Ordenar、Adicionarà página Principal、Desinstalar。
由图7A和图7B可知，由于英语和葡萄牙语在表示相同菜单项名称时对应的文本宽度不同，所以菜单项721～723在菜单显示区72内的显示位置在英语系统语言和葡萄牙语系统语言下不同。例如，由于葡萄牙语比英语表示菜单项722的菜单项名称时对应的文本宽度大，导致葡萄牙语比英语下菜单项722占用的菜单显示区72内的实际宽度大，进一步导致菜单项722在菜单显示区72内的显示位置在两种系统语言下不相同。
因而在图7B中，显示设备将自身的系统语言由英语修改为葡萄牙语后，显示设备重新为已安装应用程序配置的3个菜单项计算在菜单显示区的实际位置，进而在计算出的实际位置处显示各菜单项。这样，能够保证各菜单项中菜单项名称完整显示、菜单项名称不超出自身菜单项图标部分、以及各菜单项之间不彼此重叠。
另一些实施例中，当显示设备基于用户输入执行如图5A-5E所示的操作过程，将自身的系统语言由英语修改为汉语后，显示设备可以再次基于用户输入的激活应用程序(Apps)411的指令，如图7C所示，显示与应用程序(Apps) 411相关联的GUI700。其中，该GUI700提供的内容显示区71和菜单显示区72的内容对应的语言均切换为汉语。例如，菜单显示区72内，从右至左排列的菜单项721～723对应的菜单项名称分别显示为排序、添加到首页、卸载。
由图7A和图7C可知，由于英语和汉语在表示相同菜单项名称时对应的文本宽度不同，所以菜单项721～723在菜单显示区72内的显示位置在英语系统语言和汉语系统语言下不同。例如，由于英语比汉语表示菜单项723的菜单项名称时对应的文本宽度大，导致英语比汉语下菜单项723占用的菜单显示区72内的实际宽度大，进一步导致菜单项723在菜单显示区72内的显示位置在两种系统语言下不相同。
因而在图7C中，显示设备将自身的系统语言由英语修改为汉语后，显示设备重新为已安装应用程序配置的3个菜单项计算在菜单显示区的实际位置，进而在计算出的实际位置处显示各菜单项。这样，能够保证各菜单项中菜单项名称完整显示、菜单项名称不超出自身菜单项图标部分、以及各菜单项之间不彼此重叠。
在图7A-7C所示的菜单显示区内，各个菜单项的布局位置并不如图3B和6B中所示那样——菜单项图标按照固定显示位置、菜单项名称按照与菜单项图标左对齐的方式排布进行显示，而是根据当前系统语言(如英语、葡萄牙语、汉语)下菜单项名称对应的文本宽度、以及预先设置的菜单项图标的宽度，并按照从右至左方向确定各个菜单项的布局位置的，这样，能够避免菜单项名称对应的文本宽度过宽时，超过自身菜单项图标区域很大部分或省略部分文本，从而使得各菜单项之间保持距离而不彼此重叠、且完整显示。
此外，上述实施例中仅示例性示出了图3A所示中显示设备的首页中Apps411提供的多个已安装应用程序信息和用于执行该多个已安装应用程序信息所需功能的菜单项，但是本实施例中不限于此。
例如，图7D中示出了与图3A所示中Inputs412相关联的GUI800。其中，该GUI800包括提供多个与外部设备连接的输入接口的内容显示区81和用于执 行该多个输入接口所需功能的至少一个菜单项的菜单显示区82。
这里，内容显示区81中提供多个与外部设备连接的输入接口，例如HDMI、USB、AV等，以供用户访问相应外部设备提供的服务内容。菜单显示区82中提供用于对内容显示区81中多个输入接口执行相关功能的两个菜单项，例如Rename821(如执行将某输入接口的名称进行自定义命名)、Add to home822(如执行将某输入接口从GUI800添加到GUI400中的第一展示区(即显示设备的首页))，以供用户输入执行多个输入接口所需功能的操作意图。
同时，显示设备根据当前系统语言-英语下菜单项名称对应的文本宽度、以及预先设置的菜单项图标的宽度，并按照从右至左方向计算菜单项821～822在菜单显示区82内的布局位置，以在计算出的布局位置上分别显示菜单项821～822，从而保证各菜单项中菜单项名称完整显示、以及各菜单项之间不彼此重叠。
图8A-8B中示例性示出了本申请实施例的显示设备中提供的执行图像内容所需功能的菜单项的图形用户界面的方法流程图。
结合图1C和图8A-8B来说，该方法包括如下步骤：
步骤S81：通过用户接口接收用户操作控制装置而输入的指示显示图像内容的控制指令。例如，用户接口可以接收用户通过按压控制装置上的确认键，输入的与该确认键对应的激活图3A中Apps411的指令。
步骤S82：通过控制器执行：在显示器上显示GUI。具体为：
在显示器的内容显示区显示图像内容；以及，基于显示设备的设置语言，计算为该图像内容配置且用于执行该图像内容所需功能的至少一个菜单项在显示器的菜单显示区的实际位置，并基于计算出的实际位置显示至少一个菜单项。
例如，在图3A中，当用户按压控制装置上的确认键，显示设备可以响应于与该确认键对应的激活Apps411的指令，如图7A所示的GUI700中，在内容显示区71内显示诸如NETFLIX、YouTube、4KNOW等多个已安装应用程 序信息；以及，在菜单显示区72内，根据当前系统语言-英语来确定诸如Uninstall、Add to home、Sort等用于执行多个已安装应用程序信息所需功能的菜单项721～723的布局位置，并在确定出的布局位置处显示各菜单项。
步骤S83：通过用户接口接收用户操作控制装置而输入的指示修改显示设备的设置语言的控制指令。例如，用户接口可以接收用户通过按压控制装置上的方向键和确认键，输入的执行图5A-5E所示修改系统语言的指令。
步骤S84：通过控制器还执行：修改显示设备的设置语言为其他语言。例如，显示设备执行图5A-5E所示的操作后，将自身的系统语言由英语修改为葡萄牙语。
步骤S85：通过用户接口再次接收用户操作控制装置而输入的指示显示图像内容的控制指令。例如，用户接口可以再次接收用户通过按压控制装置上的确认键，输入的与该确认键对应的激活图3A中Apps411的指令。
步骤S86：通过控制器还执行：在显示器上显示GUI。具体为：
在显示器的内容显示区显示图像内容；以及，基于修改后显示设备的设置语言，计算为该图像内容配置且用于执行该图像内容所需功能的至少一个菜单项在显示器的菜单显示区的实际位置，并基于计算出的实际位置显示至少一个菜单项。
例如，显示设备可以基于用户输入执行如图5A-5E所示的操作过程，将自身的系统语言由英语修改为葡萄牙语。之后，在图6A中，显示设备可以再次基于用户输入的激活
Figure PCTCN2020075606-appb-000007
(Apps)411的指令，如图7B所示，在内容显示区71内显示多个已安装应用程序信息；以及，在菜单显示区72内，根据当前系统语言-葡萄牙语来重新确定执行多个已安装应用程序所需功能的菜单项721～723的布局位置，并在确定出的布局位置处显示各菜单项。其中，内容显示区71和菜单显示区72的内容对应的语言均切换为葡萄牙语。
图9示例性示出了计算各个菜单项在菜单显示区内实际布局位置的方法示意图。
下面对图9所示和下文的相关字母代表的含义进行说明。这里，下述各值的尺寸单位为rem，具体可以设置1rem＝30px。其中，px表示像素单位，其相对于显示器的屏幕分辨率而言。
W0表示菜单显示区内最右侧的菜单项与菜单显示区最右侧之间的间隙；其中，W0预设为1.6。
W1表示各个菜单项内菜单项名称与菜单项图标之间的间隙；其中，W1预设为0.4。这里，不同菜单项内菜单项名称与菜单项图标之间的间隙均相同。
W2表示各个菜单项中相邻两个菜单项之间的间隙；其中，W2预设为0.8。这里，相邻菜单项之间的间隙均相同。
A i表示各个菜单项中菜单项名称对应的文本宽度；其中，i＝1、2、3。这里，显示设备可以通过调用JavaScript属性中clientWidth方法，获取当前系统语言下，菜单项名称对应的字符串在网页中的实际占用宽度。
B表示各个菜单项中菜单项图标的宽度；其中，B预设为1.2。这里，不同菜单项中菜单项图标的宽度均相同。
L i表示各个菜单项在菜单显示区的实际占用宽度；其中，i＝1、2、3。这里，L i＝A i+B+W1。
S i表示各个菜单项在菜单显示区的实际显示位置。
需要说明的是，上述W0、W1、W2、B的具体大小均可以根据实际需求而设置。此外，不同菜单项内菜单项名称与菜单项图标之间的间隙可以不相同，不同菜单项中菜单项图标的宽度可以不相同，不同菜单项中相邻菜单项之间的间隙可以不相同。
如图9所示，示出了图7A所示GUI中的菜单显示区72。首先，获取到用于为内容显示区71内多个已安装应用程序执行相关功能的菜单项721～723，其中菜单项721～723以菜单项名称和菜单项图标表示。然后，根据显示设备当前系统语言，以及按照菜单显示区72内从右至左的排列方向，依次计算菜单项721～723中相应菜单项名称和菜单项图标的实际布局位置。最后，在计算出的 实际布局位置上显示菜单项721～723。
结合图9来说，确定菜单显示区内右侧的第一个菜单项721的显示位置，具体如下：
首先，通过调用JavaScript属性中clientWidth方法，获取当前系统语言-英语下，菜单项名称Sort对应的字符串在网页中的实际占用宽度为A 1＝1.0，以及W0＝1.6，那么菜单项名称Sort在菜单显示区的实际位置S 1A为：距离菜单显示区最右侧的间隙为1.6(W0)～2.6(W0+A 1)的位置处。接着，由于W1＝0.4、B＝1.2，那么菜单项图标蓝色矩形条在菜单显示区的实际位置S 1B为：距离菜单显示区最右侧的间隙为3.0(2.6+W1)～4.2(3.0+B)的位置处。换句话说，菜单项721在菜单显示区的实际位置S 1为：距离菜单显示区最右侧的间隙为1.6(W0)～4.2(W0+L 1)的位置处。
结合图9来说，确定菜单显示区内右侧的第二个菜单项722的显示位置，具体如下：
首先，通过调用JavaScript属性中clientWidth方法，获取当前系统语言-英语下，菜单项名称Add to home对应的字符串在网页中的实际占用宽度为A 2＝2.6，以及W2＝0.8，那么菜单项名称Add to home在菜单显示区的实际位置S 2A为：距离菜单显示区最右侧的间隙为5.0(4.2+W2)～7.6(5.0+A 2)的位置处。接着，由于W1＝0.4、B＝1.2，那么菜单项图标绿色矩形条在菜单显示区的实际位置S 2B为：距离菜单显示区最右侧的间隙为8.0(7.6+W1)～9.2(8.0+B)的位置处。换句话说，菜单项722在菜单显示区的实际位置S 2为：距离菜单显示区最右侧的间隙为5.0(W0+L 1+W2)～9.2(W0+L 1+W2+L 2)的位置处。
结合图9来说，确定菜单显示区内右侧的第三个菜单项723的显示位置，具体如下：
首先，通过调用JavaScript属性中clientWidth方法，获取当前系统语言-英语下，菜单项名称Uninstall对应的字符串在网页中的实际占用宽度为A 3＝2.1，以及W2＝0.8，那么菜单项名称Uninstall在菜单显示区的实际位置S 3A为：距 离菜单显示区最右侧的间隙为10.0(9.2+W2)～12.1(10.0+A 3)的位置处。接着，由于W1＝0.4、B＝1.2，那么菜单项图标红色矩形条在菜单显示区的实际位置S 3B为：距离菜单显示区最右侧的间隙为12.5(12.1+W1)～13.7(12.5+B)的位置处。换句话说，菜单项723在菜单显示区的实际位置S 3为：距离菜单显示区最右侧的间隙为10.0(W0+L 1+2*W2+L 2)～13.7(W0+L 1+2*W2+L 2+L 3)的位置处。
在确定菜单显示区内各菜单项分别对应的菜单项名称和菜单项图标的实际布局位置后，基于确定出的实际布局位置显示各个菜单项的菜单项名称和菜单项图标。
此外，还需说明的是，上述实施例中仅以菜单显示区内各菜单项按水平方向(横向)排列的情况，来说明菜单项布局位置的计算方法，同理，本实施例中菜单项布局位置的计算方法同样适用于菜单显示区内各菜单项按垂直方向(纵向)排列的情况。
在一些实施例中，菜单显示区72中的各菜单项721～723的显示位置可以通过如下的方式确定：
Figure PCTCN2020075606-appb-000008
Figure PCTCN2020075606-appb-000009
上述算法中，“ColorButton”可以表征菜单显示区72，“hotKeyImg”可以表征菜单项721～723中各菜单项图标，“hotKeyName”可以表征菜单项721～723中各菜单项名称，“rightHotKeys”可以表征当前确定显示位置的菜单项右侧的各菜单项，“nameLength”可以表征上个菜单项的总宽度，“lastLength”可以表征当前确定显示位置的菜单项之前所有的菜单项的总宽度。
此外，可以采用如下算法，对“nameLength”和“lastLength”进行计算。
首先在data中声明rightHotkeys的数据内容，设置nameLength和lastLength初始值为0：
Figure PCTCN2020075606-appb-000010
Figure PCTCN2020075606-appb-000011
然后再在mounted时，遍历rightHotKeys中的每个item，对于nameLength和lastLength这两个变量进行计算：
Figure PCTCN2020075606-appb-000012
如上面实施例所述，显示设备可以根据当前系统语言(如英语、葡萄牙语、汉语)下菜单项名称对应的文本宽度、以及预先设置的菜单项图标的宽度，并按照菜单显示区内从一边界至另一边界方向依次确定各个菜单项中菜单项名称和菜单项图标的实际布局位置，这样，能够实现不同系统语言下菜单项布局位置的自适应，使得各菜单项之间保持距离而不彼此重叠、且完整显示。
尽管已描述了本申请的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及
其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (18)

  1. 一种显示设备中呈现图形用户界面方法，其特征在于，包括：
    响应于用户输入的指示显示第一图像内容的第一控制指令，在显示器的内容显示区，显示所述第一图像内容；
    基于显示设备的设置语言，计算为所述第一图像内容配置且用于执行所述第一图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第一布局位置；
    基于计算出的第一布局位置显示至少一个菜单项。
  2. 根据权利要求1所述的方法，其特征在于，所述至少一个菜单项根据缺省而配置或根据用户设置而配置。
  3. 根据权利要求1所述的方法，其特征在于，所述至少一个菜单项从菜单显示区的一边界开始向另一边界排列，使得菜单项之间保持距离而不彼此重叠。
  4. 根据权利要求1所述的方法，其特征在于，计算至少一个菜单项在菜单显示区的第一布局位置，包括：
    基于显示设备的设置语言，计算至少一个菜单项在菜单显示区占用的宽度；
    基于计算出的宽度以及从菜单显示区的一边界至另一边界的排列方向，确定至少一个菜单项在菜单显示区的第一布局位置。
  5. 根据权利要求4所述的方法，其特征在于，所述菜单项包括菜单项名称和菜单项图标。
  6. 根据权利要求5所述的方法，其特征在于，计算至少一个菜单项在菜单显示区占用的宽度，包括：
    计算菜单项中菜单项名称在显示设备的设置语言下对应的文本宽度；
    获取菜单项中菜单项图标对应的宽度；
    将菜单项名称的宽度和菜单项图标的宽度之和确定为菜单项占用的宽度。
  7. 根据权利要求1所述的方法，其特征在于，还包括：
    响应于用户输入的指示修改显示设备的设置语言的第二控制指令，更新显示设备的设置语言；
    响应于用户输入的指示显示第二图像内容的第三控制指令，在显示器的内容显示区显示所述第二图像内容，其中，所述第二图像内容对应在更新的设置语言中的所述第一图像内容；
    基于更新后显示设备的设置语言，计算为所述第二图像内容配置且用于执行所述第二图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第二布局位置；
    基于计算出的第二布局位置更新所述至少一个菜单项在内容展示区的展示。
  8. 根据权利要求1所述的方法，其特征在于，所述菜单项对应的功能信息与用于将用户输入提供给显示设备的控制装置上的颜色按键信息具有映射关系。
  9. 一种显示设备，其特征在于，包括：
    显示器，用于展示图像；
    控制器，用于执行：
    响应于用户输入的指示显示第一图像内容的第一控制指令，在显示器的内容显示区，显示第一图像内容；基于显示设备的设置语言，计算为所述第一图像内容配置且用于执行所述第一图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第一布局位置；基于计算出的第一布局位置显示至少一个菜单项。
  10. 根据权利要求9所述的显示设备，其特征在于，所述至少一个菜单项根据缺省而配置或根据用户设置而配置。
  11. 根据权利要求9所述的显示设备，其特征在于，所述至少一个菜单项从菜单显示区的一边界开始向另一边界排列，使得菜单项之间保持距离而不彼此重叠。
  12. 根据权利要求9所述的显示设备，其特征在于，所述控制器通过下述执行计算至少一个菜单项在菜单显示区的第一布局位置：
    基于显示设备的设置语言，计算至少一个菜单项在菜单显示区占用的宽度；
    基于计算出的宽度以及从菜单显示区的一边界至另一边界的排列方向，确定至少一个菜单项在菜单显示区的第一布局位置。
  13. 根据权利要求12所述的显示设备，其特征在于，所述菜单项包括菜单项名称和菜单项图标。
  14. 根据权利要求13所述的显示设备，其特征在于，所述控制器通过下述执行计算至少一个菜单项在菜单显示区占用的宽度：
    计算菜单项中菜单项名称在显示设备的设置语言下对应的文本宽度；
    获取菜单项中菜单项图标对应的宽度；
    将菜单项名称的宽度和菜单项图标的宽度之和确定为菜单项占用的实际宽度。
  15. 根据权利要求9所述的显示设备，其特征在于，所述控制器还用于：
    响应于用户输入的指示修改显示设备的设置语言的第二控制指令，更新显示设备的设置语言；
    响应于用户输入的指示显示第二图像内容的第三控制指令，在显示器的内容显示区显示第二图像内容，其中，所述第二图像内容对应在更新的设置语言中的所述第一图像内容；
    基于更新后显示设备的设置语言，计算为所述第二图像内容配置且用于执行所述第二图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第二布局位置；
    基于计算出的第二布局位置更新所述至少一个菜单项在所述内容展示区的展示。
  16. 根据权利要求9所述的显示设备，其特征在于，所述菜单项对应的功能信息与用于将用户输入提供给显示设备的控制装置上的颜色键信息具有映 射关系。
  17. 一种电视，其特征在于，包括：
    遥控器，包括复数个颜色按键；
    显示设备，包括显示器和控制器，其中，
    所述显示器，用于展示图像；
    所述控制器，用于：
    接收所述遥控器发出的指示显示第一图像内容的第一控制指令；
    响应于所述第一控制指令，在显示器的内容显示区显示所述第一图像内容；
    基于显示设备的设置语言，计算为所述第一图像内容配置且用于执行所述第一图像内容所需功能的至少一个菜单项在显示器的菜单显示区的第一布局位置；
    基于计算出的第一布局位置显示至少一个菜单项。
  18. 根据权利要求17所述的电视，其特征在于，所述至少一个菜单项中的一者配置为能够被所述遥控器的复数个颜色按键中的一者控制。
PCT/CN2020/075606 2019-04-11 2020-02-17 一种提供菜单项的图形用户界面方法及显示设备 WO2020207115A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/822,756 US11343583B2 (en) 2019-04-11 2020-03-18 Method for displaying GUI for providing menu items and display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910290320.8A CN110012340A (zh) 2019-04-11 2019-04-11 一种提供菜单项的图形用户界面方法及显示设备
CN201910290320.8 2019-04-11

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/822,756 Continuation US11343583B2 (en) 2019-04-11 2020-03-18 Method for displaying GUI for providing menu items and display device

Publications (1)

Publication Number Publication Date
WO2020207115A1 true WO2020207115A1 (zh) 2020-10-15

Family

ID=67171294

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/075606 WO2020207115A1 (zh) 2019-04-11 2020-02-17 一种提供菜单项的图形用户界面方法及显示设备

Country Status (2)

Country Link
CN (1) CN110012340A (zh)
WO (1) WO2020207115A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11343583B2 (en) 2019-04-11 2022-05-24 Hisense Visual Technology Co., Ltd. Method for displaying GUI for providing menu items and display device
CN110012340A (zh) * 2019-04-11 2019-07-12 青岛海信电器股份有限公司 一种提供菜单项的图形用户界面方法及显示设备
CN111294633B (zh) 2019-12-03 2021-11-23 海信视像科技股份有限公司 一种epg用户界面的展示方法及显示设备
CN111131871B (zh) * 2019-12-03 2021-03-19 海信视像科技股份有限公司 一种播放节目时显示epg用户界面的方法及显示设备
CN112969084A (zh) * 2019-12-12 2021-06-15 青岛海信传媒网络技术有限公司 一种用户界面展示方法、存储介质及显示设备
CN113747214A (zh) * 2020-05-28 2021-12-03 海信视像科技股份有限公司 一种显示设备及触控菜单交互方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5671378A (en) * 1995-03-31 1997-09-23 International Business Machines Corporation Method and system for sizing of graphical user interface objects for localization
CN101042643A (zh) * 2006-03-24 2007-09-26 国际商业机器公司 在本地化过程中调整图形用户界面布局的方法及装置
CN101114225A (zh) * 2007-08-28 2008-01-30 中国科学院软件研究所 一种图形用户界面的多语言自适应方法
CN102196210A (zh) * 2011-05-24 2011-09-21 冠捷显示科技（厦门）有限公司 广播电视机菜单显示的方法
CN108616778A (zh) * 2018-04-24 2018-10-02 深圳Tcl数字技术有限公司 菜单布局的控制方法、电视机及存储介质
CN110012340A (zh) * 2019-04-11 2019-07-12 青岛海信电器股份有限公司 一种提供菜单项的图形用户界面方法及显示设备

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4142175B2 (ja) * 1998-10-20 2008-08-27 松下電器産業株式会社 グラフィカルユーザインタフェース装置
US20120227000A1 (en) * 2011-03-03 2012-09-06 Sony Network Entertainment International Llc Methods and systems for use in providing customized system menus
CN102207870B (zh) * 2011-06-08 2014-04-23 广东威创视讯科技股份有限公司 多语言版本的软件界面自适应方法及系统
US9547479B2 (en) * 2015-03-30 2017-01-17 Keysight Technologies, Inc. Method for adapting GUI-based instrument components in a visual programming language
CN105159868A (zh) * 2015-09-01 2015-12-16 广东欧珀移动通信有限公司 文本显示方法和系统
CN106095374A (zh) * 2016-06-23 2016-11-09 Tcl集团股份有限公司 一种文字大小自适应各国语言显示的方法及系统
CN106598562A (zh) * 2016-10-14 2017-04-26 珠海格力电器股份有限公司 多语言界面的控件自适应方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5671378A (en) * 1995-03-31 1997-09-23 International Business Machines Corporation Method and system for sizing of graphical user interface objects for localization
CN101042643A (zh) * 2006-03-24 2007-09-26 国际商业机器公司 在本地化过程中调整图形用户界面布局的方法及装置
CN101114225A (zh) * 2007-08-28 2008-01-30 中国科学院软件研究所 一种图形用户界面的多语言自适应方法
CN102196210A (zh) * 2011-05-24 2011-09-21 冠捷显示科技（厦门）有限公司 广播电视机菜单显示的方法
CN108616778A (zh) * 2018-04-24 2018-10-02 深圳Tcl数字技术有限公司 菜单布局的控制方法、电视机及存储介质
CN110012340A (zh) * 2019-04-11 2019-07-12 青岛海信电器股份有限公司 一种提供菜单项的图形用户界面方法及显示设备

Also Published As

Publication number Publication date
CN110012340A (zh) 2019-07-12

Similar Documents

Publication Publication Date Title
WO2021114560A1 (zh) 一种提示语显示方法及显示设备
WO2020207115A1 (zh) 一种提供菜单项的图形用户界面方法及显示设备
WO2021147299A1 (zh) 一种内容显示方法及显示设备
CN111182345B (zh) 一种控件的显示方法及显示设备
WO2021232506A1 (zh) 图像质量调节方法及显示设备
WO2021134998A1 (zh) 功能设定方法及显示设备
CN111045557A (zh) 焦点对象的移动方法及显示设备
CN111901653B (zh) 一种显示设备外接音响的配置方法及显示设备
CN111479155A (zh) 显示设备及用户界面显示方法
CN111669634A (zh) 一种视频文件预览方法及显示设备
CN111246309A (zh) 在显示设备中显示频道列表的方法及显示设备
US12022146B2 (en) User interface display method and device
CN112004126A (zh) 搜索结果显示方法及显示设备
CN111857502A (zh) 一种图像显示方法及显示设备
WO2021232914A1 (zh) 一种显示方法及显示设备
WO2021212667A1 (zh) 一种多媒资数据显示方法及显示设备
CN109922364A (zh) 一种显示设备
CN113115092B (zh) 一种显示设备及详情页展示方法
CN111857363A (zh) 一种输入法交互方法及显示设备
CN112040308A (zh) 一种hdmi通道切换方法及显示设备
CN111614995A (zh) 一种菜单显示方法及显示设备
CN111757154A (zh) 一种遥控器控制网页光标的方法及显示设备
WO2021109411A1 (zh) 文本类型转换方法及显示设备
CN111596771A (zh) 显示设备和输入法中选择器的移动方法
CN111459372A (zh) 一种网络列表刷新显示方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20787675

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20787675

Country of ref document: EP

Kind code of ref document: A1