WO2021196432A1 - Procédé d'affichage et dispositif d'affichage pour un contenu correspondant à une commande - Google Patents

Procédé d'affichage et dispositif d'affichage pour un contenu correspondant à une commande Download PDF

Info

Publication number
WO2021196432A1
WO2021196432A1 PCT/CN2020/098868 CN2020098868W WO2021196432A1 WO 2021196432 A1 WO2021196432 A1 WO 2021196432A1 CN 2020098868 W CN2020098868 W CN 2020098868W WO 2021196432 A1 WO2021196432 A1 WO 2021196432A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
display
selector
interface
user interaction
Prior art date
Application number
PCT/CN2020/098868
Other languages
English (en)
Chinese (zh)
Inventor
孙鲁兵
王珺
张哲铭
Original Assignee
聚好看科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 聚好看科技股份有限公司 filed Critical 聚好看科技股份有限公司
Publication of WO2021196432A1 publication Critical patent/WO2021196432A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Definitions

  • This application relates to the field of software technology, and in particular to a method and display device for displaying content corresponding to a control.
  • the first aspect of the embodiments of the present application shows a display device, including: a display for displaying a user interaction interface, the user interaction interface is provided with a first control and a selector, the position of the selector can be responsive to the user The input moves between different controls;
  • the controller is configured to: in response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the The first content corresponding to the first control; in response to the selector staying on the first control for a duration less than the first preset duration, and receiving an input confirmation operation instruction, control the display from the The user interaction interface jumps to the first interface corresponding to the first control.
  • the second aspect of the embodiments of the present application shows that another display device includes: a display for displaying a user interaction interface, the user interaction interface is located on the first layer, the user interaction interface is provided with a first control and and A selector, the position of the selector can be moved between different controls in response to user input;
  • the controller is configured to: in response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the first layer to display the The first content corresponding to the first control; in response to the selector staying on the first control for a duration shorter than the first preset duration, and receiving an input confirmation operation instruction, control the display to interact with the user The interface jumps to the first interface corresponding to the first control, and the first interface is displayed on the first layer.
  • the third aspect of the embodiments of the present application shows a display device, including: a display, configured to display a first user interaction interface, the first user interaction interface is provided with a first control, a second control, and a selector, the The position of the selector can be moved between the first control and the second control in response to the user's input;
  • the controller is configured to: in response to the selector moving from the second control to the first control, and staying on the first control for a period of time greater than a first preset period of time, controlling the display to Creating a floating layer above the first user interaction interface to display the first content corresponding to the first control; in response to the selector moving from the first control to the second control, and in the selection When the duration of the device staying on the second control is greater than or equal to the first preset duration, the controller does not create a floating layer above the first user interaction interface.
  • the fourth aspect of the embodiments of the present application shows a method for displaying content corresponding to a control, including:
  • control the display in response to the time the selector stays on the first control is greater than or equal to the first preset time, control the display to create a hover over the user interaction interface Layer to display the first content corresponding to the first control; in response to the selector staying on the first control for a duration less than the first preset duration, and receiving an input confirmation operation instruction, control all The display jumps from the user interaction interface to the first interface corresponding to the first control.
  • Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment
  • FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the embodiment
  • Fig. 3 exemplarily shows a block diagram of the hardware configuration of the control device 100 according to the embodiment
  • FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to the embodiment
  • FIG. 5a exemplarily shows a schematic diagram of the software configuration in the display device 200 according to the embodiment
  • FIG. 5b exemplarily shows a schematic diagram of the configuration of the application program in the display device 200 according to the embodiment
  • FIG. 6 exemplarily shows a schematic diagram of a user interface in the display device 200 according to the embodiment
  • FIG. 7 exemplarily shows a user interaction interface according to the embodiment
  • FIG. 8 exemplarily shows still another user interaction interface according to the embodiment
  • Fig. 9 exemplarily shows yet another user interaction interface according to the embodiment.
  • FIG. 10A exemplarily shows still another user interaction interface according to the embodiment
  • FIG. 10B exemplarily shows still another user interaction interface according to the embodiment
  • Fig. 11 exemplarily shows a flowchart of a method for displaying content corresponding to a control according to an embodiment.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.
  • remote control refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance.
  • infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect to electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors.
  • RF radio frequency
  • a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.
  • gesture used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
  • Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.
  • control device 100 may be a remote control 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 through wireless or other wired methods.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc.
  • the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.
  • the control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • a smart device such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • an application program running on a smart device is used to control the display device 200.
  • the application can provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication.
  • the mobile terminal 100B can establish a control instruction protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 100B.
  • the audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.
  • the display device 200 also performs data communication with the server 300 through multiple communication methods.
  • the display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 300 may provide various contents and interactions to the display device 200.
  • the display device 200 can receive software program updates or access a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG).
  • EPG electronic program guide
  • the server 300 may be a group or multiple groups, and may be one or more types of servers.
  • the server 300 provides other network service contents such as video-on-demand and advertising services.
  • the display device 200 may be a liquid crystal display, an OLED display, or a projection display device.
  • the specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
  • the display device 200 may additionally provide a smart network TV function with a computer support function. Examples include Internet TV, display devices, Internet Protocol Television (IPTV), and so on.
  • IPTV Internet Protocol Television
  • FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to an exemplary embodiment.
  • the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio Processor 260-2, display 280, audio output interface 272, power supply.
  • the tuner and demodulator 220 receives broadcast and TV signals through wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the TV channel selected by the user from multiple wireless or cable broadcast and TV signals
  • modulation and demodulation processing such as amplification, mixing and resonance
  • the audio and video signals carried in the frequency, and additional information (such as EPG data signals).
  • the tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.
  • the tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.
  • TV signal broadcasting systems such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting
  • Analog modulation method and according to different types of received TV signals, analog signals and digital signals can be demodulated.
  • the tuner and demodulator 220 may also be in an external device, such as an external set-top box.
  • the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the external device interface 250.
  • the communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.
  • the display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230.
  • the communicator may receive the control signal of the remote controller 100 according to the control of the controller.
  • the detector 240 is a component used by the display device 200 to collect signals from the external environment or interact with the outside.
  • the detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect attributes of users or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.
  • the detector 240 may further include a temperature sensor.
  • the display device 200 may adaptively adjust the display color temperature of the image. In some embodiments, when the temperature is relatively high, the display device 200 can be adjusted to display a colder image color temperature; when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color temperature of the image.
  • the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.
  • a sound collector such as a microphone
  • the external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices.
  • the external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
  • the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • USB universal serial bus
  • RGB red, green, and blue
  • the controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.
  • various software control programs such as an operating system and various application programs
  • the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus.
  • the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a bus.
  • the graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display 280.
  • the CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.
  • the CPU processor 212 may include multiple processors.
  • the multiple processors may include a main processor and multiple or one sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode.
  • Multiple or one sub-processor used to perform an operation in the standby mode and other states.
  • the communication interface may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
  • the controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.
  • the object may be any one of the selectable objects, such as a hyperlink or an icon.
  • Operations related to the selected object for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon.
  • the user command for selecting the UI object may be a command input through various input devices (e.g., mouse, keyboard, touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 290 includes storing various software modules used to drive and control the display device 200.
  • various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion, analysis and management.
  • the voice recognition module includes a voice parsing module and a voice command database module.
  • the display control module is a module for controlling the display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces.
  • the communication module is a module used for control and data communication with external devices.
  • the browser module is a module used to perform data communication between browsing servers.
  • the service module is a module used to provide various services and various applications.
  • the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of selector objects, and the like.
  • the user input interface is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user.
  • the control device (such as a mobile terminal or remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then the user input interface forwards the input signal to the control.
  • the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal displayed or played directly on the display 280.
  • the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to the user input or itself, so as to generate an image signal for display.
  • the frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be the same as the source
  • the video stream is related, and the output frame rate can be related to the update rate of the display.
  • the input has the usual format, such as the frame insertion method.
  • the display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.
  • the display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images and a menu control interface.
  • the display 280 includes a display component for presenting a picture and a driving component for driving image display.
  • the displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the interface of an external device.
  • the display 220 simultaneously displays a user manipulation interface UI generated in the display device 200 and used for controlling the display device 200.
  • the display 280 it also includes a driving component for driving the display.
  • the display 280 is a projection display, it may also include a projection device and a projection screen.
  • the audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.
  • the audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210.
  • the audio output interface may include a speaker 272 or output to an external audio output terminal 274 of the generator of an external device, such as : External audio terminal or headphone output terminal, etc.
  • the video processor 260-1 may include one or more chips.
  • the audio processor 260-2 may also include one or more chips.
  • the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the controller 210 in one or more chips.
  • the power supply is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210.
  • the power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface that provides an external power supply in the display device 200.
  • Fig. 3 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment.
  • the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.
  • the control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and play an intermediary role in the interaction between the user and the display device 200.
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.
  • control device 100 may be a smart device.
  • control device 100 can install various applications for controlling the display device 200 according to user requirements.
  • the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing an application for controlling the display device 200.
  • the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 100B or other smart electronic devices by installing applications to realize the function of the physical keys of the control device 100.
  • the controller 110 includes a processor 112, a RAM 113 and a ROM 114, a communication interface, and a communication bus.
  • the controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.
  • the communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the received user input signal is sent to the display device 200.
  • the communicator 130 may include at least one of communication modules such as a WIFI module 131, a Bluetooth module 132, and an NFC module 133.
  • the user input/output interface 140 wherein the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144.
  • input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144.
  • the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions.
  • the input interface converts the received analog signal into a digital signal and the digital signal into a corresponding instruction signal, and sends it to the display device 200.
  • the output interface includes an interface for sending the received user instruction to the display device 200.
  • it may be an infrared interface or a radio frequency interface.
  • the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and then sent to the display device 200 via the infrared sending module.
  • a radio frequency signal interface a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.
  • control device 100 includes at least one of a communicator 130 and an output interface.
  • the control device 100 is configured with a communicator 130, such as: WIFI, Bluetooth, NFC and other modules, which can encode user input commands through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.
  • a communicator 130 such as: WIFI, Bluetooth, NFC and other modules, which can encode user input commands through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.
  • the memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110.
  • the memory 190 can store various control signal instructions input by the user.
  • the power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. Can battery and related control circuit.
  • FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment.
  • the memory 290 is used to store an operating system, application programs, content, user data, etc., and executes the system operation of driving the display device 200 and responds to various operations of the user under the control of the controller 210.
  • the memory 290 may include volatile and/or non-volatile memory.
  • the memory 290 is specifically used to store the operating program that drives the controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and various application-related programs. Graphical user interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications.
  • the memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.
  • OS operating system
  • the memory 290 is specifically used to store driver programs and related data such as the video processor 260-1 and the audio processor 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, the detector 240, and the input/output interface.
  • the memory 290 may store software and/or programs.
  • the software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs.
  • OS operating system
  • the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or application access Controller to control or manage system resources.
  • the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, and an optical receiver Module 2909, power control module 2910, operating system 2911, and other application programs 2912, browser module, etc.
  • the controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.
  • Fig. 5a exemplarily shows a configuration block diagram of the software system in the display device 200 according to an exemplary embodiment.
  • the operating system 2911 includes operating software for processing various basic system services and for implementing hardware-related tasks, acting as a medium for data processing between application programs and hardware components.
  • part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.
  • part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device.
  • the drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.
  • the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.
  • the communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.
  • the user interface module 2911-3 is used to provide objects that display the user interface for access by various applications, and can realize user operability.
  • the control application 2911-4 is used to control process management, including runtime applications, etc.
  • the event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various events. And implement one or more sets of pre-defined operation procedures.
  • the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
  • the event recognition module 2914-1 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute their corresponding one or more sets of processing procedures .
  • the event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.).
  • an external control device such as the control device 100, etc.
  • various sub-events of voice input such as the voice input
  • gesture input sub-events of gesture recognition such as the gesture input sub-events of gesture recognition
  • sub-events of remote control button command input of control devices such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices.
  • one or more sub-events in the remote control include various forms, including but not limited to one or a combination of pressing up/down/left/right/, the OK key, and pressing the key. And the operations of non-physical buttons, such as moving, pressing, and releasing.
  • the interface layout management module 2913 which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container
  • the size or position, level, etc. of the interface are related to the various execution operations of the interface layout.
  • the application layer 2912 includes various application programs that can be executed on the display device 200.
  • the application program may include, but is not limited to, one or more application programs, such as: live TV application, video-on-demand application, media center application, application center, game application, etc.
  • Live TV applications can provide live TV through different sources.
  • a live TV application may use input from cable TV, wireless broadcasting, satellite services, or other types of live TV services to provide TV signals.
  • the live TV application can display the video of the live TV signal on the display device 200.
  • Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, from the local hard disk storage that contains stored video programs.
  • Media center applications can provide various multimedia content playback applications.
  • the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.
  • Application center can provide storage of various applications.
  • the application program may be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device.
  • the application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.
  • Fig. 6 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment.
  • the user interface includes multiple view display areas, for example, a first view display area 201 and a play screen 202, where the play screen includes layout of one or more different items.
  • the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.
  • different items can be presented by different controls.
  • the selector moves to the position of the control (that is, when the control is selected)
  • the state of the control (such as background color, font, brightness, or size, etc.) will change. Changes have taken place to improve visibility.
  • the interface corresponding to the control is entered.
  • multiple view display areas can present display screens of different levels.
  • the first view display area can present system layer item content (eg, current attributes, etc.)
  • the second view display area can present application layer item content (eg, webpage video, VOD display, application program screen, etc.).
  • the display priorities of the view display areas are different between view display areas with different priorities.
  • the priority of the system layer is higher than the priority of the application layer.
  • the screen display in the view display area of the system layer is not blocked; and the application layer is enabled according to the user's choice.
  • the size and position of the view display area change the size and position of the view display area of the system layer will not be affected.
  • the same level of display screen can also be presented.
  • the selector can switch between the display area of the first view and the display area of the second view, and when the size and position of the display area of the first view change, the second view The size and position of the display area can be changed at any time.
  • the above-mentioned display device is only an implementation solution in some embodiments, and the method of this application can also be applied to other display devices that can implement this method.
  • the user interaction interface of FIG. 7 is provided with multiple controls. In some embodiments, it includes an advertisement control. At this time, the user needs to click into the advertisement control through the control device to view the corresponding content under the advertisement control. As shown in 8, in this process, it can be found that the user views the content corresponding to the control. First, the user needs to select the control and click the button on the control device to view the content corresponding to the control.
  • the display Since the user selects the control through the button on the control device, it indicates that the user is interested in the content corresponding to the control. Therefore, in order to provide the user with a more convenient view of the content corresponding to the control, in some embodiments, the response When the duration of the selector staying on the first control is greater than or equal to the first preset duration, the display is controlled to create a floating layer above the user interaction interface to display the first content corresponding to the first control.
  • the display interface includes a first control (an exemplary vehicle advertising control), and a second control that is different from the first control.
  • the first content of causes the display to display the user interaction interface as shown in FIG. 10A.
  • the media assets corresponding to the first control may only include image content, or may include image and audio content.
  • the first content may be short videos, GIF animations, static pictures, etc., if the first content also corresponds to audio Information, while displaying the first content, control the audio decoder to parse the audio information.
  • the background color of the suspension layer may be transparent, so that the user can still see the interactive interface where the first control is located while watching the first content.
  • the display in order to avoid false triggering, when the duration of the selector staying on the first control is less than the first preset duration, the display is not controlled to display the content corresponding to the control on the floating layer .
  • the display in response to the duration of the selector staying on the first control being less than the first preset duration, and receiving an input confirmation operation instruction, the display is controlled from the user interaction interface Jump to the first interface corresponding to the first control.
  • the display in FIG. 9, after the user moves the selector 400 to the control through the buttons on the control device, the staying time of the selector is monitored, and the staying time of the selector on the first control is less than
  • the display is controlled to display the first interface as shown in FIG. 10B. The user can press the "OK" key on the control device to enter a confirmation operation instruction.
  • the first interface and the interactive interface provided with the first control are also located in the video layer for display. In some embodiments, one of the two interfaces may be displayed on the video layer and the other may be displayed on the floating layer.
  • the displayed content popped up in FIG. 10A is the same as the content displayed on the interface of FIG. 10B.
  • the two can be different in some embodiments.
  • the display of the display content of 10A is exited and the interface shown in FIG. 10B is displayed.
  • the embodiment of the present application shows a display device, including:
  • a display for displaying a user interaction interface the user interaction interface is provided with a first control and a selector, and the position of the selector can be moved between different controls in response to user input;
  • the controller is configured to: in response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the The first content corresponding to the first control.
  • a floating layer is created on the user interaction interface, a window is drawn on the floating layer, and the first content is loaded on the window.
  • the floating layer may be OSD (on-screen display, on-screen menu adjustment mode).
  • the embodiments of the present application may be applied to an advertisement control, and the content corresponding to the advertisement control may be advertisement audio and video.
  • the embodiments of the present application can also be applied to business controls set on the system, such as an album control set in the system.
  • the display In response to the selector staying on the first control for a duration greater than or equal to the first preset duration, the display is controlled to display
  • the content corresponding to the album control, and the content corresponding to the album control may be all pictures in the album. This allows users to browse the album without entering the album.
  • the first control is an album control
  • the time that the selector stays on the album control is detected.
  • the stay time is longer than the preset time, a floating layer is created above the user interaction interface where the album control is located, and the corresponding corresponding to the album control is called Store the content to display the images in the album on the floating layer.
  • the duration monitoring of the control is no longer performed. Avoid the inability to execute the lock screen logic due to repeated triggering of the floating layer to display content.
  • the selector after the user moves the selector, it restarts to detect the length of time the selector stays on the control.
  • the display in response to the time period during which the first control is selected is less than the first preset time period, the display is controlled not to create a floating layer above the user interaction interface. Avoid the user from constantly adjusting the floating layer to display the corresponding content during the browsing of the control.
  • the display in response to the duration of the selector staying on the first control being less than the first preset duration, and receiving an input confirmation operation instruction, the display is controlled from the user interaction interface Jump to the first interface corresponding to the first control.
  • the confirmation operation instruction after receiving the confirmation operation instruction from the remote control, if the first content is not displayed on the floating layer at this time, the confirmation operation instruction is not responded, and if the first content is not displayed on the floating layer at this time, then confirm The duration of the selector staying on the current control. If the duration is less than the preset duration, the corresponding first interface is displayed according to the corresponding mapping relationship of the first control.
  • the suspension layer is configured to be cancelled after a preset period of time
  • the selector on the user interaction interface does not respond to the operation of the control device. It should be noted that during the display of the first content in this application, the control device cannot control the position of the selector on the user interaction interface. In some embodiments, the controller does not respond to the up, down, left, and right key values of the remote control, but responds to other key values, such as the switch key value of the signal source, the return key key, and the standby key key value.
  • the controller receives the input confirmation operation instruction, controls the display to cancel the floating layer, and controls the display to jump from the user interaction interface to the first interface.
  • the interface corresponding to the first content may also be another interface, which is not the same as the first interface corresponding to the first control.
  • the controller receives the input return operation instruction, controls the display to cancel the floating layer, and controls the display to display the user interaction interface.
  • the controller receives the input return operation instruction, controls the display to cancel the floating layer, and controls the display to display the user interaction interface.
  • the display is controlled to cancel the floating layer, and the display is controlled to display the user interaction interface, and the selector stays at the first One control.
  • the display of the floating layer is cancelled, and the user interaction interface provided with the first control is returned to facilitate the user to continue browsing.
  • the timing monitoring is triggered by the movement of the selector, because the selector stays on the first control and does not move, so the timer monitoring will not be triggered again.
  • the timing detection for the first control is canceled at the same time to avoid repeated triggering of displaying the first content on the floating layer.
  • the controller can mark the first control that has displayed the first content (for example, using the first identification). After detecting that the selector moves to the focus, if the first control is marked, timing monitoring may not be performed. If the first control is not Marking is for timing monitoring.
  • the mark of the first control can be cancelled according to preset rules, such as a preset time period, or shutdown operation, or other rules, to control the frequency of display of the first content, and avoid overexposure. Good experience.
  • a second control is further provided on the user interaction interface, and the controller does not respond when the duration of the selector staying on the second control is greater than or equal to the first preset duration .
  • the second control will not display the content corresponding to the second control when the staying time of the selector is greater than or equal to the second preset time period.
  • the second control is different from the first control.
  • the second control can be set with a different mark (second identification), and the second control does not trigger the display of the floating layer. After the controller detects that the selector has moved to the focus, if the control is not marked, it does not need to perform timing monitoring. Therefore, even if the dwell time is longer than the first preset time, the controller will not trigger the floating layer to respond. If the control is marked Time monitoring is carried out.
  • the embodiment of the present application shows a display device, including:
  • the display is used to display a user interaction interface, the user interaction interface is located on the first layer, the user interaction interface is provided with a first control and a selector, the position of the selector can be in response to the user's input Move between different controls;
  • the controller is configured as:
  • the display In response to the duration of the selector staying on the first control being greater than or equal to the first preset duration, the display is controlled to create a floating layer above the first layer to display the first control corresponding to the first control. content;
  • control the display In response to the selector staying on the first control for a duration shorter than the first preset duration and receiving an input confirmation operation instruction, control the display to jump from the user interaction interface to the first control Corresponding to the first interface, and display the first interface on the first layer.
  • the first interface and the user interaction interface of the first control for setting are both located in the first layer.
  • the first layer is a video layer.
  • the embodiment of the present application shows a display device, including:
  • the display is configured to display a first user interaction interface.
  • the first user interaction interface is provided with a first control, a second control, and a selector, and the position of the selector can be in response to the user's input in the first control Move between and the second control;
  • the controller is configured as:
  • the controller Do not create a floating layer above the first user interaction interface.
  • the embodiment of the present application shows a method for displaying content corresponding to a control, as shown in FIG. 11, including:
  • the method further includes:
  • the suspension layer is configured to be cancelled after a preset period of time, and the method further includes:
  • the selector on the user interaction interface does not respond to the operation of the control device.
  • the embodiment of the present application shows a method for displaying content corresponding to a control and a display device.
  • the controller is configured to respond to the presence of the selector.
  • the duration of staying on the first control is greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the first content corresponding to the first control; in response to the selector
  • the duration of staying on the first control is less than the first preset duration, and the input confirmation operation instruction is received, and the display is controlled to jump from the user interaction interface to the first control corresponding to the first control. interface.
  • the first content corresponding to the first control is automatically displayed, and the user does not need to manipulate the control device to click the first control , It saves the steps of viewing the content corresponding to the first control, optimizes the operation experience, and shortens the interaction path.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention concerne un procédé d'affichage et un dispositif d'affichage pour un contenu correspondant à une commande. Un dispositif de commande est configuré pour, en réponse au fait qu'une durée d'un sélecteur restant sur une première commande est supérieure ou égale à une première durée prédéfinie, commander une unité d'affichage pour créer une couche flottante au-dessus d'une interface d'interaction d'utilisateur pour afficher un premier contenu correspondant à la première commande ; et lorsque la durée du sélecteur restant sur la première commande est inférieure à la première durée prédéfinie et qu'une instruction d'opération de confirmation entrée est reçue, l'unité d'affichage est commandée pour sauter de l'interface d'interaction d'utilisateur à une première interface correspondant à la première commande.
PCT/CN2020/098868 2020-03-30 2020-06-29 Procédé d'affichage et dispositif d'affichage pour un contenu correspondant à une commande WO2021196432A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010238265.0 2020-03-30
CN202010238265.0A CN113467651A (zh) 2020-03-30 2020-03-30 一种控件对应的内容的显示方法及显示设备

Publications (1)

Publication Number Publication Date
WO2021196432A1 true WO2021196432A1 (fr) 2021-10-07

Family

ID=77864920

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/098868 WO2021196432A1 (fr) 2020-03-30 2020-06-29 Procédé d'affichage et dispositif d'affichage pour un contenu correspondant à une commande

Country Status (2)

Country Link
CN (1) CN113467651A (fr)
WO (1) WO2021196432A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114489445A (zh) * 2022-02-11 2022-05-13 Tcl通讯科技（成都）有限公司 一种屏幕调整方法、装置、智能设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120246592A1 (en) * 2011-03-24 2012-09-27 Acer Incorporated Method for customizing user interface and electronic device thereof
CN106325648A (zh) * 2015-06-19 2017-01-11 深圳创锐思科技有限公司 图标的设置方法及移动终端
CN108536353A (zh) * 2018-03-23 2018-09-14 网易（杭州）网络有限公司 界面显示控制方法、装置及存储介质
CN109521926A (zh) * 2018-11-28 2019-03-26 青岛海信电器股份有限公司 一种应用程序的启动方法及装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104598109A (zh) * 2015-01-08 2015-05-06 天津三星通信技术研究有限公司 在便携式终端预览应用程序的方法和设备
CN106354372A (zh) * 2016-09-08 2017-01-25 珠海市魅族科技有限公司 一种信息预览方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120246592A1 (en) * 2011-03-24 2012-09-27 Acer Incorporated Method for customizing user interface and electronic device thereof
CN106325648A (zh) * 2015-06-19 2017-01-11 深圳创锐思科技有限公司 图标的设置方法及移动终端
CN108536353A (zh) * 2018-03-23 2018-09-14 网易（杭州）网络有限公司 界面显示控制方法、装置及存储介质
CN109521926A (zh) * 2018-11-28 2019-03-26 青岛海信电器股份有限公司 一种应用程序的启动方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114489445A (zh) * 2022-02-11 2022-05-13 Tcl通讯科技（成都）有限公司 一种屏幕调整方法、装置、智能设备及存储介质
CN114489445B (zh) * 2022-02-11 2024-03-19 Tcl通讯科技（成都）有限公司 一种屏幕调整方法、装置、智能设备及存储介质

Also Published As

Publication number Publication date
CN113467651A (zh) 2021-10-01

Similar Documents

Publication Publication Date Title
CN109618206B (zh) 呈现用户界面的方法和显示设备
WO2021135068A1 (fr) Procédé de commande de sélection pour un dispositif de sortie sonore, et dispositif d'affichage
CN111405338B (zh) 一种智能画质的切换方法及显示设备
WO2021031629A1 (fr) Appareil d'affichage et procédé d'application d'un bouton multifonction pour dispositif de commande
CN113259741B (zh) 一种剧集经典看点的展示方法及显示设备
CN111031375B (zh) 一种开机动画详情页的跳转方法及显示设备
CN111836109A (zh) 显示设备、服务器及自动更新栏目框的方法
CN111836115B (zh) 一种屏保展示方法、屏保跳转方法及显示设备
WO2020186863A1 (fr) Dispositif d'affichage
CN112243141B (zh) 投屏功能的显示方法及显示设备
CN111970549A (zh) 菜单显示方法和显示设备
WO2021031598A1 (fr) Procédé d'ajustement auto-adaptatif pour la position d'une fenêtre de dialogue en ligne vidéo, et dispositif d'affichage
CN111954059A (zh) 屏保的展示方法及显示设备
CN112601118B (zh) 显示设备及视频录制方法
WO2021031620A1 (fr) Dispositif d'affichage et procédé de réglage de luminosité de rétroéclairage
CN110602540B (zh) 显示设备音量控制方法及显示设备
CN109922364B (zh) 一种显示设备
CN114079819A (zh) 一种内容显示方法及显示设备
WO2021196432A1 (fr) Procédé d'affichage et dispositif d'affichage pour un contenu correspondant à une commande
WO2021159658A1 (fr) Procédé d'affichage d'interface et dispositifs d'affichage
CN111479146B (zh) 显示设备和显示方法
WO2020147507A1 (fr) Dispositif d'affichage et procédé d'affichage
CN114417035A (zh) 一种图片浏览方法和显示设备
CN114079827A (zh) 菜单显示方法和显示设备
CN112367550A (zh) 一种媒资列表多标题动态展示的实现方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20928078

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26/01/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20928078

Country of ref document: EP

Kind code of ref document: A1