WO2021196432A1

WO2021196432A1 - Display method and display device for content corresponding to control

Info

Publication number: WO2021196432A1
Application number: PCT/CN2020/098868
Authority: WO
Inventors: 孙鲁兵; 王珺; 张哲铭
Original assignee: 聚好看科技股份有限公司
Priority date: 2020-03-30
Filing date: 2020-06-29
Publication date: 2021-10-07
Also published as: CN113467651A

Abstract

A display method and display device for content corresponding to a control. A controller is configured to, in response to a duration of a selector staying on a first control being greater than or equal to a first preset duration, control a display to create a floating layer above a user interaction interface to display first content corresponding to the first control; and when the duration of the selector staying on the first control is less than the first preset duration and an inputted confirmation operation instruction is received, the display is controlled to jump from the user interaction interface to a first interface corresponding to the first control.

Description

Method and display device for displaying content corresponding to control

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on March 30, 2020, the application number is 202010238265.0, and the invention title is "a method for displaying content corresponding to a control and a display device", the entire content of which is incorporated by reference Incorporated in this application.

Technical field

This application relates to the field of software technology, and in particular to a method and display device for displaying content corresponding to a control.

Background technique

At present, when viewing the content corresponding to a certain control, the user needs to manipulate the remote control to click the control to see the corresponding content under the control. This makes viewing the content corresponding to the control cumbersome. Therefore, there is an urgent need in this field to be able to A technology that makes it easy to view the content corresponding to the control.

Summary of the invention

The first aspect of the embodiments of the present application shows a display device, including: a display for displaying a user interaction interface, the user interaction interface is provided with a first control and a selector, the position of the selector can be responsive to the user The input moves between different controls;

The controller is configured to: in response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the The first content corresponding to the first control; in response to the selector staying on the first control for a duration less than the first preset duration, and receiving an input confirmation operation instruction, control the display from the The user interaction interface jumps to the first interface corresponding to the first control.

The second aspect of the embodiments of the present application shows that another display device includes: a display for displaying a user interaction interface, the user interaction interface is located on the first layer, the user interaction interface is provided with a first control and and A selector, the position of the selector can be moved between different controls in response to user input;

The controller is configured to: in response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the first layer to display the The first content corresponding to the first control; in response to the selector staying on the first control for a duration shorter than the first preset duration, and receiving an input confirmation operation instruction, control the display to interact with the user The interface jumps to the first interface corresponding to the first control, and the first interface is displayed on the first layer.

The third aspect of the embodiments of the present application shows a display device, including: a display, configured to display a first user interaction interface, the first user interaction interface is provided with a first control, a second control, and a selector, the The position of the selector can be moved between the first control and the second control in response to the user's input;

The controller is configured to: in response to the selector moving from the second control to the first control, and staying on the first control for a period of time greater than a first preset period of time, controlling the display to Creating a floating layer above the first user interaction interface to display the first content corresponding to the first control; in response to the selector moving from the first control to the second control, and in the selection When the duration of the device staying on the second control is greater than or equal to the first preset duration, the controller does not create a floating layer above the first user interaction interface.

The fourth aspect of the embodiments of the present application shows a method for displaying content corresponding to a control, including:

Detect the time that the selector stays on the first control; in response to the time the selector stays on the first control is greater than or equal to the first preset time, control the display to create a hover over the user interaction interface Layer to display the first content corresponding to the first control; in response to the selector staying on the first control for a duration less than the first preset duration, and receiving an input confirmation operation instruction, control all The display jumps from the user interaction interface to the first interface corresponding to the first control.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings that need to be used in the embodiments. The drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative work, other drawings can be obtained from these drawings.

Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment;

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the embodiment;

Fig. 3 exemplarily shows a block diagram of the hardware configuration of the control device 100 according to the embodiment;

FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to the embodiment;

FIG. 5a exemplarily shows a schematic diagram of the software configuration in the display device 200 according to the embodiment;

FIG. 5b exemplarily shows a schematic diagram of the configuration of the application program in the display device 200 according to the embodiment;

FIG. 6 exemplarily shows a schematic diagram of a user interface in the display device 200 according to the embodiment;

FIG. 7 exemplarily shows a user interaction interface according to the embodiment;

FIG. 8 exemplarily shows still another user interaction interface according to the embodiment;

Fig. 9 exemplarily shows yet another user interaction interface according to the embodiment;

FIG. 10A exemplarily shows still another user interaction interface according to the embodiment;

FIG. 10B exemplarily shows still another user interaction interface according to the embodiment;

Fig. 11 exemplarily shows a flowchart of a method for displaying content corresponding to a control according to an embodiment.

Detailed ways

In order to make the purpose and technical solutions of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the exemplary embodiments of the present application. Obviously, The described exemplary embodiments are only a part of the embodiments of the present application, rather than all the embodiments.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete technical solution.

It should be understood that the terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or Priority. It should be understood that the data used in this way can be interchanged under appropriate circumstances, for example, it can be implemented in a sequence other than those given in the illustration or description of the embodiments of the present application.

In addition, the terms "including" and "having" and any variations of them are intended to cover but not exclusively include. For example, a product or device including a series of components need not be limited to those clearly listed, but may include Other components not clearly listed or inherent to these products or equipment.

The term "module" used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.

The term "remote control" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect to electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.

Wherein, the control device 100 may be a remote control 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 through wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.

The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like. For example, an application program running on a smart device is used to control the display device 200. The application can provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

For example, the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control instruction protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 1, the display device 200 also performs data communication with the server 300 through multiple communication methods. The display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200. For example, the display device 200 can receive software program updates or access a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 300 may be a group or multiple groups, and may be one or more types of servers. The server 300 provides other network service contents such as video-on-demand and advertising services.

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

In addition to providing the broadcast receiving TV function, the display device 200 may additionally provide a smart network TV function with a computer support function. Examples include Internet TV, display devices, Internet Protocol Television (IPTV), and so on.

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 2, the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio Processor 260-2, display 280, audio output interface 272, power supply.

The tuner and demodulator 220 receives broadcast and TV signals through wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the TV channel selected by the user from multiple wireless or cable broadcast and TV signals The audio and video signals carried in the frequency, and additional information (such as EPG data signals).

The tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.

The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.

In some other exemplary embodiments, the tuner and demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the external device interface 250.

The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.

The display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230. For example, the communicator may receive the control signal of the remote controller 100 according to the control of the controller.

The detector 240 is a component used by the display device 200 to collect signals from the external environment or interact with the outside. The detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect attributes of users or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.

In some other exemplary embodiments, the detector 240 may further include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. In some embodiments, when the temperature is relatively high, the display device 200 can be adjusted to display a colder image color temperature; when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color temperature of the image.

In some other exemplary embodiments, the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.

The external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.

Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.

The controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.

As shown in FIG. 2, the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a bus.

ROM213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start the operating system. After the operating system is started up, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.

The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display 280.

The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode and other states.

The communication interface may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.

The controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (e.g., mouse, keyboard, touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

The memory 290 includes storing various software modules used to drive and control the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Among them, the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion, analysis and management.

For example: the voice recognition module includes a voice parsing module and a voice command database module. The display control module is a module for controlling the display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.

At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of selector objects, and the like.

The user input interface is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user. In some embodiments, the control device (such as a mobile terminal or remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then the user input interface forwards the input signal to the control. Alternatively, the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal displayed or played directly on the display 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to the user input or itself, so as to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be the same as the source The video stream is related, and the output frame rate can be related to the update rate of the display. The input has the usual format, such as the frame insertion method.

The display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.

The display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images and a menu control interface. The display 280 includes a display component for presenting a picture and a driving component for driving image display. The displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the interface of an external device. The display 220 simultaneously displays a user manipulation interface UI generated in the display device 200 and used for controlling the display device 200.

And, depending on the type of the display 280, it also includes a driving component for driving the display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

The audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.

The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210. The audio output interface may include a speaker 272 or output to an external audio output terminal 274 of the generator of an external device, such as : External audio terminal or headphone output terminal, etc.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the controller 210 in one or more chips.

The power supply is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface that provides an external power supply in the display device 200.

Fig. 3 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in FIG. 3, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and play an intermediary role in the interaction between the user and the display device 200. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1, the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing an application for controlling the display device 200. For example, the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 100B or other smart electronic devices by installing applications to realize the function of the physical keys of the control device 100.

The controller 110 includes a processor 112, a RAM 113 and a ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.

The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the received user input signal is sent to the display device 200. The communicator 130 may include at least one of communication modules such as a WIFI module 131, a Bluetooth module 132, and an NFC module 133.

The user input/output interface 140, wherein the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal and the digital signal into a corresponding instruction signal, and sends it to the display device 200.

The output interface includes an interface for sending the received user instruction to the display device 200. In some embodiments, it may be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and then sent to the display device 200 via the infrared sending module. For another example, in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The control device 100 is configured with a communicator 130, such as: WIFI, Bluetooth, NFC and other modules, which can encode user input commands through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.

The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. Can battery and related control circuit.

FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 4, the memory 290 is used to store an operating system, application programs, content, user data, etc., and executes the system operation of driving the display device 200 and responds to various operations of the user under the control of the controller 210. The memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically used to store the operating program that drives the controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and various application-related programs. Graphical user interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.

The memory 290 is specifically used to store driver programs and related data such as the video processor 260-1 and the audio processor 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, the detector 240, and the input/output interface.

In some embodiments, the memory 290 may store software and/or programs. The software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs. In some embodiments, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or application access Controller to control or manage system resources.

For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, and an optical receiver Module 2909, power control module 2910, operating system 2911, and other application programs 2912, browser module, etc. The controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.

Fig. 5a exemplarily shows a configuration block diagram of the software system in the display device 200 according to an exemplary embodiment.

As shown in Figure 5a, the operating system 2911 includes operating software for processing various basic system services and for implementing hardware-related tasks, acting as a medium for data processing between application programs and hardware components.

In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.

The communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects that display the user interface for access by various applications, and can realize user operability.

The control application 2911-4 is used to control process management, including runtime applications, etc.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various events. And implement one or more sets of pre-defined operation procedures.

Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.

The event recognition module 2914-1 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute their corresponding one or more sets of processing procedures .

The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.). Such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices. For example, one or more sub-events in the remote control include various forms, including but not limited to one or a combination of pressing up/down/left/right/, the OK key, and pressing the key. And the operations of non-physical buttons, such as moving, pressing, and releasing.

The interface layout management module 2913, which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size or position, level, etc. of the interface are related to the various execution operations of the interface layout.

As shown in FIG. 5b, the application layer 2912 includes various application programs that can be executed on the display device 200. The application program may include, but is not limited to, one or more application programs, such as: live TV application, video-on-demand application, media center application, application center, game application, etc.

Live TV applications can provide live TV through different sources. For example, a live TV application may use input from cable TV, wireless broadcasting, satellite services, or other types of live TV services to provide TV signals. And, the live TV application can display the video of the live TV signal on the display device 200.

Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, from the local hard disk storage that contains stored video programs.

Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.

Application center, can provide storage of various applications. The application program may be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device. The application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.

Fig. 6 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 6, the user interface includes multiple view display areas, for example, a first view display area 201 and a play screen 202, where the play screen includes layout of one or more different items. And the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.

In some embodiments, different items can be presented by different controls. When the selector moves to the position of the control (that is, when the control is selected), the state of the control (such as background color, font, brightness, or size, etc.) will change. Changes have taken place to improve visibility. At this time, if the user's confirmation operation instruction is received, the interface corresponding to the control is entered.

It should be noted that multiple view display areas can present display screens of different levels. For example, the first view display area can present system layer item content (eg, current attributes, etc.), and the second view display area can present application layer item content (eg, webpage video, VOD display, application program screen, etc.).

Optionally, there are priority differences in the presentation of different view display areas, and the display priorities of the view display areas are different between view display areas with different priorities. For example, the priority of the system layer is higher than the priority of the application layer. When the user uses the acquisition selector and screen switching in the application layer, the screen display in the view display area of the system layer is not blocked; and the application layer is enabled according to the user's choice. When the size and position of the view display area change, the size and position of the view display area of the system layer will not be affected.

The same level of display screen can also be presented. At this time, the selector can switch between the display area of the first view and the display area of the second view, and when the size and position of the display area of the first view change, the second view The size and position of the display area can be changed at any time.

The above-mentioned display device is only an implementation solution in some embodiments, and the method of this application can also be applied to other display devices that can implement this method.

Currently, when viewing the specific content of a certain control, the user needs to manipulate the remote control to click the control to see the corresponding content under the control, which makes viewing the content corresponding to the control cumbersome.

The user interaction interface of FIG. 7 is provided with multiple controls. In some embodiments, it includes an advertisement control. At this time, the user needs to click into the advertisement control through the control device to view the corresponding content under the advertisement control. As shown in 8, in this process, it can be found that the user views the content corresponding to the control. First, the user needs to select the control and click the button on the control device to view the content corresponding to the control.

Since the user selects the control through the button on the control device, it indicates that the user is interested in the content corresponding to the control. Therefore, in order to provide the user with a more convenient view of the content corresponding to the control, in some embodiments, the response When the duration of the selector staying on the first control is greater than or equal to the first preset duration, the display is controlled to create a floating layer above the user interaction interface to display the first content corresponding to the first control. In some embodiments, in FIG. 9, the display interface includes a first control (an exemplary vehicle advertising control), and a second control that is different from the first control. The user presses the button on the control device to set the selector After 400 moves to the first control, monitor the staying time of the selector, and display the corresponding first control on the floating layer when the staying time of the selector on the first control is greater than or equal to the first preset time The first content of, causes the display to display the user interaction interface as shown in FIG. 10A. In some embodiments, the media assets corresponding to the first control may only include image content, or may include image and audio content. The first content may be short videos, GIF animations, static pictures, etc., if the first content also corresponds to audio Information, while displaying the first content, control the audio decoder to parse the audio information.

In some embodiments, the background color of the suspension layer may be transparent, so that the user can still see the interactive interface where the first control is located while watching the first content.

In some embodiments, in order to avoid false triggering, when the duration of the selector staying on the first control is less than the first preset duration, the display is not controlled to display the content corresponding to the control on the floating layer .

In some embodiments, in response to the duration of the selector staying on the first control being less than the first preset duration, and receiving an input confirmation operation instruction, the display is controlled from the user interaction interface Jump to the first interface corresponding to the first control. In some embodiments, in FIG. 9, after the user moves the selector 400 to the control through the buttons on the control device, the staying time of the selector is monitored, and the staying time of the selector on the first control is less than When the first preset duration is received and the input confirmation operation instruction is received, the display is controlled to display the first interface as shown in FIG. 10B. The user can press the "OK" key on the control device to enter a confirmation operation instruction.

In some embodiments, the first interface and the interactive interface provided with the first control are also located in the video layer for display. In some embodiments, one of the two interfaces may be displayed on the video layer and the other may be displayed on the floating layer.

In some embodiments, the displayed content popped up in FIG. 10A is the same as the content displayed on the interface of FIG. 10B. The two can be different in some embodiments.

In some embodiments, when the pop-up display content of FIG. 10A is displayed, if a user's confirmation operation instruction is received, the display of the display content of 10A is exited and the interface shown in FIG. 10B is displayed.

The embodiment of the present application shows a display device, including:

A display for displaying a user interaction interface, the user interaction interface is provided with a first control and a selector, and the position of the selector can be moved between different controls in response to user input;

The controller is configured to: in response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the The first content corresponding to the first control. When the duration of the selector staying on the first control is greater than or equal to the first preset duration, a floating layer is created on the user interaction interface, a window is drawn on the floating layer, and the first content is loaded on the window.

In some embodiments, the floating layer may be OSD (on-screen display, on-screen menu adjustment mode).

It should be noted that the embodiments of the present application may be applied to an advertisement control, and the content corresponding to the advertisement control may be advertisement audio and video. The embodiments of the present application can also be applied to business controls set on the system, such as an album control set in the system. In response to the selector staying on the first control for a duration greater than or equal to the first preset duration, the display is controlled to display The content corresponding to the album control, and the content corresponding to the album control may be all pictures in the album. This allows users to browse the album without entering the album.

When the first control is an album control, the time that the selector stays on the album control is detected. When the stay time is longer than the preset time, a floating layer is created above the user interaction interface where the album control is located, and the corresponding corresponding to the album control is called Store the content to display the images in the album on the floating layer.

When the stay time is less than the preset time length and the confirmation instruction is received, enter the album interface from the user interaction interface where the album control is located.

In some embodiments, after the content displayed on the floating layer ends or is cancelled, the duration monitoring of the control is no longer performed. Avoid the inability to execute the lock screen logic due to repeated triggering of the floating layer to display content.

In some embodiments, after the user moves the selector, it restarts to detect the length of time the selector stays on the control.

In some embodiments, in response to the time period during which the first control is selected is less than the first preset time period, the display is controlled not to create a floating layer above the user interaction interface. Avoid the user from constantly adjusting the floating layer to display the corresponding content during the browsing of the control.

In some embodiments, in response to the duration of the selector staying on the first control being less than the first preset duration, and receiving an input confirmation operation instruction, the display is controlled from the user interaction interface Jump to the first interface corresponding to the first control.

In some embodiments, after receiving the confirmation operation instruction from the remote control, if the first content is not displayed on the floating layer at this time, the confirmation operation instruction is not responded, and if the first content is not displayed on the floating layer at this time, then confirm The duration of the selector staying on the current control. If the duration is less than the preset duration, the corresponding first interface is displayed according to the corresponding mapping relationship of the first control.

In some embodiments, the suspension layer is configured to be cancelled after a preset period of time,

During the display of the first content corresponding to the first control on the created floating layer, the selector on the user interaction interface does not respond to the operation of the control device. It should be noted that during the display of the first content in this application, the control device cannot control the position of the selector on the user interaction interface. In some embodiments, the controller does not respond to the up, down, left, and right key values of the remote control, but responds to other key values, such as the switch key value of the signal source, the return key key, and the standby key key value.

In some embodiments, during the display of the first content, the controller receives the input confirmation operation instruction, controls the display to cancel the floating layer, and controls the display to jump from the user interaction interface to the first interface. At this time, when the user is watching the first content corresponding to the floating layer, if the user is interested in the corresponding content, the user presses the confirmation key, and the TV enters the first interface corresponding to the first content in response to receiving the confirmation operation instruction at this time In some embodiments, the interface corresponding to the first content may also be another interface, which is not the same as the first interface corresponding to the first control. In some embodiments, when a movie highlight is played on the floating layer, if an input confirmation instruction is received, according to a preset correspondence relationship, it will jump to the movie details page or movie playback page corresponding to the movie highlight.

In some embodiments, during the display of the first content, the controller receives the input return operation instruction, controls the display to cancel the floating layer, and controls the display to display the user interaction interface. At this time, when the user is watching the first content corresponding to the floating layer, if the user is not interested in the corresponding content, the user presses the return key, and the TV, in response to receiving the return operation instruction at this time, cancels the display of the floating layer and returns to the settings There is a user interaction interface with the first control to facilitate the user's continued browsing.

In some embodiments, after the display of the first content reaches the second preset duration, the display is controlled to cancel the floating layer, and the display is controlled to display the user interaction interface, and the selector stays at the first One control. At this time, after the user finishes watching the first content corresponding to the floating layer, the display of the floating layer is cancelled, and the user interaction interface provided with the first control is returned to facilitate the user to continue browsing.

In some embodiments, the timing monitoring is triggered by the movement of the selector, because the selector stays on the first control and does not move, so the timer monitoring will not be triggered again.

In some embodiments, the timing detection for the first control is canceled at the same time to avoid repeated triggering of displaying the first content on the floating layer. The controller can mark the first control that has displayed the first content (for example, using the first identification). After detecting that the selector moves to the focus, if the first control is marked, timing monitoring may not be performed. If the first control is not Marking is for timing monitoring.

In some embodiments, the mark of the first control can be cancelled according to preset rules, such as a preset time period, or shutdown operation, or other rules, to control the frequency of display of the first content, and avoid overexposure. Good experience.

In some embodiments, a second control is further provided on the user interaction interface, and the controller does not respond when the duration of the selector staying on the second control is greater than or equal to the first preset duration . For the second control set on the user interaction interface, the second control will not display the content corresponding to the second control when the staying time of the selector is greater than or equal to the second preset time period.

The second control is different from the first control. The second control can be set with a different mark (second identification), and the second control does not trigger the display of the floating layer. After the controller detects that the selector has moved to the focus, if the control is not marked, it does not need to perform timing monitoring. Therefore, even if the dwell time is longer than the first preset time, the controller will not trigger the floating layer to respond. If the control is marked Time monitoring is carried out.

The embodiment of the present application shows a display device, including:

The display is used to display a user interaction interface, the user interaction interface is located on the first layer, the user interaction interface is provided with a first control and a selector, the position of the selector can be in response to the user's input Move between different controls;

The controller is configured as:

In response to the duration of the selector staying on the first control being greater than or equal to the first preset duration, the display is controlled to create a floating layer above the first layer to display the first control corresponding to the first control. content;

In response to the selector staying on the first control for a duration shorter than the first preset duration and receiving an input confirmation operation instruction, control the display to jump from the user interaction interface to the first control Corresponding to the first interface, and display the first interface on the first layer.

The first interface and the user interaction interface of the first control for setting are both located in the first layer. In some embodiments, the first layer is a video layer.

The embodiment of the present application shows a display device, including:

The display is configured to display a first user interaction interface. The first user interaction interface is provided with a first control, a second control, and a selector, and the position of the selector can be in response to the user's input in the first control Move between and the second control;

The controller is configured as:

In response to the selector moving from the second control to the first control, and the length of staying on the first control is greater than a first preset time period, controlling the display on the first user interaction interface Create a floating layer at the top to display the first content corresponding to the first control;

In response to the selector moving from the first control to the second control, and the length of time the selector stays on the second control is greater than or equal to a first preset time period, the controller Do not create a floating layer above the first user interaction interface.

The embodiment of the present application shows a method for displaying content corresponding to a control, as shown in FIG. 11, including:

S100. Detect the time that the selector stays on the first control;

S200. In response to the duration of the selector staying on the first control being greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the corresponding first control The first content;

S300. In response to the selector staying on the first control for a duration less than the first preset duration, and receiving an input confirmation operation instruction, control the display to jump from the user interaction interface to the The first interface corresponding to the first control is described.

In some embodiments, the method further includes:

In response to the duration of the selector staying on the first control being less than the first preset duration, controlling the display not to create a floating layer above the user interaction interface.

In some embodiments, the suspension layer is configured to be cancelled after a preset period of time, and the method further includes:

During the display of the first content corresponding to the first control on the created floating layer, the selector on the user interaction interface does not respond to the operation of the control device.

It can be seen from the above technical solutions that the embodiment of the present application shows a method for displaying content corresponding to a control and a display device. In the technical solution shown in the embodiment of the present application, the controller is configured to respond to the presence of the selector. The duration of staying on the first control is greater than or equal to a first preset duration, controlling the display to create a floating layer above the user interaction interface to display the first content corresponding to the first control; in response to the selector The duration of staying on the first control is less than the first preset duration, and the input confirmation operation instruction is received, and the display is controlled to jump from the user interaction interface to the first control corresponding to the first control. interface. In some embodiments, when the duration of the selector staying on the first control is greater than or equal to the first preset duration, the first content corresponding to the first control is automatically displayed, and the user does not need to manipulate the control device to click the first control , It saves the steps of viewing the content corresponding to the first control, optimizes the operation experience, and shortens the interaction path.

After considering the specification and practicing the invention disclosed herein, those skilled in the art will easily think of other implementation schemes of the present application. This application is intended to cover any variations, uses, or adaptive changes of this application. These variations, uses, or adaptive changes follow the general principles of this application and include common knowledge or customary technical means in the technical field that are not disclosed in this application. . The description and examples are only to be regarded as some examples, and the true scope and spirit of the application are pointed out by the following claims.

It should be understood that the present application is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the application is only limited by the appended claims.

Claims

A display device, characterized in that it comprises:

A display for displaying a user interaction interface, the user interaction interface is provided with a first control and a selector, and the position of the selector can be moved between different controls in response to user input;

The controller is configured as:

In response to the duration of the selector staying on the first control being greater than or equal to the first preset duration, the display is controlled to create a floating layer above the user interaction interface to display the first control corresponding to the first control. content;

In response to the time that the selector stays on the first control is less than the first preset time, and the input confirmation operation instruction is received, the display is controlled to jump from the user interaction interface to the first control The first interface corresponding to a control.
The display device according to claim 1, wherein the controller is further configured to:

In response to the time period during which the first control is selected is less than the first preset time period, the display is controlled not to create a floating layer above the user interaction interface.
The display device according to claim 1, wherein the suspension layer is configured to be cancelled after a preset period of time, and the controller is further configured to:

During the display of the first content corresponding to the first control on the created floating layer, the selector on the user interaction interface does not respond to the operation of the control device.
The display device according to claim 1, wherein the controller is further configured to:

During the display of the first content, receiving an input confirmation operation instruction, controlling the display to cancel the floating layer, and controlling the display to jump from the user interaction interface to the first interface; or

During the display of the first content, receiving an input return operation instruction, controlling the display to cancel the floating layer, and controlling the display to display the user interaction interface; or

After the display of the first content reaches the second preset time period, the display is controlled to cancel the suspension layer, and the display is controlled to display the user interaction interface, and the selector stays on the first control.
The display device according to claim 1, wherein a second control is further provided on the user interaction interface;

The controller is also configured to:

When the duration of the selector staying on the second control is greater than or equal to the first preset duration, the controller does not respond.
A display device, characterized in that it comprises:

The display is used to display a user interaction interface, the user interaction interface is located on the first layer, the user interaction interface is provided with a first control and a selector, the position of the selector can be in response to the user's input Move between different controls;

The controller is configured as:

In response to the duration of the selector staying on the first control being greater than or equal to the first preset duration, the display is controlled to create a floating layer above the first layer to display the first control corresponding to the first control. content;

In response to the selector staying on the first control for a duration shorter than the first preset duration and receiving an input confirmation operation instruction, control the display to jump from the user interaction interface to the first control Corresponding to the first interface, and display the first interface on the first layer.
A method for displaying content corresponding to a control, which is characterized in that it includes:

Detect the time that the selector stays on the first control;

In response to the duration of the selector staying on the first control being greater than or equal to the first preset duration, the display is controlled to create a floating layer above the user interaction interface to display the first control corresponding to the first control. content;

In response to the time that the selector stays on the first control is less than the first preset time, and the input confirmation operation instruction is received, the display is controlled to jump from the user interaction interface to the first control The first interface corresponding to a control.
The method according to claim 8, further comprising:

In response to the time period during which the first control is selected is less than the first preset time period, the display is controlled not to create a floating layer above the user interaction interface.
The method according to claim 8, wherein the suspension layer is configured to be cancelled after a preset period of time, and the method further comprises:

During the display of the first content corresponding to the first control on the created floating layer, the selector on the user interaction interface does not respond to the operation of the control device.