CN111182345A

CN111182345A - Display method and display equipment of control

Info

Publication number: CN111182345A
Application number: CN201911331039.0A
Authority: CN
Inventors: 宋虎; 韩征
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2019-12-20
Filing date: 2019-12-20
Publication date: 2020-05-19
Anticipated expiration: 2039-12-20
Also published as: CN111182345B

Abstract

The embodiment of the invention provides a display method and display equipment of a control, which are used for adjusting the layout position of a linkage control when the position to be displayed of the linkage control to be displayed in a current interface covers the display positions of other controls. The method comprises the following steps: acquiring display position information of each adjacent control adjacent to the target control within a set range in the current display interface and position information to be displayed of the control to be displayed in the current display interface; if the overlapping area exists between the display position information of at least one adjacent control and the to-be-displayed position information of the to-be-displayed control, adjusting the layout information of the to-be-displayed control, updating the to-be-displayed position information of the to-be-displayed control, wherein the overlapping area between the updated to-be-displayed position information of the to-be-displayed control and the display position information of the adjacent control is smaller than the overlapping area before adjustment; and after the target control is determined to be in the selected state, displaying the control to be displayed in the current display interface according to the updated position information to be displayed.

Description

Display method and display equipment of control

Technical Field

The invention relates to the technical field of display, in particular to a display method and display equipment of a control.

Background

Currently, since a display device can provide a user with a play picture such as audio, video, picture, and the like, it is receiving a wide attention of the user.

However, when a user uses the display device, sometimes one control is triggered by triggering the other control in a linkage manner, and the control triggered by the linkage may cover other controls in the current display interface, which causes inconvenience for the user to operate.

Disclosure of Invention

The application provides a method and display equipment capable of dynamically adjusting layout position information of a linkage control in a current display interface of the display equipment, which are used for adjusting the layout position of the linkage control when the display position of the linkage control covers the display positions of other controls in the current interface, at least reducing the range of the display position of the linkage control covering the display positions of other controls in the current interface, and improving the user experience.

In a first aspect, a method for displaying a control is provided, including:

the method comprises the steps of obtaining display position information of adjacent controls adjacent to a target control in a set range in a current display interface and position information to be displayed of the control to be displayed in the current display interface, wherein the target control is a control corresponding to a display focus object in the current display interface and has an association relation with the control to be displayed;

if the fact that an overlapping area exists between the display position information of at least one adjacent control and the to-be-displayed position information of the to-be-displayed control is determined, adjusting the layout information of the to-be-displayed control, and updating the to-be-displayed position information of the to-be-displayed control, wherein the overlapping area between the updated to-be-displayed position information of the to-be-displayed control and the display position information of the adjacent control is smaller than the overlapping area before adjustment;

and after the target control is determined to be in the selected state, displaying the control to be displayed in the current display interface according to the updated position information to be displayed of the control to be displayed.

In a second aspect, there is provided a display device comprising:

the display is used for displaying a playing picture;

the user interface is used for receiving instructions input by a user;

a controller for performing:

In the above embodiment, when a target control such as playing or inputting is triggered on the display device, a to-be-displayed control associated with the target control is displayed on a current display interface of the display device, for example, a display control is associated with the playing control, and a control associated with the input control is an input method control. According to the embodiment of the application, the position to be displayed of the to-be-displayed control in the current display interface can be dynamically adjusted according to the positions of the adjacent controls around the target control in the current display interface, so that the shielding area between the to-be-displayed control and the adjacent controls around the target control is reduced as much as possible when the adjusted to-be-displayed control is displayed, the operation of a user is facilitated, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1A is a schematic diagram illustrating an operation scenario between a display device and a control apparatus;

fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;

fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;

FIG. 1D is a block diagram illustrating an architectural configuration of an operating system in memory of display device 200;

fig. 2A to 2E are diagrams exemplarily showing a play screen provided by the display device 200;

FIGS. 3A-3E schematically illustrate a GUI400 provided by the display device 200 by operation of the control apparatus 100;

4A-4D illustrate a flow chart of a method of displaying device information and a display interface diagram;

5A-5D illustrate interface diagrams that adjust the position of a control to be displayed.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1A is a schematic diagram illustrating an operation scenario between a display device and a control apparatus. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may provide a network television function of a broadcast receiving function and a computer support function. The display device may be implemented as a digital television, a web television, an Internet Protocol Television (IPTV), or the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.

And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.

The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio output interface 285, and a power supply 290.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's sound, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

In some other exemplary embodiments, the detector 230, which may further include an image collector 232, such as a camera, a video camera, etc., may be configured to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user.

In some other exemplary embodiments, the detector 230 may further include a light receiver for collecting the intensity of the ambient light to adapt to the display parameter variation of the display device 200.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

The external device interface 240 is a component for providing the controller 250 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in fig. 1C, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.

The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.

And a graphic processor 253 for generating various graphic objects such as icons, operation menus, and user input instruction display graphics, etc. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to the object. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, memory 260 is specifically configured to store drivers for tuner demodulator 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., and related data, such as external data (e.g., audio-visual data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received by the user interface.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a setup application, a post application, a media center application, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML5, Cascading Style Sheets (CSS), and JavaScript.

Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.

CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.

JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through the browser to realize communication with the kernel layer.

The middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

A display 275 for receiving the image signal from the video processor 270 and displaying the video content, the image and the menu manipulation interface. The display video content may be from the video content in the broadcast signal received by the tuner-demodulator 210, or from the video content input by the communicator 220 or the external device interface 240. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

The audio output interface 285 is used for receiving an audio signal output by the audio processor 280 under the control of the controller 250, and the audio output interface 285 may include a speaker 286 or an external sound output terminal 287, such as an earphone output terminal, for outputting to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

Fig. 2A to 2E are schematic views illustrating a current display interface provided by the display apparatus 200.

As shown in fig. 2A, the display device may provide a play screen 41, which may be at least one of an image, text, and video content, to the display. For example, the playback screen shown in fig. 2A is a picture screen.

As shown in fig. 2B, the display device may provide an application interface 42 to the display, and the application interface 42 may include GUIs of various controls, such as the GUI of the picture display control 4201, the GUI of the photographing control 4202, and the GUI of the navigation control 4203 included in fig. 2B.

As shown in fig. 2C, the display device may provide an application interface 43 to the display, where the application interface 43 may include a GUI of the current focus control 4301, the focus control 4301 is a control corresponding to a focus object displayed by the display, and a GUI of each adjacent control 4302 adjacent to the GUI of the focus control 4301, for example, as shown in fig. 2C, the GUI of the focus control 4301 is an edit box, and the GUI of the adjacent control 4302 is a selection check box.

As shown in fig. 2D, the display device may provide an application interface 44 to the display, where the application interface 44 may include a GUI of a current focus control 4401, where the focus control 4401 is a control corresponding to a focus object displayed on the display, and also includes GUIs of adjacent controls 4402 adjacent to the GUI of the focus control 4401, for example, as shown in fig. 2D, the GUI of the focus control 4401 is an edit box, and the GUI of the adjacent control 4402 is a selection check box. Upon receiving an instruction for editing in the focus edit box control 44 sent by the user through the operation control apparatus 100, the display device may provide GUI display contents of the input method control 4403 to the display.

As shown in fig. 2E, the display device may be a mobile terminal, and the display device may provide an application interface 45 to the display, including a GUI for the settings controls 4501, a GUI for the contacts controls 4502, a GUI for the information controls 4503, and so on in the application interface 45.

Fig. 3A-3E schematically show a GUI400 provided by the display apparatus 200 by operating the control device 100.

It should be noted that the control refers to a unit capable of controlling the display content of the display device on the application level of the display device, and the GUI provided by the control, such as an icon, a thumbnail, a link, and the like, corresponds to a visual object of the content. The presentation forms of the controls GUI are typically varied. For example, the widget GUI may include textual content and/or images for displaying thumbnails related to the textual content. As another example, the control GUI can be text and/or an icon of an application.

It should be noted that the control may be selected or controlled by controlling the movement of the display focus object in the display apparatus 200 according to the input of the user through the control device 100. Such as: the user may select and control the control by controlling the movement of the focus object between items through the directional keys on the control device 100. The identification form of the focus object is not limited. For example, as shown in fig. 3A, the position of the focus object may be realized or identified by setting the background color of the item, or may be identified by changing the border line, size, transparency, and outline of the text or image of the focused item, and/or the font.

In fig. 3A, in the current display interface 46, when the user uses the operation control device 100 to trigger the menu control 301 in the current display interface 46, the menu control 301 displays all control contents of the menu control, including a setting control 3011, a returning operation control 3012, a guiding control 3013, and a channel search control 3014; when the user moves the focus object to the setting control 3011 using the operation control apparatus 100, the control 3011 has a background color, and the return operation control 3012, the guidance control 3013, and the channel search control 3014 have no background color.

In fig. 3B, the current display shows a display interface 47, and when the user uses the operation control device 100 to send the smart home control 311, all control contents of the smart home control 311 are displayed in the display, including a scene control 3101, a monitoring control 3102, and an access control 3103; when the user moves the focus object to the scene control 3101 by using the operation control apparatus 100, the scene control 3101 has a highlight frame, and the return monitoring control 3102 and the entrance guard control 3103 do not have a highlight frame.

In fig. 3C, the display interface 48 is displayed on the current display, and when the user moves the focus object to the edit box control 321 using the operation control apparatus 100, a selection control 322 for selecting all video contents and a sort control 323 for sorting according to the degree of heat are displayed within the vicinity layout of the edit box control 321.

When the user triggers an input instruction using the operation control apparatus 100, the focus mark 324 appears in the edit box control 321, and the user triggers a determination input instruction again using the operation control apparatus 100, and then the input control 325 is displayed on the display of the current display device.

As described in the above embodiments, when the display device plays a display screen, based on user input, the display device may provide device information, such as a device brand, a device price, a device characteristic, and the like, to a user, so that the user may know the device information of the display device when viewing the display screen, thereby improving user experience.

Further, the device characteristic content of the display device may change with the upgrade of the software version in the display device, or the device price of the display device may change with the manufacturer adjustment scheme, and based on the user input, the display device may provide the user with device information after content update, further facilitating the timely update and display of the device information for the user.

Furthermore, in the process that the display device provides the updated content to the user, the display device only needs to refresh the device information display page, and does not need to quit the device information display page and then reopen, so that the user can browse conveniently.

In an alternative embodiment, as shown in fig. 3D, the current display is a display interface 49, and after the user uses the operation control device 100 to trigger the smart home control 311, all control contents of the smart home control 311 are displayed in the display, including a scene control 3101, a monitoring control 3102, and an access control 3103; when the user moves the focus object to the scene control 3101 by using the operation control apparatus 100, the scene control 3101 has a highlight frame, and the return monitoring control 3102 and the entrance guard control 3103 do not have a highlight frame. When the user moves the focus object to the edit box control 321 using the operation control apparatus 100, a selection control 322 that selects all video contents and a sort control 323 that sorts according to the degree of heat are also displayed within the vicinity layout range of the edit box control 321.

When the input control 325 is displayed, there is a display overlap area 326 between the display position of the input control 325 and the sort control 323 sorted by heat.

Due to the display problem shown in fig. 3D, the embodiment of the present application at least reduces the display overlap area 326 by adjusting the display position of the input control 325.

Certainly, in this embodiment of the application, there are also other cases where the display overlapping area exists in other related display controls, for example, as shown in fig. 3E, the current display displays a display interface 50, the display interface 50 includes a play control 331, a playlist selection control 332, and a peripheral video control 333, the play control 331 is a control corresponding to the focus object, and may also be understood as a target control, and the playlist control 332 and the peripheral video control 333 that are adjacent to each other within a set range of the play control 331 are adjacent controls of the target control.

When the user uses the operation control device 100 to trigger the play control 331, the associated control of the play control 331 is started, and the associated control is used as a control to be displayed.

Based on the problems existing in the display process, in the embodiment of the application, the display position of the control to be displayed is adjusted by determining the position information in the display interface between the adjacent control of the target control corresponding to the current focus object and the control to be displayed, so that the overlapping area between the adjacent control and the control to be displayed is reduced.

Fig. 4A-4C illustrate a flow chart of a method of displaying device information.

In connection with the method shown in FIG. 4A, the method includes the following steps S51-S54:

step S51: the display displays a current display interface, and the content displayed by the display at least comprises a target control corresponding to the current focus object and an adjacent control adjacent to the target control in a set range.

In step S52, an instruction to trigger the target control is received, which is input by the user via the control device 100. For example, the user presses a menu key, a direction key, an OK key, etc. on the control device.

Step S53: and responding to an input instruction for triggering the target control, and displaying the control to be displayed associated with the target control on the display.

For example, in the GUI shown in fig. 3E, a display interface 50 is displayed on the current display, the display interface 49 includes a play control 331, a select play list control 332, and a peripheral video control 333, the play control 331 is a control corresponding to the focus object, and may also be understood as a target control, and the adjacent play list control 332 and the peripheral video control 333 in the setting range of the play control 331 are adjacent controls of the target control.

Meanwhile, the associated control of the target control is a to-be-displayed control, namely, the video playing control 334 cannot be displayed in the display interface 50 in a state that the target control is not triggered, and when the target control is triggered, the video playing control 334 is displayed in the display interface 50.

In the embodiment of the present application, the to-be-displayed control has preset to-be-displayed position information, and the to-be-displayed position information, when displayed in the display interface 50, may cause an overlap region to exist between the to-be-displayed position of the to-be-displayed control and the display position of the adjacent control, so before the to-be-displayed control is displayed, the to-be-displayed position of the to-be-displayed control is updated according to the display position of each adjacent control, so that the area of the overlap region is reduced.

Specifically, with reference to the method shown in fig. 4B, step S53 may specifically include the following steps:

step S531: the method comprises the steps of obtaining display position information of adjacent controls adjacent to a target control in a set range in a current display interface and position information to be displayed of the controls to be displayed in the current display interface, wherein the target control is a control corresponding to a display focus object in the current display interface, and the target control and the controls to be displayed have an association relation.

Step S532: if the overlapping area exists between the display position information of at least one adjacent control and the to-be-displayed position information of the to-be-displayed control, adjusting the layout information of the to-be-displayed control, and updating the to-be-displayed position information of the to-be-displayed control, wherein the overlapping area between the updated to-be-displayed position information of the to-be-displayed control and the display position information of the adjacent control is smaller than the overlapping area before adjustment.

Step S533: and after the target control is determined to be in the selected state, displaying the control to be displayed in the current display interface according to the updated position information to be displayed of the control to be displayed.

Specifically, in step S531, the control corresponding to the focal point in the current display interface is the target control, and each control adjacent to the target control within the set range is an adjacent control. Optionally, the setting range may be the range of the whole display interface, or other setting ranges.

Specifically, in the embodiment of the present application, the display position of each control in the current display interface may be determined by determining layout information of each control in the current display interface.

Optionally, in this embodiment of the application, first, the layout information of each control in the current display interface is determined, where the layout information includes the layout information of the target control and the layout information of other controls, and which controls are adjacent controls within the set range is determined according to the layout information of the target control and the layout information of other controls.

In an optional embodiment, the layout information at least includes boundary information of the control in the display interface, where the boundary information at least includes one of a left boundary, a right boundary, an upper boundary, and a lower boundary, in this embodiment of the present application, the upper, the lower, the left, and the right are described with respect to the current display interface, for example, as shown in fig. 4C, the display interface 51 is displayed in the display in fig. 4C, and in the current display interface 51, the current display interface is divided into four vertical directions, which are, according to a clockwise description, a first direction, a second direction, a third direction, and a fourth direction, respectively.

In the embodiment of the present application, the display device is placed in a horizontal plane, and the directions parallel to the horizontal plane are a second direction and a fourth direction, the second direction being opposite to the fourth direction, and the directions perpendicular to the horizontal plane are a first direction and a third direction, the first direction being opposite to the third direction.

In the embodiment of the present application, in the layout information of the control, a boundary in the first direction is an upper boundary, a boundary in the second direction is a right boundary, a boundary in the third direction is a lower boundary, and a boundary in the fourth direction is a left boundary.

After the layout information of each adjacent control is determined, the position information of the adjacent control can be determined. And the control to be displayed is not displayed, so that the layout information to be displayed of the control to be displayed needs to be acquired, and the position information to be displayed of the control to be displayed is determined according to the layout information to be displayed.

Optionally, in this embodiment of the application, since there are multiple adjacent controls within the set range in the target control, the position information of each adjacent control is determined.

In step S532, the display position information of each adjacent control is first determined, and then it is determined whether there is an overlapping region between the display position information of each adjacent control and the position information to be displayed of the control to be displayed.

Illustratively, as shown in fig. 4D, a target control and adjacent controls within a set dotted line range from the target control are present in the current display interface, which are adjacent control 1, adjacent control 2, and adjacent control 3, respectively.

The display position information of the proximity control 1, the proximity control 2, the proximity control 3, and the proximity control 4 is determined respectively, as shown in fig. 4D, to be a first display position, a second display position, and a third display position.

Similarly, the position information to be displayed of the control to be displayed is determined, and since the position information to be displayed is not yet displayed, the position information to be displayed of the control to be displayed is a fourth display position of the dotted line position in fig. 4D.

After the display position information of the adjacent controls is determined, whether an overlapping area exists between the display position information of each adjacent control and the position information to be displayed of the control to be displayed is determined respectively. That is, it is determined whether there is an overlap region between the first display position and the fourth display position, whether there is an overlap region between the second display position and the fourth display position, and whether there is an overlap region between the third display position and the fourth display position.

Optionally, in this embodiment of the application, it may be determined whether each adjacent control has an overlapping area with the to-be-displayed position information of the to-be-displayed control according to a set order.

The setting sequence may be selected by the user through the operation control device 100, or may be determined once according to the distance in a certain direction from the target control whether the adjacent controls have an overlapping region with the to-be-displayed position information of the to-be-displayed control.

For example, in the embodiment of the present application, whether there is an overlapping area with the to-be-displayed position information of the to-be-displayed control is sequentially determined in order from a small distance to a large distance from the target control in the third direction.

For example, as shown in fig. 4D, the distance from the target control in the third direction is determined according to the lower boundary information in the layout information of each control, that is, the control bottom information of each control, the bottom information of the first display position is bottom information 1, the bottom information of the second display position is bottom information 2, the bottom information of the third display position is bottom information 3, and the bottom information of the fourth display position is bottom information 4, and whether an overlapping area exists between the target control and the to-be-displayed position information of the to-be-displayed control is sequentially determined according to the order of the distance between each bottom information and the bottom information 4 from small to large. Namely, whether an overlapping area exists between the adjacent control 2 and the position information to be displayed of the control to be displayed is determined in sequence according to the sequence of the adjacent control 1 and the adjacent control 3.

In another alternative embodiment, whether an overlapping area exists between the target control and the to-be-displayed position information of the to-be-displayed control may be determined sequentially according to the order from the greater distance to the target control in the third direction to the smaller distance. Namely, whether an overlapping area exists between the adjacent control 3 and the position information to be displayed of the control to be displayed is determined in sequence according to the sequence of the adjacent control 1, the adjacent control 2 and the adjacent control 4.

In addition to the setting sequence in the above embodiments, other setting sequences are also included, which are not described herein.

In the embodiment of the application, if it is determined that an overlapping region exists between the display position information of at least one adjacent control and the to-be-displayed position information of the to-be-displayed control, the to-be-displayed position of the to-be-displayed control needs to be adjusted, so that the area of the overlapping region between the adjusted to-be-displayed position of the to-be-displayed control and the adjacent control is reduced.

Specifically, in the embodiment of the application, in the process of sequentially determining whether an overlapping region exists between the adjacent control 4 and the to-be-displayed position information of the to-be-displayed control according to the sequence of the adjacent control 2, the adjacent control 1, and the adjacent control 3, if it is determined that an overlapping region exists between the adjacent control 4 and the to-be-displayed position information of the to-be-displayed control, the to-be-displayed position information of the to-be-displayed control needs to be adjusted, so that the adjusted first to-be-displayed position information is obtained.

Meanwhile, whether an overlapping area exists between the adjacent control 2 and the first to-be-displayed position information of the control to be displayed is determined, and if the overlapping area exists between the adjacent control 2 and the first to-be-displayed position information of the control to be displayed, the first to-be-displayed position information of the control to be displayed needs to be adjusted, so that an adjusted second to-be-displayed position is obtained.

Similarly, whether an overlapping area exists between the near control 1 and the second to-be-displayed position information of the control to be displayed is determined, if the overlapping area exists between the adjacent control 1 and the second to-be-displayed position information of the control to be displayed is determined, the second to-be-displayed position information of the control to be displayed needs to be adjusted, and an adjusted third to-be-displayed position is obtained.

Meanwhile, if it is determined that no overlapping area exists between the near control 1 and the second to-be-displayed position information of the to-be-displayed control, the second to-be-displayed position information is used as the to-be-displayed position information determined by the to-be-displayed control.

In another optional embodiment, whether an overlapping area exists between the target control and the position information to be displayed of the control to be displayed is determined in sequence according to the order from the greater distance to the target control in the third direction to the smaller distance. For example, whether an overlapping area exists between the adjacent control 3, the adjacent control 1, the adjacent control 2 and the adjacent control 4 and the position information to be displayed of the control to be displayed is determined in sequence.

Specifically, if it is determined that an overlapping region exists between the adjacent control 3 and the to-be-displayed position information of the to-be-displayed control, the to-be-displayed position information of the to-be-displayed control needs to be adjusted, so that the adjusted first to-be-displayed position information is obtained.

If it is determined that there is no overlapping area between the adjacent control 3 and the to-be-displayed position information of the to-be-displayed control, it is determined that there is no overlapping area between the other adjacent controls and the to-be-displayed position information of the to-be-displayed control, and it may be determined that the to-be-displayed position information of the to-be-displayed control does not need to be adjusted.

In another optional embodiment, after it is determined that the to-be-displayed position information of the to-be-displayed control has been adjusted to the minimum display position information, the to-be-displayed position of the to-be-displayed control is not adjusted.

That is to say, in the embodiment of the present application, it is determined one by one whether there is an overlapping region between the adjacent control and the to-be-displayed position information of the display control, and after it is determined that there is an overlapping region, the to-be-displayed position information of the to-be-displayed control is adjusted, and it is continuously determined whether there is an overlapping region between the adjusted to-be-displayed position information of the to-be-displayed control, if so, the to-be-displayed position information of the to-be-displayed control is continuously adjusted until it is determined that there is no overlapping region between the currently adjusted to-be-displayed position information of the to-be-displayed control and the adjacent control, or the.

Specifically, in step S533, after the position to be displayed of the control to be displayed is determined, and if the target control is determined to be in the selected state, that is, after the user touches the target control through the control device, the control to be displayed is displayed in the current display interface according to the updated position information to be displayed of the control to be displayed.

That is, before the adjustment, the control to be displayed is displayed at the first position, and after the adjustment, the control to be displayed is displayed at the second position.

For better explaining the embodiment of the present application, the display method provided by the embodiment of the present application is described below with reference to a specific implementation scenario, as shown in fig. 5A, a display interface of a display device displays a focus edit box and a controllable line-drawing control, where the focus edit box is an input box and is used for inputting a password, and the controllable line-drawing control is used for hiding the input password.

After a user triggers an input instruction for a password input box through a control device, the layout information of the password input box and the layout information of a selectable control for hiding an input password are obtained, and the layout information to be displayed of a control to be displayed, namely an input method control, associated with the password input box is obtained.

In the embodiment of the present application, as shown in fig. 5B, the layout information of the password input box includes an upper boundary 501, a lower boundary 502, a left boundary 503, and a right boundary 504 of the password input box, and the display position of the password input box is determined by the layout information of the password input box and is a display position 505; the layout information of the selectable control includes an upper boundary 511, a lower boundary 512, a left boundary 513, and a right boundary 514 of the selectable control, and the display position of the selectable control is determined by the layout information of the selectable control and is the display position 515.

The layout information to be displayed of the input method control is obtained, and since the input method control is not yet displayed, the layout information of the input method control is represented by a dotted line in fig. 5B, and the layout information of the input method control includes an upper boundary 521, a lower boundary 522, a left boundary 523, and a right boundary 524 of the input method control.

And determining that the selectable control is the adjacent control of the password input box according to the distance D between the lower boundary 502 in the layout information of the password input box and the lower boundary 512 in the layout information of the selectable control.

Further, a distance H between the upper boundary 521 and the lower boundary 522 in the layout information of the input method control is determined, which can be understood as H being a display height of the input method control in the display interface.

As shown in fig. 5B, a layout threshold is determined according to the lower boundary 502 in the layout information of the password input box, where the layout threshold is T, which is the distance from the lower boundary 502 in the layout information of the password input box to the bottom of the display interface.

And then determining whether an overlapping area exists between the display positions of the associated control input method control of the colludable control and the password input box, namely determining that the overlapping area exists between the display positions of the associated control input method control of the colludable control and the password input box if D + H is determined to be larger than or equal to T.

In the embodiment of the present application, in the case that the lower boundary 522 of the input method control is not changed, the overlapping area with the display position of the selectable control is reduced by reducing the height H of the mobile input method control, as shown in fig. 5C, and the height of the input method control is reduced from H to H1.

Determining whether H1+ D is greater than or equal to T, if H1+ D is greater than or equal to T, lowering H1 to H2, continuing to determine whether H2+ D is greater than or equal to T, and if H2+ D is less than or equal to T, setting the height of the input method to H2.

If H2+ D is determined to be greater than or equal to T, H2 is continuously lowered to H3 until H3 is equal to the minimum height of the input method control, and the current display position of the input method control is taken as the updated display position.

After the user sends an instruction to input a password through the control device, the input method control is displayed at the updated display position, as shown in fig. 5D.

On the basis of the above method embodiment, in combination with the display device in fig. 1C, some components in the display device specifically perform:

a display for displaying the GUI. For example, the display may display a GUI shown in fig. 3A, which includes the play screen 41. The play screen 41 includes therein a menu 301, where the menu 301 includes a setting 3011, a return operation 3012, a guide 3013, and a channel search 3014.

And the user interface is used for receiving instructions input by a user. For example, the user interface may receive an instruction from a user to control the selector to move in a downward direction in the GUI by pressing a downward direction key on the control device to change the position of the selector in the GUI.

A controller for performing:

In some embodiments, the controller is further configured to perform:

analyzing the layout information of each adjacent control in the current display interface, and determining the display position information of each adjacent control in the current interface according to each layout information;

and analyzing the layout information of the control to be displayed, and determining the position information of the control to be displayed in the current display interface according to the layout information of the control to be displayed.

In some embodiments, the controller is further configured to perform: and determining whether an overlapping area exists between each adjacent control and the control to be displayed according to the display position information of each adjacent control and the position information to be displayed of the control to be displayed.

In some embodiments, the controller is further configured to perform: and sequentially determining whether an overlapping area exists between the display position information of each adjacent control and the position information to be displayed of the control to be displayed according to a set sequence.

In some embodiments, the controller is further configured to perform: determining the offset between the bottom information of each adjacent control and the bottom information of the target control;

and sequentially determining whether an overlapping area exists between the display position information of each adjacent control and the position information to be displayed of the control to be displayed according to the offset of each adjacent control from small to large.

In some embodiments, the controller is further configured to perform: aiming at each adjacent control with an overlapping area between the adjacent control and the position information to be displayed of the control to be displayed, adjusting the layout information of the control to be displayed according to the display position information of each adjacent control and the current position information to be displayed of the control to be displayed;

and after the completion of the adjustment of the layout information of the control to be displayed is determined, updating the position information to be displayed of the control to be displayed according to the adjusted layout information of the control to be displayed.

determining whether an overlapping area exists between the adjacent control with the maximum offset and the position information to be displayed of the control to be displayed;

and if it is determined that no overlapping area exists between the adjacent control with the maximum offset and the position information to be displayed of the control to be displayed, determining that no overlapping area exists between the display position information of each adjacent control and the position information to be displayed of the control to be displayed.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A display method of a control, the method comprising:

2. The method of claim 1, wherein the obtaining of the display position information of each adjacent control adjacent to the target control within the set range in the current display interface and the position information to be displayed of the control to be displayed in the current display interface comprises:

3. The method of claim 1, wherein prior to determining that there is an overlap region between the display position information of the at least one neighboring control and the to-be-displayed position information of the to-be-displayed control, further comprising:

and determining whether an overlapping area exists between each adjacent control and the control to be displayed according to the display position information of each adjacent control and the position information to be displayed of the control to be displayed.

4. The method of claim 3, wherein the determining whether an overlapping area exists between each adjacent control and the control to be displayed according to the display position information of each adjacent control and the information of the position to be displayed of the control to be displayed comprises:

and sequentially determining whether an overlapping area exists between the display position information of each adjacent control and the position information to be displayed of the control to be displayed according to a set sequence.

5. The method according to claim 4, wherein the layout information includes bottom information of each control, and the determining whether there is an overlapping area between the display position information of each adjacent control and the position information to be displayed of the control to be displayed in sequence according to the setting order includes:

determining the offset between the bottom information of each adjacent control and the bottom information of the target control;

6. The method according to claim 5, wherein if it is determined that there is an overlapping area between the display position information of at least one adjacent control and the to-be-displayed position information of the to-be-displayed control, adjusting the layout information of the to-be-displayed control, and updating the to-be-displayed position information of the to-be-displayed control includes:

aiming at each adjacent control with an overlapping area between the adjacent control and the position information to be displayed of the control to be displayed, adjusting the layout information of the control to be displayed according to the display position information of each adjacent control and the current position information to be displayed of the control to be displayed;

7. The method according to claim 4, wherein the layout information includes bottom information of each control, and the determining whether there is an overlapping area between the display position information of each adjacent control and the position information to be displayed of the control to be displayed in sequence according to the setting order includes:

8. A display device, comprising:

the display is used for displaying a playing picture;

the user interface is used for receiving instructions input by a user;

a controller for performing:

9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any one of claims 1 to 7 are performed by the processor when the program is executed.

10. A computer-readable storage medium, in which a computer program is stored which is executable by a computer device, and which, when run on the computer device, causes the computer device to carry out the steps of the method as claimed in any one of claims 1 to 7.