WO2021223074A1

WO2021223074A1 - Display device and interaction control method

Info

Publication number: WO2021223074A1
Application number: PCT/CN2020/088653
Authority: WO
Inventors: 王学磊; 崔文华; 吴超; 孙哲; 邱若强
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-05-06
Filing date: 2020-05-06
Publication date: 2021-11-11

Abstract

Disclosed is a display device, comprising a first display, a second display and a controller, wherein the controller is used for presenting a first user interface on the first display and presenting a second user interface on the second display; in response to a menu item display instruction input by a user, a setting menu of items, for setting a push function, of the second display is displayed in the first user interface; and in response to an operation on the items for setting the push function, the push function is enabled or disabled.

Description

Display device and interactive control method

Technical field

This application relates to the technical field of display devices, and in particular to a display device and an interactive control method.

Background technique

Currently, display devices such as smart TVs can provide users with playback screens such as audio, video, and pictures, and have received widespread attention from users. With the development of big data and artificial intelligence, users' demand for the functions of display devices is increasing day by day. For example, users view information, watch videos, participate in games, learn, etc. on the display device.

Push message (Push) refers to the active push of messages by operators to user devices through their own products or third-party tools. For mobile terminal devices, push messages (push message notifications) are generally displayed on the lock screen and notification bar of the device. Click Push When information, you can call up the corresponding APP and go to the corresponding page.

Based on the difference between the display device and the mobile terminal device in the operation mode, operability, and interface design, when the above message push function is applied to the display device, it is easy to obstruct the content that the user is watching when the push information is displayed, and If it is blocked, it usually takes multiple operations to cancel the display of the push information, which is not conducive to the user experience.

Summary of the invention

The present application provides a display device and an interactive control method to solve the problem that the push information generated when the message push function is applied on the display device obscures the content that the user is watching.

In the first aspect, this application provides a display device, including:

The first display is configured to present a first user interface, where the first user interface displays a setting page and/or a playing screen;

The second display is configured to present a second user interface, and push information is displayed on the second user interface;

The controller is configured as:

Presenting a first user interface on the first display, and presenting a second user interface on the second display:

Receiving a menu item display instruction input by a user on the first user interface, where the menu item display instruction indicates to display a setting menu of the second display;

In response to the menu item display instruction, a setting menu of the second display is displayed in the first user interface, the setting menu includes items for setting a push function, and the push function refers to the second user Push information is displayed in the interface;

In response to the operation on the item for setting the push function, the push function is turned on or off.

In a second aspect, the present application also provides an interactive control method, which is applied to a display device, the display device includes a first display and a second display, and the method includes:

Description of the drawings

In order to explain the technical solutions of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those of ordinary skill in the art, without paying creative labor, Other drawings can also be obtained from these drawings.

Fig. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device;

Fig. 2 exemplarily shows a configuration block diagram of the control device 100;

FIG. 3 exemplarily shows a schematic diagram of the hardware structure of the hardware system in the display device 200;

Figure 4 exemplarily shows a schematic diagram of the connection relationship between the power board and the load;

FIG. 5 exemplarily shows a block diagram of the hardware architecture of the display device 200 shown in FIG. 3;

FIG. 6 exemplarily shows a schematic diagram of the functional configuration of the display device of the present application;

FIG. 7 exemplarily shows a configuration block diagram of the software system in the display device 200;

Fig. 8 exemplarily shows a schematic diagram of the application layer of the software system of the display device;

FIG. 9a exemplarily shows a schematic diagram of a user interface in the display device 200;

FIG. 9b exemplarily shows a play screen provided by the display device 200;

Fig. 10 exemplarily shows a user interface presented on the first display;

Fig. 11 exemplarily shows a user interface presented on the first display;

Figure 12 exemplarily shows a user interface presented on the first display;

Figure 13 exemplarily shows a user interface presented on the first display;

Figure 14 exemplarily shows a user interface presented on the first display;

Fig. 15 exemplarily shows a flow chart of the interactive control method.

Detailed ways

In order to enable those skilled in the art to better understand the technical solutions in the application, the following will clearly and completely describe the technical solutions in the embodiments of the application in conjunction with the drawings in the embodiments of the application. Obviously, the described The embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work should fall within the protection scope of this application.

In order to solve the above problems, the present application provides a display device with dual displays, which includes a first display and a second display. As shown in FIG. 1, the display sizes of the first display and the second display are different. One display plays the main display role, also called the main screen, and the smaller size second display plays the auxiliary display role, also called the secondary screen. By adding a second display below the first display that plays a main display role, the second display can be used to display push information, and the content displayed on the first display will not be blocked.

The display device provided by this application can be a display device with a dual system and dual display structure as shown in Figures 1-7, that is, it has a first controller (first hardware system) and a second controller (second hardware system). ), the audio and picture synchronization processing of the display devices of the first display and the second display can also be non-dual-system display devices, such as one controller (hardware system), or two or more controllers (hardware system). ), this application is not limited.

In the specific implementation of the present application, the technical solution of the present application will be described in conjunction with a display device with dual systems. The following firstly describes in detail the structure, function, and implementation manner of the display device with a dual-system hardware structure.

The concepts involved in the present application will be described below in conjunction with the drawings. It should be pointed out here that the following description of each concept is only to make the content of this application easier to understand, and does not mean to limit the scope of protection of this application.

The term "module" used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can execute related components Function.

The term "remote control" used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. The component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

The term "hardware system" used in the various embodiments of this application may refer to an integrated circuit (IC), printed circuit board (Printed circuit board, PCB) and other mechanical, optical, electrical, and magnetic devices with computing , Control, storage, input and output functions of the physical components. In the various embodiments of the present application, the hardware system is usually also referred to as a motherboard or a chip.

Fig. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.

Wherein, the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods for wireless or other short-distance communication. The display device 200 is controlled in a wired manner. The user can control the display device 200 by inputting user instructions through keys, voice input, control panel input, etc. on the remote controller 100A. For example: the user can control the display device by inputting corresponding control commands through the volume up and down keys on the remote control 100A, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch machine keys, etc. 200 features.

The control device 100 can also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which can be connected through a local area network (LAN, Wide Area Network), a wide area network (WAN, Wide Area Network), and a wireless local area network (WLAN, Wireless Local Area Network) or other networks communicate with the display device 200, and control the display device 200 through an application program corresponding to the display device 200. For example, an application program running on a smart device is used to control the display device 200. The application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.

For example, both the mobile terminal 100B and the display device 200 can install software applications, so that the connection and communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be realized. For example, the mobile terminal 100B can be made to establish a control command protocol with the display device 200, the remote control keyboard can be synchronized to the mobile terminal 100B, and the function of controlling the display device 200 can be realized by controlling the user interface of the mobile terminal 100B; or the mobile terminal 100B The audio and video content displayed on the screen is transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 1, the display device 200 can also communicate with the server 300 through multiple communication methods. In various embodiments of the present application, the display device 200 may be allowed to perform a wired communication connection or a wireless communication connection with the server 300 through a local area network, a wireless local area network, or other networks. The server 300 may provide various contents and interactions to the display device 200.

Illustratively, the display device 200 transmits and receives information, interacts with an Electronic Program Guide (EPG, Electronic Program Guide), receives software program updates, or accesses a remotely stored digital media library. The server 300 may be a group or multiple groups, and may be one or more types of servers. The server 300 provides other network service content such as video-on-demand and advertising services.

The display device 200 includes a first display 201 and a second display 202, wherein the first display 201 and the second display 202 are independent of each other, and the first display 201 and the second display 202 are respectively controlled by different hardware systems.

The first display 201 and the second display 202 can be used to display different screen contents. For example, the first display 201 can be used for screen display of traditional television programs, and the second display 202 can be used for screen display of auxiliary information such as notification messages and voice assistants.

In an exemplary embodiment, the content displayed on the first display 201 and the content displayed on the second display 202 may be independent of each other without affecting each other. For example, when the first display 201 is playing a TV program, the second display 202 may display information such as time, weather, temperature, and reminder messages that are not related to the TV program.

In an exemplary embodiment, there may also be an association relationship between the content displayed on the first display 201 and the content displayed on the second display 202. For example, when the first display 201 plays the main screen of the video chat, the second display 202 may display information such as the avatar and the chat duration of the user currently accessing the video chat.

In an exemplary embodiment, part or all of the content displayed on the second display 202 can be adjusted to be displayed on the first display 201. For example, the time, weather, temperature, reminder message and other information displayed on the first display 201 can be adjusted to be displayed on the first display 201, and the second display 202 can be used to display other information.

In addition, the first display 201 displays a multi-party interactive screen while displaying a traditional TV program screen, and the multi-party interactive screen does not block the traditional TV program screen. Among them, the present application does not limit the display mode of the traditional TV program screen and the multi-party interactive screen. For example, this application can set the position and size of the traditional TV program screen and the multi-party interactive screen according to the priority of the traditional TV program screen and the multi-party interactive screen.

Taking the priority of traditional TV program screens higher than the priority of multi-party interactive screens as an example, the area of traditional TV program screens is larger than that of multi-party interactive screens, and the multi-party interactive screens can be located on one side of the traditional TV program screen or can be set floating In the corner of the multi-party interactive screen.

The display device 200, on the one hand, may be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or a projection display device; on the other hand, it may be a smart TV or a display system composed of a display and a set-top box. The specific type, size, resolution, etc. of the display device 200 are not limited, and those skilled in the art can understand that the display device 200 can have some changes in its performance and configuration as required.

In addition to providing the broadcast receiving TV function, the display device 200 may additionally provide a smart network TV function with a computer support function. Such as Internet TV, Smart TV, Internet Protocol TV (IPTV), etc. In some embodiments, the display device may not have a broadcast receiving function.

As shown in FIG. 1, a camera may be connected or provided on the display device 200 for presenting a picture captured by the camera on the display screen of the display device or other display devices, so as to realize interactive chats between users. Specifically, the picture captured by the camera can be displayed on the display device in full screen, half screen, or in any selectable area.

As an optional connection method, the camera is connected to the rear shell of the display device through a connecting plate, and is fixedly installed on the upper middle of the rear shell of the display device. As an installable method, it can be fixedly installed on the rear shell of the display device. Any position can ensure that the image capture area is not blocked by the back shell, for example, the image capture area and the display device have the same orientation.

As another optional connection method, the camera can be connected to the rear shell of the display device through a connecting plate or other conceivable connectors. The connector is equipped with a lifting motor. When the user wants to use the camera or has an application to use The camera is raised above the display device. When the camera is not needed, it can be embedded behind the back shell to protect the camera from damage and protect the privacy of the user.

As an embodiment, the camera used in this application may have 16 million pixels to achieve the purpose of ultra-high-definition display. In actual use, a camera with higher or lower than 16 million pixels can also be used.

When a camera is installed on the display device, the content displayed in different application scenarios of the display device can be integrated in many different ways, so as to achieve functions that cannot be achieved by traditional display devices.

Exemplarily, the user can have a video chat with at least one other user while watching a video program. The presentation of the video program can be used as the background screen, and the video chat window is displayed on the background screen. Visually, you can call this function "watch and chat".

Optionally, in the scenario of “watching while chatting”, while watching live video or online video, at least one video chat is conducted across terminals.

In another example, the user can video chat with at least one other user while entering the education application for learning. For example, students can realize remote interaction with teachers while learning content in educational applications. Visually, you can call this function "learning while chatting".

In another example, when a user is playing a card game, a video chat is conducted with a player entering the game. For example, when a player enters a game application to participate in a game, it can realize remote interaction with other players. Visually, you can call this function "watch and play".

Optionally, the game scene is integrated with the video picture, and the portrait in the video picture is cut out and displayed on the game picture to improve the user experience.

Optionally, in somatosensory games (such as ball games, boxing games, running games, dancing games, etc.), human body postures and movements are acquired through the camera, body detection and tracking, and detection of key points of human skeleton data, and then interact with the game Animations are integrated to realize games in scenes such as sports and dance.

In another example, the user can interact with at least one other user in video and voice in the K song application. Visually, you can call this function "watch and sing". In an exemplary embodiment, when at least one user enters the application in a chat scene, multiple users may jointly complete the recording of a song.

In another example, the user can turn on the camera locally to obtain pictures and videos, which is vivid, and this function can be called "look in the mirror".

In other examples, more functions can be added or the aforementioned functions can be reduced. This application does not specifically limit the function of the display device.

The configuration block diagram of the control device 100 is exemplarily shown in FIG. 2. As shown in FIG. 2, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.

FIG. 3 exemplarily shows a schematic diagram of the hardware structure of the hardware system in the display device 200. For ease of description, the display device 200 in FIG. 3 uses a liquid crystal display as an example for illustration.

As shown in FIG. 3, the display device 200 includes: a first panel 11, a first backlight assembly 21, a main board 31, an interactive board 32, a first display driver board 33, a second panel 12, a second backlight assembly 22, and a second display driver The board 34, the power supply board 4, the key board 35, the first rear shell 51, the second rear shell 52 and the base 6.

Among them, the first panel 11 is used to present a picture of the first display 201 to the user. The first backlight assembly 21 is located below the first panel 11, and is usually some optical components for supplying sufficient brightness and uniformly distributed light sources, so that the first panel 11 can display images normally. The first backlight assembly 21 also includes a first back plate (not shown in the figure). The main board 31, the interactive board 32, the first display drive board 33, and the power board 4 are arranged on the first backplane, and some convex hull structures are usually stamped on the first backplane. The main board 31, the interactive board 32, the first display driving board 33 and the power board 4 are fixed on the convex hull by screws or hooks. The main board 31, the interactive board 32, the first display driving board 3, and the power supply board 4 may be arranged on one board, or may be arranged on different boards. The first rear housing 51 is covered on the first panel 11 to hide the components of the display device 200 such as the first backlight assembly 21, the main board 31, the interactive board 32, the first display driving board 33 and the power supply board 4, etc. Effect.

The main function of the first display driver board 33 is: the PWM signal and the Lcaldimming signal transmitted by the first controller on the main board 31 are used to control the backlight zone of thousands of levels. After the handshake is established between the first controllers, the VbyOne display signal sent by the first controller on the main board 31 is received, and the VbyOne display signal is converted into an LVDS signal to realize the image display of the first display 201.

The base 6 is used to support the display device 200. It is worth noting that only one form of base design is shown in the figure, and those skilled in the art can design different forms of bases according to product requirements.

The second panel 12 is used to present the screen of the second display 202 to the user. The second backlight assembly 22 is located below the second panel 12, and is usually some optical components for supplying sufficient brightness and uniformly distributed light sources, so that the second panel 12 can display images normally. The second backlight assembly 22 also includes a second back plate (not shown in the figure). The second display driving board 34 is disposed on the second back plate, and usually some convex hull structures are stamped on the second back plate. The second display driving board 34 is fixed on the convex hull by screws or hooks. The second display driving board 34 may be arranged on one board, or may be arranged on different boards. The second rear housing 52 is covered on the second panel 12 to hide the display device 200 such as the second backlight assembly 22, the redrive board (not shown in the figure), the second display drive board 34 and the key board 35. Parts, play a beautiful effect.

In an exemplary embodiment, FIG. 3 further includes a key board 35. The key board 35 may be arranged on the first back board or the second back board, which is not limited in the present application.

In addition, the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction. Generally, audio components can achieve sound output of at least two channels; when the panoramic sound surround effect is to be achieved, multiple audio components need to be set to output multiple channels of sound, which will not be described in detail here.

It should be noted that the display device 200 may also adopt an OLED display screen. In this way, the template included in the display device 200 will be changed accordingly, and no further description will be given here.

Fig. 4 exemplarily shows a schematic diagram of the connection relationship between the power board and the load. As shown in Fig. 4, the power board 4 includes an input terminal IN and an output terminal OUT (the first output terminal OUT1, the second output terminal OUT2, and the The third output terminal OUT3, the fourth output terminal OUT4 and the fifth output terminal OUT5), wherein the input terminal IN is connected to the mains, the output terminal OUT is connected to the load, for example, the first output terminal OUT1 and the light emitting element (such as a light bar Or self-luminous devices, etc.), the second output terminal OUT2 is connected to the audio component, the third output terminal OUT3 is connected to the main board 31, the fourth output terminal OUT4 is connected to the first display driver board 33, and the fifth output terminal OUT5 is connected to the first The backlight assembly 21 is connected. The power board 4 needs to convert the AC mains power into the DC power required by the load, and the DC power usually has different specifications, for example, the audio component requires 18V, the panel requires 12V/18V, and so on.

For ease of description, in the following, one hardware system in the dual hardware system architecture is referred to as the first hardware system or the first controller, and the other hardware system is referred to as the second hardware system or the second controller. The first controller includes various processors and various interfaces of the first controller, and the second controller includes various processors and various interfaces of the second controller. A relatively independent operating system may be installed in the first controller and the second controller, and the operating system of the first controller and the operating system of the second controller may communicate with each other through a communication protocol, for example: the first controller The framework layer of the operating system of the second controller and the framework layer of the operating system of the second controller can communicate for command and data transmission, so that there are two independent but interrelated subsystems in the display device 200.

The dual hardware system architecture of the present application will be further described below in conjunction with FIG. 5. It should be noted that FIG. 5 is only an exemplary description of the dual hardware system architecture of the present application, and does not represent a limitation to the present application. In practical applications, both hardware systems can contain more or less hardware or interfaces as required.

FIG. 5 exemplarily shows a block diagram of the hardware architecture of the display device 200 shown in FIG. 3. As shown in FIG. 5, the hardware system of the display device 200 includes a first controller 210 and a second controller 310, and modules connected to the first controller 210 or the second controller 310 through various interfaces.

Wherein, the first controller 210 may be arranged on the main board 31 shown in FIG. 3. In an exemplary embodiment, the first controller 210 mainly implements traditional TV functions (for example, an external set-top box can be connected). The second controller 310 may be disposed on the second display driving board 34 shown in FIG. 3. In an exemplary embodiment, the second controller 310 may be used to receive instructions sent by the first controller 210 and control the second display 380 to display corresponding images.

The modules connected to the first controller 210 may include a tuner and demodulator 220, a communicator 230, an external device interface 250, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, The first display 280 (ie, the first display 201 in FIG. 1), the audio output interface 270, and the power supply module 240.

In other embodiments, the first controller 210 may also be connected with more or fewer modules.

In other embodiments, the first controller includes any of the above-mentioned modules.

Among them, the tuner and demodulator 220 is used to perform modulation and demodulation processing such as amplification, mixing, and resonance on the broadcast and television signals received through wired or wireless methods, so as to demodulate the user’s information from multiple wireless or cable broadcast and television signals. Select the audio and video signals carried in the frequency of the TV channel, as well as additional information (such as EPG data signals). According to different television signal broadcasting systems, the signal path of the tuner and demodulator 220 can have many kinds, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and according to different modulation types, the signal adjustment method can be digitally modulated The method may also be an analog modulation method; and according to different types of received television signals, the tuner demodulator 220 may demodulate analog signals and/or digital signals.

The tuner and demodulator 220 is also used to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency according to the user's selection and control by the first controller 210.

In some other exemplary embodiments, the tuner and demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the external device interface 250.

The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth module 232, a wired Ethernet module 233, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown in the figure).

The display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230. For example, the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210.

The external device interface 250 is a component that provides data transmission between the first controller 210 and other external devices. The external device interface 250 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG) and other data.

Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal is also called HDMI 251, a composite video blanking synchronization (CVBS) terminal is also called AV 252, and an analog or digital component terminal is also called component 253. , Universal Serial Bus (USB) terminals are also referred to as any one or more of USB 254, red, green and blue (RGB) terminals (not shown in the figure). This application does not limit the number and types of external device interfaces.

The first controller 210 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as an operating system and/or various application programs) stored on the memory 290.

As shown in FIG. 5, the first controller 210 includes a read-only memory ROM 213, a random access memory RAM 214, a graphics processor 216, a CPU processor 212, and a communication interface 218 (first interface 218-1, second interface 218). -2. The Nth interface 218-n), and the communication bus. Among them, the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a communication bus.

ROM 213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start the operating system. After the operating system is started, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.

The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes. It also includes a renderer, generates various objects obtained based on the arithmetic, and displays the result of the rendering on the first display 280.

The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include one main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode and other states.

The communication interface 218 may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.

The first controller 210 may control operations of the display device 200 related to the first display 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

The first controller 210 may control operations of the display device 200 related to the second display 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the first controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

The memory 290 includes storing various software modules used to drive and control the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure).

Among them, the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion, analysis and management. The voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the first display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.

At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, and the like.

The user input interface 260-3 is used to send a user's input signal to the first controller 210, or to transmit a signal output from the first controller 210 to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the input signal to the user input interface 260-3. The first controller 210; or, the control device may receive output signals such as audio, video, or data output from the user input interface 260-3 processed by the first controller 210, and display the received output signal or output the received output signal It is in the form of audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the first display 280, and the user input interface 260-3 receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 recognizes the sound or gesture through a sensor to receive the user input command.

The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal is directly displayed or played on the first display 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator with the zoomed video image according to user input or by itself, so as to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be the same as the source The video stream is related, and the output frame rate can be related to the refresh rate of the display device. The display formatting module is used to change the signal output by the frame rate conversion module into a signal conforming to the display format of a display device, for example, format the signal output by the frame rate conversion module to output RGB data signals.

The first display 280 is configured to receive image signals input from the video processor 260-1, display video content and images, and a menu control interface. The first display 280 includes a display component for presenting a picture and a driving component for driving image display. The displayed video content may come from the video in the broadcast signal received by the tuner and demodulator 220, or may come from the video content input by the communicator or the interface of an external device. The first display 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.

And, depending on the type of the first display 280, it also includes a driving component for driving the display. Alternatively, if the first display 280 is a projection display, it may also include a projection device and a projection screen.

The audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be played in the speaker 272 Audio signal.

The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the first controller 210. The audio output interface may include a speaker 272 or output to an external audio output terminal 274 of a generator of an external device , Such as: external audio terminal or headphone output terminal, etc.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the first controller 210 in one or more chips.

The power supply module 240 is configured to provide power supply support for the display device 200 with power input from an external power supply under the control of the first controller 210. The power supply module 240 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.

Similar to the first controller 210, as shown in FIG. 5, the modules connected to the second controller 310 may include a communicator 330, a detector 340, a memory 390, and a second display 380 (ie, the second display in FIG. 1 202), the video processor 360 and the external device interface 350. In some embodiments, it may also include a user input interface, an audio processor, and an audio output interface (not shown in the figure). In some embodiments, there may also be a power supply module (not shown in the figure) that independently supplies power to the second controller 310.

In some embodiments, the second controller 310 may include any one or more of the aforementioned modules.

The communicator 330 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and an infrared communication protocol module and other network communication protocol modules or near field communication protocol modules (not shown in the figure).

The communicator 330 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 in the hardware system of the first controller 210 is used to connect to an external network and generate network communication with an external server or the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without direct connection with the external network, etc., and the second controller 310 connects to the external network through the first controller 210 . Therefore, for the user, a display device as in the above embodiment can display a WiFi account to the outside.

The detector 340 is a component used by the second controller 310 to collect signals from the external environment or interact with the outside. The detector 340 may include a light receiver 342, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 341, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect attributes of users or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.

The external device interface 350 provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc., in a wired/wireless manner.

The video processor 360 is used to process related video signals.

The second controller 310 controls the work of the display device 200 and responds to the user by running various software control programs (such as installed third-party applications, etc.) stored on the memory 390 and interacting with the first controller 210. Operation.

As shown in FIG. 5, the second controller 310 includes a read only memory ROM 313, a random access memory RAM 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus. Among them, the ROM 313 and the RAM 314, the graphics processor 316, the CPU processor 312, and the communication interface 318 are connected through a communication bus.

ROM 313, used to store various system startup instructions. The CPU processor 312 runs the system startup instruction in the ROM, and copies the operating system stored in the memory 390 to the RAM 314 to start the startup operating system. After the operating system is started, the CPU processor 312 copies various application programs in the memory 390 to the RAM 314, and then starts to run and start various application programs.

The CPU processor 312 is used to execute operating system and application program instructions stored in the memory 390, communicate with the first controller 210, transmit and interact with signals, data, instructions, etc., and receive various interactive instructions from external inputs. , To execute a variety of applications, data and content, in order to finally display and play a variety of audio and video content.

There are multiple communication interfaces 318, which may include a first interface 318-1, a second interface 318-2 to an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or network interfaces connected to the first controller 210 via a network.

The second controller 310 may control the operation of the display device 200 related to the second display 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the second controller 310 may perform an operation related to the object selected by the user command.

The second controller 310 may control the operation of the display device 200 related to the first display 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

The graphics processor 316 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes. It also includes a renderer, which generates various objects obtained based on the arithmetic unit, and displays the result of the rendering on the second display 380.

Both the graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 can generate various graphics objects. Differentily, if application 1 is installed in the second controller 310 and application 2 is installed in the first controller 210, when the user is on the interface of application 1, and the user inputs instructions in the application 1, the second controller The graphics processor 316 of 310 generates graphics objects. When the user is on the interface of Application 2 and performs a user-input instruction in Application 2, the graphics processor 216 of the first controller 210 generates a graphics object.

Fig. 6 exemplarily shows a schematic diagram of the functional configuration of the display device of the present application.

As shown in FIG. 6, the memory 390 of the second controller 310 and the memory 290 of the first controller 210 are respectively used to store an operating system, application programs, content, and user data. Under the control of 210, the system operation of driving the first display 280 and the second display 380 and responding to various operations of the user are executed. The memory 390 and the memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically used to store the operating program that drives the first controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and application related programs. A variety of graphical user interfaces, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.

The memory 290 is specifically used to store driver programs and related data such as the video processor 260-1 and the audio processor 260-2, the first display 280, the communicator 230, the tuner and demodulator 220, and input/output interfaces.

In some embodiments, the memory 290 may store software and/or programs. The software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller , In order to achieve control or management of system resources.

For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external command recognition module 2907, a communication control module 2908, The light receiving module 2909, the power control module 2910, the operating system 2911, and other application programs 2912, the browser module 2913, and so on. The first controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, Various functions such as external command recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.

The memory 390 includes storing various software modules used to drive and control the display device 200. For example, various software modules stored in the memory 390 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure). Since the functions of the memory 390 and the memory 290 are relatively similar, please refer to the memory 290 for related parts, which will not be repeated here.

For example, the memory 390 includes an image control module 3904, a second audio control module 3906, an external command recognition module 3907, a communication control module 3908, an optical receiving module 3909, an operating system 3911, and other application programs 3912, a browser module 3913, etc. . The first controller 210 executes various software programs in the memory 290 such as: image control function, display control function, audio control function, external command recognition function, communication control function, light signal receiving function, power control function, support Various functions such as a software control platform with various functions, and browser functions.

Differently, the external command recognition module 2907 of the first controller 210 and the external command recognition module 3907 of the second controller 310 can recognize different commands.

Exemplarily, when an image receiving device such as a camera is connected to the second controller 310, the external command recognition module 3907 of the second controller 310 may include a graphic recognition module 2907-1, and the graphic recognition module 3907-1 stores a graphic database. , When the camera receives the graphics instruction from the outside world, it will correspond to the instruction in the graphics database to control the display device. Since the voice receiving device and the remote controller are connected to the first controller 210, the external command recognition module 2907 of the first controller 210 may include a voice recognition module 2907-2, and the voice recognition module 2907-2 stores a voice database. When the voice receiving device or the like receives a voice instruction from the outside world, it corresponds to the instruction in the voice database to control the display device. Similarly, the control device 100 such as a remote controller is connected to the first controller 210, and the key instruction recognition module 2907-3 interacts with the control device 100.

FIG. 7 exemplarily shows a configuration block diagram of the software system in the display device 200.

For the first controller 210, as shown in FIG. 7, the operating system 2911 includes operating software for processing various basic system services and for implementing hardware-related tasks, acting as an application program and completing data processing between hardware components Medium.

In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.

The communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects that display the user interface for access by various applications, and can realize user operability.

The control application 2911-4 is used to control process management, including runtime applications, etc.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various event references, and A processing program that implements one or more sets of predefined operations.

Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.

The event recognition module 2914-2 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute the corresponding one or more groups of processing programs .

The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.). Such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices. For example, one or more sub-events in the remote control include various forms, including but not limited to one or a combination of pressing up/down/left/right/, the OK key, and pressing the key. And the operations of non-physical buttons, such as moving, pressing, and releasing.

The interface layout management module 2913, which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size or position, level, etc. of the interface are related to the various execution operations of the interface layout.

The event transmission system 2914 can monitor the user input of each predefined event or sub-event, and directly or indirectly provide the control of the recognized event or sub-event to the interface layout management module 2913.

The interface layout management module 2913 is used to monitor the state of the user interface (including the position and/or size, change process, etc. of the view partition, item, focus or cursor object, etc.), and according to the event or sub-event, the view display area can be modified The size, position, and level of the layout, and/or, adjust or modify the size or/and position, number, type, content, etc. of the layout of various items in the view display area. In some embodiments, modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in the view partition on the screen.

The user input interface is used to send the user's input signal to the controller, or to transmit the signal output from the controller to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the user input interface to the controller; Alternatively, the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal in the form of audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

Since the functions of the operating system 3911 of the second controller 310 and the operating system 2911 of the first controller 210 are relatively similar, please refer to the operating system 2911 for related details, which will not be repeated here.

As shown in FIG. 8, the application layer of the display device includes various application programs that can be executed on the display device 200.

The application layer 2912 of the first controller 210 may include, but is not limited to, one or more applications, such as: video-on-demand application, application center, game application, and so on. The application layer 3912 of the second controller 310 may include, but is not limited to, one or more applications, such as a live TV application, a media center application, and so on. It should be noted that the application programs included in the second controller 310 and the first controller 210 are determined according to the operating system and other designs, and the present invention does not need to determine the application programs included in the second controller 310 and the first controller 210. The application program is specifically defined and divided.

Live TV applications can provide live TV through different sources. For example, a live TV application can provide a TV signal using input from cable TV, wireless broadcasting, satellite services, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200.

Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.

Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.

Application center, can provide storage of various applications. The application program may be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device. The application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.

Since the second controller 310 and the first controller 210 may be respectively installed with independent operating systems, there are two independent but related sub-systems in the display device 200. For example, both the second controller 310 and the first controller 210 can be independently installed with Android (Android) and various APPs, both of which can realize certain functions, and the second controller 310 and the first controller 210 can cooperate to realize certain functions. Item function.

FIG. 9a exemplarily shows a schematic diagram of a user interface in the display device 200. As shown in FIG. 9a, the user interface includes a first view display area 2011 and a second view display area 2021. The functions of the first view display area 2011 and the second view display area 2021 are basically the same. The following only focuses on the first view display area 2011. For example, the first view display area 2011 includes one or more different items in the layout. And, the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.

"User interface" is a medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of an electronic device. The control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. Visual interface elements.

In some embodiments, the first view display area 2011 is a zoomable view display. “Scalable” may indicate that the size or proportion of the first view display area 2011 on the screen is scalable, and the size or proportion of the items in the first view display area 2011 is scalable.

"Items" are displayed in the view display area of the user interface in the display device 200 to represent visual objects corresponding to the content, such as icons, thumbnails, and video clips. For example: the item can represent the image content or video clip of a movie, TV series, audio content of music, application program, or other user access content history information.

In addition, the item may indicate an interface or a set of interfaces displayed by which the display device 200 is connected to an external device, or may indicate the name of an external device connected to the display device, or the like. Such as: signal source input interface collection, or high-definition multimedia interface (High Definition Multimedia Interface, HDMI), USB interface, PC terminal interface, etc.

It should be noted that: the view display area can present the content of the video chat project or the content of the application layer project (for example, webpage video, video on demand (VOD) display, application program screen, etc.).

"Selector" is used to indicate that any item has been selected, such as cursor or focus object. According to the position of the icon or menu touched by the user in the display 200, the selection information input is positioned, and the movement of the focus object displayed in the display device 200 can be used to select the control item, and one or more items can be selected or controlled.

The focus object refers to the object that moves between items based on user input. For example, draw a thick line on the edge of the item to realize or identify the position of the focus object. In other embodiments, the focus form is not limited to examples, it can be a tangible or intangible form that can be recognized by the user such as a cursor, such as a 3D deformation of the item, and the border line and size of the text or image of the focused item can also be changed. , Color, transparency and outline and/or font.

In some embodiments, the first controller 210 controls the operation and response of the display device 200 and the first display by running various software control programs (such as an operating system and/or various application programs) stored on the memory 290. 280 related user operations. For example, the user interface is controlled to be presented on the first display 280, and the user interface includes a number of UI objects; in response to a received user command to the UI object on the user interface, the first controller 210 can execute the object selected by the user command Related operations.

The second controller 310 controls the operation and response of the display device 200 by running various software control programs (such as installed third-party applications, etc.) stored on the memory 390 and interacting with the first controller 210 to control the operation and response of the display device 200 2. User operations related to the display 380. For example, controlling the presentation of a user interface on the second display 380, the user interface includes a number of UI objects, in response to the received user command to the UI object on the user interface, the second controller 310 can execute the object selected by the user command Related operations.

For ease of description, the user interface presented on the first display 280 is referred to as the first user interface, and the user interface presented on the second display 380 is referred to as the second user interface. In an exemplary embodiment, the first user interface and the second user interface may respectively display the homepages of the operating systems run by the first controller and the second controller.

Figure 9b exemplarily shows a play screen provided by the display device. As shown in Figure 9b, the play screen is composed of a first user interface presented on the first display and a second user interface presented on the second display. The first user interface and/or the second user interface may display one or more of interface elements, video screens, picture screens, etc., such as the homepage displayed on the first display in FIG. 9b.

Limited by the size of the second display/second user interface, it is impossible to display too many operable items in the second user interface. To solve this problem, the setting menu of the second display is displayed in the second user interface in the embodiment of the application. In the second user interface, the setting menu includes operable items acting on the second display, and further, the user can input operations in the second user interface to control the second display.

Figures 9b to 12 exemplarily show schematic diagrams of the interaction process of making the first display present a GUI by operating the control device.

When the first display shows the first user interface as shown in FIG. 9b, the user can input a menu item display instruction by operating the control device 100 (such as the remote control 100A) to instruct the display device to present the display of the second display on the first display. The setting menu has multiple items, such as items for setting the push function, and items for adjusting the backlight brightness of the second display. The push function refers to displaying push information in the second user interface. When the first controller receives the menu item display instruction input by the user, in response to the menu item display instruction, it controls to present the setting menu of the second display on the first display.

The following describes the user interface interaction process of the display device presenting the setting menu of the second display with reference to FIG. 10 to FIG. 12.

First, on the interface shown in Figure 9b, the user can input a user instruction to display the system menu by triggering the "menu" key on the control device, and the first controller can respond to the user instruction and display a display such as 10 shows the user interface, the user interface displays a menu option page 90, the menu option page 90 contains a plurality of items 91-97, and displays a selector 98 indicating that any item is selected, the user can operate The position of the selector 98 in the user interface is moved by the input of the control device to change the selection of different items.

Next, in FIG. 10, when the user operates the control device and inputs a user instruction instructing the selector 98 to select the item 96, the first controller may respond to the user instruction and present the user as shown in FIG. 11 on the first display. Interface, a main setting menu page ("AI setting") 96 is displayed in the user interface, and the main setting menu page 96 corresponds to the detailed menu options of item 96, that is, items 961-967. After that, in FIG. 11, when the user operates the control device and inputs a user instruction instructing the selector 98 to select the item 964, the first controller may respond to the user instruction and present the user as shown in FIG. 12 on the first display. An interface, the user interface displays a setting menu ("secondary screen setting") 964 of the second display, and the setting menu of the second display contains detailed menu options corresponding to the item 964, that is, items 9641-9644.

As mentioned above, the setting menu of the second display presented on the first display has multiple items, such as the item 9661 ("Sub-screen brightness") and item 9662 ("Do Not Disturb") shown in FIG. 12 , Project 9663 ("Smart Life") and Project 9664 ("Sub-screen Theme"). Among them, item 9661 ("secondary screen brightness") and item 9662 ("Do Not Disturb") are used to adjust the backlight brightness of the second display, and item 9663 ("smart life") is used to turn on or off the application on the second display. Push function, that is, display push information on the second user interface, item 9664 ("secondary screen theme") user sets the interface theme of the second user interface.

In some embodiments, the items used to adjust the backlight brightness of the second display correspond to different adjustment rules, such as proportional adjustment, that is, the backlight brightness is proportionally adjusted in response to the user's adjustment of the brightness value on the user interface. , Another example is the automatic adjustment of conditions, that is, the backlight brightness is adjusted to a preset value in response to the satisfaction of the preset condition.

When the first display displays the setting menu as shown in FIG. 12, the user can operate the item for adjusting the brightness of the second display on the setting menu by operating the control device, and when the first controller receives the user's user operation on the item At this time, in response to the operation, the brightness of the second display is adjusted according to the adjustment rule corresponding to the operated item.

For example, the aforementioned item for adjusting the brightness of the second display may be the first item for proportionally adjusting the brightness of the second display, such as the item 9641 (“secondary screen brightness”) shown in FIG. 12. The user can input the brightness value of the second display by operating the aforementioned first item, and the first controller can adjust the backlight brightness of the second display to the brightness value input by the user.

For example, as shown in FIG. 12, the user can instruct the selector 98 to select the item 9661 by operating the control device. In response to the user operation, the first controller presents the user interface shown in FIG. 13 on the first display. The brightness adjustment bar is displayed in. On the user interface shown in FIG. 13, the user can trigger the left or right arrow keys on the control device to adjust the brightness value lower or higher.

It can be seen from the above example that the user can modify the brightness value of the second display based on the interaction with the first item and the brightness adjustment bar. At the same time, based on the user's operation of the first item and the brightness adjustment bar, the first controller can receive the brightness value input by the user, and further, can adjust the backlight brightness of the second display to the brightness value input by the user.

In specific implementation, the brightness value corresponds to the PWM value in an equal proportion. The first controller can convert the brightness value input by the user into the corresponding PWM signal, and transmit the PWM signal to the communication bus (I2C), and read/write the first controller through the communication bus. The GPIO interface on the second display driving board 33 inputs the PWM signal to the second display driving board 33 so that the second display driving board 33 controls the backlight brightness of the second backlight assembly 22 according to the input PWM signal.

As another example, the above item for adjusting the brightness of the second display is a second item for automatically adjusting the brightness of the second display, such as the item 9642 ("Do Not Disturb") shown in FIG. 12. The user can input the duration threshold for triggering the automatic adjustment of the brightness of the second display by operating the aforementioned second item, so that when the top page displayed by the second display is the homepage of the operating system of the second controller and the display duration reaches the duration When the threshold is set, the first controller adjusts the backlight brightness of the second display to a preset low brightness.

For example, as shown in FIG. 12, the user may instruct the selector 98 to select the item 9642 by operating the control device, and the first controller may present the user interface as shown in FIG. 14 on the first display in response to the user's operation. There are multiple items 96421-96426 displayed on the interface, which correspond to the switch button of the "Do Not Disturb" function and the time threshold option provided by the display device. In the user interface shown in Figure 14, the user can operate the control device to select an item to enter the time threshold corresponding to the selected item, such as 2 minutes as shown in Figure 14, or enter to turn off the "Do Not Disturb" function User instructions.

In specific implementation, the first controller sends the brightness value input by the user to the second controller, and after receiving the brightness value, the second controller saves it as a system attribute value. The second controller obtains the top activity displayed on the second display and monitors the switching of the top page to determine whether the top page is the homepage (Launcher) of the operating system running on the second controller. When the homepage is When the top page is displayed, the display time of the top page is timed. When the display time of the homepage on the top page reaches the duration threshold, the first message is sent to the first controller to instruct the first controller to 2. The backlight brightness of the display is adjusted from the current brightness to the preset low brightness.

Wherein, the preset low brightness is a brightness value pre-stored by the first controller. In an exemplary embodiment, the preset low brightness value is lower than the brightness value set by the user for the first display and also lower than the brightness value set by the user for the second display, but it is not limited to this.

It needs to be added that if the homepage exits from the top page when the display time of the homepage on the top page does not reach the duration threshold, that is, the top page is switched from the homepage to a page other than the homepage, the timing needs to be stopped.

In this way, when there is no interaction and push on the second display, its backlight brightness will be automatically adjusted down after a period of time (time threshold), so that the second display is integrated with the display device frame and base in appearance, and will not be affected. The user is disturbed when the user inputs an operation related to the first display.

In some embodiments, when the brightness of the second display is the preset low brightness, if the second controller detects that the top page displayed on the second display is switched from the home page to another interface other than the home page, The second controller sends a second message to the first controller to instruct the first controller to adjust the brightness of the second display from a preset low brightness to a brightness value set by the user, so as to ensure that the second display normally presents screen content.

It should be noted that the first controller adjusts the brightness of the second display in response to receiving the first message or the second message, and the second controller adjusts the second display in response to the user's operation of the first item. The process of brightness is the same, so I won't repeat it here.

It can be seen from the above embodiment that when the first display presents the first user interface, the first controller can respond to the menu item display instruction input by the user, and present the setting menu of the second display on the first display, which can respond to the user For the operation of the item used to adjust the brightness of the second display on the aforementioned setting menu, the backlight brightness of the second display is adjusted according to the adjustment rule corresponding to the item.

Wherein, the item used to adjust the brightness of the second display may include a first item and/or a second item. The first item is used to scale the brightness of the second display, so that the display device supports the user to control the second display through the setting menu. The brightness is actively adjusted, and the second item is used to automatically adjust the brightness of the second display, so that the display device supports when there is no interaction and push on the second display, the brightness is automatically reduced after a period of time, both from the appearance and the display The device frame and the base are integrated, and the user will not be disturbed when the user inputs operations related to the first display.

In some embodiments, the setting menu of the second display has an item for turning on or off the push function, and the user can operate the item on the setting menu by operating the control device to turn the push function on or off. For example, as shown in FIG. 12, the user can move the position of the selector to make the selector fall into item 9663 ("Smart Life") and operate the OK key to turn on or turn off the push function. When the push function is turned on, the controller obtains the push information and displays the push information in the second user interface. In this way, not only can the user obtain the experience of receiving the message push on the display device, the displayed push information will not obstruct the content that the user is watching.

In some embodiments, the push information includes but is not limited to pictures, posters, texts, and so on.

In some embodiments, the push information may specifically include: weather information, historical records of the application login account (such as video viewing records), various update information (such as the update of the drama provided by the application, order progress), and various recommended information ( Such as product recommendation, new film/program recommendation), real-time/hot information information, and various help information (such as how to shut down, how to use voice functions, etc.). For example, weather information is displayed in the second user interface shown in FIG. 9, and a new message reminder is displayed in the second user interface shown in FIG. 9.

Due to the complexity of the push information, in order to improve the push effect and to ensure that the user pays attention, in some embodiments, the push order is preset, and when the push is required, the push information is displayed in the second user interface according to the preset order.

In some embodiments, the controller detects whether the push function is turned on in response to the display device being turned on, and if the push function is turned on, acquires at least one piece of push information, and displays the at least one piece of push information in the second user interface in a preset order. If the push function is turned off, the process ends, that is, the step of pushing information to the second display is not executed.

In specific implementation, the on or off state of the above push function can be saved as a system attribute, and different attribute values are used to represent the on and off states. For example, when the push function is turned on by a user operation, the attribute value 1 is saved. When the user operation closes the push function, the attribute value 0 is saved. The controller can detect whether the push function is enabled by obtaining the attribute value of the attribute.

In some embodiments, not only the push messages are pushed to the second user interface in a preset order, but also the display duration can be set for each push message in advance. The preset display duration corresponding to different push messages can be the same or different. When the push information is displayed, the display duration of the current push information is timed. When the display duration of the current push information reaches its corresponding preset display duration, the push information is cancelled and the next push information is displayed. In this way, for each piece of push information, after its display time reaches a certain value, it will automatically disappear in the second user interface without user operation, so it can provide a user experience.

In some embodiments, after the display of the last push message is completed, the backlight brightness of the second display is reduced to the aforementioned preset low brightness, so that the second display is integrated with the frame and base of the display device in appearance. It will disturb the user when the user inputs an operation related to the first display.

For example, push information such as weather, history, drama update, member notification, order progress, hot information, new movie recommendation, good thing recommendation, voice help, etc. are displayed in the second user interface in the following order and display duration.

顺序order	推送信息名称Push message name	显示时长/秒Display duration/sec
11	天气weather	1515
22	历史记录history record	1010
33	追剧更新Chase drama update	1010
44	会员通知Member notification	1010
55	订单进展Order progress	1010
66	热点资讯Hot info	1515
77	新片推荐New movie recommendation	1010
88	好物推荐Good things recommended	1010
99	语音帮助Voice help	1010

It should be noted that the foregoing push sequence and display duration are only an exemplary embodiment, and those skilled in the art can adjust the push sequence and duration according to needs, and can also set different push times for different push information, for example, in Push the weather of the day before 18:00 every day, push the news of tomorrow after 18:00 every day, push the weather of the next week at 12:00 noon every day, and so on. In addition, you can increase or decrease information pushes based on user operations. The number of push messages can also be set for each type of push information. For example, after each boot, three push messages of good thing recommendation are obtained and displayed in the second user interface in order.

In the display device provided by the embodiment of the present application, by adding a second display below the first display that plays a main display role, the second display can be used to display push information, which not only enables the user to get the experience of receiving message push on the display device, It will not block the content displayed on the first display. The operable items that act on the second display (that is, the items in the setting menu of the second display) are displayed in the first user interface, which is convenient for the user to operate and avoids the inconvenience caused by the small size of the second display.

The embodiment of the present application also provides an interactive control method. With reference to the method flowchart shown in FIG. 15, the method may be executed by the first controller, but is not limited to this. Referring to FIG. 15, the method may include:

Step 101: Present a first user interface on a first display; for example, the first user interface shown in FIG. 8.

In some embodiments, while the first user interface is presented on the first display, the second user interface is presented on the second display.

Step 102: Receive a menu item display instruction input by a user on the first user interface, where the menu item display instruction indicates to display a setting menu of the second display.

The user can input the above-mentioned menu item display instructions by operating the control device, for example, pressing the menu key, direction key, OK key, etc. on the control device one or more times.

Step 103: In response to the menu item display instruction, a setting menu of the second display is presented on the first display, the setting menu includes items for setting a push function, and the push function refers to 2. The push information is displayed in the user interface;

The setting menu of the above-mentioned second display may be the setting menu 966 in the first user interface as shown in FIG. 12. The items used to set the push function on the setting menu can be item 9663 ("Smart Life") as shown in Figure 12.

Step 104: In response to the operation on the item for setting the push function, turn on or turn off the push function.

In some embodiments, in response to turning on the display device, it is detected whether the push function is turned on; if the push function is turned on, at least one piece of push information is acquired; Shown in the second user interface.

In some embodiments, the displaying at least one piece of push information in the second user interface in a preset order includes: obtaining a preset display duration of the push information; and when the current display duration of the push information reaches the corresponding preset When the display duration is displayed, cancel the display of the current push message, and display the next push message.

In some embodiments, after the display of the last piece of push information is completed, the backlight brightness of the second display is reduced to a preset low brightness.

In some embodiments, the setting menu further includes an item for adjusting the brightness of the second display, and the method further includes: setting the item for adjusting the brightness of the second display in response to a user's operation on the item for adjusting the brightness of the second display. The brightness of the second display is adjusted to the target brightness.

In specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments of the interactive control method provided by the present invention when the program is executed. The storage medium may be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated as ROM) or a random access memory (English: random access memory, abbreviated as: RAM), etc.

Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions in the embodiments of the present invention can be embodied in the form of software products, which can be stored in a storage medium, such as ROM/RAM. , Magnetic disks, optical disks, etc., including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in the various embodiments or some parts of the embodiments of the present invention.

The same or similar parts in the various embodiments in this specification can be referred to each other. In particular, as for the method embodiment, since it is basically similar to the display device embodiment, the description is relatively simple, and for related parts, please refer to the description in the display device embodiment.

The embodiments of the present invention described above do not constitute a limitation on the protection scope of the present invention.

Claims

A display device, characterized in that it comprises:

The first display is configured to present a first user interface, where the first user interface displays a setting page and/or a playing screen;

The second display is configured to present a second user interface, and push information is displayed on the second user interface;

The controller is configured as:

Presenting a first user interface on the first display, and presenting a second user interface on the second display:

Receiving a menu item display instruction input by a user on the first user interface, where the menu item display instruction indicates to display a setting menu of the second display;

In response to the menu item display instruction, a setting menu of the second display is displayed in the first user interface, the setting menu includes items for setting a push function, and the push function refers to the second user Push information is displayed in the interface;

In response to the operation on the item for setting the push function, the push function is turned on or off.
The display device according to claim 1, wherein the controller is further configured to:

In response to turning on the display device, detecting whether the push function is turned on;

If the push function is enabled, obtain at least one piece of push information;

Displaying the at least one piece of push information in the second user interface in a preset order.
The display device according to claim 2, wherein the controller is further configured to display push information in the second user interface according to the following steps:

Obtain the preset display duration of the push information;

When the display duration of the current push information reaches the corresponding preset display duration, cancel the display of the current push information, and display the next push information.
The display device according to any one of claims 1-3, wherein the controller is further configured to:

After completing the display of the last piece of push information, the backlight brightness of the second display is reduced to a preset low brightness.
The display device according to any one of claims 1 to 3, wherein the setting menu further includes an item for adjusting the brightness of the second display, and the controller is further configured to:

In response to the user's operation of the item for adjusting the brightness of the second display, the brightness of the second display is set, and the second display is adjusted to the target brightness.
An interactive control method, characterized in that it is applied to a display device, the display device includes a first display and a second display, and the method includes:

Presenting a first user interface on the first display, and presenting a second user interface on the second display:

Receiving a menu item display instruction input by a user on the first user interface, where the menu item display instruction indicates to display a setting menu of the second display;

In response to the menu item display instruction, a setting menu of the second display is displayed in the first user interface, the setting menu includes items for setting a push function, and the push function refers to the second user Push information is displayed in the interface;

In response to the operation on the item for setting the push function, the push function is turned on or off.
The method according to claim 6, wherein the method further comprises:

In response to turning on the display device, detecting whether the push function is turned on;

If the push function is enabled, obtain at least one piece of push information;

Displaying the at least one piece of push information in the second user interface in a preset order.
The method according to claim 7, wherein the displaying at least one piece of push information in the second user interface in a preset order comprises:

Obtain the preset display duration of the push information;

When the display duration of the current push information reaches the corresponding preset display duration, cancel the display of the current push information, and display the next push information.
The method according to any one of claims 6-8, wherein the method further comprises:

After completing the display of the last piece of push information, the backlight brightness of the second display is reduced to a preset low brightness.
The method according to any one of claims 6-8, wherein the setting menu further includes an item for adjusting the brightness of the second display, and the method further comprises:

In response to the user's operation of the item for adjusting the brightness of the second display, the brightness of the second display is set, and the second display is adjusted to the target brightness.