CN113497966A

CN113497966A - Double-screen display equipment

Info

Publication number: CN113497966A
Application number: CN202010265551.6A
Authority: CN
Inventors: 何营昊; 李东航
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-04-07
Filing date: 2020-04-07
Publication date: 2021-10-12
Anticipated expiration: 2040-04-07
Also published as: CN113497966B

Abstract

The application discloses double screen display equipment, the second controller obtains the connection status of first controller data interface and the connection status of second controller data interface, and the receipt is applied and is started the instruction, confirms the application source and the show demand of appointed application based on the packet name, combines the connection status of two controller data interface, generates the interface and switches the sign. And calling a data interface of the controller to which the specified application belongs, which corresponds to the interface switching identifier, and displaying the display content of the specified application in a display corresponding to the display requirement. Therefore, according to the dual-screen display device provided by the embodiment of the invention, the second controller judges whether the designated application belongs to the first controller or the second controller and needs to be displayed on the first display or the second display, so as to generate the interface switching identifier, and display of the display content of the designated application on the display corresponding to the display requirement is realized, so that coordinated display of the dual-system dual-screen application is ensured.

Description

Double-screen display equipment

Technical Field

The application relates to the technical field of dual-system dual-screen application display switching, in particular to a dual-screen display device.

Background

With the continuous development of communication technology, terminal devices such as computers, smart phones and display devices have become more and more popular. In addition, as the demand of the user on the application experience is higher and higher, the requirements on various performance indexes of the operating system of the terminal equipment are also higher, and in order to provide rich display contents, it is possible to set a double screen on the Android terminal equipment.

Therefore, how to present the picture on the dual-screen display and whether a corresponding interface exists between the dual-screen display to meet better user experience become a technical problem to be solved urgently in the field.

Disclosure of Invention

The application provides a double-screen display device to solve the problem of how to ensure the content coordination display of double-screen application.

In a first aspect, the present application provides a dual-screen display device, including:

the first controller is configured to receive an application starting instruction sent by the second controller and switch the data interface;

a first display communicatively connected to the first controller, the first display configured to display content of a first application, the first application being an application configured in the first controller;

a second display communicatively connected to a second controller, the second display configured to display content of a first application or display content of a second application, the second application being an application configured in the second controller;

a second controller configured to acquire a connection state of the data interface of the first controller, wherein the connection state of the data interface is used for representing whether the first controller is connected with the first display or the second display currently;

receiving an application starting instruction for starting a specified application;

responding to the application starting instruction, and judging an application source and a display requirement of the specified application, wherein the application source is used for representing whether the specified application belongs to a first controller or a second controller, and the display requirement is used for representing whether display content of the specified application needs to be displayed on a first display or a second display;

if the application source of the specified application is a first controller, and the display corresponding to the display requirement of the specified application is inconsistent with the display corresponding to the connection state of the data interface of the first controller, generating an interface switching identifier, switching the connection between the data interface of the first controller and the controller to which the display corresponding to the display requirement belongs, and presenting the display content of the specified application in the display corresponding to the display requirement.

In a second aspect, the present application provides a dual screen display device, comprising:

a second controller configured to receive an application start instruction for starting a designated application when the data interface of the first controller is connected with the second display;

if the application source of the specified application is the second controller and the display requirement of the specified application is the second display, generating an interface switching identifier, switching the signal source of the second controller to the system interface of the second controller, and displaying the display content of the specified application in the second display corresponding to the display requirement.

In a third aspect, the present application provides a dual screen display device, comprising:

a second controller configured to obtain a connection state of a first controller data interface and a connection state of a second controller data interface, the connection states of the data interfaces being used to represent whether a corresponding controller is currently connected with the first display or the second display;

receiving an application starting instruction for starting a specified application, wherein the application starting instruction carries a package name of the specified application;

determining an application source and a display requirement of the specified application based on the package name of the specified application, wherein the application source is used for representing whether the specified application belongs to a first controller or a second controller, and the display requirement is used for representing whether display content of the specified application needs to be displayed on a first display or a second display;

generating an interface switching identifier based on the connection state of the first controller data interface, the connection state of the second controller data interface, the display requirement of the specified application and an application source;

and calling a data interface of the controller to which the specified application belongs, which corresponds to the interface switching identifier, and displaying the display content of the specified application in a display corresponding to the display requirement.

As can be seen from the foregoing technical solutions, in the dual-screen display device provided in the embodiments of the present invention, the processing method of the second controller includes obtaining a connection state of the data interface of the first controller and a connection state of the data interface of the second controller, receiving an application start instruction for starting a carrying package name of a specified application, determining an application source and a display requirement of the specified application based on the package name of the specified application, and generating an interface switching identifier in combination with the connection states of the data interfaces of the two controllers, so as to implement calling of the data interfaces of the corresponding controllers. And calling a data interface of the controller to which the specified application belongs, which corresponds to the interface switching identifier, and displaying the display content of the specified application in a display corresponding to the display requirement. As can be seen, in the dual-screen display device provided in the embodiment of the present invention, the second controller determines whether the designated application corresponding to the application start instruction belongs to the first controller or the second controller, and the display content of the designated application needs to be displayed on the first display or the second display, and after determining the application source and the display requirement, generates the interface switching identifier to control the corresponding controller to switch the data interface, so as to implement the display of the display content of the designated application on the display corresponding to the display requirement, and ensure the coordinated display of the dual-screen application in the dual system.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an exemplary embodiment;

fig. 2 is a block diagram schematically showing a configuration of the control apparatus 100 according to an exemplary embodiment;

fig. 3 is a diagram schematically illustrating a hardware configuration of a hardware system in the display apparatus 200 according to the exemplary embodiment;

FIG. 4 is a schematic diagram illustrating the connection of a power strip to a load;

fig. 5 is a block diagram illustrating an exemplary hardware architecture of the display device 200 shown in fig. 3;

fig. 6 is a diagram exemplarily showing a functional configuration of a display device according to an exemplary embodiment;

fig. 7 is a block diagram schematically showing a configuration of a software system in the display apparatus 200 according to the exemplary embodiment;

FIG. 8 is a block diagram illustrating the architecture of the application layer of a display device in accordance with an exemplary embodiment;

FIG. 9 is a schematic diagram illustrating a user interface in the display device 200 according to an exemplary embodiment;

FIG. 10 is a block diagram illustrating a display device presenting dual system dual screens in accordance with an exemplary embodiment;

fig. 11 is a block diagram schematically illustrating a structure of a dual screen display device according to an exemplary embodiment;

FIG. 12 is a flow chart illustrating a method for switching between dual system size and dual screen application displays in accordance with an exemplary embodiment;

FIG. 13 is another flow chart illustrating a method for switching a dual system size dual screen application display in accordance with an exemplary embodiment;

FIG. 14 is a first data flow diagram illustrating a method for switching between dual system size and dual screen application displays in accordance with an illustrative embodiment;

FIG. 15 is a flow chart illustrating a method of generating an interface switch identification in accordance with the exemplary embodiment;

FIG. 16 is a flow chart illustrating another method of generating an interface switch identification in accordance with the illustrative embodiment;

FIG. 17 is a flow chart illustrating a first method of presenting display content of a specified application in accordance with an illustrative embodiment;

FIG. 18 is a flow chart illustrating a second method of presenting display content of a specified application in accordance with an illustrative embodiment;

FIG. 19 is a second data flow diagram illustrating a method for switching a display of a dual system size dual screen application in accordance with an illustrative embodiment;

FIG. 20 is a flow chart illustrating a third method of presenting display content of a specified application in accordance with an illustrative embodiment;

a third data flow diagram illustrating a method for switching a display of a dual system size dual screen application in accordance with an exemplary embodiment is shown in fig. 21.

Detailed Description

The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The present application is mainly directed to a sound and picture synchronization process of a display device having a dual-system and dual-display structure, that is, a display device having a first controller (a first hardware system), a second controller (a second hardware system), a first display, and a second display, and the following first describes details of structures, functions, implementation manners, and the like of the display device having the dual-system hardware structure.

For the convenience of users, various external device interfaces are usually provided on the display device to facilitate connection of different peripheral devices or cables to implement corresponding functions. When a high-definition camera is connected to an interface of the display device, if a hardware system of the display device does not have a hardware interface of a high-pixel camera receiving the source code, data received by the camera cannot be displayed on a display screen of the display device.

Furthermore, due to the hardware structure, the hardware system of the conventional display device only supports one path of hard decoding resources, and usually only supports video decoding with a resolution of 4K at most, so when a user wants to perform video chat while watching a network television, the user needs to use the hard decoding resources (usually GPU in the hardware system) to decode the network video without reducing the definition of the network video screen, and in this case, the user can only process the video chat screen by using a general-purpose processor (e.g. CPU) in the hardware system to perform soft decoding on the video.

The soft decoding is adopted to process the video chat picture, so that the data processing burden of a CPU (central processing unit) can be greatly increased, and when the data processing burden of the CPU is too heavy, the problem of picture blocking or unsmooth flow can occur. Further, due to the data processing capability of the CPU, when the CPU performs soft decoding on the video chat screen, multi-channel video calls cannot be generally implemented, and when a user wants to perform video chat with multiple other users in the same chat scene, access is blocked.

In view of the above aspects, to overcome the above drawbacks, the present application discloses a dual hardware system architecture to implement multiple channels of video chat data (at least one channel of local video).

The concept to which the present application relates will be first explained below with reference to the drawings. It should be noted that the following descriptions of the concepts are only for the purpose of facilitating understanding of the contents of the present application, and do not represent limitations on the scope of the present application.

The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.

The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be referred to as a motherboard (or chip).

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an exemplary embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the control device 100.

The control device 100 may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on the remote controller 100A, voice input, control panel input, or the like to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right movement keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller 100A to control the functions of the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like, which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application may provide various controls to the User through an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 100B and the display device 200 may each have a software application installed thereon, so that connection communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be in a wired or wireless communication connection with the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.

Illustratively, the display device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

The display device 200 includes a first display 201 and a second display 202, wherein the first display 201 and the second display 202 are independent from each other, and a dual hardware control system is adopted between the first display 201 and the second display 202.

The first display 201 and the second display 202 may be used to display different display screens. For example, the first display 201 may be used for screen display of conventional television programs, and the second display 202 may be used for screen display of auxiliary information such as notification type messages, voice assistants, and the like.

Alternatively, the content displayed by the first display 201 and the content displayed by the second display 202 may be independent of each other and not affected by each other. For example, when the first display 201 plays a television program, the second display 202 may display information such as time, weather, temperature, reminder messages, and the like, which are not related to the television program.

Optionally, there may also be an association between the content displayed by the first display 201 and the content displayed by the second display 202. For example, when the first display 201 plays a main screen of a video chat, the second display 202 may display information such as an avatar, a chat duration, and the like of a user currently accessing the video chat.

Optionally, part or all of the content displayed by the second display 202 may be adjusted to be displayed by the first display 201. For example, the information such as time, weather, temperature, reminder message, etc. displayed on the first display 201 may be adjusted to be displayed on the first display 201, while other information is displayed on the second display 202.

In addition, the first display 201 displays the multi-party interactive picture while displaying the traditional television program picture, and the multi-party interactive picture does not block the traditional television program picture. The display mode of the traditional television program picture and the multi-party interactive picture is not limited by the application. For example, the position and the size of the traditional television program picture and the multi-party interactive picture can be set according to the priority of the traditional television program picture and the multi-party interactive picture.

Taking the example that the priority of the traditional television program picture is higher than that of the multi-party interactive picture, the area of the traditional television program picture is larger than that of the multi-party interactive picture, and the multi-party interactive picture can be positioned at one side of the traditional television program picture and can also be arranged at one corner of the multi-party interactive picture in a floating manner.

The display device 200 may be, for example, a liquid crystal display, an oled (organic Light Emitting diode) display, or a projection display device; on the other hand, the display device can be a display system consisting of an intelligent television or a display and a set-top box. The specific display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like. In some embodiments, the display device may not have a broadcast receiving television function.

As shown in fig. 1, a camera may be connected or disposed on the display device 200, and is used to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement interactive chat between users. Specifically, the picture shot by the camera can be displayed on the display device in a full screen mode, a half screen mode or any optional area.

As an optional connection mode, the camera is connected with the rear shell of the display device through the connecting plate, and is fixedly installed in the middle of the upper side of the rear shell of the display device.

As another optional connection mode, the camera is connected to the rear shell of the display device through a connection board or another conceivable connector, the camera is capable of lifting and descending, a lifting motor is installed on the connector, when a user wants to use the camera or an application program wants to use the camera, the camera is lifted out of the display device, and when the camera is not needed, the camera can be embedded into the rear shell, so that the camera is protected from being damaged, and privacy safety of the user is protected.

As an embodiment, the camera adopted in the present application may have 1600 ten thousand pixels, so as to achieve the purpose of ultra high definition display. In actual use, cameras higher or lower than 1600 ten thousand pixels may also be used.

After the camera is installed on the display device, the contents displayed by different application scenes of the display device can be fused in various different modes, so that the function which cannot be realized by the traditional display device is achieved.

Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.

Optionally, in a scene of "chat while watching", at least one video chat is performed across terminals while watching a live video or a network video.

In another example, a user can conduct a video chat with at least one other user while entering the educational application for learning. For example, a student may interact remotely with a teacher while learning content in an educational application. Vividly, this function can be called "chatting while learning".

In another example, a user conducts a video chat with a player entering a card game while playing the game. For example, a player may enable remote interaction with other players when entering a gaming application to participate in a game. Figuratively, this function may be referred to as "watch while playing".

Optionally, the game scene is fused with the video picture, the portrait in the video picture is scratched and displayed in the game picture, and the user experience is improved.

Optionally, in the motion sensing game (such as ball hitting, boxing, running and dancing), the human posture and motion, limb detection and tracking and human skeleton key point data detection are obtained through the camera, and then the human posture and motion, the limb detection and tracking and the human skeleton key point data detection are fused with the animation in the game, so that the game of scenes such as sports and dancing is realized.

In another example, a user may interact with at least one other user in a karaoke application in video and voice. Vividly, this function can be called "sing while watching". Optionally, when at least one user enters the application in a chat scenario, multiple users may jointly complete recording of a song.

In another example, a user may turn on a camera locally to take pictures and videos, figurative, which may be referred to as "looking into the mirror".

In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.

Fig. 2 is a block diagram schematically showing the configuration of the control apparatus 100 according to the exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control apparatus 100 is configured to control the display device 200, and to receive an input operation instruction from a user, and convert the operation instruction into an instruction recognizable and responsive by the display device 200, and to mediate interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display device 200 according to user demands.

In some embodiments, as shown in fig. 1, the mobile terminal 100B or other intelligent electronic device may function similar to the control apparatus 100 after installing an application for manipulating the display device 200. Such as: the user may implement the functions of controlling the physical keys of the apparatus 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 100B or other intelligent electronic devices.

The controller 110 includes a processor 112, a RAM 113 and a ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communicator 130 may include at least one of a WIFI module 131, a bluetooth module 132, an NFC module 133, and the like.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, a camera 145, and the like. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, it may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The communicator 130 is configured in the control device 100, such as: the modules of WIFI, bluetooth, NFC, etc. may send the user input command to the display device 200 through the WIFI protocol, or the bluetooth protocol, or the NFC protocol code.

And a memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operation power support for each electrical component of the control device 100 under the control of the controller 110. The power supply 180 may be powered by a battery and associated control circuitry.

Fig. 3 is a diagram illustrating a hardware configuration of a hardware system in the display apparatus 200 according to an exemplary embodiment. For convenience of explanation, the display device 200 in fig. 3 is illustrated by taking a liquid crystal display as an example.

As shown in fig. 3, the display device 200 includes: the display panel comprises a first panel 11, a first backlight assembly 21, a main board 31, an interactive board 32, a first display driving board 33, a second panel 12, a second backlight assembly 22, a second display driving board 34, a power supply board 4, a first rear case 51, a second rear case 52 and a base 6.

The first panel 11 is used for presenting the picture of the first display 201 to the user. The first backlight assembly 21 is disposed under the first panel 11, and is generally an optical assembly for providing sufficient light source with uniform brightness and distribution to enable the first panel 11 to normally display images. The first backlight assembly 21 further includes a first back plate (not shown). The main board 31, the interactive board 32, the first display driving board 33 and the power board 4 are disposed on the first back board, and some convex hull structures are typically formed by stamping on the first back board. The main board 31, the interactive board 32, the first display driving board 33 and the power board 4 are fixed on the convex hull through screws or hooks. The main board 31, the interactive board 32, the first display driving board 3 and the power board 4 may be disposed on one board, or may be disposed on different boards respectively. The first rear case 51 covers the first panel 11 to hide the parts of the display device 200, such as the first backlight assembly 21, the main board 31, the interactive board 32, the first display driving board 33, and the power board 4, and to achieve an aesthetic effect.

Among them, the first display driving board 33 mainly functions to: the multilevel backlight partition control is performed through the PWM signal and the lcaldimeming signal transmitted by the first controller on the motherboard 31, and the control is changed according to the image content, and after the handshake is established between the first controller on the motherboard 31 and the VbyOne display signal transmitted by the first controller on the motherboard 31 is received, and the VbyOne display signal is converted into the LVDS signal, so that the image display of the first display 201 is realized. The base 6 is used for supporting the display device 200, and it should be noted that the drawings only show one type of base design, and those skilled in the art can design different types of bases according to the product requirements.

Wherein the second panel 12 is used to present the screen of the second display 202 to the user. The second backlight assembly 22 is disposed under the second panel 12, and is generally an optical assembly for providing sufficient brightness and uniform light distribution to enable the second panel 12 to normally display images. The second backlight assembly 22 further includes a second back plate (not shown). Second display driver board 34 is disposed on the second backplane, typically with some convex hull structures stamped thereon. The second display driving board 34 is fixed to the convex bag by a screw or a hook. The second display driving board 34 may be provided on one board or may be provided on different boards, respectively. The second rear case 52 covers the second panel 12 to hide the second backlight assembly 22, the adapter driving board 35, the second TCON board 34b, the key board 36, and other parts of the display device 200, thereby achieving an aesthetic effect.

Optionally, fig. 3 further includes a key sheet 35, where the key sheet 35 may be disposed on the first back plate or the second back plate, which is not limited in this application.

In addition, the display device 200 further includes a sound reproducing means (not shown in the figure), such as an audio component, e.g., an I2S interface including a power Amplifier (AMP) and a Speaker (Speaker), etc., for realizing reproduction of sound. Usually, the sound components are capable of realizing sound output of at least two sound channels; when the panoramic surround effect is to be achieved, a plurality of acoustic components are required to be arranged to output sounds of a plurality of sound channels, and a detailed description thereof is omitted.

It should be noted that the display device 200 may also adopt an OLED display screen, so that the template included in the display device 200 is changed accordingly, which is not described herein too much.

Fig. 4 is a schematic diagram illustrating a connection relationship between a power board and a load, and as shown IN fig. 4, the power board 4 includes an input terminal IN and an output terminal OUT (a first output terminal OUT1, a second output terminal OUT2, a third output terminal OUT3, a fourth output terminal OUT4 and a fifth output terminal OUT5 are shown IN the figure), where the input terminal IN is connected to a commercial power, the output terminal OUT is connected to the load, for example, a first output terminal OUT1 is connected to a light emitting element (such as a light bar or a self-light emitting device), a second output terminal OUT2 is connected to an audio component, a third output terminal OUT3 is connected to the main board 31, a fourth output terminal OUT4 is connected to the first display driving board 33, and a fifth output terminal OUT5 is connected to the first backlight driving board 21. The power board 4 needs to convert the ac power into dc power required by the load, and the dc power is usually in different specifications, for example, 18V is required for the audio components, 12V/18V is required for the panel, etc.

For ease of description, one hardware system in a dual hardware system architecture will be referred to hereinafter as a first hardware system or a first controller, and the other hardware system will be referred to hereinafter as a second hardware system or a second controller. The first controller comprises various processors and various interfaces of the first controller, and the second controller comprises various processors and various interfaces of the second controller. The first controller and the second controller may each have a relatively independent operating system installed therein, and the operating system of the first controller and the operating system of the second controller may communicate with each other through a communication protocol, which is as follows: the frame layer of the operating system of the first controller and the frame layer of the operating system of the second controller can communicate for the transmission of commands and data, so that there are two independent but interrelated subsystems in the display device 200.

The dual hardware system architecture of the present application is further described below with reference to fig. 5. It should be noted that fig. 5 is only an exemplary illustration of the dual hardware system architecture of the present application, and does not represent a limitation of the present application. In actual practice, both hardware systems may contain more or less hardware or interfaces as desired.

A block diagram of the hardware architecture of the display device 200 according to fig. 3 is exemplarily shown in fig. 5. As shown in fig. 5, the hardware system of the display apparatus 200 may include a first controller 210 and a second controller 310, and a module connected to the first controller 210 or the second controller 310 through various interfaces.

Among them, the first controller 210 may be disposed on the main board 31 shown in fig. 3. Optionally, the first controller 210: the traditional television function is mainly realized (for example, a set top box can be externally connected). The second controller 310 may be disposed on the second display driving board 34 shown in fig. 3. Optionally: the second controller 310 may be used to receive instructions sent by the first controller 210 and control the second display 380 to display a corresponding image.

The modules connected to the first controller 210 may include a tuning demodulator 220, a communicator 230, an external device interface 25, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, a first display 280 (i.e., the first display 201 in fig. 1), an audio output interface 270, and a power supply module 240.

In other embodiments, more or fewer modules may be connected to the first controller 210.

In other embodiments, the first controller includes any of the modules described above.

The tuning demodulator 220 is configured to perform modulation and demodulation processing such as amplification, mixing, resonance and the like on a broadcast television signal received in a wired or wireless manner, so as to demodulate an audio/video signal carried in a frequency of a television channel selected by a user and additional information (e.g., an EPG data signal) from a plurality of wireless or wired broadcast television signals. Depending on the broadcast system of the television signal, the signal path of the tuner 220 may be various, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; according to different modulation types, the adjustment mode of the signal can be a digital modulation mode or an analog modulation mode; and depending on the type of television signal being received, tuner demodulator 220 may demodulate analog and/or digital signals.

The tuner demodulator 220 is also operative to respond to the user-selected television channel frequency and the television signal carried thereby, in accordance with the user selection and as controlled by the first controller 210.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the external device interface 250.

The communicator 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 230 may include a WIFI module 231, a bluetooth communication protocol module 232, a wired ethernet communication protocol module 233, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown).

The display apparatus 200 may establish a connection of a control signal and a data signal with an external control apparatus or a content providing apparatus through the communicator 230. For example, the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210.

The external device interface 250 is a component that provides data transmission between the first controller 210 and other external devices. The external device interface 250 may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 250 may include: a High Definition Multimedia Interface (HDMI) terminal is also referred to as HDMI251, a Composite Video Blanking Sync (CVBS) terminal is also referred to as AV 252, an analog or digital component terminal is also referred to as component 253, a Universal Serial Bus (USB) terminal 254, a Red Green Blue (RGB) terminal (not shown in the figure), and the like. The number and type of external device interfaces are not limited by this application.

The first controller 210 controls the operation of the display apparatus 200 and responds to the operation of the user by running various software control programs (e.g., an operating system and/or various application programs) stored on the memory 290.

As shown in fig. 5, the first controller 210 includes a read only memory RAM 213, a random access memory ROM 214, a graphic processor 216, a CPU processor 212, a communication interface 218, and a communication bus. The RAM 213 and the ROM 214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM 213 for storing instructions for various system boots. If the display device 200 is powered on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM and copies the operating system stored in the memory 290 to the RAM 214 to start running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM 214, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator, and displaying the rendered result on the first display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include a main processor and a plurality of or a sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-unit for performing an operation in a standby mode or the like.

The communication interface 218 may include a first interface 218-1 through an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.

The first controller 210 may control operations of the display device 200 in relation to the first display 280. For example: in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

The first controller 210 may control operations of the display device 200 in relation to the second display 380. For example: in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the first controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to an icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 290, including: a base module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc. (not shown in the figure).

The basic module is a bottom layer software module for signal communication between hardware in the display device 200 and sending processing and control signals to an upper layer module. The detection module is a management module used for collecting various information from various sensors or user input interfaces, and performing digital-to-analog conversion and analysis management. The voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the first display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. The communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. The service module is a module for providing various services and various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A user input interface 260-3 for transmitting an input signal of a user to the first controller 210 or transmitting a signal output from the first controller 210 to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user input interface, and then the input signal is forwarded to the first controller 210 through the user input interface 260-3; alternatively, the control device may receive an output signal such as audio, video or data processed by the first controller 210 and output from the user input interface 260-3, and display or output the received output signal in audio or vibration form.

In some embodiments, the user may input a user command on a Graphical User Interface (GUI) displayed on the first display 280, and the user input interface 260-3 receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 260-1 is configured to receive a video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal directly displayed or played on the first display 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like (not shown in the figure).

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module, such as an image synthesizer, is used for performing superposition mixing processing on the GUI signal input by the user or generated by the user and the video picture after the zooming processing by the graphics generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, such as a frame rate of an input 24Hz, 25Hz, 30Hz, or 60Hz video into a frame rate of 60Hz, 120Hz, or 240Hz, where the input frame rate may be related to a source video stream, and the output frame rate may be related to a refresh rate of a display device. And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display device, such as converting the format of the signal output by the frame rate conversion module to output RGB data signals.

First display 280 for receiving image signals input from video processor 260-1 for displaying video content and images and menu manipulation interface first display 280 includes a display component for presenting a picture and a driving component for driving the display of the image. The video content may be displayed from the video in the broadcast signal received by the tuner/demodulator 220, or from the video content input from the communicator or the external device interface. The first display 280 simultaneously displays a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And a driving component for driving the display according to the type of the first display 280. Alternatively, a projection device and a projection screen may be included, provided that the first display 280 is a projection display.

The audio processor 260-2 is configured to receive an audio signal, and perform decompression and decoding according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker 272.

An audio output interface 270 for receiving the audio signal output by the audio processor 260-2 under the control of the first controller 210, wherein the audio output interface may include a speaker 272 or an external sound output terminal 274 for outputting to a generating device of an external device, such as: external sound terminal or earphone output terminal.

In other exemplary embodiments, video processor 260-1 may comprise one or more chip components. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated in one or more chips together with the first controller 210.

And a power supply module 240 for providing power supply support for the display device 200 by the power input from the external power source under the control of the first controller 210. The power supply module 240 may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply installed outside the display apparatus 200, such as a power supply interface for providing an external power supply in the display apparatus 200.

Similar to the first controller 210, as shown in fig. 5, the module connected to the second controller 310 may include a communicator 330, a detector 340, a memory 390, and a second display 380 (i.e., the second display 202 in fig. 1). A user input interface, a video processor, an audio processor, a display, an audio output interface (not shown) may also be included in some embodiments. In some embodiments, there may also be a power supply module (not shown) that independently powers the second controller 310.

In some embodiments, the second controller 310 may include any one or more of the modules described above.

The communicator 330 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 330 may include a WIFI module 331, a bluetooth communication protocol module 332, a wired ethernet communication protocol module 333, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown).

The communicator 330 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 within the hardware system of the first controller 210 is used to connect to an external network, generate network communication with an external server, and the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without making a direct connection with an external network or the like, and the second controller 310 is connected to the external network through the first controller 210. Therefore, for the user, a display device as in the above embodiment displays a WiFi account to the outside.

The detector 340 is a component of the second controller 310 for collecting signals of an external environment or interaction with the outside. The detector 340 may include a light receiver 342, a sensor for collecting the intensity of ambient light, which may be used to adapt to display parameter changes, etc.; the system may further include an image collector 341, such as a camera, a video camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or interact gestures with the user, adaptively change display parameters, and identify user gestures, so as to implement a function of interaction with the user.

An external device interface 350, which provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner.

A video processor 360 for processing the associated video signal.

The second controller 310 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs stored on the memory 390 (e.g., using installed third party applications, etc.), and interacting with the first controller 210.

As shown in fig. 5, the second controller 310 includes a read only memory ROM 313, a random access memory RAM 314, a graphic processor 316, a CPU processor 312, a communication interface 318, and a communication bus. The ROM 313 and the RAM 314, the graphic processor 316, the CPU processor 312, and the communication interface 318 are connected via a bus.

A ROM 313 for storing instructions for various system boots. CPU processor 312 executes system boot instructions in ROM and copies the operating system stored in memory 390 to RAM 314 to begin running the boot operating system. After the start of the operating system is completed, the CPU processor 312 copies various application programs in the memory 390 to the RAM 314, and then starts running and starting various application programs.

A CPU processor 312 for executing the operating system and application program instructions stored in the memory 390, communicating with the first controller 210, transmitting and interacting signals, data, instructions, etc., and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents.

The communication interface 318 is plural and may include a first interface 318-1 to an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to the first controller 210 via a network.

The second controller 310 may control operations of the display device 200 in relation to the second display 380. For example: in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the second controller 310 may perform an operation related to the object selected by the user command.

The second controller 310 may control operations of the display device 200 in relation to the first display 280. For example: in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.

A graphics processor 316 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator, and displaying the rendered result on the second display 380.

The graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 are both capable of generating various graphics objects. In distinction, if the application 1 is installed in the second controller 310 and the application 2 is installed in the first controller 210, the graphic object is generated by the graphic processor 316 of the second controller 310 when the user performs an instruction input by the user in the application 1 at the interface of the application 1. When a user is at the interface of the application 2 and an instruction input by the user is made within the application 2, a graphic object is generated by the graphic processor 216 of the first controller 210.

Fig. 6 is a diagram schematically illustrating a functional configuration of a display device according to an exemplary embodiment.

As shown in fig. 6, the memory 390 of the second controller 310 and the memory 290 of the first controller 210 are used to store an operating system, an application program, contents, user data, and the like, respectively, and perform system operations for driving the first display 280 and the second display 380 and various operations in response to a user under the control of the second controller 310 and the first controller 210. Memory 390 and memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically used for storing an operating program for driving the first controller 210 in the display device 200, and storing various applications built in the display device 200, various applications downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an Operating System (OS) kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data such as the video processor 260-1 and the audio processor 260-2, the first display 280, the communicator 230, the tuning demodulator 220, the input/output interface, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The memory 290, for example, includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module 2913, and so forth. The first controller 210 performs operations such as: the system comprises a broadcast television signal receiving and demodulating function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction identification function, a communication control function, an optical signal receiving function, an electric power control function, a software control platform supporting various functions, a browser function and other various functions.

The memory 390 includes a memory storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 390, including: a base module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc. (not shown in the figure). Since the functions of the memory 390 and the memory 290 are similar, reference may be made to the memory 290 for relevant points, and thus, detailed description thereof is omitted here.

Illustratively, the memory 390 includes an image control module 3904, a second audio control module 3906, an external instruction recognition module 3907, a communication control module 3908, a light receiving module 3909, an operating system 3911, and other application programs 3912, a browser module 3913, and the like. The first controller 210 performs operations such as: the system comprises an image control function, a display control function, an audio control function, an external instruction identification function, a communication control function, an optical signal receiving function, an electric power control function, a software control platform supporting various functions, a browser function and other various functions.

Differently, the external instruction recognition module 2907 of the first controller 210 and the external instruction recognition module 3907 of the second controller 310 may recognize different instructions.

For example, when an image receiving device such as a camera is connected to the second controller 310, the external instruction recognition module 3907 of the second controller 310 may include an image recognition module 2907-1, a graphic database is stored in the image recognition module 3907-1, and when the camera receives an external graphic instruction, the camera corresponds to the instruction in the graphic database to perform instruction control on the display device. Since the voice receiving device and the remote controller are connected to the first controller 210, the external command recognition module 2907 of the first controller 210 may include a voice recognition module 2907-2, a voice database is stored in the voice recognition module 2907-2, and when the voice receiving device receives an external voice command or the like, the voice receiving device and the like perform a corresponding relationship with a command in the voice database to perform command control on the display device. Similarly, the control device 100 such as a remote controller is connected to the first controller 210, and the button command recognition module 2907-3 performs command interaction with the control device 100.

Fig. 7 is a block diagram illustrating a configuration of a software system in the display device 200 according to the exemplary embodiment.

With respect to the first controller 210, as shown in FIG. 7, the operating system 2911, which includes executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary between applications and hardware components for performing data processing.

In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controlling process management, including runtime applications and the like.

The event transmission system 2914 may be implemented within the operating system 2911 or within the application 2912. In some embodiments, an aspect is implemented within the operating system 2911, while implemented in the application 2912, for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-2 is used to input various event definitions for various user input interfaces, identify various events or sub-events, and transmit them to the process for executing one or more sets of their corresponding handlers.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout management module 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.

Since the operating system 3911 of the second controller 310 is similar to the operating system 2911 of the first controller 210 in function, reference may be made to the operating system 2911 for details, which are not repeated herein.

Fig. 8 is a block diagram illustrating a structure of an application layer of a display device according to an exemplary embodiment. As shown in fig. 8, the application layer of the display device contains various applications that can be executed at the display device 200.

The application layer 2912 of the first controller 210 may include, but is not limited to, one or more applications such as: a video-on-demand application, an application center, a game application, and the like. The application layer 3912 of the second controller 310 may include, but is not limited to, one or more applications such as: live television applications, media center applications, and the like. It should be noted that what applications are respectively contained in the second controller 310 and the first controller 210 is determined according to the operating system and other designs, and the present invention does not need to make specific limitations and divisions on the applications contained in the second controller 310 and the first controller 210.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on a display device. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

Since the second controller 310 and the first controller 210 may have independent operating systems installed therein, there are two independent but interrelated subsystems in the display apparatus 200. For example, Android (Android) and various APPs may be independently installed on the second controller 310 and the first controller 210, and may all realize a certain function, and the second controller 310 and the first controller 210 cooperate to realize a certain function.

A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 9. As shown in fig. 9, the user interface includes a first diagram display area 2011 and a second diagram display area 2021. The first diagram display area 2011 and the second diagram display area 2021 have substantially the same function, and only the first diagram display area 2011 is described in an important manner below. Illustratively, among other things, the first view display 2011 includes layouts for one or more different items. And a selector indicating that the item is selected is also included in the user interface, and a position of the selector is movable by a user input to change a selection of a different item.

A "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables the conversion of the internal form of information to a form acceptable to the user. A common presentation form of a user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the first view display area 2011 is a scalable view display. "scalable" may mean that the first view display area 2011 is scalable in size or proportion on the screen, or that the items in the view display 201 are scalable in size or proportion on the screen.

"item" refers to a visual object displayed in a view display area of a user interface in the display device 200 to represent corresponding content, such as icons, thumbnails, video clips, and the like. For example: the items may represent movies, image content or video clips of a television show, audio content of music, applications, or other user access content history information.

Further, the item may represent an interface or a collection of interfaces on which the display device 200 is connected to an external device, or may represent a name of an external device connected to the display device, or the like. Such as: a signal source input Interface set, or a High Definition Multimedia Interface (HDMI), a USB Interface, a PC terminal Interface, and the like.

It should be noted that: the view display area may present Video chat project content or application layer project content (e.g., web page Video, Video On Demand (VOD) presentations, application screens, etc.).

A "selector" is used to indicate where any item has been selected, such as a cursor or a focus object. Positioning the selection information input according to an icon or menu position touched by the user in the display 200 may cause movement of a focus object displayed in the display device 200 to select a control item, one or more of which may be selected or controlled.

The focus object refers to an object that moves between items according to user input. Illustratively, the focus object position is implemented or identified by drawing a thick line through the item edge. In other embodiments, the focus form is not limited to an example, and may be a form such as a cursor that is recognizable by the user, either tangible or intangible, such as in the form of a 3D deformation of the item, or may change the identification of the border lines, size, color, transparency, and outline and/or font of the text or image of the item in focus.

The event transmission system 2914, which may monitor user input for each predefined event or sub-event heard, provides control identifying the event or sub-event directly or indirectly to the interface layout management module 2913.

The interface layout management module 2913 is configured to monitor the state of the user interface (including the position and/or size of the view partition, the item, the focus or the cursor object, the change process, and the like), and according to the event or the sub-event, may perform a modification on the layout of the size and position, the hierarchy, and the like of the view display area, and/or adjust or modify the layout of the size or/and position, the number, the type, the content, and the like of the layout of various items in the view display area. In some embodiments, the layout is modified and adjusted, including displaying or not displaying the view sections or the content of the items in the view sections on the screen.

And a user input interface for transmitting an input signal of a user to the controller or transmitting a signal output from the controller to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by a user to the user input interface, and then the input signal is forwarded to the controller by the user input interface; alternatively, the control device may receive an output signal such as audio, video, or data output from the user input interface via the controller, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may input a user command on a Graphical User Interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

Fig. 10 is a block diagram illustrating a structure in which a display device presents dual systems and dual screens according to an exemplary embodiment. Referring to fig. 10, the display device provided in the embodiment of the present invention includes two main controllers, which are a second controller and a first controller, respectively, each main controller runs an independent Android system, that is, a system N (a second hardware system) is configured in the second controller, a system a (a first hardware system) is configured in the first controller, the system N is a main system, and the system a is a slave system.

To enable the capabilities of both systems to be exposed to the user, the display device is configured with dual displays. The dual display comprises a first display (small screen) and a second display (large screen), wherein the second display is in communication connection with the system N and is used for displaying the display content of each application configured in the system N and providing main television services; the first display is connected with the camera and the system A and used for showing the social ability and the auxiliary information prompt for the user. The system A is provided with an application related to the camera, and the system N is provided with other applications for presenting social ability. The first display may also be connected to the system N, and the system N is configured to control the backlight of the first display to be turned on and off when the first display is connected to the system N.

The system N and the system A are connected through an HDMI interface, and the switching of the system N and the system A interface can be realized. The two systems can be connected through a data path to realize data transmission between the two systems. Because the system N does not provide social ability, the functions of video chat, magic mirror and the like are configured on the system A, when a user conducts video chat, the content of the system A is displayed through a second display (large screen) instead of a first display (small screen); and when the user quits the video chat, the content of the system A is displayed through the first display, and the content of the system N is displayed through the second display.

Therefore, in order to realize the content coordination display in the large and small double screens of the double-system display device, the embodiment of the invention provides the double-screen display device, and when the application in the system A needs to be displayed on the second display, the application is switched to the data interface of the system A, and the related data of the system A is transmitted to the second display for display; and when the application in the system A does not need to be displayed on the second display, the data interface of the system N is switched to, the related data of the system N is displayed on the second display, and then the related data of the system A is displayed on the first display. Therefore, the double-screen display device provided by the embodiment can realize the coordinated display of the double-system application on the double displays.

Fig. 11 is a block diagram illustrating a structure of a dual screen display device according to an exemplary embodiment. Referring to fig. 11, a dual-screen display device provided in an embodiment of the present invention includes: the display device comprises a first controller, a second controller, a first display and a second display. The first display is in communication connection with the first controller, the first display is configured to display content of a first application, and the first application refers to an application configured in the first controller; the second display is in communication connection with the second controller, and the second display is configured to display content of the first application or display content of a second application, and the second application refers to an application configured in the second controller.

The first controller comprises an HDMI Switch module, the second controller comprises a signal source switching module, the first controller is configured to receive an application starting instruction sent by the second controller, and the HDMI Switch module switches a data interface; the signal source switching module is configured to switch data interfaces of the first controller and the second controller, and when a first application needs to be displayed on the second display, the signal source switching module can switch a currently connected data interface (normally, the data interface connected with the second controller) to the data interface of the first controller, so that the data interface of the first controller is connected with the second display, and the display content of the first application is displayed on the second display; then, when the second application is displayed on the second display, the signal source switching module may switch the currently connected data interface (which may be the data interface of the first controller) to the data interface of the second controller, and establish a connection between the data interface of the second controller and the second display, so that the display content of the second application is displayed on the second display.

The triggering condition of the signal source switching module for switching the data interfaces of the two controllers is that an instruction of the second controller is received, the second controller realizes the switching of the data interfaces, and the connection with the corresponding display is timely switched and established according to the display requirement applied in each controller.

Fig. 12 is a flow chart illustrating a method for switching a dual system size dual screen application display according to an exemplary embodiment. To this end, to implement the coordinated presentation of the dual system application on the dual display, the second controller is configured to execute a switching method of the dual system size dual screen application display, referring to fig. 12, the method includes:

and S21, acquiring the connection state of the data interface of the first controller and the connection state of the data interface of the second controller, wherein the connection state of the data interface is used for representing whether the corresponding controller is connected with the first display or the second display currently.

When the double-system application is coordinated and displayed on the double displays, the connection state of the double displays and the double controllers in the current double-screen display equipment needs to be determined, and the connection state of the double controllers can be represented by the signal source switching module. For this purpose, the second controller obtains the connection state of the signal source switching module, and the connection state of the signal source switching module is used for representing the connection state of the first controller data interface and the connection state of the second controller data interface.

That is, it can be determined whether the first controller data interface is connected to the first display or the second display according to the connection state of the signal source switching module, and whether the second controller data interface is connected to the second display. After the connection state of the data interface of the first controller and the connection state of the data interface of the second controller are determined, which controller the second display is connected with can be determined, and whether the process of switching the data interface needs to be executed or not when a certain application is started subsequently is further determined.

For example, the connection state of the signal source switching module may be determined by, but not limited to, the first controller data interface being connected to the first display, and the second controller data interface being connected to the second display; the first controller data interface is connected with the second display, and the second controller data interface is not connected with any display and belongs to a pending state.

And S22, receiving an application starting instruction for starting the specified application, wherein the application starting instruction carries the package name of the specified application.

When a user starts a certain application through a remote controller or a homepage of the display device, the generated application starting instruction is sent to the second controller, and the second controller receives and responds to the application starting instruction to start the specified application. The designated application may be an application configured in the first controller or an application configured in the second controller.

The home page is configured in the first controller, and when a user wants to start the application in the first controller, the user needs to send an application starting instruction to the second controller for processing no matter whether the first controller or the second controller receives a request first.

When the user selects the appointed application to be started, the sent application starting instruction comprises the packet name of the appointed application so as to distinguish the application.

And S23, determining an application source and a display requirement of the specified application based on the package name of the specified application, wherein the application source is used for representing whether the specified application belongs to the first controller or the second controller, and the display requirement is used for representing whether the display content of the specified application needs to be displayed on the first display or the second display.

The package name may determine the name of the designated application and may also determine the source and presentation requirements of the application, i.e., based on the package name, it may be determined that the designated application is an application configured in the first controller and required to be displayed on the first display, or that the designated application is an application configured in the first controller and required to be displayed on the second display, or that the designated application is an application configured in the second controller and required to be displayed on the second display.

And S24, generating an interface switching identifier based on the connection state of the first controller data interface, the connection state of the second controller data interface, the display requirement of the designated application and the application source.

The connection status of the first controller data interface and the connection status of the second controller data interface may determine which controller is connected to the second display and which controller is connected to the first display, and the presentation requirements and application source of a given application may determine explicitly whether the application is an application configured in the first controller or an application in the second controller and whether the application needs to be displayed in the first display or the second display. Therefore, according to the four parameters, whether the data interface of the corresponding controller needs to be switched can be judged, and when the data interface needs to be switched, an interface switching identifier is generated and used for calling the data interface of the controller to which the specified application belongs.

In some embodiments, the case where the interface switch identifier needs to be generated includes, but is not limited to: when the data interface of the first controller is connected with the first display and the designated application is the application which is the first controller and needs to be displayed in the second display, switching is needed at the moment. When the data interface of the first controller is connected with the second display and the designated application is the first controller and needs to be displayed in the first display, switching is needed. When the data interface of the first controller is connected with the second display and the designated application is the second controller and needs to be displayed in the second display, switching is needed. The three cases of the above example are the cases where the data interface of the first controller and the data interface of the second controller need to be switched, and at this time, an interface switching identifier needs to be generated to implement switching between the data interfaces of the two controllers. It can be seen that the situation that the data interface needs to be switched is when the currently connected display of the same controller is inconsistent with the display to be connected according to the display requirement, or when the currently connected display of the same controller is inconsistent with the controller to be connected.

In other embodiments, when the data interface of the first controller is connected to the second display and the application is designated as the first controller and needs to be displayed on the second display, the display content of the application in the first controller can be directly displayed on the second display without switching. When the data interface of the current first controller is connected with the first display and the designated application is the first controller and needs to be displayed in the first display, the display content of the application in the first controller can be directly displayed in the first display without switching. In this case, it is only necessary to directly call the display content of the application to be displayed on the corresponding display.

And S25, calling the data interface of the controller to which the designated application belongs corresponding to the interface switching identifier, and displaying the display content of the designated application in the display corresponding to the display requirement.

When the data interfaces of the two controllers need to be switched, the second controller calls the data interface of the controller to which the designated application belongs, responds to the interface switching identifier, determines the switched display and the switched data interface, and establishes connection between the display and the data interface of the controller, so that the display content of the designated application is displayed in the display, and the display is a target display determined according to the display requirement of the designated application.

If the designated application is the application in the first controller and needs to be displayed on the second display, at this time, the first controller in the first controller needs to receive an application starting instruction sent by the second controller, start the designated application in response to the application starting instruction, and simultaneously switch the data interface of the first controller to the HDMI interface so as to transmit the display content of the designated application to the second display through the HDMI interface and display the display content.

In some exemplary embodiments of the present application, the second controller further includes a signal source switching module configured to switch the data interface of the first controller and the second controller; and generating an interface switching identifier according to the following steps: acquiring a connection state of a signal source switching module, wherein the connection state of the signal source switching module is used for representing the connection state of a first controller data interface and the connection state of a second controller data interface; judging whether a current controller corresponding to the connection state of the signal source switching module is consistent with a controller belonging to the specified application or not and whether a current display corresponding to the connection state of the signal source switching module is consistent with a target display of the specified application or not based on the connection state of the signal source switching module, the display requirement of the specified application and an application source; and if the current controller corresponding to the connection state of the signal source switching module is consistent with the controller of the specified application and the current display corresponding to the connection state of the signal source switching module is inconsistent with the target display of the specified application, generating an interface switching identifier.

In some exemplary embodiments of the present application, a content presentation application is configured within the second controller; and the step of presenting the display content of the specified application in the display corresponding to the display requirement comprises the following steps: when the data interface of the first controller is connected with a first display, the application source of the specified application is the first controller, and the display requirement is that the specified application is displayed on a second display, an application starting instruction carrying the interface switching identifier is sent to the first controller, and the first controller is used for switching the data interface of the first controller according to the interface switching identifier carried in the application starting instruction; starting a content display application, and generating a display interface in the second display, wherein the display interface of the content display application is used for displaying the display content of the specified application; and calling the data interface switched by the first controller, and displaying the display content of the specified application in a display interface corresponding to the second display.

In some exemplary embodiments of the present application, the data interface comprises an HDMI interface; and the step of presenting the display content of the specified application in the display interface corresponding to the second display comprises the following steps: calling a signal source switching module, and switching a signal source of the second controller to an HDMI (high-definition multimedia interface) of the first controller, wherein the HDMI is used for transmitting display content of a specified application in the first controller; and receiving the display content of the specified application transmitted by the HDMI interface, and presenting the display content in a display interface corresponding to the second display.

In some exemplary embodiments of the present application, the first display is communicatively coupled to the second controller; and, the method further comprises: receiving a first display backlight closing instruction sent by the first controller, wherein the first display backlight closing instruction is used for closing the backlight of a first display in the first controller; and in response to the instruction for turning off the first display backlight, turning off the backlight of the first display in the first controller.

In some exemplary embodiments of the present application, the method further comprises: acquiring display content of a previous application in the second display before displaying the display content of the specified application; displaying the display content of the prior application in a second display.

In some exemplary embodiments of the present application, the presenting the display content of the specific application in the display corresponding to the presentation requirement includes: when the data interface of the first controller is connected with a second display, the application source of the designated application is the second controller, and the display requirement is that the designated application is started when the second display is displayed; calling a signal source switching module to switch the signal source of the second controller to a system interface of the second controller; and acquiring the display content of the specified application based on the system interface of the second controller, and presenting the display content in the second display.

In some exemplary embodiments of the present application, the method further comprises: sending an interface change notification to a first controller, wherein the interface change notification is used for enabling the first controller to acquire a homepage of the first controller and display the homepage in a first display, and sending a backlight instruction for starting the first display to a second controller; receiving a first display backlight starting instruction sent by the first controller, wherein the first display backlight starting instruction is used for starting the backlight of a first display in the first controller; and responding to the instruction for starting the first display backlight, and starting the backlight of the first display in the first controller.

FIG. 13 is another flow chart illustrating a method for switching a dual system size dual screen application display in accordance with an exemplary embodiment; a first data flow diagram of a method for switching a display of a dual system size dual screen application according to an exemplary embodiment is illustrated in fig. 14. To this end, to implement the coordinated presentation of the dual system application on the dual display, the first controller of the first controller is configured to perform a switching method of the dual system size dual screen application display, see fig. 13 and 14, the method comprising the steps of:

and S11, receiving an application starting instruction which is sent by the second controller and carries an interface switching identifier, wherein the application starting instruction is used for starting a specified application, and the interface switching identifier is an identifier generated by the second controller based on the connection state of the data interface of the first controller, the connection state of the data interface of the second controller, the display requirement of the specified application and the application source.

After the user starts the designated application by sending an application start instruction to the second controller, the second controller executes the processes of steps S22 to S24 to determine the display requirement and the application source of the designated application, and then generates an interface switching identifier according to the connection state of the first controller data interface and the connection state of the second controller data interface. The data interface switching instruction of the first controller is required to designate the application as the application in the first controller, and the application needs to be displayed on the second display.

After the interface switching identifier is generated by the second controller, it is indicated that the display currently connected with the first controller is inconsistent with the display corresponding to the display requirement, and the data interface of the first controller needs to be switched to be connected with the display corresponding to the display requirement. For example, the data interface of the first controller is currently connected with the first display, and the designated application needs to be displayed on the second display, the data interface of the first controller needs to be switched to the HDMI to establish connection with the second display, and the display content of the designated application is output to the second display for displaying.

Therefore, when the second controller sends the application start instruction to the first controller, the second controller needs to carry the interface switching identifier at the same time, so that the first controller can switch the data interface of the first controller according to the interface switching identifier after receiving the application start instruction.

And S12, responding to the application starting instruction, and switching a data interface, wherein the data interface is used for outputting display content to the first display or outputting the display content to the second display.

And S13, starting the specified application based on the switched data interface, and displaying the display content of the specified application in the display calling the switched data interface.

The first controller responds to an application starting instruction to start a specified application, and simultaneously, the HDMI Switch module switches the display content output interface according to the interface switching identifier, namely, the data interface of the first controller is switched to the HDMI connected with the target display. After the interface switched by the first controller is connected with the display calling the interface, the first controller can start the specified application, and simultaneously, the display content of the specified application is output to the display calling the interface for displaying. For example, if the interface switched by the first controller is called as the second display, the display content of the specified application is output to the second display for displaying.

In another embodiment, the display content of the designated application may also need to be displayed on the first display, and at this time, the first controller switches the data interface of the first controller to establish connection with the first display, and calls the switched data interface as the first display. The first controller responds to the application starting instruction, starts the specified application, and outputs the display content of the specified application to the first display for displaying.

As can be seen, when the dual-screen display device provided in the embodiment of the present invention executes the method for switching the dual-system large and small dual-screen application display, the second controller receives an application start instruction triggered by a user, determines a display requirement and an application source of a specific application according to the application start instruction, and generates an interface switching identifier according to a connection state of the first controller data interface and a connection state of the second controller data interface. If the designated application is the application in the first controller, the first controller receives and responds to an application starting instruction which is sent by the second controller and carries an interface switching identifier, after the data interface switching of the first controller is completed, the designated application is started, and meanwhile, the display content of the designated application is output to a display which calls the switched data interface, wherein the display content can be the first display or the second display, so that the coordinated display of the dual-system application on the dual-display is realized.

In the foregoing step S24, several situations that need to perform data interface switching are disclosed, including when the currently connected display of the same controller is inconsistent with the display to be connected according to the display requirement, or when the currently connected controller of the same controller is inconsistent with the controller to be connected. The processing procedure of the second controller in generating the interface switching identifier is different for different situations.

A flow chart of a method of generating an interface switch identification in accordance with the exemplary embodiment is illustrated in fig. 15. Referring to fig. 15, the interface switching identifier is generated when the currently connected display of the same controller is not consistent with the display to be connected according to the display requirement. At this time, the second controller is further configured to perform the steps of:

s201, obtaining a connection state of a signal source switching module, wherein the connection state of the signal source switching module is used for representing the connection state of a first controller data interface and the connection state of a second controller data interface.

The signal source switching module configured in the second controller is used for switching the data interfaces of the first controller and the second controller, that is, the signal source switching module calls and switches the data interfaces of the first controller and the second controller. The second controller obtains the connection state of the signal source switching module, and can determine which display the first controller data interface is establishing connection with, or which display the second controller data interface is establishing connection with.

For example, the first controller data interface is establishing a connection with a first display, or the first controller data interface is establishing a connection with a second display, or the second controller data interface is establishing a connection with a second display.

S202, judging whether a current controller corresponding to the connection state of the signal source switching module is consistent with a controller of a designated application or not and whether a current display corresponding to the connection state of the signal source switching module is consistent with a target display of the designated application or not based on the connection state of the signal source switching module, the display requirement of the designated application and an application source;

s203, if the current controller corresponding to the connection state of the signal source switching module is consistent with the controller of the designated application, and the current display corresponding to the connection state of the signal source switching module is inconsistent with the target display of the designated application, generating an interface switching identifier.

The connection state of the signal source switching module can determine which display the data interfaces of the two controllers are in connection with, the display requirement of the designated application can determine whether the application needs to be displayed on the first display or the second display, and the application source of the designated application can determine whether the application to be started is located in the first controller or the second controller. Therefore, the judgment criteria for judging whether a certain controller data interface needs to be switched are whether a controller connected with a certain display is consistent with the controller of the specified application and whether a display connected with the current controller is consistent with the target display of the specified application. The target display is the display corresponding to the display requirement.

And if the controller connected with a certain display is not consistent with the controller of the designated application and the display connected with the current controller is not consistent with the target display of the designated application, switching the data interface to enable the data interface of the controller of the designated application to be connected with the display corresponding to the display requirement.

For example, when the data interface of the first controller is connected to the first display, and the controller to which the application belongs is the first controller and the target display is the second display, the switching is required. When the data interface of the current first controller is connected with the second display, and the controller to which the designated application belongs is the first controller and the target display is the first display, switching is required at this time.

And the second controller immediately generates an interface switching identifier when judging that the data interface needs to be switched.

Another method of generating an interface switch identity according to an exemplary embodiment is illustrated in fig. 16. Referring to fig. 16, it is applicable to the case where the current controller connected to the same display and the controller to which connection is required are not identical. At this time, the second controller is further configured to perform the steps of:

s301, obtaining a connection state of the signal source switching module, wherein the connection state of the signal source switching module is used for representing the connection state of the first controller data interface and the connection state of the second controller data interface.

S302, judging whether a current controller corresponding to the connection state of the signal source switching module is consistent with a controller of the specified application or not and whether a current display corresponding to the connection state of the signal source switching module is consistent with a target display of the specified application or not based on the connection state of the signal source switching module, the display requirement of the specified application and the application source.

And S303, if the current controller corresponding to the connection state of the signal source switching module is inconsistent with the controller of the specified application and the current display corresponding to the connection state of the signal source switching module is consistent with the target display of the specified application, generating an interface switching identifier.

In this embodiment, the contents of steps S301 to S302 refer to the contents of steps S201 to S202, and the standard for the second controller to determine whether the interface switching identifier needs to be generated is the same as that in the foregoing embodiment, which is not described herein again.

And if the second controller judges whether the controller connected with a certain display is inconsistent with the controller of the specified application and whether the display connected with the current controller is consistent with the target display of the specified application, switching the data interface to enable the data interface of the controller of the specified application to be connected with the display corresponding to the display requirement.

For example, when the data interface of the first controller is connected to the second display, and the controller to which the application belongs is the second controller and the target display is the second display, the switching is required.

As can be seen, according to the method for generating an interface switching identifier provided in each of the above embodiments, the second controller can accurately determine whether the data interface of the corresponding controller needs to be switched according to the relevant information (display requirement and application source) of the specified application and the connection state of the signal source switching module, and generate the interface switching identifier when data switching is needed.

And after the second controller judges that the data interface needs to be switched, calling the switched interface, and displaying the display content of the specified application in the target display. In the above embodiment, but not limited to the three cases where the data interface needs to be switched, in order to display the display content of the designated application, based on step S25, the following embodiment provides three corresponding methods for displaying the display content of the designated application.

It should be understood that the case where the data interface needs to be switched is not limited to the three cases proposed in the foregoing embodiments, and the method of presenting the display content of the specific application is not limited to the three cases proposed in the following embodiments.

A first method flowchart for presenting display content of a specified application in accordance with an exemplary embodiment is illustrated in fig. 17. Referring to fig. 14 and 17, for the case where the HDMI interface of the first controller is currently output to the small screen, but an application that the first controller needs to display on the large screen needs to be started, the second controller is further configured to perform the following steps:

s401, connecting a data interface of a first controller with a first display, designating an application source of an application as the first controller, and sending an application starting instruction carrying an interface switching identifier to the first controller when a display requirement is that the application starting instruction is displayed on a second display, wherein the first controller is used for switching the data interface of the first controller according to the interface switching identifier carried in the application starting instruction.

When the data interface needs to be switched, for example, a display currently connected to the data interface of the first controller is a first display (small screen), but a specific application to be started by a user is an application installed in the first controller, and the application needs to be displayed on a second display (large screen), the second controller sends an application start instruction to the first controller.

The first controller switches the display content output interface to the HDMI connected to the second display by the HDMI Switch module according to the interface switching identifier carried in the application start instruction, that is, the data interface of the first controller is switched to the HDMI interface, so as to facilitate the output of the display content of the specified application in the first controller.

S402, starting the content display application, and generating a display interface in the second display, wherein the display interface of the content display application is used for displaying the display content of the designated application.

A content presentation application (LiveTV) is configured in the second controller and is started by the second controller. And the content display application is opened to provide a display interface and is displayed in the second display, and the display content of the specified application is presented in the display interface.

And the second controller starts the content display application after sending the application starting instruction to the first controller so as to generate a display interface in the second display.

And S403, calling the switched data interface of the first controller, and displaying the display content of the specified application in a display interface corresponding to the second display.

After the data interface of the first controller is switched to the HDMI interface by the first controller according to the interface switching identifier carried in the application starting instruction, the second controller calls the HDMI interface of the first controller, and the display content of the specified application is output to the second display through the HDMI interface and is presented in the display interface.

Specifically, when the second controller calls the switched data interface of the first controller to display the display content of the specified application, the second controller is further configured to execute the following steps:

step 501, a signal source switching module is called, a signal source of the second controller is switched to an HDMI interface of the first controller, and the HDMI interface is used for transmitting display content of a designated application in the first controller.

When the data interface between the two controllers is switched, the switched data interface is an HDMI interface. And after the data interface of the first controller is switched to the HDMI by the first controller, waiting to be called.

The signal source switching module is used for switching the signal source (data interface) in the double-screen display equipment, so that the second controller controls the signal source switching module to switch the signal source of the second controller where the target display is located to the HDMI of the first controller, and the HDMI of the first controller transmits the display content of the designated application.

In the process of switching the signal source by the signal source switching module, although the switching process is short, a blank space appears in the second display. Therefore, in order to avoid displaying the switching state on the second display in a flashing manner, a default interface can be generated and displayed on the second display in the signal source switching process, and the signal source callback process is blocked. And after the signal source switching is completed, synchronously displaying the display interface of the second display and the display content of the designated application.

And 502, receiving display content of the specified application transmitted by the HDMI, and presenting the display content in a display interface corresponding to the second display.

After the signal source switching module completes the switching of the signal source and the HDMI of the first controller is connected with the second display, the second controller can receive the display content of the designated application in the first controller transmitted through the HDMI. At this time, the second controller has opened the content presentation application and generated the presentation interface in the second display, and thus, the display content of the specified application can be presented in the presentation interface.

After the display content of the designated application in the first controller is displayed in the second display, the first display does not need to provide social ability any more, and then can enter a standby state, namely, the backlight of the first display can be turned off. The backlight of the first display is controlled by a second controller of the second controllers, and thus, the first display is communicatively coupled to the second controller. At this time, in performing turning off the first display backlight, the second controller is further configured to perform the following method:

step 601, receiving a first display backlight closing instruction sent by a first controller, where the first display backlight closing instruction is used to close the backlight of a first display in the first controller.

Step 602, in response to the instruction to turn off the first display backlight, turn off the first display backlight in the first controller.

After the first controller completes the switching of the data interface of the first controller, the first display does not need to display the relevant information of the designated application, and therefore, the first controller can generate a command for closing the backlight of the first display and send the command to the second controller. The second controller receives and responds to the instruction of closing the first display backlight, and the second controller closes the first display backlight.

In this embodiment, the timing when the second controller executes the instruction to turn off the backlight of the first display is prior to the process that the second controller calls the signal source switching module to switch the signal source and displays the display content of the designated application in the second display, and the effect of turning off the backlight first is presented, so that the situation that the backlight of the first display is turned on all the time to affect the visual effect of the user and the experience is poor in the process of switching the signal source and displaying the display content of the designated application is avoided.

For example, when the user clicks the mirror application icon on the home page, and the second controller receives an application start instruction for starting the application, it is determined that the mirror application in the first controller is started and needs to be displayed on the second display. At this time, the second controller generates an interface switching identifier and sends the interface switching identifier to the first controller along with an application starting instruction. The first controller sends a command for closing the backlight of the first display to the second controller, and the second controller closes the backlight of the first display after receiving the command. The second controller launches a content presentation application (LiveTV), generates a presentation interface and displays it in the second display. Meanwhile, the first controller switches the display content output interface to the HDMI connected with the second display by the HDMI Switch module according to the interface switching identifier, namely, the data interface of the first controller is switched to the HDMI interface, so that the display content applied by the mirror is output to the HDMI connected with the second controller. The second controller calls the signal source switching module to establish connection between the HDMI of the second controller and the HDMI of the first controller, so that display content applied to the mirror is output to the second display through the HDMI and is displayed in the display interface. At this point, the second display (large screen) displays the interface for the mirror application, while the first display (small screen) is blank.

FIG. 18 is a flow chart illustrating a second method of presenting display content of a specified application in accordance with an illustrative embodiment; a second data flow diagram illustrating a method of switching a display of a dual system size dual screen application according to an exemplary embodiment is shown in fig. 19. Referring to fig. 18 and 19, for the case where the HDMI interface of the first controller is currently output to the large screen but an application that the first controller needs to display on the small screen needs to be started, the first controller is further configured to perform the following steps:

and S701, connecting a data interface of the first controller with a second display, designating an application source of the application as the first controller, and receiving an application starting instruction which is sent by the second controller and carries an interface switching identifier when the display requirement is that the first display is displayed, so as to switch the data interface of the first controller according to the interface switching identifier carried in the application starting instruction.

When the data interface needs to be switched, for example, a display currently connected to the data interface of the first controller is a second display (large screen), but a specific application to be started by a user is an application installed in the first controller, and the application needs to be displayed on the first display (small screen), the second controller sends an application start instruction to the first controller.

The first controller switches the display content output interface to the HDMI connected with the first display by the HDMI Switch module according to the interface switching identifier carried in the application starting instruction, namely, the data interface of the first controller is switched to the HDMI interface, so that the display content of the designated application in the first controller can be conveniently output to the small screen.

And S702, calling the switched data interface of the first controller, and displaying the display content of the specified application in a display interface corresponding to the first display.

After the first controller completes switching the data interface of the first controller, the data interface of the first controller is disconnected from the second display, and is connected with the first display. And the first controller transmits the display content of the appointed application to the first display through the data interface switched by the first controller so as to display on the first display.

The method provided by this embodiment is also applicable to a case where, when the application in the first controller runs, the display content of the application is displayed in the second display, and after the application runs, the display content of the application in the first controller is displayed in the first display again by switching the data interface. When the application in the first controller needs to be displayed on a large screen, the display content can be transmitted to the large screen; and when the display is not needed on the large screen, the display content is transmitted to the small screen again by switching the data interface, so that the coordinated display of the double-screen application is realized.

Since the backlight of the first display is in an off state when the first display is not used, the backlight of the first display needs to be turned on again after the first controller completes the data interface switching and displays the display content of the designated application. Specifically, in performing turning on the first display backlight, the first controller is further configured to:

step 801, sending a first display backlight starting instruction to a second controller, where the first display backlight starting instruction is used to start the backlight of a first display in the first controller.

Step 802, the second controller starts the backlight of the first display in the first controller in response to the instruction to start the backlight of the first display.

The first controller needs to turn on the backlight of the first display again for the user's viewing convenience after outputting the display contents of the designated application to the first display. Therefore, the first controller generates a first display backlight starting instruction and sends the first display backlight starting instruction to the second controller, and the second controller receives and responds to the first display backlight starting instruction to start the backlight of the first display, so that a user can view the display content of the specific application displayed in the first display.

In this embodiment, the first controller presents a "back-on backlight" effect in a process that the first controller outputs the display content of the designated application to the first display after the timing of sending the instruction to turn on the backlight of the first display, so as to avoid that the first display is preferentially turned on, and at this time, the display content of the designated application is not yet displayed in the first display, so as to avoid that the blank display is seen by the user.

After the display content of the designated application in the first controller is switched from the second display to the first display for displaying, the second display does not need to display the display content of the designated application any more, but cannot display a blank screen, and at this time, the second controller can acquire the previous display content for displaying. To this end, the second controller is further configured to perform the steps of:

step 901, obtaining the display content of the previous application before the display content of the specified application is displayed in the second display.

And step 902, displaying the display content of the prior application in the second display.

Before displaying the display content of the designated application in the first controller, the second display executes the preset program of the second display, namely the second display displays the display content of a certain application. The second display displays the content that has been displayed before the display content of the specified application as the display content of the previous application.

After the first controller switches the data interface, the first controller disconnects the second display, and simultaneously the second controller closes the content display application, at this time, the display interface is no longer presented in the second display. In order to avoid blank screens on the second display, the display content of the prior application is acquired by the second controller and is redisplayed in the second display.

For example, when the user starts the application a, the second controller determines that the application a is the application in the first controller and needs to be displayed on the first display. And determining that the data interface of the first controller is connected with the second display according to the connection state of the signal source switching module, and generating an interface switching identifier by the second controller at the moment and sending the interface switching identifier to the first controller through the data path along with an application starting instruction. The first controller responds to an application starting instruction, and according to the interface switching identifier, the HDMI Switch module switches the display content output interface to the HDMI connected with the first display, so that the data interface of the first controller is switched, the interface is connected with the first display, and the display content of the application A is output to the first display for display. At the same time, the second controller closes the content presentation application (LiveTV) and calls the second controller to enter the display content of the application prior to LiveTV for presentation on the second display. The first controller sends a first display backlight starting instruction to the second controller, and the second controller starts the backlight of the first display after receiving the first display backlight starting instruction. At this time, the second display (large screen) displays the display content of the previous application, and the first display (small screen) displays the display content of application a.

FIG. 20 is a flow chart illustrating a third method of presenting display content of a specified application in accordance with an illustrative embodiment; a third data flow diagram illustrating a method for switching a display of a dual system size dual screen application in accordance with an exemplary embodiment is shown in fig. 21. Referring to fig. 20 and 21, this is applicable to the case where the HDMI interface of the first controller is currently output to the large screen, but the application in the second controller needs to be started, and the application in the second controller is displayed on the large screen, and the second controller is further configured to perform the following steps:

s1001, connecting a data interface of the first controller with a second display, and starting the designated application when the application source of the designated application is the second controller and the display requirement is the second display.

And S1002, calling a signal source switching module, and switching the signal source of the second controller to the system interface of the second controller.

And S1003, acquiring display content of the specified application based on the system interface of the second controller, and presenting the display content in the second display.

When the data interface needs to be switched, for example, a display currently connected to the data interface of the first controller is a second display (large screen), and a specific application to be started by a user is an application installed in the second controller, and the second controller sends an application start instruction to the first controller when the application needs to be displayed on the second display (large screen).

In other embodiments, this may also happen when the user directly opens the application in the second controller after the display content of the application in the first controller is shown in the second display.

The user triggers the designated application in the second controller and thereupon launches the designated application. At this time, in order to start the designated application, the second controller calls the signal source switching module, and the data interface of the first controller which is connected with the second display needs to be switched to the system interface of the second controller. Since the application is designated as the application in the second controller and can only be displayed in the second display, the signal source switching module switches to the system interface when switching back to the data interface in the second controller.

The second controller establishes connection between a system interface of the second controller and the second display, and outputs display content of the specified application to the second display through the system interface for display.

When the second display is in the process of displaying the display content of the application in the first controller and the application in the second controller is forcibly started, the connection between the data interface of the first controller and the second display is cut off, and the display content of the application in the first controller can not be displayed in the second display any more. Thus, for subsequent processing of the application in the first controller, after the second controller launches the specified application, the second controller is further configured to perform the method of:

step 1101, sending an interface change notification to the first controller, wherein the interface change notification is used for enabling the first controller to acquire a homepage of the first controller and display the homepage in the first display, and sending a backlight instruction for turning on the first display to the second controller.

Step 1102, receiving a first display backlight starting instruction sent by a first controller, wherein the first display backlight starting instruction is used for starting backlight of a first display in the first controller.

Step 1103, in response to the instruction to turn on the first display backlight, turning on the backlight of the first display in the first controller.

And after the second controller is switched to a system interface of the second controller and displays the display content of the specified application in the second display, generating an interface change notice and sending the interface change notice to the first controller. The first controller receives and responds to the interface change notification to cut off the progress of the application originally displayed in the second display. Meanwhile, the homepage of the first controller is acquired, and the display content output interface is switched to the HDMI connected with the first display by the HDMI Switch module, so that the homepage of the first controller is displayed in the first display. That is, after the application of the first controller is displayed on the second display and the user forcibly starts the application of the second controller, the started application of the first controller cannot display the display content on the first display, and therefore, the application of the first controller is immediately ended and the running of the application is exited.

The first controller may turn on the backlight of the first display again in order to facilitate viewing by the user after displaying the home page on the first display. Therefore, the first controller generates a first display backlight starting instruction and sends the first display backlight starting instruction to the second controller, and the second controller receives and responds to the first display backlight starting instruction to start the backlight of the first display, so that a user can view the display content of the specific application displayed in the first display.

In this embodiment, in the process that the first controller acquires the content of the homepage to the first display after the first controller sends the backlight command for turning on the first display, the "back-on backlight" effect is presented, so that the situation that the first display is preferentially turned on but no content is displayed in the first display at this time is avoided, and the blank display is prevented from being seen by the user.

For example, when the data interface of the first controller is output to the second display, the application B on the second controller is directly started (the applications on the system N are all displayed in the second display). When the user starts the application B, the second controller immediately starts the application B when judging that the application B is the application on the second controller, and the data interface output to the second display is switched to the system interface of the second controller. The second controller generates an interface switching notice and sends the interface switching notice to the first controller, after the first controller receives the interface switching notice, the first controller judges that an interface output to the second display is switched to other signal sources (system interfaces) from the HDMI, a homepage of the first controller is obtained, and the HDMI Switch module switches a display content output interface to the HDMI connected with the first display, so that the homepage of the first controller is displayed on the first display. The first controller sends a first display backlight starting instruction to the second controller, and the second controller starts the backlight of the first display after receiving the first display backlight starting instruction. At this time, the second display displays the display content of the application B, and the first display displays the homepage of the first controller.

As can be seen from the foregoing technical solutions, the dual-screen display device according to the embodiments of the present invention executes a switching method for displaying a dual-system large and small dual-screen application, where the processing method of the second controller includes obtaining a connection state of a data interface of the first controller and a connection state of a data interface of the second controller, receiving an application start instruction for starting a carrying packet name of a specified application, determining an application source and a display requirement of the specified application based on the packet name of the specified application, and generating an interface switching identifier in combination with the connection states of the data interfaces of the two controllers, so as to implement calling of the data interfaces of the corresponding controllers. And calling a data interface of the controller to which the specified application belongs, which corresponds to the interface switching identifier, and displaying the display content of the specified application in a display corresponding to the display requirement. As can be seen, in the dual-screen display device provided in the embodiment of the present invention, the second controller determines whether the designated application corresponding to the application start instruction belongs to the first controller or the second controller, and the display content of the designated application needs to be displayed on the first display or the second display, and after determining the application source and the display requirement, generates the interface switching identifier to control the corresponding controller to switch the data interface, so as to implement the display of the display content of the designated application on the display corresponding to the display requirement, and ensure the coordinated display of the dual-screen application in the dual system.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in each embodiment of the method for switching a dual-system-size dual-screen application display provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

The same and similar parts in the various embodiments in this specification may be referred to each other. Particularly, for the embodiment of the switching method of the dual-system-size dual-screen application display, since the embodiment is basically similar to the embodiment of the dual-screen display device, the description is simple, and for the relevant points, reference may be made to the description in the embodiment of the method.

The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.

Claims

1. A dual screen display device, comprising:

2. A dual screen display device, comprising:

3. A dual screen display device, comprising:

4. The dual screen display device of claim 3, wherein the second controller further comprises a signal source switching module configured to switch the data interface of the first controller with the second controller; and the second controller is further configured to:

acquiring a connection state of a signal source switching module, wherein the connection state of the signal source switching module is used for representing the connection state of a first controller data interface and the connection state of a second controller data interface;

judging whether a current controller corresponding to the connection state of the signal source switching module is consistent with a controller of the specified application or not and whether a current display corresponding to the connection state of the signal source switching module is consistent with a target display of the specified application or not based on the connection state of the signal source switching module, the display requirement of the specified application and an application source;

and if the current controller corresponding to the connection state of the signal source switching module is consistent with the controller of the specified application and the current display corresponding to the connection state of the signal source switching module is inconsistent with the target display of the specified application, generating an interface switching identifier.

5. The dual screen display device of claim 3, wherein the second controller further comprises a signal source switching module configured to switch the data interface of the first controller with the second controller; and the second controller is further configured to:

and if the current controller corresponding to the connection state of the signal source switching module is inconsistent with the controller of the specified application and the current display corresponding to the connection state of the signal source switching module is consistent with the target display of the specified application, generating an interface switching identifier.

6. The dual screen display device of claim 3, wherein a content presentation application is configured within the second controller; and the second controller is further configured to:

when the data interface of the first controller is connected with a first display, the application source of the specified application is the first controller, and the display requirement is that the specified application is displayed on a second display, an application starting instruction carrying the interface switching identifier is sent to the first controller, and the first controller is used for switching the data interface of the first controller according to the interface switching identifier carried in the application starting instruction;

starting a content display application, and generating a display interface in the second display, wherein the display interface of the content display application is used for displaying the display content of the specified application;

and calling the data interface switched by the first controller, and displaying the display content of the specified application in a display interface corresponding to the second display.

7. The dual screen display device of claim 6, wherein the data interface comprises an HDMI interface; and the second controller is further configured to:

calling a signal source switching module, and switching a signal source of the second controller to an HDMI (high-definition multimedia interface) of the first controller, wherein the HDMI is used for transmitting display content of a specified application in the first controller;

and receiving the display content of the specified application transmitted by the HDMI interface, and presenting the display content in a display interface corresponding to the second display.

8. The dual screen display device of claim 6, wherein the first display is communicatively coupled to the second controller; and the second controller is further configured to:

receiving a first display backlight closing instruction sent by the first controller, wherein the first display backlight closing instruction is used for closing the backlight of a first display in the first controller;

and in response to the instruction for turning off the first display backlight, turning off the backlight of the first display in the first controller.

9. The dual screen display device of claim 3, wherein the first controller is further configured to:

when the data interface of the first controller is connected with a second display, the application source of the specified application is the first controller, and the display requirement is the display on the first display, receiving an application starting instruction which is sent by the second controller and carries the interface switching identifier, and sending the application starting instruction to the first controller so as to switch the data interface of the first controller according to the interface switching identifier carried in the application starting instruction;

and calling the data interface after the first controller is switched, and displaying the display content of the specified application in a display interface corresponding to the first display.

10. The dual screen display device of claim 9, wherein the first controller is further configured to:

sending a first display backlight starting instruction to a second controller, wherein the first display backlight starting instruction is used for starting the backlight of a first display in the first controller;

the second controller responds to the instruction for starting the first display backlight and starts the backlight of the first display in the first controller.

11. The dual screen display device of claim 9, wherein the second controller is further configured to:

acquiring display content of a previous application in the second display before displaying the display content of the specified application;

displaying the display content of the prior application in a second display.

12. The dual screen display device of claim 3, wherein the second controller is further configured to:

when the data interface of the first controller is connected with a second display, the application source of the designated application is the second controller, and the display requirement is that the designated application is started when the second display is displayed;

calling a signal source switching module to switch the signal source of the second controller to a system interface of the second controller;

and acquiring the display content of the specified application based on the system interface of the second controller, and presenting the display content in the second display.

13. The dual screen display device of claim 12, wherein the second controller is further configured to:

sending an interface change notification to a first controller, wherein the interface change notification is used for enabling the first controller to acquire a homepage of the first controller and display the homepage in a first display, and sending a backlight instruction for starting the first display to a second controller;

receiving a first display backlight starting instruction sent by the first controller, wherein the first display backlight starting instruction is used for starting the backlight of a first display in the first controller;

and responding to the instruction for starting the first display backlight, and starting the backlight of the first display in the first controller.