CN112399243A

CN112399243A - Playing method and display device

Info

Publication number: CN112399243A
Application number: CN202010744717.2A
Authority: CN
Inventors: 左剑; 李慧娟; 陈俊宁; 齐消消; 闫磊; 仲伟男
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2019-08-18
Filing date: 2020-07-29
Publication date: 2021-02-23

Abstract

The application discloses a playing method and a display device, wherein a second user interface in a hidden state is created in response to the fact that the time difference between the current playing time point and the ending time point of push information is equal to a time threshold value, and a video received from a transmission interface is delivered to the second user interface; wherein the push information is played on the first user interface; setting a second audio channel for outputting the audio received from the transmission interface in the dual audio channels to a mute state; and when the push information is played, adjusting the second user interface to be in a visible state, adjusting the first user interface to be in a hidden state, and removing the mute state of the second audio channel. According to the method and the device, when the push information is played, seamless switching from the push information to the playing source is achieved, and the phenomenon of screen blacking occurring from the end of the push information playing to the display of the playing source is eliminated.

Description

Playing method and display device

The present application claims priority of chinese patent application entitled "a playback method and display device" filed by the chinese patent office on 18/08/2019 under application number 201910761464.7, which is incorporated herein by reference in its entirety.

Technical Field

The present application relates to the technical field of display devices, and in particular, to a playing method and a display device.

Background

The display device is generally configured with an HDMI (High Definition Multimedia Interface), and the HDMI can connect a set top box, a DVD (Digital Video Disc) player, a Video game machine, and other playback sources, so as to simultaneously transmit a Video signal and an audio signal in the playback sources to the display device, so that the display device plays Video and audio.

In the display device, it is often necessary to switch the playing content of the display interface by using the HDMI, for example, when the display device is powered on, the display device generally plays the push information for a certain time, such as power-on advertisement, power-on animation, and after the push information is played, the content played by the display device is switched from the push information to the video and audio transmitted by the HDMI, so as to start the playing source after the power-on.

However, if the display device switches the playing source by using the HDMI, a certain time is consumed, and if the content played by the display device is switched from the push information to the video and audio transmitted by the HDMI after the push information is played, a black screen phenomenon may occur on the interface of the display device in a time period from the end of the push information to the start of the playing source.

Disclosure of Invention

The application provides a playing method and display equipment, and aims to solve the problem that when contents played by the display equipment are switched to audio and video transmitted by an HDMI from push information, a display equipment interface is blacked.

In a first aspect, the present application provides a display device, comprising:

a display for displaying video images and a user interface;

a sound player for playing audio;

the transmission interface is used for externally connecting the playing source equipment;

a controller connected to the display, the sound player and the transmission interface, configured to perform the following program steps:

responding to the time difference between the current playing time point and the ending time point of the push information being equal to the time threshold, controlling a display to create a second user interface in a hidden state, and delivering the video received from the transmission interface to the second user interface; wherein the push information is played by a first user interface displayed by the display;

setting a second audio channel for outputting the audio received from the transmission interface in the dual audio channels to a mute state;

and when the push information is played, controlling the display to adjust the second user interface to be in a visible state, adjusting the first user interface to be in a hidden state, and removing the mute state of the second audio channel.

In a second aspect, the present application provides a display device, comprising:

a display for displaying video images and a user interface;

a sound player for playing audio;

a second controller as a play source built in the display device;

the first controller is connected with the display and the sound player respectively, and the first controller is connected with the second controller through a transmission interface; the first controller is configured to perform the following program steps:

responding to the time difference between the current playing time point and the ending time point of the push information being equal to the time threshold, controlling the display to create a second user interface in a hidden state, and delivering the video in the second controller received from the transmission interface to the second user interface; wherein the push information is played by a first user interface displayed by the display;

In a third aspect, the present application provides a playing method for a display device, where the method includes:

in response to that the time difference between the current playing time point and the ending time point of the push information is equal to a time threshold value, creating a second user interface in a hidden state, and delivering the video received from the transmission interface to the second user interface; wherein the push information is played on a first user interface;

and when the push information is played, adjusting the second user interface to be in a visible state, adjusting the first user interface to be in a hidden state, and removing the mute state of the second audio channel.

In a fourth aspect, the present application provides another playing method for a display device, including:

in response to that the time difference between the current playing time point and the ending time point of the push information is equal to a time threshold, creating a second user interface in a hidden state, and delivering the video in the second controller received from the transmission interface to the second user interface; the push information is played on a first user interface, and the second controller is a playing source arranged in the display equipment;

The working mechanism and the beneficial effects of the technical scheme are as follows: when the display device is started, firstly playing push information in a first user interface, because the display device can have a certain time consumption when being switched from the push information to a playing source, a time threshold value can be preset according to the time consumption, the time threshold value is larger than or equal to the time consumption, in the playing process of the push information, the time difference between the current playing time point and the ending time point is obtained, namely how long the push information is played and ended, then, the time difference is compared with the time threshold value, when the time difference is equal to the time threshold value, a second user interface is created in the display, is positioned at the next layer of the first user interface and is in a hidden state, the video received from the transmission interface is delivered to the second user interface, and at the moment, the second user interface displays the video received from the transmission interface, and the part of the video cannot be displayed in the display, the current display of the display is still the push information played in the first user interface. During the playing period of the push information, the video received from the transmission interface is switched to the second user interface to be displayed in advance, and the process can be completed within a time threshold value, so that after the push information is completed, the first user interface is only needed to be hidden, the second user interface is displayed, the switching of the first user interface to the second user interface is completed, and the seamless connection of the push information and the video transmitted by the transmission interface can be completed.

The transmission interface simultaneously transmits a video signal and an audio signal in a playing source to the display device, because the video received from the transmission interface is put on the second user interface in advance, the display device can also receive the audio sent by the transmission interface in advance when the playing of the push information is not finished, because the display device is generally provided with a sound player, in order to avoid that the audio sent by the transmission interface influences the playing of the push information audio before the playing of the push information is not finished, when the time difference is judged to be equal to the time threshold, a double audio channel can be established, the two audio channels are mutually independent and parallel, the output ends of the two audio channels are connected with the sound player, a first audio channel corresponding to the first user interface is used for outputting the audio of the push information, and a second audio channel corresponding to the second user interface is used for outputting the audio received from the transmission interface, at this time, the second audio channel is in a mute state, the dual audio channels output the audio to the sound player and play the audio which is only the push information, and the two audio channels do not interfere with each other. Namely, during the playing of the push information, the audio sent by the transmission interface is switched to the second audio channel in advance, and the process can be completed within a time threshold value, so that when the push information is completed, the mute state of the second audio channel is only required to be released when the playing of the push information is completed, the second audio channel can normally play the audio received from the transmission interface, and the seamless connection between the push information and the audio transmitted by the transmission interface is completed.

In summary, the present application can realize seamless switching from the push information to the play source when the push information is played, and eliminate the black screen phenomenon occurring from the end of the push information to the display of the play source.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic view of an operation scenario between a display device and a control apparatus according to an embodiment of the present application;

fig. 2 is a block diagram of a hardware configuration of the control device 100 according to an embodiment of the present application;

fig. 3 is a block diagram illustrating a hardware configuration of a display device 200 according to an embodiment of the present disclosure;

fig. 4 is a block diagram illustrating a hardware architecture of a display device 200 according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram illustrating a functional configuration of a display device 200 according to an embodiment of the present application;

fig. 6(a) is a schematic diagram illustrating a software configuration in the display device 200 according to an embodiment of the present application;

fig. 6(b) is a schematic configuration diagram of an application program in the display device 200 according to the embodiment of the present application;

FIG. 7 is a schematic diagram of a user interface in the display device 200 according to an embodiment of the present disclosure;

fig. 8 is a flowchart illustrating a playing method according to an embodiment of the present application;

fig. 9 is a flowchart illustrating a dual audio channel operation before the end of playing push information according to an embodiment of the present application;

fig. 10 is a flow chart of a single audio channel for playing audio received from a transmission interface after the push information is played according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the embodiments of the present application, the display device may be a smart television, an outdoor display screen, a computer, a projection display device, or the like. In this embodiment, after the display device is started, the push information may be different types of playing contents such as a start-up advertisement, a dynamic video, a picture, and the like, the push information has a certain playing duration, the push information may be sent to the display device through a transmission mode such as an HDMI or other interfaces, and the content mode, the transmission mode, the playing time, the display mode, and the like of the push information are not limited.

The display device is provided with a transmission interface, the transmission interface is used for transmitting the audio and video of the playing source to a controller of the display device, the transmission interface can adopt an HDMI (high-definition multimedia interface), the HDMI can be an external interface, and the HDMI is open to users and is used for externally connecting the playing source devices such as a set top box, a DVD player and a television game machine. Because the display device has playing resources such as a network film source, an application, local multimedia, a default startup homepage interface and the like, and secondly, the display device can also have a built-in HDMI interface, the HDMI is not open to a user, and the playing resources built in the display device system can be sent to a controller for controlling audio and video playing through the HDMI, so that the display of push information and a playing source is controlled. The playing method provided by the application can be suitable for display equipment with any one of the HDMI interfaces or other types of transmission interfaces, so that the problem of screen blackness caused by time consumption generated in the switching process when the display interface is switched to the Video resource and the Audio resource received from the transmission interface after the push information is played is solved. For other HDMI/transmission interfaces in connection forms, the present solution can be applied as long as the problems set forth in the background of the present application exist. In the embodiments of the present application, the playing of the playing source refers to displaying the video data received from the transmission interface in the display, and playing the audio data received from the transmission interface in the sound player synchronously. The sound player may be a sound device in which a speaker is connected to an external sound output terminal.

Specifically, the second built-in HDMI interface is mainly for a display device having a dual system architecture, that is, has a first controller and a second controller, where the first controller and the second controller are connected through a transmission interface, the first controller is used to control the push information and the play of the play source, and the second controller is used as a built-in play source of the first controller; the external HDMI interface of the first kind may be suitable for both a conventional single-system display device (i.e. having one controller) and a dual-system display device. The structure, function, implementation, and the like of the display device having the dual system hardware structure will be described in detail first.

For the convenience of users, various external device interfaces are usually provided on the display device to facilitate connection of different peripheral devices or cables to implement corresponding functions. When a high-definition camera is connected to an interface of the display device, if a hardware system of the display device does not have a hardware interface of a high-pixel camera receiving the source code, data received by the camera cannot be displayed on a display screen of the display device.

Furthermore, due to the hardware structure, the hardware system of the conventional display device only supports one path of hard decoding resources, and usually only supports video decoding with a resolution of 4K at most, so when a user wants to perform video chat while watching a network television, the user needs to use the hard decoding resources (usually GPU in the hardware system) to decode the network video without reducing the definition of the network video screen, and in this case, the user can only process the video chat screen by using a general-purpose processor (e.g. CPU) in the hardware system to perform soft decoding on the video.

The soft decoding is adopted to process the video chat picture, so that the data processing burden of a CPU (central processing unit) can be greatly increased, and when the data processing burden of the CPU is too heavy, the problem of picture blocking or unsmooth flow can occur. Further, due to the data processing capability of the CPU, when the CPU performs soft decoding on the video chat screen, multi-channel video calls cannot be generally implemented, and when a user wants to perform video chat with multiple other users in the same chat scene, access is blocked.

In view of the above aspects, to overcome the above drawbacks, the present application discloses a dual hardware system architecture to implement multiple channels of video chat data (at least one channel of local video).

The concept to which the present application relates will be first explained below with reference to the drawings. It should be noted that the following descriptions of the concepts are only for the purpose of facilitating understanding of the contents of the present application, and do not represent limitations on the scope of the present application.

The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.

The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be referred to as a motherboard (or chip).

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the control device 100.

The control device 100 may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control apparatus 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a notebook computer, etc., which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200.

For example, the mobile terminal 100B and the display device 200 may each be installed with a software application, so that the connection between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be communicatively coupled to the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.

Illustratively, the display device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

The display device 200 may be, for example, a liquid crystal display, an oled (organic Light Emitting diode) display, or a projection display device; on the other hand, the display device can be a display system consisting of an intelligent television or a display and a set-top box. The specific display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like. In some embodiments, the display device may not have a broadcast receiving television function.

As shown in fig. 1, the display device may be connected or provided with a camera, and is configured to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement interactive chat between users. Specifically, the picture shot by the camera can be displayed on the display device in a full screen mode, a half screen mode or any optional area.

As an optional connection mode, the camera is connected with the display rear shell through the connecting plate, is fixedly installed in the middle of the upper side of the display rear shell, and can be fixedly installed at any position of the display rear shell as an installable mode, so that an image acquisition area is ensured not to be shielded by the rear shell, for example, the display orientation of the image acquisition area is the same as that of the display equipment.

As another optional connection mode, the camera is connected to the display rear shell through a connection board or another conceivable connector, the camera is capable of lifting and descending, a lifting motor is installed on the connector, when a user wants to use the camera or an application program wants to use the camera, the camera is lifted out of the display, and when the camera does not need to be used, the camera can be embedded in the rear shell, so that the camera is protected from being damaged, and privacy safety of the user is protected.

As an embodiment, the camera adopted in the present application may have 1600 ten thousand pixels, so as to achieve the purpose of ultra high definition display. In actual use, cameras higher or lower than 1600 ten thousand pixels may also be used.

After the camera is installed on the display device, the contents displayed by different application scenes of the display device can be fused in various different modes, so that the function which cannot be realized by the traditional display device is achieved.

Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.

Optionally, in a scene of "chat while watching", at least one video chat is performed across terminals while watching a live video or a network video.

In another example, a user can conduct a video chat with at least one other user while entering the educational application for learning. For example, a student may interact remotely with a teacher while learning content in an educational application. Vividly, this function can be called "chatting while learning".

In another example, a user conducts a video chat with a player entering a card game while playing the game. For example, a player may enable remote interaction with other players when entering a gaming application to participate in a game. Figuratively, this function may be referred to as "watch while playing".

Optionally, the game scene is fused with the video picture, the portrait in the video picture is scratched and displayed in the game picture, and the user experience is improved.

Optionally, in the motion sensing game (such as ball hitting, boxing, running and dancing), the human posture and motion, limb detection and tracking and human skeleton key point data detection are obtained through the camera, and then the human posture and motion, the limb detection and tracking and the human skeleton key point data detection are fused with the animation in the game, so that the game of scenes such as sports and dancing is realized.

In another example, a user may interact with at least one other user in a karaoke application in video and voice. Vividly, this function can be called "sing while watching". Optionally, when at least one user enters the application in a chat scenario, multiple users may jointly complete recording of a song.

In another example, a user may turn on a camera locally to take pictures and videos, figurative, which may be referred to as "looking into the mirror".

In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.

Fig. 2 is a block diagram schematically showing the configuration of the control apparatus 100 according to the exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control apparatus 100 is configured to control the display device 200, and to receive an input operation instruction from a user, and convert the operation instruction into an instruction recognizable and responsive by the display device 200, and to mediate interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display device 200 according to user demands.

In some embodiments, as shown in fig. 1, the mobile terminal 100B or other intelligent electronic device may function similar to the control apparatus 100 after installing an application for manipulating the display device 200. Such as: the user may implement the functions of controlling the physical keys of the apparatus 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 100B or other intelligent electronic devices.

The controller 110 includes a processor 112, a RAM113 and a ROM114, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communicator 130 may include at least one of a WIFI module 131, a bluetooth module 132, an NFC module 133, and the like.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, it may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The communicator 130 is configured in the control device 100, such as: the modules of WIFI, bluetooth, NFC, etc. may send the user input command to the display device 200 through the WIFI protocol, or the bluetooth protocol, or the NFC protocol code.

And a memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operation power support for each electrical component of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

A hardware configuration block diagram of a hardware system in the display apparatus 200 according to an exemplary embodiment is exemplarily illustrated in fig. 3.

When a dual hardware system architecture is adopted, the mechanism relationship of the hardware system can be shown in fig. 3. The first controller comprises various processors and various interfaces of the first controller, and the second controller comprises various processors and various interfaces of the second controller. The first controller and the second controller may each have a relatively independent operating system installed therein, and the operating system of the second controller and the operating system of the first controller may communicate with each other through a communication protocol, which is as follows: the frame layer of the operating system of the second controller and the frame layer of the operating system of the first controller can communicate for the transmission of commands and data, so that there are two independent but interrelated subsystems in the display device 200.

As shown in fig. 3, the connection, communication and power supply between the second controller and the first controller can be realized through a plurality of interfaces of different types. The interface type of the interface between the second controller and the first controller may include a General-purpose input/output (GPIO), a USB interface, an HDMI interface, a UART interface, and the like. One or more of these interfaces may be used for communication or power transfer between the second controller and the first controller. For example, as shown in fig. 3, in the dual hardware system architecture, the first controller may be powered by an external power source (power), and the second controller may be powered by the first controller instead of the external power source. Optionally, the external power source may also be connected to the first controller and the second controller, respectively, to supply power to the first controller and the second controller.

In addition to the interface for connecting with the first controller, the second controller may also include an interface for connecting with other devices or components, such as a MIPI interface for connecting with a Camera (Camera), a bluetooth interface, etc., shown in fig. 3.

Similarly, in addition to the interface for connecting with the first controller, the first controller may further include an VBY interface for connecting with a display screen tcon (timer Control register), an I2S interface for connecting with a power Amplifier (AMP) and a Speaker (Speaker); and an IR/Key interface, a USB interface, a Wifi interface, a bluetooth interface, an HDMI interface, a Tuner interface, and the like.

The dual hardware system architecture of the present application is further described below with reference to fig. 4. It should be noted that fig. 4 is only an exemplary illustration of the dual hardware system architecture of the present application, and does not represent a limitation of the present application. In actual practice, both hardware systems may contain more or less hardware or interfaces as desired.

A block diagram of the hardware architecture of the display device 200 according to fig. 3 is exemplarily shown in fig. 4. As shown in fig. 4, the hardware system of the display apparatus 200 may include a first controller 210 and a second controller 310, and a module connected to the first controller 210 or the second controller 310 through various interfaces.

The first controller 210 mainly implements a conventional television function (for example, a set-top box may be connected externally), and the second controller 310 may be configured to receive an instruction sent by the first controller 210.

The modules connected to the first controller 210 may include a tuning demodulator 220, a communicator 230, an external device interface 250, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, a display 280, an audio output interface 270, and a power supply module 240. The first controller 210 may include more or fewer modules in other embodiments.

In other embodiments, more or fewer modules may be connected to the first controller 210.

In other embodiments, the first controller 210 may include any one or more of the modules described above. When any one or more of the above modules is included in the first controller 210, the first controller 210 may not be connected to modules having the same function.

The tuning demodulator 220 is configured to perform modulation and demodulation processing such as amplification, mixing, resonance and the like on a broadcast television signal received in a wired or wireless manner, so as to demodulate an audio/video signal carried in a frequency of a television channel selected by a user and additional information (e.g., an EPG data signal) from a plurality of wireless or wired broadcast television signals. Depending on the broadcast system of the television signal, the signal path of the tuner 220 may be various, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; according to different modulation types, the adjustment mode of the signal can be a digital modulation mode or an analog modulation mode; and depending on the type of television signal being received, tuner demodulator 220 may demodulate analog and/or digital signals.

The tuner demodulator 220 is also operative to respond to the user-selected television channel frequency and the television signal carried thereby, in accordance with the user selection and as controlled by the first controller 210.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the external device interface 250.

The communicator 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 230 may include a WIFI module 231, a bluetooth communication protocol module 232, a wired ethernet communication protocol module 233, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown).

The display apparatus 200 may establish a connection of a control signal and a data signal with an external control apparatus or a content providing apparatus through the communicator 230. For example, the communicator may receive a control signal of the remote controller 100A according to the control of the controller.

The external device interface 250 is a component for providing data transmission between the first controller 210 and the second controller and other external devices. The external device interface 250 may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 250 may include: a High Definition Multimedia Interface (HDMI) terminal is also referred to as HDMI251, a Composite Video Blanking Sync (CVBS) terminal is also referred to as AV252, an analog or digital component terminal is also referred to as component 253, a Universal Serial Bus (USB) terminal is also referred to as USB254, a Red Green Blue (RGB) terminal (not shown in the figure), and the like. The number and type of external device interfaces are not limited by this application.

The first controller 210 controls the operation of the display apparatus 200 and responds to the operation of the user by running various software control programs (e.g., an operating system and/or various application programs) stored on the memory 290.

As shown in fig. 4, the first controller 210 includes a read only memory RAM214, a random access memory ROM213, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. The RAM214, the ROM213, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the display apparatus 200 starts to be powered on when the power-on signal is received, the CPU processor 212 executes a system boot instruction in the ROM213, and copies the operating system stored in the memory 290 to the RAM214 to start running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM214, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include a main processor and a plurality of or a sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for performing an operation in a standby mode or the like.

The communication interface 218 may include a first interface 218-1 through an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.

The first controller 210 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the first controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to an icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 290, including: a base module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc. (not shown in the figure).

The basic module is a bottom layer software module for signal communication between hardware in the display device 200 and sending processing and control signals to an upper layer module. The detection module is a management module used for collecting various information from various sensors or user input interfaces, and performing digital-to-analog conversion and analysis management. The voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. The communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. The service module is a module for providing various services and various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A user input interface 260-3 for transmitting an input signal of a user to the first controller 210 or transmitting a signal output from the first controller 210 to the user. For example, the control device (e.g., the mobile terminal 100B or the remote controller 100A) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user input interface, and then forward the input signal to the first controller 210 through the user input interface 260-3; alternatively, the control device may receive an output signal such as audio, video or data processed by the first controller 210 and output from the user input interface 260-3, and display or output the received output signal in audio or vibration form.

In some embodiments, the user may input a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface 260-3 receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 receives the user input command by recognizing the sound or gesture through the sensor.

A video signal displayed or played on the display 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like (not shown in the figure).

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module, such as an image synthesizer, is used for performing superposition mixing processing on the GUI signal input by the user or generated by the user and the video picture after the zooming processing by the graphics generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, such as a 24Hz, 25Hz, 30Hz, or 60Hz video, into a 60Hz, 120Hz, or 240Hz frame rate, wherein the input frame rate may be related to a source video stream, and the output frame rate may be related to a refresh rate of a display. And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And a display 280 for receiving the image signal input from the video processor 260-1 and displaying the video content and image and the menu manipulation interface. The display 280 includes a display component for presenting a picture and a driving component for driving the display of an image. The video content may be displayed from the video in the broadcast signal received by the tuner/demodulator 220, or from the video content input from the communicator or the external device interface. The display 280 simultaneously displays a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.

The audio processor 260-2 is configured to receive an audio signal, decompress and decode the audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification and other audio data processing to obtain an audio signal that can be played in the speaker 272.

An audio output interface 270 for receiving the audio signal output by the audio processor 260-2 under the control of the first controller 210, wherein the audio output interface may include a speaker 272 or an external sound output terminal 274 for outputting to a generating device of an external device, such as: external sound terminal or earphone output terminal.

In other exemplary embodiments, video processor 260-1 may comprise one or more chip components. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated in one or more chips together with the first controller 210.

And a power supply module 240 for providing power supply support for the display device 200 by the power input from the external power source under the control of the first controller 210. The power supply module 240 may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply installed outside the display apparatus 200, such as a power supply interface for providing an external power supply in the display apparatus 200.

As shown in fig. 4, the modules connected with the second controller 310 may include a communicator 330, a detector 340, and a memory 390. A user input interface, a video processor 360-1, an audio processor 360-2, a display, an audio output interface (not shown) may also be included in some embodiments. In some embodiments, there may also be a power module ((not shown)) that independently powers the second controller 310.

In some embodiments, more or fewer modules may also be connected to the second controller 310.

In some embodiments, the second controller 310 may include any one or more of the modules described above. When any one or more of the above modules is included in the second controller 310, the first controller 210 may not be connected to modules having the same function.

The communicator 330 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 330 may include a WIFI module 331, a bluetooth communication protocol module 332, a wired ethernet communication protocol module 333, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module.

(not shown in the figure)

The communicator 330 of the second controller 310 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 within the hardware system of the first controller 210 is used to connect to an external network, generate network communication with an external server, and the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without making a direct connection with an external network or the like, and the second controller 310 is connected to the external network through the first controller 210. Therefore, for the user, a display device as in the above embodiment displays a WiFi account to the outside.

The detector 340 is a component of the display device, the second controller 310 is used to collect an external environment or a signal interacting with the outside. The detector 340 may include a light receiver 342, a sensor for collecting the intensity of ambient light, which may be used to adapt to display parameter changes, etc.; the system may further include an image collector 341, such as a camera, a video camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or interact gestures with the user, adaptively change display parameters, and identify user gestures, so as to implement a function of interaction with the user.

An external device interface 350, which provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface 350 may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner.

A video processor 360-1 for processing the associated video signal.

The second controller 310 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs stored on the memory 390 (e.g., using installed third party applications, etc.), and interacting with the first controller 210.

As shown in fig. 4, the second controller 310 includes a read only memory ROM313, a random access memory RAM314, a graphic processor 316, a CPU processor 312, a communication interface 318, and a communication bus. The ROM313 and the RAM314, the graphic processor 316, the CPU processor 312, and the communication interface 318 are connected via a bus.

A ROM313 for storing instructions for various system boots. The CPU processor 312 executes the system boot instructions in the ROM313, copying the operating system stored in the memory 390 into the RAM314 to start running the boot operating system. After the start of the operating system is completed, the CPU processor 312 copies various application programs in the memory 390 to the RAM314, and then starts running and starting various application programs.

A CPU processor 312 for executing the operating system and application program instructions stored in the memory 390, communicating with the first controller 210, transmitting and interacting signals, data, instructions, etc., and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents.

The communication interface 318 is plural and may include a first interface 318-1 to an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to the first controller 210 via a network.

The second controller 310 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the first controller 210 may perform an operation related to the object selected by the user command.

A graphics processor 316 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

The graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 are both capable of generating various graphics objects. In distinction, if the application 1 is installed in the second controller 310 and the application 2 is installed in the first controller 210, the graphic object is generated by the graphic processor 316 of the second controller 310 when the user performs an instruction input by the user in the application 1 at the interface of the application 1. When a user is at the interface of the application 2 and an instruction input by the user is made within the application 2, a graphic object is generated by the graphic processor 216 of the first controller 210.

Fig. 5 is a diagram schematically illustrating a functional configuration of a display device according to an exemplary embodiment.

As shown in fig. 5, the memory 390 of the second controller and the memory 290 of the first controller are used to store an operating system, an application program, contents, user data, and the like, respectively, perform system operations for driving the display device 200 and various operations in response to a user under the control of the second controller 310 and the first controller 210. The memory 390 of the second controller and the memory 290 of the first controller may include volatile and/or non-volatile memory.

As for the first controller 210, the memory 290 is specifically used for storing an operating program for driving the first controller 210 in the display device 200, and storing various applications built in the display device 200, various applications downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an Operating System (OS) kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data of the video processor 260-1 and the audio processor 260-2, the display 280, the communicator 230, the tuning demodulator 220, the input/output interface, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The memory 290, for example, includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and an application 2912, a browser module (not shown in the figure), and the like. The first controller 210 performs operations such as: the system comprises a broadcast television signal receiving and demodulating function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction identification function, a communication control function, an optical signal receiving function, an electric power control function, a software control platform supporting various functions, a browser function and other various functions.

The memory 390 includes a memory storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 390, including: a base module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc. (not shown in the figure). Since the functions of the memory 390 and the memory 290 are similar, reference may be made to the memory 290 for relevant points, and thus, detailed description thereof is omitted here.

Illustratively, the memory 390 includes an image control module 3904, a second audio control module 3906, an external instruction recognition module 3907, a communication control module 3908, a light receiving module 3909, an operating system 3911, and an application 3912, a browser module 3913, and the like. The second controller 310 performs operations such as: the system comprises an image control function, a display control function, an audio control function, an external instruction identification function, a communication control function, an optical signal receiving function, an electric power control function, a software control platform supporting various functions, a browser function and other various functions.

Distinctively, the external instruction recognition module 2907 of the first controller and the external instruction recognition module 3907 of the second controller can recognize different instructions.

Illustratively, since the image receiving device such as a camera is connected with the second controller 310, the external instruction recognition module 3907 of the second controller may include an image recognition module 3907-1, a graph database is stored in the image recognition module 3907-1, and when the camera receives an external graph instruction, the camera corresponds to the instruction in the graph database to perform instruction control on the display device. Since the voice receiving device and the remote controller are connected to the first controller 210, the external command recognition module 2907 of the first controller may include a voice recognition module 2907-2, a voice database is stored in the voice recognition module 2907-2, and when the voice receiving device receives an external voice command or the like, the voice receiving device and the like perform a corresponding relationship with a command in the voice database to perform command control on the display device. Similarly, the control device 100 such as a remote controller is connected to the first controller 210, and the button command recognition module 2907-3 performs command interaction with the control device 100.

Fig. 6(a) is a block diagram illustrating a configuration of a software system in the display device 200 according to an exemplary embodiment.

As shown in fig. 6(a), the operating system 2911, including the executing operating software for handling various basic system services and for carrying out hardware related tasks, acts as an intermediary between applications and hardware components for data processing for the first controller 210.

In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controlling process management, including runtime applications and the like.

The event transmission system 2914 may be implemented within the operating system 2911 or within the application 2912. In some embodiments, an aspect is implemented within the operating system 2911, while implemented in the application 2912, for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-2 is used to input various event definitions for various user input interfaces, identify various events or sub-events, and transmit them to the process for executing one or more sets of their corresponding handlers.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout management module 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.

Since the os 3911 of the second controller has similar functions to the os 2911 of the first controller, reference may be made to the os 2911 for relevant points, and details are not repeated here.

As shown in fig. 6(b), the application programs of the display device include various application programs executable at the display device 200.

The first controller's applications 2912 may include, but are not limited to, one or more applications such as: a video-on-demand application, an application center, a game application, and the like. The applications 3912 of the second controller may include, but are not limited to, one or more applications such as: live television applications, media center applications, and the like. It should be noted that what applications are respectively contained in the second controller and the first controller is determined according to the operating system and other designs, and the present invention does not need to make specific limitations and divisions on the applications contained in the second controller and the first controller.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on a display device. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

The modules included in the hardware in the above embodiments are an example of a real-time implementation manner, and are not necessarily shown in the display device or the method of the present application, and those skilled in the art may add or subtract appropriately on the basis of the above hardware implementation manner as long as the implementation of the scheme is not affected.

A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 7. As shown in fig. 7, the user interface includes a plurality of view display areas, illustratively, a first view display area 201 and a play screen 202, wherein the play screen includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.

It should be noted that the multiple view display areas may present display screens of different hierarchies. For example, a first view display area may present video chat project content and a second view display area may present application layer project content (e.g., web page video, VOD presentations, application screens, etc.).

Optionally, the different view display areas are presented with different priorities, and the display priorities of the view display areas are different among the view display areas with different priorities. If the priority of the system layer is higher than that of the application layer, when the user uses the acquisition selector and picture switching in the application layer, the picture display of the view display area of the system layer is not blocked; and when the size and the position of the view display area of the application layer are changed according to the selection of the user, the size and the position of the view display area of the system layer are not influenced.

The display frames of the same hierarchy can also be presented, at this time, the selector can switch between the first view display area and the second view display area, and when the size and the position of the first view display area are changed, the size and the position of the second view display area can be changed along with the change.

Since the second controller 310 and the first controller 210 may have independent operating systems installed therein, there are two independent but interrelated subsystems in the display apparatus 200. For example, Android (Android) and various APPs may be independently installed on the second controller 310 and the first controller 210, so that each chip may implement a certain function, and the second controller 310 and the first controller 210 cooperatively implement a certain function.

For the display device with the dual-system architecture introduced above, the first controller and the second controller are connected through a transmission interface such as HDMI, and a playing source such as a system application, a network source, and a default startup homepage interface is preset in the second controller; the first controller is respectively connected with the display and the sound player and mainly plays the functions of video display, sound playing and the like. The push information is controlled to be played by the first controller, and the video and audio of the second controller are transmitted to the first controller through the transmission interface, so that after the push information is played, the first controller controls the playing of the audio and video data transmitted by the transmission interface. The following describes the playback method according to this embodiment.

As shown in fig. 8, in a playing method provided in an embodiment of the present application, after a display device is turned on, the method includes the following steps:

and step S0, playing the push information by the first user interface. After the Display device is powered On, the first user interface is used to play the push information, in some embodiments, an OSD (On-Screen Display) layer of the Display device may be used as the first user interface, the OSD layer may provide a function of superimposing an output image and text On a video image, the OSD layer is a Display interface layer located at the uppermost layer and may be used to play a static picture, and the Display state of the OSD layer may be adjusted by adjusting the transparency of the OSD layer, and when the OSD layer is set to be transparent, the Display state of the OSD layer is a hidden state, so that the lower Display interface covered by the OSD layer is in a visible state; when the OSD layer is set to be non-transparent, the display state of the OSD layer is a visible state, and the display interface layer below the OSD layer is not visible. The push information in the form of still pictures is displayed by displaying the pictures on the OSD layer and overlaying the OSD layer on the other Video layer (i.e., Video layer). In addition, the OSD may also support adjustments to various display performance metrics, such as color, mode, geometry, distortion, color temperature, etc., to achieve the best visible display.

In some embodiments, the first user interface may be a Video layer created at the time of device startup, and the Video layer may be used to play dynamic videos, such as dynamic startup pictures, startup advertisements, and the like. Alternatively, if there are multiple Video layers below the OSD layer when the OSD layer is transparent, the display state of each Video layer needs to be set separately, thereby completing the switching of the Video layers. In this embodiment, the display state includes a visible state and a hidden state.

Step S1, obtaining a time difference between the current playing time point and the ending time point of the push information.

The time difference is used for representing the time from the end of playing the push information, for example, if the duration of a certain push information is 20 seconds and the current push information is played for 12 seconds, the time difference can be calculated to be 8 seconds.

In step S2, it is determined whether the time difference is equal to a time threshold. Because certain time consumption exists when the display equipment is switched from the push information to the playing source connected with the transmission interface, a time threshold value can be preset according to the time consumption, so that the time threshold value is greater than or equal to the time consumption, seamless playing between the push information and the playing source is ensured, the problem of black screen in the starting process is solved, and the display effect of the display equipment is improved. If the time difference is equal to the time threshold, performing step S3 and step S4 simultaneously; otherwise, the process returns to step S1.

If the time difference is equal to the time threshold, in step S3, a second user interface in a hidden state is created, and the video received from the transmission interface is delivered to the second user interface.

And when the time difference is equal to the time threshold, creating a second user interface, and enabling the second user interface to be positioned on the next layer of the first user interface, namely, covered by the first user interface, so that the second user interface is in a hidden state. And delivering the video received from the transmission interface to a second user interface, wherein the second user interface displays the video received from the transmission interface, the part of the video cannot be displayed in the display and cannot be seen by naked eyes of a user, the push information played in the first user interface is still currently displayed by the display, so that the push information and the video image transmitted by the transmission interface can be separated, and the second user interface is in a ready state to be displayed. During the playing period of the push information, the video received from the transmission interface is delivered to the second user interface to be displayed in advance, and the process can be completed within a time threshold value, so that after the push information is completed, the first user interface is only needed to be hidden, the second user interface is displayed, the switching of the first user interface to the second user interface is completed, and the seamless connection of the push information and the video transmitted by the transmission interface can be realized. The first user interface and the second user interface are not displayed on the display at the same time when the first user interface and the second user interface are displayed in a hidden mode.

While only one user interface is created as the second user interface, in other possible implementations, multiple user interfaces may be created and one may be randomly selected from the multiple user interfaces as the second user interface when the time difference is equal to the time threshold. Similarly, the second user interface may be a newly created Video layer, and the first user interface is a Video layer or an OSD layer; or, if the OSD layer is used as the second user interface, the first user interface is the Video layer. The type and display state adjustment manner of the second user interface may be selected specifically with reference to the description of the first user interface in step S0.

Since the video received from the transmission interface is played in the display and the audio transmitted from the transmission interface needs to be played in the sound player, the video and the audio need to be separated. The transmission interface sends the video signal and the audio signal in the playing source to the display device at the same time, and puts the video sent by the transmission interface in the second user interface in advance, and the display device also receives the audio sent by the transmission interface in advance when the playing of the push information is not finished.

In step S4, a dual audio channel is established, and a second audio channel for outputting the audio received from the transmission interface in the dual audio channel is set to a mute state.

In some embodiments, in response to a time difference between a current playing time point and an ending time point of the push information being equal to a time threshold, a dual audio channel may be simultaneously established in the controller, and for the aforementioned display device of the dual system architecture, the dual audio channel is disposed in the first controller. As shown in fig. 9, the dual audio channels include a first audio channel and a second audio channel, which are independent and parallel to each other. The input end of the first audio channel is connected with the sending interface for pushing information, and the output end of the first audio channel is connected with the sound player; the input end of the second audio channel is connected to the transmission interface such as HDMI, and the output end of the second audio channel is connected to the sound player, that is, the output ends of the dual audio channels in this embodiment may be connected to the same sound player. The first audio channel and the first user interface have a corresponding relation and are related to the playing of the push information; the second audio channel and the second user interface have a corresponding relationship, and are both related to the data sent by the playing transmission interface. The first audio channel is used for synchronously outputting the audio of the push information when the video of the push information is played on the first user interface, so that the playing of the push information audio and video is realized when the first user interface is in a visible state; the second audio channel is used for synchronously outputting the audio received from the transmission interface when the second user interface plays the video received from the transmission interface, so that when the second user interface is in a visible state and the second audio channel is in a mute state, the audio and video data transmitted and received are played, and the second user interface is switched to a playing source.

After the dual audio channels are established, before the push information is played, the second audio channel is always kept in a mute state, the first audio channel is set to be played at a normal volume (namely, in a non-mute state), at the moment, after audio output by the dual audio channels is mixed, only audio of the push information is played, and the two audio channels cannot interfere with each other in playing. During the playing of the push information, the audio received from the transmission interface is switched to the second audio channel in advance, and the process can be completed within a time threshold value, so that when the push information is completed (the audio is not output from the first audio channel at this time), the audio sent by the transmission interface can be output by the second audio channel only by removing the mute state of the second audio channel, and the audio output by the second audio channel is played by the sound player, so that the seamless connection between the push information and the audio transmitted by the transmission interface is completed. After determining that the time difference is equal to the time threshold, step S3 and step S4 are performed simultaneously.

Considering that the display device is generally equipped with only one sound player, and the audio output by the first audio channel and the second audio channel needs to be mixed and played by the sound player, referring to fig. 9, before the end of playing the push information, the work flow of dual-audio channel sound playing is as follows: inputting the video of the push information into a first audio channel, and inputting the audio received from the transmission interface into a second audio channel; then, respectively carrying out front-end volume control on the first audio channel and the second audio channel, and controlling the volume of the second audio channel to be zero (mute), so that the second audio channel is set to be in a mute state; after the front-end volume is adjusted, audio mixing processing is carried out on the audio of the first audio channel and the audio of the second audio channel; and performing back-end volume control on the audio subjected to the audio mixing, namely controlling the volume of the audio mixing, and outputting the audio subjected to the back-end volume control to a sound player so as to finish the audio mixing playing of the double audio channels in one sound player. It should be noted that fig. 9 only shows an example of a dual audio channel operating mode, and in practical applications, other sound processing links, such as sound effect processing, may also be added.

The sound mixing is to superpose the sounds of the first audio channel and the second audio channel, so as to form a section of audio, so that a single sound player can realize the playing of the dual-audio channel audio, the sound mixing can be realized by means of sound mixing equipment or sound mixing software, and the sound mixing equipment can be a sound mixing base, a synthesizer, a sound effect processor and the like. The "front-end volume control" refers to volume control performed on the first audio channel and the second audio channel respectively before mixing, and the "back-end volume control" refers to volume control performed on audio superimposed on the two audio channels after mixing. Since the second audio channel is already adjusted to be in a mute playing state before audio mixing, after the first audio channel and the second audio channel are mixed, the user only hears the audio of the push information played by the first audio channel, and does not hear the audio played by the second audio channel. The front-end Volume Control and the back-end Volume Control can be performed through an AVC (automatic Volume Control) module, the AVC can realize automatic Volume Control, limit the sound output amplitude of a signal source, the display device can automatically adjust the output Volume level according to the Volume level of video input, keep the sound stable, reduce or eliminate explosive sound, amplify smaller sound to a proper range, and the AVC can realize the mute and non-mute mode play of audio in an audio channel.

For the above dual audio channel workflow, on one hand, the audio of the push information and the audio sent by the transmission interface can be separated, and the two can not interfere with each other when played; on the other hand, the audio sent by the transmission interface can be ensured to be input to the second audio channel in advance, so that seamless playing of the audio is realized; in another aspect, the audio of the dual audio channels can be superimposed into a segment of audio to accommodate audio playback by a single sound player.

In the foregoing embodiments, it is exemplified that a display device is configured with a sound player conventionally, in some embodiments, some display devices may be configured with at least two sound players, in this case, the output ends of two audio channels may not need to be connected to the same sound player, that is, there is no need to perform mixing processing, for example, the output end of a first audio channel may be connected to the sound player 1, and the output end of a second audio channel may be connected to the sound player 2, when playing push information, the first audio channel outputs the audio of the push information to the sound player 1 at a normal volume, and the second audio channel is set to a mute state, that is, the second audio channel mutes the audio received from the transmission interface to the sound player 2, which is embodied in an actual sound playing scene, only the sound player 1 plays the audio of the push information, the sound player 2 has no audio playing, that is, the audio sent by the transmission interface does not affect the audio playing of the push information. When the playing of the push information is finished, the first audio channel has no audio output, the sound player 1 does not play audio, the second audio channel in the mute state outputs the audio sent by the transmission interface to the sound player 2, the sound player 2 can play the audio of the playing source when the playing of the push information is finished, only one effective audio output before and after the playing of the push information can be realized by the double audio channels, and the seamless connection of the audio is realized. The present embodiment is exemplary, and particularly, based on practical applications, a person skilled in the art may adaptively set the output and playing mode of the audio based on the hardware configuration of the display device, the scene requirements, and the like, and is not limited to the embodiments of the present application.

And step S5, when the push information is played, adjusting the second user interface to be in a visible state, and adjusting the first user interface to be in a hidden state.

In step S6, when the push information is played, the mute state of the second audio channel is released.

When the push information playback ends, step S5 and step S6 are executed simultaneously. Since the video received from the transmission interface has been previously dropped to the second user interface and the audio received from the transmission interface has also been previously transmitted to the second audio channel, i.e. the video and audio received from the transmission interface are already in a state to be played. When the push information is played, the first user interface is adjusted to be hidden, and the second user interface is in a visible state, so that the first user interface is switched to the second user interface, the video in the second user interface can be directly played in the display, and the seamless display of the video is realized; when the push information is played, the mute state of the second audio channel needs to be released, so that the second audio channel can play the audio sent by the transmission interface at normal volume, and after the push information is played, the first audio channel does not have audio input and output of the push information, so that only the audio sent by the transmission interface is output by the dual-audio-channel system. The dual audio channels shown in this embodiment can prevent, on one hand, a conflict between the audio sent by the transmission interface and the audio of the push information in a time period corresponding to a time threshold before the push information is played, so that the push information is not interfered in playing, and on the other hand, seamless playing between the audio of the push information and the audio sent by the transmission interface can be achieved. According to the method and the device, seamless switching from the push information to the play source can be realized when the push information is played, so that the problem of black screen is solved.

In some embodiments, the first user interface may be adjusted to the hidden state as follows: one is to destroy the first user interface directly, because the push information is not played in the first user interface after the push information is played, and the first user interface is equivalent to a waste Window, the first user interface can be destroyed directly, which is beneficial to eliminating the occupation and consumption of Window resources by the first user interface; alternatively, if the first user interface is an on-screen menu type adjustment layer (OSD layer) in the display device, the transparency of the OSD layer may be adjusted to make the first user interface transparent, so that the first user interface is invisible and the second user interface covered by the first user interface may be directly shown on the display. It should be noted that, in the actual application, other implementation manners may be possible in the switching process between the first user interface and the second user interface, which is not limited to the embodiment.

In some embodiments, when the push information is played, the first audio channel does not have audio input and output of the push information, the first audio channel is equivalent to a discarded audio channel, and at this time, only the second audio channel in the dual system plays the audio input by the transmission interface, so that the dual audio channel is not required to be maintained, but the first audio channel can be destroyed, please refer to fig. 10, the dual audio channel mode is converted into a single audio channel mode only retaining the second audio channel, that is, no mixing process is required, and no front-end volume control or back-end volume control is required, after the audio sent by the transmission interface enters the second audio channel when the push information is played, the volume is controlled to increase the volume, so as to remove the mute state of the second audio channel, and then the audio is directly output, so that the first audio channel is favorable for reducing occupation and destruction of system resources of the display device, the working mode of the audio channel is simpler and more efficient.

Another embodiment of the present application provides a display device, where the display device may be a display device of the foregoing dual system architecture, or a display device of another system architecture, as long as a transmission interface is used for externally connecting a playback source device, where the transmission interface is, for example, an external HDMI interface of the display device, the display device includes at least a display, a sound player, a transmission interface, and a controller, the controller is connected to the display, the sound player, and the transmission interface, and the controller is configured to perform:

In some embodiments, the controller is further configured to perform:

responding to the fact that the time difference between the current playing time point and the ending time point of the push information is equal to a time threshold value, and establishing a dual-audio channel; the dual audio channels comprise a first audio channel and a second audio channel, wherein the first audio channel is used for outputting the audio of the push information, and the second audio channel is used for outputting the audio received from the transmission interface;

and setting the second audio channel to be in a mute state, and inputting audio mixed by the first audio channel and the second audio channel into the sound player.

The controller may also be configured to perform other program steps in the foregoing embodiments, which are not described herein. For the display device with the external HDMI, the video and audio transmitted by the HDMI come from the external playing source device. The above-described playback method is configured to be executed in the first controller if the dual system display device has an external HDMI interface.

In this embodiment, when the display device is started, the push information is played in the first user interface, since the display device may have a certain consumed time when switching from the push information to the play source, a time threshold may be preset according to the consumed time, where the time threshold is greater than or equal to the consumed time, in the playing process of the push information, a time difference between a current playing time point and an ending time point is obtained, that is, how long the push information is played and ended is obtained, and then the time difference is compared with the time threshold, when the time difference is equal to the time threshold, the application may create a second user interface in the display, where the second user interface is located at a next level of the first user interface and is in a hidden state, and a video received from the transmission interface is launched to the second user interface, where the second user interface displays a video sent by the transmission interface, and the portion of the video may not be displayed in the display, the current display of the display is still the push information played in the first user interface. During the playing period of the push information, the video sent by the transmission interface is switched to the second user interface to be displayed in advance, and the process can be completed within a time threshold, so that after the push information is completed, the first user interface is only needed to be hidden, the second user interface is displayed, the switching of the first user interface to the second user interface is completed, and the seamless connection of the push information and the video transmitted by the transmission interface can be completed.

The transmission interface simultaneously transmits a video signal and an audio signal in a playing source to the display device, the display device also receives the audio transmitted by the transmission interface in advance when the playing of the push information is not finished due to the fact that the video transmitted by the transmission interface is put on the second user interface in advance, the display device is generally provided with a sound player, in order to avoid the situation that the audio transmitted by the transmission interface influences the playing of the push information audio before the playing of the push information is not finished, when the time difference is judged to be equal to the time threshold value, a double audio channel is simultaneously established, the two audio channels are mutually independent, the output ends of the two audio channels are connected with the sound player, a first audio channel corresponding to the first user interface is used for outputting the audio of the push information, and a second audio channel corresponding to the second user interface is used for outputting the audio transmitted by the transmission interface, at this time, the second audio channel is in a mute state, the two audio channels play audio only with push information, and the two audio channels do not interfere with each other. Namely, during the playing period of the push information, the audio sent by the transmission interface is switched to the second audio channel in advance, and the process can be completed within a time threshold value, so that when the push information is completed, only the mute state of the second audio channel needs to be released, the second audio channel can normally play the audio sent by the transmission interface, and the seamless connection between the push information and the audio transmitted by the transmission interface is completed. In summary, the present application can realize seamless switching from the push information to the play source when the push information is played, thereby eliminating the problem of screen blacking.

In some embodiments, there is also provided a playing method of a dual system display device, the method including:

In some embodiments, the method further comprises: responding to the fact that the time difference between the current playing time point and the ending time point of the push information is equal to a time threshold value, and establishing a dual-audio channel; the dual audio channels comprise a first audio channel and a second audio channel, wherein the first audio channel is used for outputting the audio of the push information, and the second audio channel is used for outputting the audio received from the transmission interface; and setting the second audio channel to be in a mute state, and playing audio mixed by the first audio channel and the second audio channel.

In some embodiments, said adjusting said first user interface to a hidden state comprises:

if the first user interface is a screen menu type adjusting layer in the display equipment, setting the screen menu type adjusting layer to be in transparent display; or destroying the first user interface.

In some embodiments, the method further comprises: and destroying the first audio channel when the mute state of the second audio channel is released.

In some embodiments, the transmission interface is an HDMI interface built in the display device.

In some embodiments, the method further comprises:

before the push information is played, respectively carrying out front-end volume control on the first audio channel and the second audio channel, and controlling the volume of the second audio channel to be zero;

performing audio mixing processing on the audio of the first audio channel and the audio of the second audio channel;

and performing back-end volume control on the audio subjected to the audio mixing processing.

Referring to the foregoing description of the dual system architecture display device and fig. 2 to 5, another embodiment of the present application provides a display device, where the display device includes at least a first controller and a second controller, the first controller is connected to the second controller through a transmission interface, where the transmission interface may be an HDMI interface built in the display device, the first controller is a master controller, the second controller is a playback source built in the first controller, and the transmission interface is used to send video and audio in the second controller to the first controller; the first controller is respectively connected with the display and the sound player, and the sound player can be a loudspeaker or sound equipment externally connected through an external sound output terminal; wherein the first controller is configured to perform the following program steps:

setting the second audio channel to be in a mute state, and playing audio mixed by the first audio channel and the second audio channel;

The first controller may also be configured to execute other program steps in the foregoing embodiment of the playing method for the dual-system display device, which are not described herein again. The embodiment is suitable for dual-system display equipment with built-in HDMI, in practical application, one dual-system display equipment has both built-in HDMI and external HDMI, and the power-on optimization of the display equipment can be realized by respectively referring to the embodiment and the previous embodiment, so that the black screen phenomenon is eliminated.

In the present application, when the transmission interface is an external interface, the transmission interface is used for connecting an external playing source device, and the playing source described in the present application is an external playing source, such as a playing source from a set top box, a DVD player, a television game machine, or other devices; when the display device has a dual system structure and the transmission interface is a built-in interface, the second controller serves as a playback source built in the first controller, such as an application, a web source, a homepage, and the like. The transmission interface is not limited to the HDMI interface, that is, the transmission interface is internally or externally only different from the playing source, so that in practical application, according to the system architectures of different display devices and the types of the transmission interfaces, based on the inventive concept of the present application, the problem of black screen during switching between the push information and the playing source can be adaptively solved, so as to improve the playing effect of the display device.

For a display device with a built-in HDMI interface and other types of system architectures, on the basis of the scheme described in the embodiments of the present application, programs executed by hardware devices such as a relevant controller may be adaptively configured according to a system structure, and the playing method described in the present application may be implemented. In addition, it should be emphasized that, in the embodiment of the present application, a situation that the push information played at the time of starting is switched to the home page interface is shown, and in an actual application, since the display states of the first user interface and the second user interface are both adjustable, the present application is not limited to the implementation manner and the application scenario provided in the above embodiments, for example, when the push information is also transmitted through HDMI, a black screen-free switching display from a certain play source to the push information in the operation process of the display device may also be implemented, where the push information may not be limited to starting, but may also be play information with different contents, formats and display manners received in the operation process of the display device. Furthermore, the terms "first," "second," and the like are used solely to distinguish one from another and are not to be construed as indicating/implying a relative order of importance or order.

Those skilled in the art will clearly understand that the techniques in the embodiments of the present application may be implemented by way of software plus a required general hardware platform. In a specific implementation manner, the present application further provides a computer storage medium, where the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in the embodiments of the playing method and the display device provided by the present application. The computer storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. The specification and examples are to be regarded in an illustrative manner only and are not intended to limit the scope of the present invention. With a true scope and spirit of the invention being indicated by the following claims.

The same and similar parts in the various embodiments are referred to each other in this specification.

Claims

1. A display device, comprising:

a display for displaying video images and a user interface;

a sound player for playing audio;

2. The display device according to claim 1, wherein the controller is further configured to perform:

3. The display device of claim 1, wherein the controller is further configured to adjust the first user interface to a hidden state as follows:

if the first user interface is a screen menu type adjusting layer in the display equipment, controlling the display to set the screen menu type adjusting layer to be in transparent display; or controlling a display to destroy the first user interface.

4. The display device according to claim 1 or 2, wherein the controller is further configured to perform:

and destroying the first audio channel when the mute state of the second audio channel is released.

5. The display device according to claim 2, wherein the controller is further configured to perform:

6. The display device according to claim 1, wherein the transmission interface is an HDMI interface external to the display device.

7. A display device, comprising:

a display for displaying video images and a user interface;

a sound player for playing audio;

a second controller as a play source built in the display device;

8. The display device according to claim 7, wherein the first controller is further configured to perform:

9. The display device of claim 7, wherein the first controller is further configured to adjust the first user interface to a hidden state as follows:

if the first user interface is a screen menu type adjusting layer in the display equipment, controlling the display to set the screen menu type adjusting layer to be in transparent display;

or controlling a display to destroy the first user interface.

10. The display device according to claim 7 or 8, wherein the first controller is further configured to perform:

11. The display device according to claim 8, wherein the first controller is further configured to perform:

12. The device according to claim 7, wherein the transmission interface is an HDMI interface built in the display device.

13. A playback method for a display device, the method comprising:

14. A playback method for a display device, the method comprising: