CN112835547A - Media asset file split-screen display method and display device - Google Patents

Media asset file split-screen display method and display device Download PDF

Info

Publication number
CN112835547A
CN112835547A CN202110323799.8A CN202110323799A CN112835547A CN 112835547 A CN112835547 A CN 112835547A CN 202110323799 A CN202110323799 A CN 202110323799A CN 112835547 A CN112835547 A CN 112835547A
Authority
CN
China
Prior art keywords
display
message
media asset
information
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110323799.8A
Other languages
Chinese (zh)
Inventor
王光强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Media Network Technology Co Ltd
Juhaokan Technology Co Ltd
Original Assignee
Qingdao Hisense Media Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Media Network Technology Co Ltd filed Critical Qingdao Hisense Media Network Technology Co Ltd
Priority to CN202110323799.8A priority Critical patent/CN112835547A/en
Publication of CN112835547A publication Critical patent/CN112835547A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a method and a display device for displaying a media asset file in a split screen mode. Displaying the media asset content corresponding to the first message on a first display, and displaying the media asset information corresponding to the second message on a second display when the prior message is not displayed in the second display; when a preceding message is presented in the second display, the content of the corresponding preceding message or second message of high priority is presented in the second display. Therefore, the method and the display device can display the media asset file in a split screen mode, and determine whether the message can be displayed according to the message priority when the second display displays the message, so that the media asset information and the media asset content are prevented from being shielded, meanwhile, the newly generated second message can be displayed on the second display without influencing the display content of the first display in the process of displaying the media asset file, and user experience is good.

Description

Media asset file split-screen display method and display device
Technical Field
The application relates to the technical field of double-screen intelligent television display, in particular to a media asset file split-screen display method and display equipment.
Background
Along with the rapid development of display equipment, the functions of the display equipment are more and more abundant, and the performance of the display equipment is more and more powerful, and at present, the display equipment comprises an intelligent television, other products with an intelligent display screen and the like. In order to improve user experience, the display device may provide operating functions of different applications, media resources (media resources for short), and the like.
The media asset file comprises media asset content and media asset information, and the media asset information is brief introduction information of the media asset content. When viewing asset files with a display device, typically only the asset content is presented in the display of the display device. However, the user only views the asset content, and may not be able to accurately know the asset information of the asset file. If the media asset information is also displayed in the display, the media asset content is shielded, and the user experience is not good.
Disclosure of Invention
The application provides a screen-sharing display method and display equipment for media asset files, and aims to solve the problem that the existing display equipment cannot display more contents of the media asset files.
In a first aspect, the present application provides a display device comprising:
a first display configured to present a first user interface;
a second display configured to present a second user interface;
a controller connected with the first display and the second display, the controller configured to:
responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display, and displaying the media resource content corresponding to the first message in the first display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message, and displaying the media asset content corresponding to the first message in the first display.
In a second aspect, the present application also provides a display device, including:
a first display configured to present a first user interface;
a second display configured to present a second user interface;
a first controller connected with the first display, the first controller configured to:
responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
displaying the media asset content corresponding to the first message in a first display, and sending the second message to a second controller so that the second controller displays the media asset content corresponding to the second message;
a second controller connected with the second display, the second controller configured to:
receiving a second message sent by the first controller, and determining whether a previous message is displayed in the second display;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message.
In a third aspect, the present application further provides a method for displaying a media asset file in a split screen manner, where the method includes:
responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display, and displaying the media resource content corresponding to the first message in the first display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message, and displaying the media asset content corresponding to the first message in the first display.
In a fourth aspect, the present application further provides a method for displaying media asset files in a split screen manner, where the method includes:
receiving a second message sent by the first controller, and determining whether a prior message is displayed in the second display;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message.
In a fifth aspect, the present application further provides a storage medium, where the computer storage medium may store a program, and when the program is executed, the program may implement some or all of the steps in each embodiment of the media asset file split-screen display method provided in the present application.
According to the technical scheme, the screen-sharing display method and the display device for the media asset files provided by the embodiment of the invention trigger the media asset files to be displayed to generate the first message and the second message when the screen-sharing display method for the media asset files is executed. Displaying the media asset content corresponding to the first message on a first display, and displaying the media asset information corresponding to the second message on a second display when the prior message is not displayed in the second display; when a preceding message is presented in the second display, the content of the corresponding preceding message or second message of high priority is presented in the second display. Therefore, the method and the display device provided by the embodiment of the invention can display the media asset file in a split screen manner, and determine whether the message can be displayed according to the message priority when the second display displays the message, so that the media asset information and the media asset content are prevented from being shielded, and meanwhile, the newly generated second message can be displayed on the second display without influencing the display content of the first display in the process of displaying the media asset file, and the user experience is good.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
FIG. 1 illustrates a usage scenario of a display device according to some embodiments;
fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;
FIG. 3 illustrates a block diagram of a single system hardware configuration of a display device 200 according to some embodiments;
FIG. 4 illustrates a block diagram of a dual system hardware configuration of a display device 200 according to some embodiments;
FIG. 5 illustrates a software configuration diagram in the display device 200 according to some embodiments;
FIG. 6 illustrates an icon control interface display of an application in display device 200, in accordance with some embodiments;
FIG. 7 illustrates a block diagram of a dual screen dual system display device according to some embodiments;
FIG. 8 illustrates a block diagram of a dual screen display device according to some embodiments;
FIG. 9 illustrates a flow diagram of a method for split-screen presentation of a asset file, according to some embodiments;
FIG. 10 illustrates a data flow diagram of a method for split-screen presentation of a media asset file, in accordance with some embodiments;
FIG. 11 illustrates a schematic diagram of presenting a list of videos in a first user interface, in accordance with some embodiments;
FIG. 12 illustrates an effect diagram of a dual screen display device presenting a video file, according to some embodiments;
FIG. 13 illustrates a diagram of a dual screen display device showing effects of a paint file, in accordance with some embodiments;
FIG. 14(a) is a schematic diagram illustrating one effect of a second display presenting an ephemeral-like message, in accordance with some embodiments;
FIG. 14(b) is a schematic diagram illustrating another effect of a second display presenting an ephemeral-like message, in accordance with some embodiments;
FIG. 15 is a diagram illustrating the effect of a second display showing media asset recommendation information, according to some embodiments;
FIG. 16 illustrates an effect diagram of the second display showing the post-lineup information according to some embodiments;
FIG. 17 illustrates a business timing diagram of a method for split-screen presentation of a asset file, according to some embodiments;
FIG. 18 illustrates another flow diagram of a method for split-screen presentation of a asset file, according to some embodiments.
Detailed Description
The concept to which the present application relates will be first explained below with reference to the drawings. It should be noted that the following descriptions of the concepts are only for the purpose of facilitating understanding of the contents of the present application, and do not represent limitations on the scope of the present application.
The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may typically be connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.
The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.
The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be referred to as a motherboard (or chip).
FIG. 1 illustrates a usage scenario of a display device according to some embodiments. As shown in fig. 1, a user may operate the display apparatus 200 through the control device 100.
The control device 100 may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on the remote controller 100A, voice input, control panel input, or the like to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right movement keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller 100A to control the functions of the display device 200.
The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like, which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application may provide various controls to the User through an intuitive User Interface (UI) on a screen associated with the smart device.
For example, the mobile terminal 100B and the display device 200 may each have a software application installed thereon, so that connection communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be in a wired or wireless communication connection with the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.
Illustratively, the display device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
The display device 200 includes a first display 201 and a second display 202, wherein the first display 201 and the second display 202 are independent from each other, and the first display 201 and the second display 202 are controlled by different hardware systems respectively.
The first display 201 and the second display 202 may be used to display different screen contents. For example, the first display 201 may be used for screen display of conventional television programs, and the second display 202 may be used for screen display of auxiliary information such as notification type messages, voice assistants, and the like.
In an exemplary embodiment, the content displayed by the first display 201 and the content displayed by the second display 202 may be independent of each other and may not affect each other. For example, when the first display 201 plays a television program, the second display 202 may display information such as time, weather, temperature, reminder messages, and the like, which are not related to the television program.
In an exemplary embodiment, there may also be an association between the content displayed by the first display 201 and the content displayed by the second display 202. For example, when the first display 201 plays a main screen of a video chat, the second display 202 may display information such as an avatar, a chat duration, and the like of a user currently accessing the video chat.
In an exemplary embodiment, some or all of the content displayed on the second display 202 may be adjusted to be displayed on the first display 201. For example, the information such as time, weather, temperature, reminder message, etc. displayed on the first display 201 may be adjusted to be displayed on the first display 201, while other information is displayed on the second display 202.
In addition, the first display 201 displays the multi-party interactive picture while displaying the traditional television program picture, and the multi-party interactive picture does not block the traditional television program picture. The display mode of the traditional television program picture and the multi-party interactive picture is not limited by the application. For example, the position and the size of the traditional television program picture and the multi-party interactive picture can be set according to the priority of the traditional television program picture and the multi-party interactive picture.
Taking the example that the priority of the traditional television program picture is higher than that of the multi-party interactive picture, the area of the traditional television program picture is larger than that of the multi-party interactive picture, and the multi-party interactive picture can be positioned at one side of the traditional television program picture and can also be arranged at one corner of the multi-party interactive picture in a floating manner.
The display device 200, in one aspect, may be a liquid crystal display, an oled (organic Light Emitting diode) display, a projection display device; in another aspect, the display system may be a smart television or a display and a set-top box. The specific type, size, resolution, etc. of the display device 200 are not limited, and those skilled in the art will appreciate that the display device 200 may vary somewhat in its capabilities and configuration as desired.
The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Such as a network television, a smart television, an Internet Protocol Television (IPTV), etc. In some embodiments, the display device may not have a broadcast receiving television function.
As shown in fig. 1, a camera may be connected or disposed on the display device 200, and is used to present a picture taken by the camera on a display screen of the display device or other display devices, so as to implement interactive chat between users. Specifically, the picture shot by the camera may be displayed on the display device in a full screen, a half screen, or in any selectable area.
As an optional connection mode, the camera is connected with the rear shell of the display device through the connecting plate, and is fixedly installed in the middle of the upper side of the rear shell of the display device.
As another optional connection mode, the camera is connected to the rear shell of the display device through a connection board or another conceivable connector, the camera is capable of lifting and descending, a lifting motor is installed on the connector, when a user wants to use the camera or an application program wants to use the camera, the camera is lifted out of the display device, and when the camera is not needed, the camera can be embedded into the rear shell, so that the camera is protected from being damaged, and privacy safety of the user is protected.
As an embodiment, the camera adopted in the present application may have 1600 ten thousand pixels, so as to achieve the purpose of ultra high definition display. In actual use, cameras higher or lower than 1600 ten thousand pixels may also be used.
After the camera is installed on the display device, the contents displayed by different application scenes of the display device can be fused in various different modes, so that the function which cannot be realized by the traditional display device is achieved.
Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.
Optionally, in a scene of "chat while watching", at least one video chat is performed across terminals while watching a live video or a network video.
In another example, a user can conduct a video chat with at least one other user while entering the educational application for learning. For example, a student may interact remotely with a teacher while learning content in an educational application. Vividly, this function can be called "chatting while learning".
In another example, a user conducts a video chat with a player entering a card game while playing the game. For example, a player may enable remote interaction with other players when entering a gaming application to participate in a game. Figuratively, this function may be referred to as "watch while playing".
Optionally, the game scene is fused with the video picture, the portrait in the video picture is scratched and displayed in the game picture, and the user experience is improved.
Optionally, in the motion sensing game (such as ball hitting, boxing, running and dancing), the human posture and motion, limb detection and tracking and human skeleton key point data detection are obtained through the camera, and then the human posture and motion, the limb detection and tracking and the human skeleton key point data detection are fused with the animation in the game, so that the game of scenes such as sports and dancing is realized.
In another example, a user may interact with at least one other user in a karaoke application in video and voice. Vividly, this function can be called "sing while watching". In an exemplary embodiment, when at least one user enters the application in a chat scenario, multiple users may jointly complete recording of a song.
In another example, a user may turn on a camera locally to take pictures and videos, figurative, which may be referred to as "looking into the mirror".
In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.
Fig. 2 illustrates a block diagram of a hardware configuration of the control apparatus 100 according to some embodiments. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.
In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.
The display device provided by the present application may be a display device of a dual system and dual display structure, that is, a sound and picture synchronization process of a display device having a first controller (first hardware system), a second controller (second hardware system), a first display, and a second display, or may be a display device of a non-dual system, for example, one controller (hardware system) may be provided, or two or more controllers (hardware systems) may be provided, which is not limited in the present application.
FIG. 3 illustrates a block diagram of a single system hardware configuration of a display device 200 according to some embodiments. Referring to fig. 3, in some embodiments, when the dual screen display apparatus employs a single system, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.
In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.
In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.
And the CPU is used for executing the operating system and the application program instructions stored in the memory and executing various application programs, data and contents according to various interaction instructions for receiving external input so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.
In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.
In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.
In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.
In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).
In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.
Fig. 4 illustrates a block diagram of a dual system hardware configuration of a display device 200 according to some embodiments. Referring to fig. 4, in some embodiments, when the dual screen display device adopts a dual system, the hardware system of the display device 200 includes a first controller 210 and a second controller 310, and a module connected to the first controller 210 or the second controller 310 through various interfaces.
Among them, the first controller 210 may be disposed on the main board 31 shown in fig. 3. In an exemplary embodiment, the first controller 210: the traditional television function is mainly realized (for example, a set top box can be externally connected). The second controller 310 may be disposed on the second display driving board 34 shown in fig. 3. In an exemplary embodiment: the second controller 310 can be used to receive the instruction sent by the first controller 210 and control the second display 380 (such as the second display 202 in fig. 1) to display the corresponding image.
The modules connected to the first controller 210 may include a tuning demodulator 220, a communicator 230, an external device interface 250, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, a first display 280 (i.e., the first display 201 in fig. 1), an audio output interface 270, and a power supply module 240.
In other embodiments, more or fewer modules may be connected to the first controller 210.
In other embodiments, the first controller includes any of the modules described above.
The tuning demodulator 220 is configured to perform modulation and demodulation processing such as amplification, mixing, resonance and the like on a broadcast television signal received in a wired or wireless manner, so as to demodulate an audio/video signal carried in a frequency of a television channel selected by a user and additional information (e.g., an EPG data signal) from a plurality of wireless or wired broadcast television signals. Depending on the broadcast system of the television signal, the signal path of the tuner 220 may be various, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; according to different modulation types, the adjustment mode of the signal can be a digital modulation mode or an analog modulation mode; and depending on the type of television signal being received, tuner demodulator 220 may demodulate analog and/or digital signals.
The tuner demodulator 220 is also operative to respond to the user-selected television channel frequency and the television signal carried thereby, in accordance with the user selection and as controlled by the first controller 210.
In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the external device interface 250.
The communicator 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 230 may include a WIFI module 231, a bluetooth module 232, a wired ethernet module 233, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown).
The display apparatus 200 may establish a connection of a control signal and a data signal with an external control apparatus or a content providing apparatus through the communicator 230. For example, the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210.
The external device interface 250 is a component that provides data transmission between the first controller 210 and other external devices. The external device interface 250 may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.
The external device interface 250 may include: a High Definition Multimedia Interface (HDMI) terminal is also referred to as HDMI251, a Composite Video Blanking Sync (CVBS) terminal is also referred to as AV 252, an analog or digital component terminal is also referred to as component 253, a Universal Serial Bus (USB) terminal is also referred to as USB 254, a Red Green Blue (RGB) terminal (not shown), and the like. The number and type of external device interfaces are not limited by this application.
The first controller 210 controls the operation of the display apparatus 200 and responds to the operation of the user by running various software control programs (e.g., an operating system and/or various application programs) stored on the memory 290.
As shown in FIG. 4, the first controller 210 includes a read only memory ROM 213, a random access memory RAM 214, a graphics processor 216, a CPU processor 212, a communication interface 218 (a first interface 218-1, a second interface 218-2, an Nth interface 218-N), and a communication bus. The RAM 213 and the ROM 214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a communication bus.
A ROM 213 for storing instructions for various system boots. If the display device 200 is powered on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM and copies the operating system stored in the memory 290 to the RAM 214 to start running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM 214, and then starts running and starting the various application programs.
A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator, and displaying the rendered result on the first display 280.
A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.
In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include a main processor and a plurality of or a sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for performing an operation in a standby mode or the like.
The communication interface 218 may include a first interface 218-1 through an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.
The first controller 210 may control operations of the display device 200 in relation to the first display 280. For example: in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.
The first controller 210 may control operations of the display device 200 in relation to the second display 380. For example: in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the first controller 210 may perform an operation related to the object selected by the user command.
Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to an icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.
The memory 290 includes a memory for storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 290, including: a base module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc. (not shown in the figure).
The basic module is a bottom layer software module for signal communication between hardware in the display device 200 and sending processing and control signals to an upper layer module. The detection module is a management module used for collecting various information from various sensors or user input interfaces, and performing digital-to-analog conversion and analysis management. The voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the first display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. The communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. The service module is a module for providing various services and various application programs.
Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.
A user input interface 260-3 for transmitting an input signal of a user to the first controller 210 or transmitting a signal output from the first controller 210 to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user input interface, and then the input signal is forwarded to the first controller 210 through the user input interface 260-3; alternatively, the control device may receive an output signal such as audio, video or data processed by the first controller 210 and output from the user input interface 260-3, and display or output the received output signal in audio or vibration form.
In some embodiments, the user may input a user command on a Graphical User Interface (GUI) displayed on the first display 280, and the user input interface 260-3 receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 receives the user input command by recognizing the sound or gesture through the sensor.
The video processor 260-1 is configured to receive a video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal directly displayed or played on the first display 280.
Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like (not shown in the figure).
The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.
And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.
And the image synthesis module, such as an image synthesizer, is used for performing superposition mixing processing on the GUI signal input by the user or generated by the user and the video picture after the zooming processing by the graphics generator so as to generate an image signal for display.
The frame rate conversion module is configured to convert a frame rate of an input video, such as a frame rate of an input 24Hz, 25Hz, 30Hz, or 60Hz video into a frame rate of 60Hz, 120Hz, or 240Hz, where the input frame rate may be related to a source video stream, and the output frame rate may be related to a refresh rate of a display device. And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display device, such as converting the format of the signal output by the frame rate conversion module to output RGB data signals.
A first display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and the menu manipulation interface. The first display 280 includes a display component for presenting a picture and a driving component for driving an image display. The video content to be displayed may be from the video in the broadcast signal received by the tuner/demodulator 220, or may be from the video content input from the communicator or the external device interface. The first display 280 simultaneously displays a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.
And a driving component for driving the display according to the type of the first display 280. Alternatively, a projection device and a projection screen may be included, provided that the first display 280 is a projection display.
The audio processor 260-2 is configured to receive an audio signal, and perform decompression and decoding according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker 272.
An audio output interface 270 for receiving the audio signal output by the audio processor 260-2 under the control of the first controller 210, wherein the audio output interface may include a speaker 272 or an external sound output terminal 274 for outputting to a generating device of an external device, such as: external sound terminal or earphone output terminal.
In other exemplary embodiments, video processor 260-1 may comprise one or more chip components. The audio processor 260-2 may also include one or more chips.
And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated in one or more chips together with the first controller 210.
And a power supply module 240 for providing power supply support for the display device 200 by the power input from the external power source under the control of the first controller 210. The power supply module 240 may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply installed outside the display apparatus 200, such as a power supply interface for providing an external power supply in the display apparatus 200.
Similar to the first controller 210, as shown in fig. 5, the modules connected to the second controller 310 may include a communicator 330, a detector 340, a memory 390, a second display 380 (i.e., the second display 202 in fig. 1), a video processor 360, and an external device interface 350. A user input interface, an audio processor, an audio output interface (not shown) may also be included in some embodiments. In some embodiments, there may also be a power supply module (not shown) that independently powers the second controller 310.
In some embodiments, the second controller 310 may include any one or more of the modules described above.
The communicator 330 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 330 may include a WIFI module 331, a bluetooth communication protocol module 332, a wired ethernet communication protocol module 333, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module (not shown).
The communicator 330 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 within the hardware system of the first controller 210 is used to connect to an external network, generate network communication with an external server, and the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without making a direct connection with an external network or the like, and the second controller 310 is connected to the external network through the first controller 210. Therefore, for the user, a display device as in the above embodiment displays a WiFi account to the outside.
The detector 340 is a component of the second controller 310 for collecting signals of an external environment or interaction with the outside. The detector 340 may include a light receiver 342, a sensor for collecting the intensity of ambient light, which may be used to adapt to display parameter changes, etc.; the system may further include an image collector 341, such as a camera, a video camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or interact gestures with the user, adaptively change display parameters, and identify user gestures, so as to implement a function of interaction with the user.
An external device interface 350, which provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner.
A video processor 360 for processing the associated video signal.
The second controller 310 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs stored on the memory 390 (e.g., using installed third party applications, etc.), and interacting with the first controller 210.
As shown in fig. 4, the second controller 310 includes a read only memory ROM 313, a random access memory RAM 314, a graphic processor 316, a CPU processor 312, a communication interface 318, and a communication bus. The ROM 313 and the RAM 314, the graphic processor 316, the CPU processor 312, and the communication interface 318 are connected by a communication bus.
A ROM 313 for storing instructions for various system boots. CPU processor 312 executes system boot instructions in ROM and copies the operating system stored in memory 390 to RAM 314 to begin running the boot operating system. After the start of the operating system is completed, the CPU processor 312 copies various application programs in the memory 390 to the RAM 314, and then starts running and starting various application programs.
A CPU processor 312 for executing the operating system and application program instructions stored in the memory 390, communicating with the first controller 210, transmitting and interacting signals, data, instructions, etc., and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents.
The communication interface 318 is a plurality and may include a first interface 318-1, a second interface 318-2 through an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to the first controller 210 via a network.
The second controller 310 may control operations of the display device 200 in relation to the second display 380. For example: in response to receiving a user command for selecting a UI object to be displayed on the second display 380, the second controller 310 may perform an operation related to the object selected by the user command.
The second controller 310 may control operations of the display device 200 in relation to the first display 280. For example: in response to receiving a user command for selecting a UI object to be displayed on the first display 280, the first controller 210 may perform an operation related to the object selected by the user command.
A graphics processor 316 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator, and displaying the rendered result on the second display 380.
The graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 are both capable of generating various graphics objects. In distinction, if the application 1 is installed in the second controller 310 and the application 2 is installed in the first controller 210, the graphic object is generated by the graphic processor 316 of the second controller 310 when the user performs an instruction input by the user in the application 1 at the interface of the application 1. When a user is at the interface of the application 2 and an instruction input by the user is made within the application 2, a graphic object is generated by the graphic processor 216 of the first controller 210.
Fig. 5 illustrates a software configuration diagram in the display device 200 according to some embodiments. Referring to fig. 5, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer, respectively, from top to bottom.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 5, in the embodiment of the present application, the application framework layer includes Managers (Managers), providers (Content providers), a network management system, and the like, where the Managers include at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.
In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
FIG. 6 illustrates an icon control interface display of an application in display device 200, according to some embodiments. In some embodiments, the display device may directly enter the interface of the preset vod program after being activated, and the interface of the vod program may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 6, where the content displayed in the content display area may change according to the change of the selected control in the navigation bar. The programs in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.
In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects different signal sources, the display may display contents obtained from different signal sources.
In some embodiments, when the asset file is displayed by using the display device, the asset file includes asset content and asset information, and the asset information is profile information of the asset content. Because the existing display equipment is only provided with one display, the media asset content and the media asset information need to be displayed at the same time in order that a user can synchronously know the media asset when viewing the media asset content. However, when the display is performed, the media information can shield the media content, so that the user cannot watch the media content conveniently, and the experience is not good.
In some embodiments, the asset files include video files, drawing files, service notification files, and the like. The video file comprises video content and video information, and the video information is used for introducing the video content; the drawing file comprises drawing contents and drawing information, and the drawing information is used for introducing the drawing contents; the service notification file comprises service messages and notification messages, and the notification messages are used for providing reminding services for users, such as equipment failure, weather early warning, alarm clock and the like; the service message is used for providing the user with message leaving information or chat information sent by other users.
In order to improve user experience, when the display equipment is used for displaying the media resource files, the media resource contents and the media resource information of the media resource files can be displayed in a split screen mode, at the moment, two displays need to be configured for the display equipment, and therefore the double-screen display equipment is formed. One display displays the media asset content, and the other display displays the media asset information, so that the media asset content and the media asset information which need to be displayed are prevented from being shielded.
In some embodiments, to improve the user experience, the display device may be configured with two displays, namely a first display and a second display, where the first display is used as a main screen (large screen) for displaying the display content of the corresponding application, such as the media asset content; the second display is used as a secondary screen (small screen) and is used for showing the social ability, information prompt and other contents of the user, such as media information.
In some embodiments, both displays may be controlled by a single overall controller, and in this case, a single controller is configured in the display device to form a dual-screen single-system display device. The controller is in communication connection with the first display and the second display respectively, and content display of the two displays is achieved.
In some embodiments, the two displays may be respectively controlled by corresponding controllers, and at this time, the two controllers, namely the first controller and the second controller, are configured in the display device, so as to form a dual-screen dual-system display device. A first hardware system is configured in the first controller and is a main chip; and a second hardware system is configured in the second controller and is an auxiliary chip.
Fig. 7 illustrates a block diagram of a dual screen dual system display device according to some embodiments. Referring to fig. 7, the first controller 210 is connected to the first display 201, and the second controller 310 is connected to the second display 202. The first controller controls the display of each content in the first display and sends a broadcast to the second controller to inform the second controller to control the second display to display the content.
When a user operates the display device to generate a message or the device itself generates a message, the first controller sends the message to be presented in the second display to the second controller, so that the second controller presents the message in the second display.
Therefore, the double-screen display equipment is used for displaying the media asset files in a split screen mode, when media asset contents are displayed in the first display, if new media asset information is generated at the moment, the new media asset information can be displayed in the second display, and the original display process of the first display is not interrupted. Meanwhile, the media asset information and the media asset content are displayed separately, so that content shielding cannot be generated between the media asset information and the media asset content, and the user experience is good.
FIG. 8 illustrates a block diagram of a dual screen display device according to some embodiments. In order to implement the split-screen display of the media asset file and improve the user experience, an embodiment of the present invention provides a display device, which is applied to a display device of a dual-screen single system, and referring to fig. 8, the display device 200 includes: a first display 201 configured to present a first user interface in which content of applications, messages or assets is presented; a second display 202 configured to present a second user interface in which system messages, notifications, or media asset information, etc. are presented; and the controller is connected with the first display and the second display and is configured to execute the media asset file split screen display method.
FIG. 9 illustrates a flow diagram of a method for split-screen presentation of a asset file, according to some embodiments; figure 10 illustrates a data flow diagram of a method for split-screen presentation of a asset file, according to some embodiments. An embodiment of the present invention provides a display device, which may be a dual-screen single-system display device, and when the method for displaying a media asset file in a split screen manner shown in fig. 9 and 10 is executed, a controller is configured to execute the following steps:
and S11, responding to the operation of triggering the display of the media asset file, generating a first message needing to be displayed in the first display and a second message needing to be displayed in the second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file.
When the display equipment is needed to be used for displaying the media asset files, a user can click and designate the media asset files in a remote controller or voice mode, and the media asset files can be video files needing to be played and can also be files for displaying pictures.
In some embodiments, when the media asset file needs to be displayed, a media asset acquisition request can be sent to the server through the large-screen application, and the server issues the corresponding specified media asset file. The large screen application refers to an application that the asset file is to be displayed when being started, and the asset content is to be displayed on the first display (large screen).
And after receiving the specified media asset file returned by the server, judging whether double-screen display is needed or not according to the service scene. And obtaining the system attribute of the display equipment, and if the system attribute represents that the home terminal is the double-screen display equipment and the specified media asset file comprises media asset content and media asset information, determining that the specified media asset file needs double-screen display.
When a user triggers a certain appointed media asset file, a first message needing to be displayed in the first display and a second message needing to be displayed in the second display can be synchronously generated, and the first display or the second display can conveniently display the content according to the corresponding messages. And, the generated first message is different and the second message is different according to different application scenarios.
In some embodiments, when the asset file is a video file, the controller is further configured to, in performing generating a first message to be presented in the first display and a second message to be presented in the second display:
step 1111, in response to the operation of triggering the video file playing, acquiring the video content and the video information of the video file.
Step 1112 generates a first message to be presented on the first display based on the video content and generates a second message to be presented on the second display based on the video information.
When video playing needs to be performed by using the display device, a video list comprising different video files is presented in a first user interface of the first display, and a user can trigger a certain video file in the list to be played in a remote controller or a voice mode.
FIG. 11 illustrates a schematic diagram of presenting a list of videos in a first user interface, according to some embodiments. After the user starts the display device, the homepage of the display device presents a user interface, and the user interface comprises different types of applications such as my, recommendation, list, special subject, movie and television, games and the like. If the user wants to view the movie-like resource, then "movie" is triggered, and a list of videos is presented in the user interface. Referring to fig. 11, the video list includes a plurality of different video files, such as "daddy", "all are good", "jadeite", etc., the user triggers the "daddy" video file in the list through a remote controller or a voice mode, and the controller obtains the video content and the video information of the video file from the server.
In order to improve the experience of a user, the double-screen display equipment can realize the split-screen display of the video file. Since the viewable area of the first display is larger than the viewable area of the second display, the video content is presented on the first display and the video information is presented on the second display.
Therefore, the playing operation of the user on the specified video file is received, and the video content and the video information of the video file are acquired from the server side. In this case, the video content is content to be displayed on the first display, and the video information is content to be displayed on the second display.
The video information comprises information such as a progress bar, a video name and a video set number, and the video content is a video picture of the video file. In order to avoid shielding the video picture, the video information needs to be sent to the second display for displaying, and the video content needs to be sent to the first display for displaying. Therefore, a first message is generated based on the video content, and the first display responds to the first message to display the video content. And generating a second message based on the video information, the second display responding to the second message to display the media information.
In some embodiments, during the playing of a certain video file, a recommendation medium may also be generated according to the face of a certain actor appearing in the video frame, so as to be pushed to the user. Accordingly, the controller is further configured to:
and 1113, when the first display plays the video content, if the playing picture of the first display has the image of the designated person, performing media asset search based on the designated person to obtain media asset push information including the designated person.
Step 1114, generating a second message to be presented on the second display based on the asset push information including the designated persona.
In order to realize the media asset recommendation process, the designated persons capable of executing media asset recommendation can be preset, namely, the media asset push information is generated only according to the designated persons, and the media asset push information is not generated for other persons.
When the first display plays video content, people appearing in a playing picture are detected in real time, if the appearing people are designated people, media asset searching is carried out based on the designated people, and all media assets in which designated tasks participate are generated into media asset pushing information. For example, when a "all good" video file is played, if an image of "yaohao" appears in the video screen, a resource search may be performed based on the image of "yaohao", and a movie resource related to "yaohao" is pushed to the user.
In order to avoid shielding original displayed content in the first display when the media asset push information is displayed, the media asset push information can be sent to the second display for displaying, and at the moment, a second message needing to be displayed on the second display is generated based on the media asset push information comprising the designated figure.
In some embodiments, after the video file is played in the vicinity of the video file, a file similar to the video file may be generated to be pushed to the user. Thus, when the asset push during the playing of the video file generates a second message requiring content presentation on the second display, the controller is further configured to perform the steps of: when the video file is played, if the playing time length of the video file meets the pushing time condition, generating the post-simulcast information based on the video file; based on the post-simulcast information, a second message is generated that needs to be presented on a second display.
When the dual-screen display device is used for playing the video file, if the video file is close to the playing completion time, for example, the playing time of the video file meets the pushing time condition, the post-simulcast information can be generated based on the video file. The push time condition refers to a time condition for pushing the video resource, and in some embodiments, the push time condition may be set to the first 30 seconds of the overall duration of the video file, that is, the last 30 seconds after the video file is played, and the post-simulcast information may be generated according to the currently played video file.
In some embodiments, when the asset file is a drawing file, the controller is further configured to, in performing generating a first message to be presented in the first display and a second message to be presented in the second display:
step 1121, responding to the operation of triggering the display of the drawing file, and acquiring the drawing content and the drawing information of the drawing file.
Step 1122 generates a first message to be presented on the first display based on the drawing content, and generates a second message to be presented on the second display based on the drawing information.
When the display device is required to be used for displaying the painting, a painting list comprising different painting files is displayed in a first user interface of the first display, and a user can trigger a certain painting file in the list to be displayed in a remote controller or a voice mode. The presentation form of the drawing list may be the same as that of the video list shown in fig. 11, and is not described herein again.
In order to improve the experience of a user, the double-screen display equipment can realize the split-screen display of the drawing file. At the moment, the display device receives the playing operation of the user on the appointed drawing file, and obtains the drawing content and the drawing information of the drawing file from the server side. In this case, the drawing content is the content to be displayed on the first display, and the drawing information is the content to be displayed on the second display.
The painting information includes the name of the painting, the author of the painting, the brief introduction of the painting, and the like, and the painting contents are the painting itself, such as painting works, photographic works, and the like. In order to avoid shielding the drawing content, the drawing information needs to be sent to the second display for displaying, and the drawing content is sent to the first display for displaying. Therefore, a first message is generated based on the drawing content, and the first display responds to the first message to display the drawing content. And generating a second message based on the painting information, the second display responding to the second message to display the painting information.
In some embodiments, the second message generated to be displayed on the second display during the display of the video file or the drawing file may also be a notification service type message automatically triggered by the system, for example, a message generated when the device fails, a message generated when a weather warning is received, a message generated when an alarm clock set by the user reaches a set time point, a message generated by message information or chat information sent by other users, and the like.
In some embodiments, after different first messages and second messages are generated in different service scenarios, the first messages are sent to a first display, so that media asset information corresponding to the first messages is displayed by the first display; and sending the second message to a second display so that the second display displays the media asset information corresponding to the second message.
And S12, if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display, and displaying the media information content corresponding to the first message in the first display.
When the second message is sent to the second display so that the second display displays the media asset information corresponding to the second message, the second display can display different types of messages, namely the media asset information corresponding to the media asset content and service notification type information generated by the system.
Then, if the second display receives the media asset information or the service notification information during the process of displaying the media asset information, the second display cannot determine whether to display the newly received information or continue to display the original information.
Therefore, after receiving the second message, the second display needs to first determine whether the information is displayed in the second display. If the second display does not display the previous message, the second display can directly display the content corresponding to the second message, that is, the media information corresponding to the second message is displayed in the second display. And simultaneously, displaying the media asset content corresponding to the first message in the first display.
In some embodiments, the previous message refers to media information or service notification type information that is presented before the second display, and the previous message does not include information that is presented by default on the second display, such as date, time, volume, number of messages, and the like.
If the second display displays the previous message, the priority order of the previous message and the second message needs to be judged to determine the display content of the second display.
FIG. 12 illustrates an effect diagram of a dual screen display device presenting a video file, according to some embodiments. Referring to fig. 12, in some embodiments, when a user triggers a "dad" video file by means of a remote controller or voice while a video file is being presented using a dual-screen display device, the episode content of "dad" is presented on a first display. If the second display did not show the previous message, then the video information of "dad (progress bar, video name, video set number, etc.) is shown on the second display.
FIG. 13 illustrates a diagram of a dual screen display device showing the effects of a paint file, according to some embodiments. Referring to fig. 13, in some embodiments, when the painting file is displayed by using the dual-screen display device, the user triggers the "sunrise and moonnight" painting file through a remote controller or by voice, and the contents of the "sunrise and moonnight" painting are displayed on the first display. And if the second display does not display the prior message, displaying the painting information (information such as painting name, painting author and the like) of 'star night and moon' on the second display.
S13, if the second display displays the prior message, the content corresponding to the designated message is displayed in the second display according to the priority order of the second message and the prior message, the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message, and the media asset content corresponding to the first message is displayed in the first display.
If the second display displays the previous message, that is, the second display receives the media asset information or the service notification information in the process of displaying the media asset information, the display content of the second display can be determined according to the priority order of each message, so that the display content of the second display can be determined.
The priority of different messages is pre-configured by the system, messages with high priority can be responded to with priority, and messages with low priority can be responded to with delay or not. Under normal conditions, the priority of equipment failure type messages is highest, the priority of weather early warning type messages and alarm clock reminding type messages is next, the priority of messages leaving messages or chatting type messages is next, the priority of recommendation type messages is next, and the priority of video (drawing) information type messages is lowest.
After the first message and the second message are generated, the media asset content corresponding to the first message is displayed in the first display. And the second display judges the priority order of the second message and the prior message first, and further determines the content of the designated message which can be displayed. The content of the designated message can be the media information corresponding to the newly received second message and can also be the prior content originally displayed.
In some embodiments, the controller, in performing presenting content corresponding to the specified message in the second display according to a priority order of the second message with the previous message, is further configured to:
and step 131, determining the priority order of the media asset information and the prior message according to the priority attribute carried by the second message and the priority attribute carried by the prior message.
And 132, if the priority of the second message is higher than or equal to that of the prior message, displaying the media information corresponding to the second message in the second display.
And step 133, if the priority of the second message is lower than that of the previous message, not displaying the media information corresponding to the second message in the second display, and displaying the previous content corresponding to the previous message in the second display.
And when the priority of the second message is compared with the priority of the previous message, acquiring the priority attribute carried by the second message and the priority attribute carried by the previous message, wherein the priority attribute is used for representing the priority level of the corresponding message. Based on the priority attributes of the two messages, the priority order of the media asset information and the prior message can be determined.
In some embodiments, if the priority of the second message is higher than or equal to the priority of the previous message, it is indicated that the second message can be responded to, and its corresponding asset information can be presented. At this time, the media asset information corresponding to the second message is displayed in the second display, that is, the second display displays the content corresponding to the new message, and the display content is switched from the previous content to the media asset information corresponding to the second message.
In some embodiments, if the priority of the second message is lower than the priority of the previous message, it indicates that the second message cannot be responded, and the corresponding media information cannot be displayed. At this time, the media information corresponding to the second message is not displayed in the second display, and the original content, that is, the previous content corresponding to the previous message is still displayed in the second display.
In some embodiments, the second display presents content corresponding to messages of high priority and does not present content corresponding to messages of low priority.
In some embodiments, the replacement of the presentation content is also performed when the priority of the two messages is consistent. For example, if the user previously watched the drawing a, the first display shows the content of the drawing a, and the second display shows the information of the drawing a; and if the user views the painting B again, the first display displays the content of the painting B, and the priority of the information of the painting B is consistent with that of the information of the painting A, the second display performs content replacement, namely displays the information of the painting B.
In some embodiments, different message types need to be presented for different durations, for example, a message of a video progress bar type needs to be presented continuously during playing of a video file, while a message of a service notification type only needs to be presented for a certain period of time, and the presentation is cancelled after the user is predicted to have finished viewing the message. Based on this, the messages can be divided into short-time messages and long-time messages according to the display duration requirement.
The transient message refers to a message with the display duration meeting the duration requirement, such as a service notification message, the transient message does not need to be displayed all the time, the display can be cancelled after the duration requirement is met, and at the moment, the second display resumes displaying the original content. The long-life type message refers to a message needing to be continuously displayed, such as a video progress bar and the like.
In some embodiments, in the case that the priority of the second message is higher than the priority of the previous message, or the priority of the second message coincides with the priority of the previous message, the controller is further configured to:
step 1321, when the media information corresponding to the second message is displayed in the second display, determining the message type of the second message according to the type identifier carried by the second message.
Step 1322, if the type identifier of the second message represents the transient type message, canceling the display of the media asset information when the display duration of the media asset information in the second display exceeds a first preset duration, and displaying the previous content corresponding to the previous message in the second display.
And 1323, if the type identifier of the second message represents the permanent type message, canceling the display of the previous content corresponding to the previous message, and displaying the media information corresponding to the second message in the second display in a replacement manner.
And under the condition that the priority of the second message is higher than that of the prior message or the priority of the second message is consistent with that of the prior message, the media asset information corresponding to the newly received second message can be displayed in the second display. At this time, in order to determine the presentation form of the media asset information corresponding to the second message, the type identifier carried by the second message may be acquired to determine the message type of the second message.
In some embodiments, if the type identifier of the second message indicates that the message is an ephemeral type message, it indicates that the message only needs to be ephemeral. Therefore, the display time of the second display in displaying the medium resource information is counted. And if the display time of the media asset information in the second display exceeds the first preset time, indicating that the display needs to be resumed, namely canceling the display of the media asset information, and displaying the prior content corresponding to the prior message in the second display.
In some embodiments, the first preset time period may be set to 15 seconds, or may be set to other values according to practical applications, and is not limited herein. When the display time of the media asset information displayed in the second display exceeds 15 seconds, the second display (small screen) is restored to the original display state, namely, the originally displayed content is continuously displayed.
In some embodiments, when a video file is presented using a dual screen display device, the content presented in the dual screen display device is as shown in FIG. 12. For example, a user triggers a "dad" video file by means of a remote controller or voice, and then shows the episode content of "dad" on a first display. And showing the video information (progress bar, video name, video set number and the like) of the 'dad' on the second display. It can be seen that the previous message in the second display is video information, the priority level is lowest, and the displayed progress bar is a long-term message.
If in the process of playing the video file, messages or chatting messages are generated, such as the messages sent by summer arbor. It can be known that the priority of the message or the chat message is higher than that of the video information, so that the second display is required to display the message or the chat message.
FIG. 14(a) illustrates an effect diagram of a second display showing an ephemeral-like message, in accordance with some embodiments. Referring to fig. 14(a), when other users send messages to the home user in summer, rain, and george, the messages do not directly display the content, but first display a prompt message, such as "you have a new message". If the user at the end needs to check the details of the message, a menu key of the remote controller is triggered according to the operation prompt displayed on the right side of the second display, so that the message is checked. At this time, the prompt content corresponding to the message or the chat message is displayed in the second display, and the episode content of "dad" is still displayed in the first display.
FIG. 14(b) illustrates another effect diagram of the second display presenting an ephemeral-like message, in accordance with some embodiments. Referring to fig. 14(b), if the user wants to view the prompting message in the second display, the menu key of the remote controller is triggered to obtain the specific content corresponding to the prompting message, such as the message "summer rain joe: today overtime, without returning to eat, you eat … "and show that particular content in the second display, while still showing" dad's "episode content in the first display.
Because the message or the chat message is a transient message, the message is only displayed transiently. Therefore, when the second display starts to display the messages or the chat messages, the display duration of the messages or the chat messages is counted. When the display duration exceeds the first preset duration (15 seconds), the second display cancels the display of the messages or the chat messages, and the second display (small screen) restores to the original display state, namely, the video information of dad continues to be displayed. The effect of the recovery state is shown in fig. 12.
In some embodiments, in the case that the priority of the second message is higher than that of the previous message, or the priority of the second message is consistent with that of the previous message, the second display may display the asset information corresponding to the newly received second message. If the type identifier of the second message indicates that the message is a long-time type message, the message needs to be continuously displayed. Therefore, the display content of the second display needs to be completely switched, a display recovery process is not needed, namely, the display of the previous content corresponding to the previous message is cancelled, and meanwhile, the media information corresponding to the second message is displayed in the second display in a replacement mode.
In some embodiments, when a paint file is presented using a dual-screen display device, the content presented in the dual-screen display device is as shown in FIG. 12. In some embodiments, when the user triggers the drawing file of "star moon night" by means of a remote controller or voice while the drawing file is displayed by using the dual-screen display device, the contents of the drawing of "star moon night" are displayed on the first display. And displaying the painting information (information such as painting name, painting author and the like) of the 'star night and moon' on the second display. It can be seen that the previous message in the second display is the drawing information, with the lowest priority.
If the user starts a certain video file to play in the process of displaying the drawing file, the generated message is the video information comprising the progress bar. The priority of the video information is consistent with that of the drawing information, content replacement display can be carried out, namely the video information is displayed in the second display, and meanwhile, after media asset switching is carried out, the video content is switched and displayed in the first display.
Since the video information including the progress bar is a long-term type information, it needs to be continuously displayed. Therefore, the display content in the second display needs to be replaced completely, that is, the originally displayed painting information is canceled from being displayed, and meanwhile, the next video file is displayed in the second display where the video information is continuously displayed. The replaced two-screen display content may be as shown in fig. 12.
In some embodiments, the content presented in the second display may determine whether the message may be presented according to a message priority, and determine a presentation form of the message according to a message type.
In some embodiments, when the previous content displayed in the second display is video information, if the second message represents the asset recommendation information, the display content of the second display is switched from the video information to the asset recommendation information, and when the display duration of the asset recommendation information exceeds a first preset duration, the display content of the second display is switched from the asset push information back to the video information.
Referring again to fig. 12, the user triggers "dad" video file by means of remote control or voice, and then shows the episode content of "dad" on the first display. And showing the video information (progress bar, video name, video set number and the like) of the 'dad' on the second display. It can be seen that the previous message in the second display is video information, the priority level is lowest, and the displayed progress bar is a long-term message.
FIG. 15 illustrates an effect of the second display showing media asset recommendation information according to some embodiments. Referring to fig. 15, in the process of playing a video file of "dad", if a specified character, such as an actor "article", appears in the played picture, media recommendation information, such as "article highlights, and love beans shots" are generated according to other movie works that the actor "article" shows.
The media asset recommendation information is recommendation type information, and the priority of the recommendation type information is higher than that of the video information, so that the media asset recommendation information can be displayed by the second display. At this time, the first display still shows the episode content of dad, and the second display does not show the video information such as progress bar, but instead shows the recommendation information of media assets, such as "wonderful article, enjoy loving beans shot".
Because the media asset recommendation information is a transient message, the short-term display is only needed. Therefore, after the display duration of the media recommendation information in the second display exceeds the first preset duration (15 seconds), the second display cancels the display of the media recommendation information, and the second display (small screen) restores to the original display state, namely, the video information of 'dad' is continuously displayed. The effect of the recovery state is shown in fig. 12.
In some embodiments, when the previous content displayed in the second display is video information, if the second message represents video information, the priority of the two information is the same, and content replacement can also be performed. At this time, the display content of the second display is replaced by the video information corresponding to the second message instead of the video information corresponding to the prior content.
For example, if a user plays a "dad" video file first, the first display shows the episode content of "dad", and the second display shows the video information (progress bar, video name, number of video episodes, etc.) of "dad". And then, if the video file which is 'good' is played again, the priority of the generated new video information is consistent with that of the original video information, and the new video information and the original video information are all long-term messages, the content of the second display can be replaced so as to display the next video file, and at the moment, the first display synchronously replaces the content. After replacement, the first display shows the episode content of the 'all-upright' episode, and the second display shows the video information of the 'all-upright'.
In some embodiments, after the video file is played in the vicinity of the video file, a file similar to the video file may be generated to be pushed to the user, that is, the generated simulcast information is sent to the second display for display. Referring again to fig. 12, the user triggers "daddy" video file by means of remote control or voice, and then shows the episode content of "daddy" on the first display. And showing the video information (progress bar, video name, video set number and the like) of the 'dad' on the second display.
Fig. 16 illustrates an effect diagram of the second display showing the post-lineup information according to some embodiments. Referring to fig. 16, in the playing process of the video file "dad", if the video file is close to the playing completion time, that is, 30 seconds before the playing of the video file is completed, the post-simulcast information generated according to the currently played video file is "summer health preserving wonderful move". The post-simulcast information is a recommendation-type message with a higher priority than the video information, so that the post-simulcast information is displayed in the second display, while the episode content of "daddy" is still displayed in the first display.
Since the post-simulcast information is a transient message, only transient display is needed. Therefore, after the display duration of the post-simulcast information in the second display exceeds the first preset duration (15 seconds), the second display cancels the display of the post-simulcast information, and the second display (small screen) recovers to the original display state, i.e. continues to display the video information of dad. The effect of the recovery state is shown in fig. 12.
The post-simulcast information refers to media assets recommended to the user to be displayed after the currently played video file is played. Because the post-simulcast information is the video resource pushed to the user, in order to facilitate the user to click the pushed video resource to play, an operation prompt can be synchronously popped up at the right side of the post-simulcast information display position to inform the user of corresponding operation, and the prompt content can be 'click a menu key to view'. The user can check the specific content of the summer health care wonderful invitation by triggering the menu key of the remote controller, and at the moment, the specific content of the summer health care wonderful invitation is switched and displayed in the first display.
In some embodiments, the drawing information may be a transient type message or a persistent type message. Specifically, the method can be determined according to system configuration, and if the drawing content needs to be viewed and the drawing information can be correspondingly viewed all the time, the drawing information can be configured into a long-term message. If the painting information needs to be correspondingly viewed only at the initial moment or in the process of viewing while the painting content needs to be viewed, the painting information can be configured into a transient message.
Therefore, the display device provided by the embodiment of the invention can display the media asset file in a split screen manner, can determine whether the message can be displayed according to the message priority when the second display displays the message, and can determine the display form of the message according to the message type, so that the mutual shielding of the media asset information and the media asset content is avoided, and meanwhile, other messages can be displayed without influencing the display content of the first display in the display process of the media asset file, so that a user can continuously check the display content of the first display, and the user experience is good.
When the display device provided by the foregoing embodiment executes the method for displaying the media asset file in a split screen manner, the method is applied to a display device of a dual-screen single system, and both displays are controlled by a general controller, that is, the process of displaying the content by the first display and the second display is controlled by the general controller.
In other embodiments, the display device may also be a dual-screen dual-system display device, i.e., the first controller controls the display of each content in the first display and sends a broadcast to the second controller to inform the second controller to control the second display to display the content. In the dual-screen dual-system display device, a first controller is a main controller, a second controller is an auxiliary controller, a message needing to be displayed in a second display is generated in the first controller, the first controller sends the message to the second controller, and the second controller controls the second display to display.
Fig. 17 illustrates a business timing diagram of a method for split-screen presentation of a asset file according to some embodiments. Referring to fig. 17, the asset file to be displayed is triggered by an application (large screen application) configured in the first controller, and the large screen application acquires the specified asset file from the server and generates a first message to be displayed in the first display and a second message to be displayed in the second display.
In a scene of performing the dual-screen display, the first controller needs to send the second message to the second controller, so that the second controller determines whether to display the content corresponding to the second message according to the display state of the second display, and determines a display form, such as transient display or continuous display, of the content corresponding to the second message according to the scene.
In some embodiments, when sending the second message, a hiprp (dual screen information relay channel) is configured in the first controller, and the first controller forwards the second message to the second controller through the hiprp.
In some embodiments, an embodiment of the present invention provides a display device, including: a first display configured to present a first user interface in which content of applications, messages, or assets is presented; a second display configured to present a second user interface in which system messages, notifications, or media asset information, etc. are presented; a first controller connected with the first display, the first controller configured to: responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file; and displaying the media asset content corresponding to the first message in a first display, and sending the second message to a second controller so that the second controller displays the media asset content corresponding to the second message. And the second controller is connected with the second display and is configured to execute the media asset file split screen display method.
FIG. 18 illustrates another flow diagram of a method for split-screen presentation of a asset file, according to some embodiments. The display device provided in the embodiment of the present invention may be a dual-screen dual-system display device, and when the method for displaying a media asset file in a split screen manner shown in fig. 18 is executed, the second controller is configured to execute the following steps:
s21, receiving a second message sent by the first controller, and determining whether a previous message is displayed in the second display.
S22, if the second display displays prior messages, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior messages, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior messages.
S23, if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display.
In the dual-screen dual-system display device, since the first controller is the main controller, a message to be displayed on the first display and a message to be displayed on the second display are both generated in the first controller.
When the split-screen display is realized, the first controller displays the media asset content corresponding to the generated first message in the first display, meanwhile, the first controller sends the generated second message to the second controller, and the second controller judges whether the content is displayed in the second display after receiving the second message.
If the prior message is displayed, determining the priority order of the prior message and the newly received second message, and if the priority of the second message is higher than or equal to that of the prior message, displaying the media information corresponding to the second message in a second display; if the priority of the second message is lower than the priority of the prior message, the prior content corresponding to the prior message is presented in the second display. And if the second display does not display the prior message, the media information corresponding to the second message can be directly displayed in the second display.
In some embodiments, a first message and a second message are generated by a first controller, the first controller presents media asset content corresponding to the generated first message in a first display, and simultaneously, the first controller sends the generated second message to a second controller. The second controller determines whether a prior message, a priority order of the second message and the prior message, and a message type of the second message are shown in the second display. The specific execution processes of the first controller and the second controller can refer to the execution processes of the dual-screen single-system display device in the foregoing embodiments, and details are not repeated here.
Therefore, when the double-screen display equipment is used, a user selects the media asset file for display through the content displayed by the first display (large screen) after starting up, and sends the generated first message to the first display so as to display the media asset content on the first display; the generated second message is sent to the second controller. The second controller determines the display content of the second display according to the priority order of the new message and the previous message after receiving the large-screen message. When the message is displayed, whether the message is displayed continuously or transiently is determined according to the type of the message, and the display process is automatically performed without user intervention. The process can be applied to a double system or a single system, and the only dependent scene is the display equipment needing the content split-screen display, namely the double-screen display equipment.
According to the technical scheme, when the display device provided by the embodiment of the invention executes the method for displaying the media asset files in a split screen manner, the media asset files are triggered to be displayed, and the first message and the second message are generated. Displaying the media asset content corresponding to the first message on a first display, and displaying the media asset information corresponding to the second message on a second display when the prior message is not displayed in the second display; when a preceding message is presented in the second display, the content of the corresponding preceding message or second message of high priority is presented in the second display. Therefore, the display device provided by the embodiment of the invention can display the media asset file in a split screen manner, and determine whether the message can be displayed according to the message priority when the second display displays the message, so that the media asset information and the media asset content are prevented from being shielded, and meanwhile, the newly generated second message can be displayed on the second display without influencing the display content of the first display in the process of displaying the media asset file, and the user experience is good.
Fig. 9 illustrates a flowchart of a method for split-screen presentation of a media asset file according to some embodiments. Referring to fig. 9, the present application further provides a method for displaying a media asset file in a split screen manner, where the method is executed by a controller of a display device of a dual-screen single system in the foregoing embodiment, and the method includes:
s11, responding to the operation of triggering the display of the media asset file, generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
s12, if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display, and displaying the media asset content corresponding to the first message in the first display;
s13, if a prior message is displayed in the second display, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message, and displaying the media asset content corresponding to the first message in the first display.
FIG. 18 illustrates another flow diagram of a method for split-screen presentation of a asset file, according to some embodiments. Referring to fig. 18, a method for displaying a media asset file in a split screen manner provided in an embodiment of the present invention is executed by a second controller of a dual-screen dual-system display device in the foregoing embodiment, where the method includes:
s21, receiving a second message sent by the first controller, and determining whether a previous message is displayed in the second display;
s22, if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display;
s23, if the second display displays prior messages, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior messages, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior messages. .
In a specific implementation manner, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the media asset file split-screen display method provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
The same and similar parts in the various embodiments in this specification may be referred to each other. Particularly, for the embodiment of the method for displaying the media asset files in a split screen manner, the description is relatively simple because the method is basically similar to the embodiment of the display device, and relevant points can be referred to the description in the embodiment of the display device.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, comprising:
a first display configured to present a first user interface;
a second display configured to present a second user interface;
a controller connected with the first display and the second display, the controller configured to:
responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display, and displaying the media resource content corresponding to the first message in the first display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message, and displaying the media asset content corresponding to the first message in the first display.
2. The display device of claim 1, wherein the media asset file comprises a video file; and the controller, in performing the generating of the first message to be presented in the first display and the second message to be presented in the second display, is further configured to:
responding to an operation of triggering video file playing, and acquiring video content and video information of the video file;
a first message is generated to be presented on a first display based on the video content, and a second message is generated to be presented on a second display based on the video information.
3. The display device of claim 2, wherein the controller is further configured to:
when the first display plays the video content, if the image of the appointed person exists in the playing picture of the first display, carrying out media asset search based on the appointed person to obtain media asset push information comprising the appointed person;
and generating a second message needing to be displayed on a second display based on the media asset pushing information comprising the designated person.
4. The display device of claim 1, wherein the media asset files comprise a drawing file; and the controller, in performing the generating of the first message to be presented in the first display and the second message to be presented in the second display, is further configured to:
responding to the operation of triggering the display of the drawing file, and acquiring the drawing content and the drawing information of the drawing file;
and generating a first message needing to be displayed on the first display based on the drawing content, and generating a second message needing to be displayed on the second display based on the drawing information.
5. The display device according to claim 1, wherein the controller, in performing the presenting of the content corresponding to the specified message in the second display according to the priority order of the second message and the previous message, is further configured to:
determining the priority order of the media asset information and the prior message according to the priority attribute carried by the second message and the priority attribute carried by the prior message;
if the priority of the second message is higher than or equal to the priority of the prior message, displaying the media information corresponding to the second message in the second display;
and if the priority of the second message is lower than that of the prior message, not displaying the media information corresponding to the second message in the second display, and displaying the prior content corresponding to the prior message in the second display.
6. The display device of claim 5, wherein the controller is further configured to:
when the media information corresponding to the second message is displayed in the second display, determining the message type of the second message according to the type identifier carried by the second message;
if the type identifier of the second message represents a transient type message, canceling the display of the media information when the display time of the media information in the second display exceeds a first preset time, and displaying the prior content corresponding to the prior message in the second display;
and if the type identifier of the second message represents the permanent type message, canceling the display of the prior content corresponding to the prior message, and replacing and displaying the media information corresponding to the second message in the second display.
7. The display device of claim 6, wherein the controller is further configured to:
when the prior content displayed in the second display is video information, if the second message represents the media asset recommendation information, switching the displayed content of the second display from the video information to the media asset recommendation information, and switching the displayed content of the second display from the media asset push information back to the video information when the display duration of the media asset recommendation information exceeds a first preset duration;
and if the second message represents the video information, replacing the display content of the second display with the video information corresponding to the second message instead of the video information corresponding to the prior content.
8. A display device, comprising:
a first display configured to present a first user interface;
a second display configured to present a second user interface;
a first controller connected with the first display, the first controller configured to:
responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
displaying the media asset content corresponding to the first message in a first display, and sending the second message to a second controller so that the second controller displays the media asset content corresponding to the second message;
a second controller connected with the second display, the second controller configured to:
receiving a second message sent by the first controller, and determining whether a previous message is displayed in the second display;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message.
9. A method for displaying media asset files in a split screen manner is characterized by comprising the following steps:
responding to an operation of triggering the display of the media asset file, and generating a first message needing to be displayed in a first display and a second message needing to be displayed in a second display, wherein the first message is used for representing the media asset content of the media asset file, and the second message is used for representing the media asset information of the media asset file;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display, and displaying the media resource content corresponding to the first message in the first display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message, and displaying the media asset content corresponding to the first message in the first display.
10. A method for displaying media asset files in a split screen manner is characterized by comprising the following steps:
receiving a second message sent by the first controller, and determining whether a prior message is displayed in the second display;
if the second display does not display the prior message, displaying the media information corresponding to the second message in the second display;
if the second display displays the prior message, displaying the content corresponding to the designated message in the second display according to the priority order of the second message and the prior message, wherein the content corresponding to the designated message comprises the media asset information corresponding to the second message and the prior content corresponding to the prior message.
CN202110323799.8A 2021-03-26 2021-03-26 Media asset file split-screen display method and display device Pending CN112835547A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110323799.8A CN112835547A (en) 2021-03-26 2021-03-26 Media asset file split-screen display method and display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110323799.8A CN112835547A (en) 2021-03-26 2021-03-26 Media asset file split-screen display method and display device

Publications (1)

Publication Number Publication Date
CN112835547A true CN112835547A (en) 2021-05-25

Family

ID=75930583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110323799.8A Pending CN112835547A (en) 2021-03-26 2021-03-26 Media asset file split-screen display method and display device

Country Status (1)

Country Link
CN (1) CN112835547A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201100956Y (en) * 2007-10-16 2008-08-13 鹰达科技有限公司 Training multimedia control system
CN105426150A (en) * 2015-11-27 2016-03-23 青岛海信电器股份有限公司 Multimedia information playing method and apparatus
CN106899517A (en) * 2017-04-21 2017-06-27 深圳市茁壮网络股份有限公司 The display methods and device of a kind of message
CN111510753A (en) * 2019-11-04 2020-08-07 海信视像科技股份有限公司 Display apparatus and content display method
CN111526402A (en) * 2020-05-06 2020-08-11 海信电子科技(武汉)有限公司 Method for searching video resources through voice of multi-screen display equipment and display equipment
CN112004131A (en) * 2020-08-12 2020-11-27 海信电子科技(武汉)有限公司 Display system
CN112423052A (en) * 2019-11-04 2021-02-26 青岛海信激光显示股份有限公司 Display system and display method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201100956Y (en) * 2007-10-16 2008-08-13 鹰达科技有限公司 Training multimedia control system
CN105426150A (en) * 2015-11-27 2016-03-23 青岛海信电器股份有限公司 Multimedia information playing method and apparatus
CN106899517A (en) * 2017-04-21 2017-06-27 深圳市茁壮网络股份有限公司 The display methods and device of a kind of message
CN111510753A (en) * 2019-11-04 2020-08-07 海信视像科技股份有限公司 Display apparatus and content display method
CN112423052A (en) * 2019-11-04 2021-02-26 青岛海信激光显示股份有限公司 Display system and display method
CN111526402A (en) * 2020-05-06 2020-08-11 海信电子科技(武汉)有限公司 Method for searching video resources through voice of multi-screen display equipment and display equipment
CN112004131A (en) * 2020-08-12 2020-11-27 海信电子科技(武汉)有限公司 Display system

Similar Documents

Publication Publication Date Title
CN111741372B (en) Screen projection method for video call, display device and terminal device
US11805292B2 (en) Display apparatus and content display method
WO2020248680A1 (en) Video data processing method and apparatus, and display device
CN111277884A (en) Video playing method and device
WO2021189358A1 (en) Display device and volume adjustment method
CN111836115B (en) Screen saver display method, screen saver skipping method and display device
US11425466B2 (en) Data transmission method and device
CN112153406A (en) Live broadcast data generation method, display equipment and server
WO2020248697A1 (en) Display device and video communication data processing method
WO2021031598A1 (en) Self-adaptive adjustment method for video chat window position, and display device
CN112437334A (en) Display device
CN112203154A (en) Display device
CN112243141A (en) Display method and display equipment for screen projection function
CN113038210B (en) Double-screen synchronous playing method of video file and display equipment
WO2020248699A1 (en) Sound processing method and display apparatus
CN112463267B (en) Method for presenting screen saver information on display device screen and display device
CN112162764A (en) Display device, server and camera software upgrading method
CN114095769A (en) Live broadcast low-delay processing method of application-level player and display equipment
CN112788378A (en) Display apparatus and content display method
CN112783380A (en) Display apparatus and method
WO2020248790A1 (en) Voice control method and display device
CN114390190A (en) Display equipment and method for monitoring application to start camera
CN112261463A (en) Display device and program recommendation method
CN112367550A (en) Method for realizing multi-title dynamic display of media asset list and display equipment
CN112199560A (en) Setting item searching method and display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination